4 Commits

Author	SHA1	Message	Date
Bilal Catic	3140fdf0c0	use function generator to index pages; crawl in parallel	2019-09-25 08:55:00 +02:00
Bilal Catic	c4f6c6e1c3	construct crawling url before indexing single page	2019-09-25 08:55:00 +02:00
Bilal Catic	3d46c82d3d	create new crawler and Postgres saver	2019-09-18 15:32:48 +02:00
Bilal Catic	76a989fa37	replace old crawler, without specific crawler and saver implementation	2019-09-16 15:59:53 +02:00