Bilal Catic 06d35fcb4b move ignored usernames config to crawler specific config

2019-09-25 08:55:00 +02:00

..

savers

use function generator to index pages; crawl in parallel

2019-09-25 08:55:00 +02:00

specific

parse and save published and renewed dates

2019-09-25 08:55:00 +02:00

crawl.js

use function generator to index pages; crawl in parallel

2019-09-25 08:55:00 +02:00

crawlerConfig.js

move ignored usernames config to crawler specific config

2019-09-25 08:55:00 +02:00