Naida Vatric
|
b11f18696f
|
Prepared config files.
|
2020-01-29 01:09:53 +01:00 |
|
Bilal Catic
|
f899c96dc6
|
add crawler and crawler config for Aktido agency
|
2019-10-28 09:14:45 +01:00 |
|
Bilal Catic
|
6fc4218e39
|
add config files for Prostor agency
|
2019-10-24 17:11:12 +02:00 |
|
Bilal Catic
|
935ae60ae1
|
move specific crawler config to the separated files
|
2019-10-24 16:57:23 +02:00 |
|
Bilal Catic
|
ec798fe94c
|
add crawler config and include specific crawler for "rental" agency
|
2019-10-24 11:26:11 +02:00 |
|
Bilal Catic
|
5e8e13a984
|
fix enums
|
2019-09-30 14:27:01 +02:00 |
|
Bilal Catic
|
e3e47345bc
|
load AWS config through app config; fix ENV path
|
2019-09-30 09:44:19 +02:00 |
|
Bilal Catic
|
f93d0e738f
|
add delay between pages config variable
|
2019-09-25 08:55:00 +02:00 |
|
Bilal Catic
|
06d35fcb4b
|
move ignored usernames config to crawler specific config
|
2019-09-25 08:55:00 +02:00 |
|
Bilal Catic
|
3140fdf0c0
|
use function generator to index pages; crawl in parallel
|
2019-09-25 08:55:00 +02:00 |
|
Bilal Catic
|
3d46c82d3d
|
create new crawler and Postgres saver
|
2019-09-18 15:32:48 +02:00 |
|