Bilal Catic
|
f899c96dc6
|
add crawler and crawler config for Aktido agency
|
2019-10-28 09:14:45 +01:00 |
|
Bilal Catic
|
7e3b0bfcd5
|
implement crawler for Prostor agency
|
2019-10-25 10:54:08 +02:00 |
|
Bilal Catic
|
935ae60ae1
|
move specific crawler config to the separated files
|
2019-10-24 16:57:23 +02:00 |
|
Bilal Catic
|
ec798fe94c
|
add crawler config and include specific crawler for "rental" agency
|
2019-10-24 11:26:11 +02:00 |
|
Bilal Catic
|
9c0104a57c
|
refactor crawler - adapt to use new ENUM objects
|
2019-09-30 10:27:12 +02:00 |
|
Bilal Catic
|
2e92f961ff
|
start crawler loop when server is started
|
2019-09-26 17:30:06 +02:00 |
|
Bilal Catic
|
c9a959f8be
|
stop crawling when existing, not renewed ad is found
|
2019-09-25 08:55:00 +02:00 |
|
Bilal Catic
|
90bc57edb6
|
stop crawling when existing, non-renewed ad is found
|
2019-09-25 08:55:00 +02:00 |
|
Bilal Catic
|
3140fdf0c0
|
use function generator to index pages; crawl in parallel
|
2019-09-25 08:55:00 +02:00 |
|
Bilal Catic
|
3d46c82d3d
|
create new crawler and Postgres saver
|
2019-09-18 15:32:48 +02:00 |
|
Bilal Catic
|
76a989fa37
|
replace old crawler, without specific crawler and saver implementation
|
2019-09-16 15:59:53 +02:00 |
|