Commit Graph

30 Commits

Author SHA1 Message Date
=
698acb010a Add timeout to fetch wrapper 2020-09-15 01:27:20 -07:00
=
ade3eb307d Add try/catch to generator 2020-09-14 14:54:39 -07:00
=
8018caab47 Enable inspector and debugger 2020-09-14 06:53:35 -07:00
=
dfbefc20cd Remove PromisePool from olx 2020-09-13 04:57:01 -07:00
=
a481ecfe37 Debug 2020-09-13 04:48:11 -07:00
Senad Uka
8df94da48c Saljic fix fix 2020-09-11 05:03:37 +02:00
Senad Uka
d4fcd1950d Fix saljic 2020-09-11 04:51:54 +02:00
=
e8115a9215 moar fixes 2020-09-10 14:26:48 -07:00
=
160efdf6ab More fixes 2020-09-10 14:06:09 -07:00
=
c9b8c2e1a5 Fiks 2020-09-10 13:31:57 -07:00
Senad Uka
855b93ca41 Scraped data 2020-09-10 19:46:25 +02:00
Senad Uka
70779b24c0 Scraped data 2020-09-10 19:42:50 +02:00
Senad Uka
e4775158fc Promise pool 2020-09-10 19:39:13 +02:00
Senad Uka
b27d9d3499 Add debugging info 2020-09-10 18:00:13 +02:00
Bilal
1229b3fa6c Add more debug logs 2020-06-16 19:51:13 +02:00
Bilal
65068932ad handle failed page fetch; detect discounted price 2020-05-18 03:43:49 +02:00
Naida Vatric
df5e38092d Decomment and saljic smal fix. 2020-02-28 17:12:55 +01:00
Naida Vatric
feb2d04ed6 Olx debugg log. 2020-02-28 15:43:35 +01:00
Naida Vatric
90e171d07d Olx scraper debugging. 2020-02-28 15:41:20 +01:00
Naida Vatric
747f56941a Logged olx price scraping. 2020-02-28 14:21:53 +01:00
Naida Vatric
441f905b29 Olx price parsing changed. 2020-02-27 23:35:18 +01:00
Bilal Catic
4f230020d7 use fetch wrapper instead of node-fetch 2020-02-20 19:49:29 +01:00
Bilal Catic
af42d2c448 improve OLX ad status detection 2019-11-14 08:47:48 +01:00
Bilal Catic
a7cd75653d improve OLX ad status detection 2019-11-14 08:04:58 +01:00
Bilal Catic
b6024af2cb add new fields for OLX crawler 2019-11-08 17:05:51 +01:00
Bilal Catic
2e3ddbac95 fix request ad type bug 2019-11-01 00:01:02 +01:00
Bilal Catic
4318fa8a2d extend AD_TYPE enum in specific crawler files 2019-10-31 19:06:44 +01:00
Bilal Catic
3abbed183e implement RENT and REQUEST option for OLX; implement force crawl option 2019-10-30 15:03:59 +01:00
Bilal Catic
747ebb88e5 add debugging log switch for crawler process 2019-10-25 11:08:52 +02:00
Bilal Catic
935ae60ae1 move specific crawler config to the separated files 2019-10-24 16:57:23 +02:00