Senad Uka
|
92e4f4ed5a
|
Add caching to fetch wrapper
|
2020-10-21 06:16:35 +02:00 |
|
=
|
698acb010a
|
Add timeout to fetch wrapper
|
2020-09-15 01:27:20 -07:00 |
|
=
|
ade3eb307d
|
Add try/catch to generator
|
2020-09-14 14:54:39 -07:00 |
|
=
|
8018caab47
|
Enable inspector and debugger
|
2020-09-14 06:53:35 -07:00 |
|
=
|
dfbefc20cd
|
Remove PromisePool from olx
|
2020-09-13 04:57:01 -07:00 |
|
=
|
a481ecfe37
|
Debug
|
2020-09-13 04:48:11 -07:00 |
|
Senad Uka
|
8df94da48c
|
Saljic fix fix
|
2020-09-11 05:03:37 +02:00 |
|
Senad Uka
|
d4fcd1950d
|
Fix saljic
|
2020-09-11 04:51:54 +02:00 |
|
=
|
e8115a9215
|
moar fixes
|
2020-09-10 14:26:48 -07:00 |
|
=
|
160efdf6ab
|
More fixes
|
2020-09-10 14:06:09 -07:00 |
|
=
|
c9b8c2e1a5
|
Fiks
|
2020-09-10 13:31:57 -07:00 |
|
Senad Uka
|
855b93ca41
|
Scraped data
|
2020-09-10 19:46:25 +02:00 |
|
Senad Uka
|
70779b24c0
|
Scraped data
|
2020-09-10 19:42:50 +02:00 |
|
Senad Uka
|
e4775158fc
|
Promise pool
|
2020-09-10 19:39:13 +02:00 |
|
Senad Uka
|
b27d9d3499
|
Add debugging info
|
2020-09-10 18:00:13 +02:00 |
|
Bilal
|
1229b3fa6c
|
Add more debug logs
|
2020-06-16 19:51:13 +02:00 |
|
Bilal
|
159fedbc2d
|
handle failed page fetch
|
2020-05-18 03:53:08 +02:00 |
|
Bilal
|
65068932ad
|
handle failed page fetch; detect discounted price
|
2020-05-18 03:43:49 +02:00 |
|
Bilal
|
d35a113baa
|
Fix saljic crawler
|
2020-05-14 19:01:19 +02:00 |
|
Bilal
|
ba60f8749d
|
Fix Prostor crawler - use new JSON location in page body
|
2020-05-14 15:38:15 +02:00 |
|
Naida Vatric
|
df5e38092d
|
Decomment and saljic smal fix.
|
2020-02-28 17:12:55 +01:00 |
|
Naida Vatric
|
feb2d04ed6
|
Olx debugg log.
|
2020-02-28 15:43:35 +01:00 |
|
Naida Vatric
|
90e171d07d
|
Olx scraper debugging.
|
2020-02-28 15:41:20 +01:00 |
|
Naida Vatric
|
747f56941a
|
Logged olx price scraping.
|
2020-02-28 14:21:53 +01:00 |
|
Naida Vatric
|
441f905b29
|
Olx price parsing changed.
|
2020-02-27 23:35:18 +01:00 |
|
Naida Vatric
|
edca7f91af
|
Commented checkup out and Prostor fetch changed.
|
2020-02-27 19:01:11 +01:00 |
|
Naida Vatric
|
44402a9cc4
|
Merge branch 'saljic-crawler-fix' into 'master'
Saljic crawler changed substring call.
See merge request saburly/marketalarm/web!95
|
2020-02-26 15:09:22 +00:00 |
|
Bilal Catic
|
4f230020d7
|
use fetch wrapper instead of node-fetch
|
2020-02-20 19:49:29 +01:00 |
|
Bilal Catic
|
cff7cc2e9c
|
apply prettier
|
2020-02-20 19:46:39 +01:00 |
|
Naida Vatric
|
f56cd5b549
|
More elegant scrape of lat and long.
|
2020-02-17 21:55:24 +01:00 |
|
Naida Vatric
|
addd8c1344
|
Saljic crawler changed substring call.
|
2020-02-14 23:42:19 +01:00 |
|
Naida Vatric
|
5bdc8e149a
|
Prostor VIP ads fixed.
|
2020-02-14 22:41:51 +01:00 |
|
Naida Vatric
|
b82134e280
|
Fixed saljic bug for heroku.
|
2020-02-09 19:09:00 +01:00 |
|
Naida Vatric
|
be378883c8
|
Just another fix try.
|
2020-02-08 00:47:00 +01:00 |
|
Naida Vatric
|
8a87b9e253
|
Another fix.
|
2020-02-08 00:27:26 +01:00 |
|
Naida Vatric
|
43bc23b164
|
Another fix. Defined more var.
|
2020-02-07 22:27:01 +01:00 |
|
Naida Vatric
|
fc6351af46
|
Added columns and logs for types.
|
2020-02-07 22:12:53 +01:00 |
|
Naida Vatric
|
97724a47a1
|
Removed debugg logs. Smal fixes.
|
2020-02-06 22:40:56 +01:00 |
|
Naida Vatric
|
d29b3eb1b3
|
Merge branch 'crawler-saljicnekretnine' into 'master'
Crawler saljicnekretnine
See merge request saburly/marketalarm/web!90
|
2020-02-04 13:09:10 +00:00 |
|
Naida Vatric
|
1ba7cf8531
|
Added crawler for Saljic nekretnine.
|
2020-01-31 22:03:39 +01:00 |
|
Naida Vatric
|
7a7aecb3ee
|
WIP Scraped no of rooms, floors etc.
|
2020-01-31 00:55:24 +01:00 |
|
Naida Vatric
|
78c4054cde
|
WIP Scraped title, price and location.
|
2020-01-30 16:24:34 +01:00 |
|
Naida Vatric
|
94ffc2d6d2
|
WIP Started saljic crawler.
|
2020-01-29 23:22:39 +01:00 |
|
Naida Vatric
|
b11f18696f
|
Prepared config files.
|
2020-01-29 01:09:53 +01:00 |
|
Naida Vatric
|
511b290096
|
Login to prostor.ba befoure crawl.
|
2020-01-13 12:05:33 +01:00 |
|
Naida Vatric
|
ba43fa0713
|
WIP Changed cookies.
|
2020-01-13 11:02:26 +01:00 |
|
Naida Vatric
|
e70901d369
|
WIP Changed login to crawler.
|
2020-01-13 09:12:03 +01:00 |
|
Naida Vatric
|
8505282670
|
WiP Login of crawler prostor.
|
2020-01-12 01:22:50 +01:00 |
|
Naida Vatric
|
64e4835899
|
Changed redirecting for VIP ads.
|
2020-01-10 22:52:50 +01:00 |
|
Naida Vatric
|
1658325c4b
|
WIP Fake vip ads.
|
2020-01-10 19:20:26 +01:00 |
|