=
|
bf8d131025
|
Increase timeout to 20 secs
|
2020-09-15 01:34:07 -07:00 |
|
=
|
698acb010a
|
Add timeout to fetch wrapper
|
2020-09-15 01:27:20 -07:00 |
|
=
|
ade3eb307d
|
Add try/catch to generator
|
2020-09-14 14:54:39 -07:00 |
|
=
|
8018caab47
|
Enable inspector and debugger
|
2020-09-14 06:53:35 -07:00 |
|
Edin Dazdarevic
|
d871d9ad1f
|
More debugging, disable all crawlers
|
2020-09-13 23:45:08 +02:00 |
|
=
|
dfbefc20cd
|
Remove PromisePool from olx
|
2020-09-13 04:57:01 -07:00 |
|
=
|
a481ecfe37
|
Debug
|
2020-09-13 04:48:11 -07:00 |
|
Senad Uka
|
8df94da48c
|
Saljic fix fix
|
2020-09-11 05:03:37 +02:00 |
|
Senad Uka
|
d4fcd1950d
|
Fix saljic
|
2020-09-11 04:51:54 +02:00 |
|
=
|
e8115a9215
|
moar fixes
|
2020-09-10 14:26:48 -07:00 |
|
=
|
160efdf6ab
|
More fixes
|
2020-09-10 14:06:09 -07:00 |
|
=
|
c9b8c2e1a5
|
Fiks
|
2020-09-10 13:31:57 -07:00 |
|
Senad Uka
|
855b93ca41
|
Scraped data
|
2020-09-10 19:46:25 +02:00 |
|
Senad Uka
|
70779b24c0
|
Scraped data
|
2020-09-10 19:42:50 +02:00 |
|
Senad Uka
|
e4775158fc
|
Promise pool
|
2020-09-10 19:39:13 +02:00 |
|
Senad Uka
|
26377c485c
|
Reverting
|
2020-09-10 18:30:14 +02:00 |
|
Senad Uka
|
b30b0f45a6
|
trying different approach
|
2020-09-10 18:23:01 +02:00 |
|
Senad Uka
|
9c1a029ff1
|
Debugging ba
|
2020-09-10 18:17:16 +02:00 |
|
Senad Uka
|
9b49759485
|
Pause is not enough
|
2020-09-10 18:13:47 +02:00 |
|
Senad Uka
|
0c2f8d11ee
|
Add random timeout up to 500ms
|
2020-09-10 18:10:42 +02:00 |
|
Senad Uka
|
b27d9d3499
|
Add debugging info
|
2020-09-10 18:00:13 +02:00 |
|
Senad Uka
|
dd3f30ef0e
|
Comment agent header
|
2020-09-10 17:57:21 +02:00 |
|
Senad Uka
|
78c6056db4
|
Change for scraperapi
|
2020-09-10 17:37:19 +02:00 |
|
Bilal
|
1229b3fa6c
|
Add more debug logs
|
2020-06-16 19:51:13 +02:00 |
|
=
|
0aa851015b
|
Improve styling of WOM message
|
2020-06-05 09:07:54 -07:00 |
|
Senad Uka
|
0895654db2
|
Update emailContentGenerator.js
|
2020-06-05 14:55:00 +00:00 |
|
Senad Uka
|
8925eb9f4e
|
Update emailContentGenerator.js
|
2020-06-05 14:54:22 +00:00 |
|
=
|
52201af3ba
|
Add word of mouth requests
|
2020-06-05 07:52:52 -07:00 |
|
Bilal
|
159fedbc2d
|
handle failed page fetch
|
2020-05-18 03:53:08 +02:00 |
|
Bilal
|
65068932ad
|
handle failed page fetch; detect discounted price
|
2020-05-18 03:43:49 +02:00 |
|
Bilal
|
d35a113baa
|
Fix saljic crawler
|
2020-05-14 19:01:19 +02:00 |
|
Bilal
|
ba60f8749d
|
Fix Prostor crawler - use new JSON location in page body
|
2020-05-14 15:38:15 +02:00 |
|
Bilal
|
ff923605ad
|
Move scraper api base url to the ENV; send URL as base64 string
|
2020-05-12 13:44:09 +02:00 |
|
Naida Vatric
|
df5e38092d
|
Decomment and saljic smal fix.
|
2020-02-28 17:12:55 +01:00 |
|
Naida Vatric
|
feb2d04ed6
|
Olx debugg log.
|
2020-02-28 15:43:35 +01:00 |
|
Naida Vatric
|
90e171d07d
|
Olx scraper debugging.
|
2020-02-28 15:41:20 +01:00 |
|
Naida Vatric
|
747f56941a
|
Logged olx price scraping.
|
2020-02-28 14:21:53 +01:00 |
|
Naida Vatric
|
441f905b29
|
Olx price parsing changed.
|
2020-02-27 23:35:18 +01:00 |
|
Naida Vatric
|
edca7f91af
|
Commented checkup out and Prostor fetch changed.
|
2020-02-27 19:01:11 +01:00 |
|
Naida Vatric
|
44402a9cc4
|
Merge branch 'saljic-crawler-fix' into 'master'
Saljic crawler changed substring call.
See merge request saburly/marketalarm/web!95
|
2020-02-26 15:09:22 +00:00 |
|
Naida Vatric
|
a508f72d7c
|
Merge branch 'master' into 'checkup-email-bug-fix'
# Conflicts:
# app/services/notificationService.js
|
2020-02-25 15:12:47 +00:00 |
|
Naida Vatric
|
ce857ddce9
|
Renamed var.
|
2020-02-23 23:11:21 +01:00 |
|
Naida Vatric
|
148b2ea863
|
Changed default.
|
2020-02-23 16:38:40 +01:00 |
|
Naida Vatric
|
d436d4a37b
|
Added Scraper API option.
|
2020-02-22 22:15:27 +01:00 |
|
Bilal Catic
|
6791a509d0
|
make user agent header configurable through env variable
|
2020-02-20 21:07:16 +01:00 |
|
Bilal Catic
|
4f230020d7
|
use fetch wrapper instead of node-fetch
|
2020-02-20 19:49:29 +01:00 |
|
Bilal Catic
|
f62a7200c7
|
create fetch wrapper with mandatory user agent header
|
2020-02-20 19:47:30 +01:00 |
|
Bilal Catic
|
cff7cc2e9c
|
apply prettier
|
2020-02-20 19:46:39 +01:00 |
|
Naida Vatric
|
f56cd5b549
|
More elegant scrape of lat and long.
|
2020-02-17 21:55:24 +01:00 |
|
Naida Vatric
|
bc7ce9d708
|
Changed checkup query to miliseconds.
|
2020-02-17 21:22:45 +01:00 |
|