Senad Uka
|
855b93ca41
|
Scraped data
|
2020-09-10 19:46:25 +02:00 |
|
Senad Uka
|
70779b24c0
|
Scraped data
|
2020-09-10 19:42:50 +02:00 |
|
Senad Uka
|
ba873f9f4e
|
package json
|
2020-09-10 19:40:51 +02:00 |
|
Senad Uka
|
e4775158fc
|
Promise pool
|
2020-09-10 19:39:13 +02:00 |
|
Senad Uka
|
26377c485c
|
Reverting
|
2020-09-10 18:30:14 +02:00 |
|
Senad Uka
|
b30b0f45a6
|
trying different approach
|
2020-09-10 18:23:01 +02:00 |
|
Senad Uka
|
9c1a029ff1
|
Debugging ba
|
2020-09-10 18:17:16 +02:00 |
|
Senad Uka
|
9b49759485
|
Pause is not enough
|
2020-09-10 18:13:47 +02:00 |
|
Senad Uka
|
0c2f8d11ee
|
Add random timeout up to 500ms
|
2020-09-10 18:10:42 +02:00 |
|
Senad Uka
|
b27d9d3499
|
Add debugging info
|
2020-09-10 18:00:13 +02:00 |
|
Senad Uka
|
dd3f30ef0e
|
Comment agent header
|
2020-09-10 17:57:21 +02:00 |
|
Senad Uka
|
78c6056db4
|
Change for scraperapi
|
2020-09-10 17:37:19 +02:00 |
|
Bilal Catic
|
ecf27f2ba1
|
Merge branch 'improve-olx-scrapper' into 'master'
Improve olx scrapper
See merge request saburly/marketalarm/web!113
|
2020-06-16 20:37:37 +00:00 |
|
Bilal
|
1229b3fa6c
|
Add more debug logs
|
2020-06-16 19:51:13 +02:00 |
|
Edin
|
542ff56123
|
Merge branch 'improve-wom' into 'master'
Improve styling of WOM message
See merge request saburly/marketalarm/web!112
|
2020-06-05 16:24:31 +00:00 |
|
=
|
0aa851015b
|
Improve styling of WOM message
|
2020-06-05 09:07:54 -07:00 |
|
Senad Uka
|
c033b2e47c
|
Merge branch 'word-of-mouth-email' into 'master'
Add word of mouth requests
See merge request saburly/marketalarm/web!111
|
2020-06-05 14:55:44 +00:00 |
|
Senad Uka
|
0895654db2
|
Update emailContentGenerator.js
|
2020-06-05 14:55:00 +00:00 |
|
Senad Uka
|
8925eb9f4e
|
Update emailContentGenerator.js
|
2020-06-05 14:54:22 +00:00 |
|
=
|
52201af3ba
|
Add word of mouth requests
|
2020-06-05 07:52:52 -07:00 |
|
Senad Uka
|
1505c07363
|
Merge branch 'improve-crawler' into 'master'
Improve crawler
See merge request saburly/marketalarm/web!110
|
2020-05-18 09:30:24 +00:00 |
|
Bilal
|
159fedbc2d
|
handle failed page fetch
|
2020-05-18 03:53:08 +02:00 |
|
Bilal
|
65068932ad
|
handle failed page fetch; detect discounted price
|
2020-05-18 03:43:49 +02:00 |
|
Senad Uka
|
820227827e
|
Merge branch 'fix-crawler-errors' into 'master'
Fix crawler errors
See merge request saburly/marketalarm/web!109
|
2020-05-14 21:34:17 +00:00 |
|
Bilal
|
d35a113baa
|
Fix saljic crawler
|
2020-05-14 19:01:19 +02:00 |
|
Bilal
|
ba60f8749d
|
Fix Prostor crawler - use new JSON location in page body
|
2020-05-14 15:38:15 +02:00 |
|
Senad Uka
|
f1d45fed26
|
Merge branch 'move-scraper-url-to-the-env' into 'master'
Move scraper api url to the ENV
See merge request saburly/marketalarm/web!108
|
2020-05-12 11:55:12 +00:00 |
|
Bilal
|
ff923605ad
|
Move scraper api base url to the ENV; send URL as base64 string
|
2020-05-12 13:44:09 +02:00 |
|
Naida Vatric
|
692577fb8c
|
Merge branch 'after-scraper-fix' into 'master'
After scraper fix
See merge request saburly/marketalarm/web!104
|
2020-02-28 16:14:43 +00:00 |
|
Naida Vatric
|
df5e38092d
|
Decomment and saljic smal fix.
|
2020-02-28 17:12:55 +01:00 |
|
Naida Vatric
|
feb2d04ed6
|
Olx debugg log.
|
2020-02-28 15:43:35 +01:00 |
|
Naida Vatric
|
90e171d07d
|
Olx scraper debugging.
|
2020-02-28 15:41:20 +01:00 |
|
Naida Vatric
|
747f56941a
|
Logged olx price scraping.
|
2020-02-28 14:21:53 +01:00 |
|
Naida Vatric
|
2a13ab55ed
|
Merge branch 'after-scraper-fix' into 'master'
Olx price parsing changed.
See merge request saburly/marketalarm/web!103
|
2020-02-27 22:38:00 +00:00 |
|
Naida Vatric
|
441f905b29
|
Olx price parsing changed.
|
2020-02-27 23:35:18 +01:00 |
|
Naida Vatric
|
39f9383ae2
|
Merge branch 'after-scraper-fix' into 'master'
Commented checkup out and Prostor fetch changed.
See merge request saburly/marketalarm/web!102
|
2020-02-27 20:31:14 +00:00 |
|
Naida Vatric
|
edca7f91af
|
Commented checkup out and Prostor fetch changed.
|
2020-02-27 19:01:11 +01:00 |
|
Naida Vatric
|
44402a9cc4
|
Merge branch 'saljic-crawler-fix' into 'master'
Saljic crawler changed substring call.
See merge request saburly/marketalarm/web!95
|
2020-02-26 15:09:22 +00:00 |
|
Naida Vatric
|
b913daa1f7
|
Merge branch 'checkup-email-bug-fix' into 'master'
Changed checkup email logic.
See merge request saburly/marketalarm/web!97
|
2020-02-25 15:13:20 +00:00 |
|
Naida Vatric
|
a508f72d7c
|
Merge branch 'master' into 'checkup-email-bug-fix'
# Conflicts:
# app/services/notificationService.js
|
2020-02-25 15:12:47 +00:00 |
|
Naida Vatric
|
08ad9edfe1
|
Merge branch 'scraper-api-support' into 'master'
Added Scraper API option.
See merge request saburly/marketalarm/web!100
|
2020-02-25 15:10:39 +00:00 |
|
Naida Vatric
|
ce857ddce9
|
Renamed var.
|
2020-02-23 23:11:21 +01:00 |
|
Naida Vatric
|
148b2ea863
|
Changed default.
|
2020-02-23 16:38:40 +01:00 |
|
Naida Vatric
|
d436d4a37b
|
Added Scraper API option.
|
2020-02-22 22:15:27 +01:00 |
|
Bilal Catic
|
6791a509d0
|
make user agent header configurable through env variable
|
2020-02-20 21:07:16 +01:00 |
|
Bilal Catic
|
edc6e2bbf7
|
Merge branch 'create-fetch-wrapper-with-user-agent' into 'master'
Create fetch wrapper with user agent
See merge request saburly/marketalarm/web!98
|
2020-02-20 19:58:32 +00:00 |
|
Bilal Catic
|
4f230020d7
|
use fetch wrapper instead of node-fetch
|
2020-02-20 19:49:29 +01:00 |
|
Bilal Catic
|
f62a7200c7
|
create fetch wrapper with mandatory user agent header
|
2020-02-20 19:47:30 +01:00 |
|
Bilal Catic
|
cff7cc2e9c
|
apply prettier
|
2020-02-20 19:46:39 +01:00 |
|
Naida Vatric
|
f56cd5b549
|
More elegant scrape of lat and long.
|
2020-02-17 21:55:24 +01:00 |
|