old-web

senaduka/old-web

Fork 0

Commit Graph

Select branches

Hide Pull Requests

add-currency-to-price-filters

add-even-more-filters

add-more-real-estate-filters

ads-without-price

after-scraper-fix

block-next-button-while-loading

checkup-email

checkup-email-bug-fix

crawler-optimisation

crawler-saljicnekretnine

crawler-service

dockerize-database

double-email

edit-bug-fix

edit-location-start

email-density

email-notifications-kivi-ads

email-results-view

email_to_amazon

fetch-optimisation

fixing-saljic-bugs

google-maps

heroku-port

implement-renting-option-frontend

include-incomplete-ads-inverse

kivi-original-ads-input

lat-lng-scraping

master

migrate-to-serverless

more-details-email

move-locate-me-button

no-all-results-email

places

price-history-log

promise-experiment

prostor-vip-ads

prostor-vip-ads-fix

rename

rename-settings-var

rename-variables

rental-crawler-fix

replace-frontend-arrow-functions-with-old-style-function

results-link

saljic-crawler-fix

scraper-api-support

send-notification

sliders-formating

staging-tag-to-checkup-email

tag-staging-email

update-dockerfile-readme-setup

view-ad-kivi-original

wizard

#1

#10

#100

#101

#102

#103

#104

#105

#106

#107

#108

#109

#11

#110

#111

#112

#113

#12

#13

#14

#15

#16

#17

#18

#19

#2

#20

#21

#22

#23

#24

#25

#26

#27

#28

#29

#3

#30

#31

#32

#33

#34

#35

#36

#37

#38

#39

#4

#40

#41

#42

#43

#44

#45

#46

#47

#48

#49

#5

#50

#51

#52

#53

#54

#55

#56

#57

#58

#59

#6

#60

#61

#62

#63

#64

#65

#66

#67

#68

#69

#7

#70

#71

#72

#73

#74

#75

#76

#77

#78

#79

#8

#80

#81

#82

#83

#84

#85

#86

#87

#88

#89

#9

#90

#91

#92

#93

#94

#95

#96

#97

#98

#99

778197b32f Merge branch 'add-notification-on-new-search-request' into 'master' Bilal Catic 2019-10-09 13:41:57 +00:00
72864f3a37 move email input to the review step Bilal Catic 2019-10-08 20:42:43 +02:00
615aed65b6 find matching real estates for new search request and notify Bilal Catic 2019-10-07 20:49:54 +02:00
502c7c3e35 fix error on email validation failure Bilal Catic 2019-09-30 19:33:01 +02:00
3e5371f780 Merge branch 'notification-service' into 'master' Bilal Catic 2019-09-30 14:23:39 +00:00
bbff526ea0 skip real estates without location in search Bilal Catic 2019-09-30 14:27:26 +02:00
5e8e13a984 fix enums Bilal Catic 2019-09-30 14:27:01 +02:00
37ba7e2c8c pass new real estates to the notification service Bilal Catic 2019-09-30 13:53:35 +02:00
99a6cefd89 fix real estates list Bilal Catic 2019-09-30 13:24:07 +02:00
0fdef956a7 use sequelize include option when querying real estates from matches Bilal Catic 2019-09-30 13:20:38 +02:00
4b5548aa96 ad AS to DB query Bilal Catic 2019-09-30 13:20:11 +02:00
b703d55c06 fix model associations Bilal Catic 2019-09-30 13:17:27 +02:00
4713e78d51 remove obsolete DB helper functions Bilal Catic 2019-09-30 12:08:37 +02:00
6272ec0f47 use matching service to find matches Bilal Catic 2019-09-30 12:08:16 +02:00
dac7043a56 add service to find real estate - search request matches Bilal Catic 2019-09-30 12:07:47 +02:00
12f826ef55 add methods to add and find real estate - search request matches Bilal Catic 2019-09-30 12:07:21 +02:00
5a7b9826c2 refactor email content Bilal Catic 2019-09-30 12:06:35 +02:00
b3ea2398d4 add more real estates to test Bilal Catic 2019-09-30 10:31:50 +02:00
af36653c1a refactor redirect - use new method to find real estate by id Bilal Catic 2019-09-30 10:31:07 +02:00
31ffc3253f add method to find search requests for real estate Bilal Catic 2019-09-30 10:30:13 +02:00
54f7e4ba53 add method to find real estate by id Bilal Catic 2019-09-30 10:29:27 +02:00
87a72be8fe use notificationService to send email for new search request Bilal Catic 2019-09-30 10:29:05 +02:00
a738a371ae add notificationService to handle when, what and to whom to send email Bilal Catic 2019-09-30 10:28:29 +02:00
9c0104a57c refactor crawler - adapt to use new ENUM objects Bilal Catic 2019-09-30 10:27:12 +02:00
e1dfd6a4eb add helper to generate email; install html-to-text package Bilal Catic 2019-09-30 09:51:10 +02:00
68ef31f867 add emailService to handle email sending Bilal Catic 2019-09-30 09:49:47 +02:00
e3e47345bc load AWS config through app config; fix ENV path Bilal Catic 2019-09-30 09:44:19 +02:00
c57d3f8457 add npm command to test matching and notification services Bilal Catic 2019-09-29 19:28:47 +02:00
6d7366f2c2 use single ENUMS; change old realEstateType enums Bilal Catic 2019-09-27 19:36:20 +02:00
d8d801d314 use single ENUMS; change old realEstateType enums Bilal Catic 2019-09-27 18:20:16 +02:00
f31355dd84 use AD_TYPE enums for SearchRequest adType field Bilal Catic 2019-09-27 09:23:08 +02:00
ad873d61e7 Merge branch 'start-crawler-loop-with-server' into 'master' Bilal Catic 2019-09-27 09:22:17 +00:00
c5a720484a add ENV variable to control crawler execution Bilal Catic 2019-09-26 23:55:34 +02:00
2e92f961ff start crawler loop when server is started Bilal Catic 2019-09-26 17:30:06 +02:00
0b083a02e2 Merge branch 'make-crawler-smarter' into 'master' Bilal Catic 2019-09-25 17:15:14 +00:00
3d203df988 remove comment from delay between indexing pages Bilal Catic 2019-09-25 10:00:42 +00:00
c9a959f8be stop crawling when existing, not renewed ad is found Bilal Catic 2019-09-25 08:54:33 +02:00
b3fcc6ba9a return new and existing real estates when saving results Bilal Catic 2019-09-25 08:32:37 +02:00
f93d0e738f add delay between pages config variable Bilal Catic 2019-09-25 08:31:37 +02:00
90bc57edb6 stop crawling when existing, non-renewed ad is found Bilal Catic 2019-09-24 23:23:09 +02:00
746732f30b remove deleted column from RealEstate model Bilal Catic 2019-09-24 23:21:22 +02:00
06d35fcb4b move ignored usernames config to crawler specific config Bilal Catic 2019-09-24 23:21:06 +02:00
63eb64b0f6 parse and save published and renewed dates Bilal Catic 2019-09-23 21:19:28 +02:00
c7184be5fc install moment and moment-timezone packages Bilal Catic 2019-09-23 21:18:48 +02:00
18db554ea8 add published and renewed date columns to the RealEstates table Bilal Catic 2019-09-23 19:02:00 +02:00
3140fdf0c0 use function generator to index pages; crawl in parallel Bilal Catic 2019-09-23 10:46:31 +02:00
c4f6c6e1c3 construct crawling url before indexing single page Bilal Catic 2019-09-21 15:45:48 +02:00
5f1697f6ae Set viewport correctly Edin Dazdarevic 2019-09-21 19:44:22 +02:00
7845587fa7 Merge branch 'go_again_copy' into 'master' Bilal Catic 2019-09-21 15:58:20 +00:00
c2d1725173 Merge branch 'map_screen_copy' into 'master' Bilal Catic 2019-09-21 14:42:32 +00:00
e3636451b7 fix typo Bilal Catic 2019-09-21 14:41:20 +00:00
0f01a070ca Change final screen to explain to user what they can expect next Senad Uka 2019-09-21 08:14:04 +02:00
bfcc0a09d9 Add copy that explains the map screen better. Senad Uka 2019-09-21 06:06:39 +02:00
51411a4109 Merge branch 'switch-to-new-crawler' into 'master' Bilal Catic 2019-09-18 14:06:16 +00:00
f9cd26fca8 refactor enums Bilal Catic 2019-09-18 15:33:58 +02:00
e374cac60e update RealEstates model, add DB helper functions for RealEstates model Bilal Catic 2019-09-18 15:33:42 +02:00
d3b2f95719 add new ENV variables to control crawler Bilal Catic 2019-09-18 15:33:09 +02:00
3d46c82d3d create new crawler and Postgres saver Bilal Catic 2019-09-18 15:32:48 +02:00
2e13763939 update Sequelize Bilal Catic 2019-09-18 06:35:39 +02:00
2702259eb1 change title, short and long description columns type to Text Bilal Catic 2019-09-18 06:35:26 +02:00
17461b2e57 remove deleted and sold columns, adStatus is replacement column Bilal Catic 2019-09-17 10:27:25 +02:00
5cb12b1714 remove lastTimeCrawled column - use updatedAt for this Bilal Catic 2019-09-17 10:12:49 +02:00
b96ce17dbf add unique constraint - composite key to the RealEstates table Bilal Catic 2019-09-17 09:07:14 +02:00
88ee2ee326 add adStatus column to the RealEstates table Bilal Catic 2019-09-16 23:20:18 +02:00
33b91c8161 add short and long description columns to the RealEstates table Bilal Catic 2019-09-16 23:09:29 +02:00
25faf75d6f add title column to the RealEstates table Bilal Catic 2019-09-16 16:08:29 +02:00
76a989fa37 replace old crawler, without specific crawler and saver implementation Bilal Catic 2019-09-16 15:59:53 +02:00
b28b160852 fix locate me button position Bilal Catic 2019-09-16 11:56:55 +02:00
dbb9807e63 Merge branch 'redesign-DB-and-adapt-search-request' into 'master' Bilal Catic 2019-09-13 16:55:11 +00:00
5dfe363adc adapt unsubscribe step for new DB design Bilal Catic 2019-09-13 14:54:21 +02:00
2b22cd04fd fix unsubscribe and review links in email notification Bilal Catic 2019-09-13 14:50:23 +02:00
c01cb03762 adapt query submit size step for new DB design Bilal Catic 2019-09-13 14:40:10 +02:00
b4c71b93de adapt garden size step for new DB design Bilal Catic 2019-09-13 14:30:54 +02:00
e26c2b6e8d adapt price and query review steps for new DB design Bilal Catic 2019-09-13 14:17:46 +02:00
ff68e96f4f adapt size step for new DB design Bilal Catic 2019-09-13 13:58:58 +02:00
db58d1e98b adapt location step for new DB design Bilal Catic 2019-09-13 12:37:53 +02:00
fbf7aabe93 use sequelize findByPk method for getting SearchRequest object Bilal Catic 2019-09-13 12:35:23 +02:00
f258800fd8 change defaultValue for subscribed to false Bilal Catic 2019-09-13 12:33:16 +02:00
8f09d4f227 change url param case from snake_case to camelCase Bilal Catic 2019-09-13 11:11:28 +02:00
1a874d4d88 adapt first step of search request to new DB design Bilal Catic 2019-09-13 11:08:45 +02:00
3cbd79dcc9 create SearchRequest db helper model Bilal Catic 2019-09-13 11:06:58 +02:00
77d9669ad6 modify URL helper for getting searchRequestId Bilal Catic 2019-09-13 11:06:03 +02:00
b7d147b0a6 fix SearchRequest model, add default values for not null fields Bilal Catic 2019-09-13 10:57:43 +02:00
e32e98537c add createdAt, updatedAt fields; add default values for not null fields Bilal Catic 2019-09-13 10:56:46 +02:00
81ecb37493 add models for new DB design Bilal Catic 2019-09-13 09:47:49 +02:00
75daf55fdf add migrations for new DB design Bilal Catic 2019-09-13 09:46:59 +02:00
05f8cbd816 move old models to oldModels folder Bilal Catic 2019-09-13 08:57:41 +02:00
a61816c5c2 move routes to separated file; stop running crawler in main loop Bilal Catic 2019-09-12 06:23:03 +02:00
f781dc1cd0 create separate file for routes Bilal Catic 2019-09-12 06:21:49 +02:00
510c7917dd fix APP_URL variable Bilal Catic 2019-09-11 11:27:45 +02:00
202c4e441e use process.env.PORT so it can be deployed to Heroku Bilal Catic 2019-09-11 11:23:05 +02:00
0b78254573 Merge branch 'restrict-email-results-to-10-only' into 'master' Bilal Catic 2019-09-10 15:25:29 +00:00
1f79e1d555 limit number of real estate results in email to 10 Bilal Catic 2019-09-10 13:41:16 +02:00
de3ea71342 Merge branch 'simplify-location-search' into 'master' Bilal Catic 2019-09-10 15:15:09 +00:00
74125d761a improve zoom level by incrementing by one Bilal Catic 2019-09-10 17:08:24 +02:00
9ec7e4be14 add locate me button; fix zoom level Bilal Catic 2019-09-10 16:59:59 +02:00
aea221f0c3 Change email template; remove region, municipality values Bilal Catic 2019-09-10 12:11:44 +02:00
4d245f3127 add zoom controls on the location map Bilal Catic 2019-09-10 11:49:42 +02:00
fbbc0952e3 fix undefined split function exception Bilal Catic 2019-09-10 11:49:26 +02:00
93fe5ee870 remove region and municipality params when searching olx Bilal Catic 2019-09-10 11:19:42 +02:00

... 3 4 5 6 7 ...