senaduka/old-kiviscrapworker
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Merge branch 'add-new-envs' into 'master'

Browse Source 
Add new envs

See merge request saburly/kiviscrapworker!5
This commit was merged in pull request #5.
This commit is contained in:
Senad Uka
2020-05-22 17:01:31 +00:00
parent a147dd466d 8438a673da
commit 8fda824b70
1 changed files with 4 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
example.env
View File

@@ -6,4 +6,7 @@ CLIENT_WAITING_TIMEOUT = Number of seconds to wait for request from server
WORKER_SERVER_ADDRESS = Address in form of IP:PORT (127.0.0.1:1338)
REQUEST_MESSAGE_PREFIX = Prefix that worker server adds to the request message when sending to the worker client. Use double quotes if prefix has a space (eg. "URL ")
PROXY_LIST_BASE_URL = Base url where proxy list can be fetched. Proxy type(https, socks5) will be concatenated to this URL
CUSTOM_SOCKS5_PROXY_LIST = List of proxies to append on list from PROXY_LIST_BASE_URL, comma separated (ip:port, ip:port, ...)
PROXY_LIST_TIMEOUT = Wait PROXY_LIST_TIMEOUT seconds for proxy list before dropping request
PROXY_LIST_RELOAD_INTERVAL = Refresh proxy list every PROXY_LIST_RELOAD_INTERVAL minutes
CUSTOM_SOCKS5_PROXY_LIST = List of proxies to append on list from PROXY_LIST_BASE_URL, comma separated (ip:port, ip:port, ...)
FETCH_TIMEOUT = Timeout in seconds after which fetch connection is dropped