Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

StageRetryableException: Could not download url https://urlhaus.abuse.ch/downloads/csv/: Timeout after 30 #198

Open
sentry-io bot opened this issue Feb 16, 2021 · 0 comments

Comments

@sentry-io
Copy link

sentry-io bot commented Feb 16, 2021

Sentry Issue: CHECKMATE-F

timeout: The read operation timed out
(5 additional frame(s) were not displayed)
...
  File "http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "socket.py", line 586, in readinto
    return self._sock.recv_into(b)
  File "ssl.py", line 1012, in recv_into
    return self.read(nbytes, buffer)
  File "ssl.py", line 874, in read
    return self._sslobj.read(len, buffer)
  File "ssl.py", line 631, in read
    v = self._sslobj.read(len, buffer)

ReadTimeoutError: HTTPSConnectionPool(host='urlhaus.abuse.ch', port=443): Read timed out. (read timeout=30)
(2 additional frame(s) were not displayed)
...
  File "urllib3/util/retry.py", line 531, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "urllib3/packages/six.py", line 735, in reraise
    raise value
  File "urllib3/connectionpool.py", line 706, in urlopen
    chunked=chunked,
  File "urllib3/connectionpool.py", line 447, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "urllib3/connectionpool.py", line 337, in _raise_timeout
    self, url, "Read timed out. (read timeout=%s)" % timeout_value

ReadTimeout: HTTPSConnectionPool(host='urlhaus.abuse.ch', port=443): Read timed out. (read timeout=30)
(2 additional frame(s) were not displayed)
...
  File "requests/api.py", line 76, in get
    return request('get', url, params=params, **kwargs)
  File "requests/api.py", line 61, in request
    return session.request(method=method, url=url, **kwargs)
  File "requests/sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "requests/sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)

StageRetryableException: Could not download url https://urlhaus.abuse.ch/downloads/csv/: Timeout after 30
(3 additional frame(s) were not displayed)
...
  File "checkmate/async/tasks.py", line 62, in initialize_urlhaus
    synced = URLHaus(request.db).reinitialize_db()
  File "checkmate/checker/url/url_haus.py", line 52, in reinitialize_db
    return self._update(self.INITIAL_FEED)
  File "checkmate/checker/url/url_haus.py", line 63, in _update
    values=(self._value_from_row(row) for row in feed(working_dir)),
  File "checkmate/checker/pipeline/core.py", line 49, in __call__
    source = stage(working_dir, source)
  File "checkmate/checker/pipeline/web.py", line 32, in __call__
    ) from err
@seanh seanh added the Backend label Feb 16, 2021
@seanh seanh added this to Backlog in Secure Via via automation Feb 16, 2021
@seanh seanh added the URLHaus label Mar 5, 2021
@seanh seanh removed this from Backlog in Secure Via Mar 5, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant