Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GCS: Retrying failed requests #867

Closed
defined-user opened this issue Mar 31, 2020 · 1 comment
Closed

GCS: Retrying failed requests #867

defined-user opened this issue Mar 31, 2020 · 1 comment

Comments

@defined-user
Copy link

defined-user commented Mar 31, 2020

Working with a GoogleCloudStorage API may fail due to some transient server side errors, such as TooManyRequests, ServiceUnavailable, InternalServerError, etc. Retrying failed requests is recommended by Google for some specific errors. As an example, gsutil tool, which is written in Python, has it's own retry handling strategy (more information on what errors are considered to be retryable can be found there). These errors could be handled with an exponential backoff retrying algorithm. In case, if that does not help, it would still prevent the client from making too many requests and and retrying indefinitely.
Beside that, aforementioned gsutil tool also retries on transient network errors, and I consider the one specified in @and3rson's issue #735 to be one of those. Using a standard Google's retry handler allows to handle such exceptions by appending the list of exceptions that must be handled.

@defined-user
Copy link
Author

defined-user commented Mar 16, 2021

Closing it, as there has been no feedback from the maintainers on this issue and related PR for almost a year.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant