New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add enviroment variable for openai timeout, backoff and max retries #7610
Comments
Working on it. |
@nickprock, I've been locking for this environment variables on the v1.x and v1.25.x branches and cannot find any reference to them, could you give me more info please. |
In 1.25 there are these environment variables
https://github.com/deepset-ai/haystack/blob/v1.25.5/haystack/environment.py I talked with @vblagoje on Discord here: https://discord.com/channels/993534733298450452/1232706764294717511 |
@nickprock the discord invitation does not work. Could you send a new one please. |
Not really getting anywhere, and I will be out for the next few days, so feel free to proceed with this implementation. :) |
Hey @masci just wanted to give you a heads up that deepset Cloud + Sol will want this since we used this extensively for client pipelines that timed out when using bigger models like GPT4. |
Is your feature request related to a problem? Please describe.
In version 1, haystack allows to set three environment variables to manage:
It's useful also for the versione 2.0
The text was updated successfully, but these errors were encountered: