Issues: Lightning-AI/litserve
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
automatically dump dictionary to json in encode_response while Streaming
enhancement
New feature or request
help wanted
Extra attention is needed
#84
opened May 11, 2024 by
aniketmaurya
Logging error
bug
Something isn't working
help wanted
Extra attention is needed
#83
opened May 11, 2024 by
williamFalcon
Print "Setup complete" when setup is complete
enhancement
New feature or request
help wanted
Extra attention is needed
#81
opened May 11, 2024 by
williamFalcon
Add OpenAI as a pluggable spec
enhancement
New feature or request
help wanted
Extra attention is needed
#72
opened Apr 30, 2024 by
lantiga
test_timeout test is flaky
bug
Something isn't working
help wanted
Extra attention is needed
#71
opened Apr 30, 2024 by
aniketmaurya
end-to-end tests
ci / tests
enhancement
New feature or request
help wanted
Extra attention is needed
#67
opened Apr 25, 2024 by
aniketmaurya
3 of 4 tasks
avoid sending content past the last token during batching / batched streaming
#57
opened Apr 23, 2024 by
aniketmaurya
Add a detached mode
enhancement
New feature or request
help wanted
Extra attention is needed
#56
opened Apr 22, 2024 by
rasbt
Handle streaming loop if client has disconnected
enhancement
New feature or request
help wanted
Extra attention is needed
#48
opened Apr 16, 2024 by
aniketmaurya
Only enable either Something isn't working
help wanted
Extra attention is needed
predict
or stream-predict
API based on stream
argument to LitServer
bug
#47
opened Apr 16, 2024 by
aniketmaurya
add test for failed preds and catch timeout during streaming
#46
opened Apr 16, 2024 by
aniketmaurya
Improve canceling via Ctrl+C
enhancement
New feature or request
help wanted
Extra attention is needed
#11
opened Mar 7, 2024 by
lantiga
ProTip!
Exclude everything labeled
bug
with -label:bug.