Skip to content

Issues: bentoml/OpenLLM

tracking: Fine-tuning support
#61 opened Jun 24, 2023 by aarnphm
Open 1
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

87 Open 162 Closed
87 Open 162 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

feat: Multimodal LLMs?
#972 opened Apr 30, 2024 by Trickster85
For AMD/GPU, how to use multi GPUS in the api_server.py
#968 opened Apr 28, 2024 by williamZQ
bug: error coming up while install the vllm using pip install "openllm[vllm]"
#967 opened Apr 25, 2024 by Developer-atomic-amardeep
feat: support LMDeploy backend
#966 opened Apr 25, 2024 by zhyncs
1
bug: WARNING: openllm 0.4.44 does not provide the extra 'gemma'
#965 opened Apr 24, 2024 by infinite-Joy
feat: Can you support llama3?
#961 opened Apr 18, 2024 by ICLXL
1
bug: Not enough data for satisfy transfer length header
#960 opened Apr 18, 2024 by Cherchercher
bug: An exception occurred while instantiating runner 'llm-mistral-runner'
#952 opened Apr 14, 2024 by billy-le
1
feat: any plan to support NPU
#951 opened Apr 13, 2024 by zhangxinyang97
feat: support Qwen1.5
#948 opened Apr 9, 2024 by sudazzk
1
feat: c4ai-command-r-v01 support
#944 opened Apr 6, 2024 by 0x77dev
2
FileNotFoundError: [Errno 2] No such file or directory: b'/root/bentoml/models/pt-google--gemma-7b-it/latest'
#937 opened Mar 21, 2024 by PaoloBarba
Deprecation Warning for PyTorch Backend
#936 opened Mar 19, 2024 by byteshiva
2
Deploying LLM in On-Premises Server to Assist Users to Launch Locally in Work Laptop - Web Browser
#934 opened Mar 18, 2024 by sanket038
3
feat: support volta architecture GPUs for the vLLM backend
#930 opened Mar 12, 2024 by K-Mistele
I'm having trouble getting statted with openllm, but I don't want to use conda and I have WSL2
#929 opened Mar 11, 2024 by Lightwave234
1
bug: start chatglm-6b locally err
#926 opened Mar 5, 2024 by zhangxinyang97
bug: not generate eos_token when using qwen7B-chat
#924 opened Feb 29, 2024 by qiufengyuyi
When attempting to add the CohereForAI/aya-101 model using CohereForAI's Aya model, an error occurred during the loading process.
#910 opened Feb 20, 2024 by yasserkh2
Runtime error about concurrency
#905 opened Feb 16, 2024 by meanwo
bug: Error in sending post request for bentoml container service
#904 opened Feb 13, 2024 by hahmad2008
1
bug: Requests with "use_beam_search: true" fail with an unclear exception message.
#903 opened Feb 13, 2024 by yan-virin
Can't pass workers_per_resource to the bentoml container
#901 opened Feb 12, 2024 by hahmad2008
@aarnphm
2
feat: Document usage of request_id
#900 opened Feb 12, 2024 by AlexanderFillbrunn
How to update the prompt template without change openllm-core config
#895 opened Feb 11, 2024 by hahmad2008
ProTip! Find all open issues with in progress development work with linked:pr.