Skip to content

Issues: huggingface/text-generation-inference

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

138 Open 975 Closed
138 Open 975 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Llama3 Tokenizer Troubles: All added_tokens unrecognized, given id of None
#1984 opened May 30, 2024 by Dtphelan1
2 of 4 tasks
Intel XPU Docker image import error on start
#1983 opened May 30, 2024 by grafail
2 of 4 tasks
Support OpenAI's stop parameter logic
#1979 opened May 30, 2024 by thomas-schillaci
[Feature]: Additional metrics to enable better autoscaling / load balancing of TGI servers in Kubernetes
#1977 opened May 29, 2024 by EandrewJones
Wrong tool choice makes server crash
#1976 opened May 29, 2024 by antonioloison
2 of 4 tasks
Cannot load microsoft/Phi-3-medium and microsoft/Phi-3-small with TGI-2.0.4
#1974 opened May 29, 2024 by singh-git10
1 of 4 tasks
2
Low-Rank Adaptation of Large Language Models
#1973 opened May 29, 2024 by mhou7712
The PHI-3 gives warnings about Tokens and returns additional tokens.
#1972 opened May 29, 2024 by PawelFaron
2 of 4 tasks
TGI 2.0.3 fails to serve CodeLlama models that 2.0.1 supports
#1969 opened May 28, 2024 by KCFindstr
2 of 4 tasks
4
Cannot load Gemma models with TGI 2.0.3
#1968 opened May 28, 2024 by KCFindstr
2 of 4 tasks
3
Add response_format to chat/completions
#1966 opened May 28, 2024 by thomas-schillaci
can add model deepseek-ai/DeepSeek-V2-Lite?
#1964 opened May 28, 2024 by Semihal
ValueError: Unsupported model type llava
#1962 opened May 28, 2024 by pseudotensor
2 of 4 tasks
1
ModuleNotFoundError: No module named 'dropout_layer_norm'
#1961 opened May 27, 2024 by gokerguner
2 of 4 tasks
4
TGI hard crashes after 1 OOM error
#1960 opened May 27, 2024 by pranavthombare
2 of 4 tasks
2
Gibberish generated with deepseek-ai/deepseek-coder-6.7b-instruct
#1957 opened May 27, 2024 by chuaweien
2 of 4 tasks
TGI does not always preserve order of grammar's JSON keys/Pydantic arguments
#1956 opened May 27, 2024 by MoritzLaurer
2 of 4 tasks
1
Can't load local models
#1955 opened May 27, 2024 by danielkorat
1 of 4 tasks
Expose ignore_eos_token to HTTP endpoints
#1944 opened May 24, 2024 by nathan-az
multiple origins
#1941 opened May 23, 2024 by LukaszHem
Falcon 11B VLM Support
#1933 opened May 22, 2024 by ulrichkr
2 of 4 tasks
Phi-3 medium 128k instruct fails to start
#1930 opened May 21, 2024 by xfalcox
2 of 4 tasks
7
TGI crash during Warming up model - invalid opcode in rotary_emb.cpython-310-x86_64-linux-gnu.so
#1928 opened May 21, 2024 by zidsi
2 of 4 tasks
1
Pydantic validation error re: ChoiceDelta (text_generation/types.py)
#1927 opened May 20, 2024 by mphipps2
2 of 4 tasks
version in docker not correct
#1926 opened May 20, 2024 by arunpatala
2 of 4 tasks
ProTip! no:milestone will show everything without a milestone.