Skip to content

Issues: Lightning-AI/litgpt

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

157 Open 468 Closed
157 Open 468 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

support for qwen2 and baichuan
#1411 opened May 11, 2024 by bestpredicts
Streamline LitGPT API breaking change
#1403 opened May 8, 2024 by rasbt
@rasbt
7
Pretraining example from readme fails in Colab
#1402 opened May 8, 2024 by AndisDraguns
@awaelchli
3
Remove old and unused LLMs
#1401 opened May 8, 2024 by rasbt
LoRA matrices dropout
#1398 opened May 7, 2024 by belerico
how to solve this debug
#1394 opened May 7, 2024 by Learneducn
LR scheduler can result in a division by 0 bug Something isn't working
#1393 opened May 6, 2024 by carmocca
Address frozen parameter warning with FSDP on nightly torch fine-tuning
#1392 opened May 6, 2024 by carmocca
Will CycleIterator forward to dataset on resume for pretrain?
#1386 opened May 5, 2024 by calvintwr
1
fabric.print only works on sys.stderr, does not print inference result question Further information is requested
#1384 opened May 4, 2024 by lastmjs
1
How to use custom dataset for evaluate?
#1383 opened May 4, 2024 by Gooooooogo
After some iteration in pretraining a LLM, IndexError is raised related to dataset chunking
#1377 opened May 1, 2024 by MusulmonLolayev
Why FSDPStrategy is so slow-down when I use multi-machine
#1369 opened Apr 29, 2024 by Graduo
4
A potential bug for multi-GPU training
#1368 opened Apr 28, 2024 by zyushun
5
combine FSDP with selective activation checkpointing
#1366 opened Apr 28, 2024 by nemoramo
Add support for memory-efficient and faster optimizers
#1364 opened Apr 27, 2024 by rasbt
1
Failed to load the finetuned model with AutoModelForCausalLM.from_pretrained(name, state_dict=state_dict) 3rd party bug Something isn't working
#1362 opened Apr 27, 2024 by zhaosheng-thu
@rasbt
4
Conversion to HF checkpoint should generate a checkpoint format that can be loaded directly conversion For model weight-map conversions enhancement New feature or request
#1359 opened Apr 25, 2024 by awaelchli
1
Nucleus (top-p) sampling enhancement New feature or request generation
#1347 opened Apr 24, 2024 by belerico
2
Qwen1.5 Family Support
#1340 opened Apr 23, 2024 by junzhang-zj
simple API interface for initializing and running model inference enhancement New feature or request
#1329 opened Apr 19, 2024 by aniketmaurya
Blockwise quantization only supports 16/32-bit floats, but got torch.uint8 ( bnb.nf4 quantisation is not working)
#1325 opened Apr 19, 2024 by Anindyadeep
15
Pretraining example is not working
#1318 opened Apr 18, 2024 by iloshchilov
1
Docs for non-cli usage
#1310 opened Apr 17, 2024 by shatz01
3
On the relationship with torchtune
#1309 opened Apr 16, 2024 by jwkirchenbauer
1
ProTip! What’s not been updated in a month: updated:<2024-04-12.