Skip to content

Issues: Lightning-AI/litdata

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

23 Open 12 Closed
23 Open 12 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Cache directory resolution issues in Google Colab bug Something isn't working help wanted Extra attention is needed
#126 opened May 8, 2024 by awaelchli
1
Optimizing dictionary data structures fails when using a partially initialized function
#120 opened May 6, 2024 by enrico-stauss
2
Time per sample grows as processed samples grows bug Something isn't working help wanted Extra attention is needed
#119 opened May 5, 2024 by scritter
4
Slow Dataset Preprocessing due to CPU affinity (?) issues bug Something isn't working help wanted Extra attention is needed
#118 opened May 2, 2024 by mgolub2
3
optimize function on multiple machine writing to local pathes enhancement New feature or request help wanted Extra attention is needed
#105 opened Apr 22, 2024 by rakro101
Dataloading is not working when used in litgpt's debug pretraining example bug Something isn't working help wanted Extra attention is needed
#103 opened Apr 18, 2024 by iloshchilov
4
ValueError: buffer size must be a multiple of element size bug Something isn't working help wanted Extra attention is needed
#102 opened Apr 18, 2024 by awaelchli
Question: is there a plan to support streaming from GCS? enhancement New feature or request
#101 opened Apr 13, 2024 by dnnspark
6
Compression using the optimize function from litdata bug Something isn't working help wanted Extra attention is needed
#97 opened Apr 11, 2024 by rakro101
5
GCSFuse mount + Vertex AI custom training jobs support enhancement New feature or request
#94 opened Apr 7, 2024 by miguelalba96
1
litdata.optimize accidentally deletes files from the local filesystem bug Something isn't working help wanted Extra attention is needed
#93 opened Apr 5, 2024 by hubertsiuzdak
2
Assert when deserializing no_header_numpy or no_header_tensor. bug Something isn't working help wanted Extra attention is needed
#92 opened Apr 4, 2024 by ouj
4
Issue with StreamingDataset when not using all GPUs on host. bug Something isn't working help wanted Extra attention is needed
#91 opened Apr 3, 2024 by gkroiz
1
6
TPU support enhancement New feature or request
#79 opened Mar 26, 2024 by miguelalba96
5
Prints inside the worker processes mess up the progress bar bug Something isn't working help wanted Extra attention is needed
#76 opened Mar 24, 2024 by carmocca
1
Allow a StreamingDataset to wrap around when running in a CombinedStreamingDataset enhancement New feature or request
#74 opened Mar 14, 2024 by lantiga
1
litdata with huggingface instead of S3 enhancement New feature or request
#64 opened Mar 8, 2024 by ehartford
6
The tested speed is not as fast as expected. bug Something isn't working help wanted Extra attention is needed
#60 opened Mar 7, 2024 by tikboaHIT
20
Resuming StreamingDataloader with num_workers=0 fails bug Something isn't working
#24 opened Feb 26, 2024 by tchaton
1
Append data to pre-optimized dataset enhancement New feature or request
#23 opened Feb 26, 2024 by tchaton
1
map device management enhancement New feature or request
#15 opened Feb 23, 2024 by ethanwharris
2
Fast random access for StreamingDataset enhancement New feature or request
#14 opened Feb 23, 2024 by ethanwharris
Support StreamingDataLoader passed to map enhancement New feature or request
#13 opened Feb 23, 2024 by ethanwharris
1
ProTip! Mix and match filters to narrow down what you’re looking for.