LightningCLI fails with num_workers > 0 and custom dataset #19763
Unanswered
adosar
asked this question in
Lightning Trainer API: Trainer, LightningModule, LightningDataModule
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hello,
I have a custom dataset that looks like this:
Everything works fine even with
num_workers > 0
when I train my model with a custom script. The problem appears when I train the model with theLightningCLI
. I am getting the following error:It passes the sanity checks for the validation dataloader but then fails. If I just use
num_workers == 0
it runs without problems also withLightningCLI
. Any ideas?Note
Adding
fast_dev_run == True
also runs without problems withnum_workers > 0
andLightningCLI
.Beta Was this translation helpful? Give feedback.
All reactions