How to use different dataloader for different GPU in DDP #19691
Unanswered
xiachenrui
asked this question in
DDP / multi-GPU / multi-node
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi, all
I really like lightning! Now, I want to train a GNN on some big graphs (200+ graphs, each graph contains 1M nodes), it is hard to load them into memory once and use DDP. I want to know if it is possible to allocate each GPU process with a Dataloader.
I am also hesitating whether to use IterableDataset, it seems hard to combine IterableDataset and DDP traning.
Any other suggestions will be useful !
Best,
Chen-Rui
Beta Was this translation helpful? Give feedback.
All reactions