Skip to content

Commit

Permalink
typo fix (#1114)
Browse files Browse the repository at this point in the history
(cherry picked from commit 3be919d)
  • Loading branch information
jessecambon authored and Borda committed Jun 29, 2022
1 parent 48ec43a commit 3afb7e1
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/source/pages/overview.rst
Original file line number Diff line number Diff line change
Expand Up @@ -162,7 +162,7 @@ When using metrics in `Distributed Data Parallel (DDP) <https://pytorch.org/docs
mode, one should be aware that DDP will add additional samples to your dataset if the size of your dataset is
not equally divisible by ``batch_size * num_processors``. The added samples will always be replicates of datapoints
already in your dataset. This is done to secure an equal load for all processes. However, this has the consequence
that the calculated metric value will be sligtly bias towards those replicated samples, leading to a wrong result.
that the calculated metric value will be slightly biased towards those replicated samples, leading to a wrong result.

During training and/or validation this may not be important, however it is highly recommended when evaluating
the test dataset to only run on a single gpu or use a `join <https://pytorch.org/docs/stable/_modules/torch/nn/parallel/distributed.html#DistributedDataParallel.join>`_
Expand Down

0 comments on commit 3afb7e1

Please sign in to comment.