Pinned

1. microsoft/DeepSpeed microsoft/DeepSpeed Public

   DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

   Python 33k 3.9k

2. microsoft/DeepSpeedExamples microsoft/DeepSpeedExamples Public

   Example models using DeepSpeed

   Python 5.7k 969

3. microsoft/DeepSpeed-MII microsoft/DeepSpeed-MII Public

   MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

   Python 1.7k 156

4. microsoft/Megatron-DeepSpeed microsoft/Megatron-DeepSpeed Public

   Forked from NVIDIA/Megatron-LM

   Ongoing research training transformer language models at scale, including: BERT & GPT-2

   Python 1.6k 316

5. LLNL/lbann LLNL/lbann Public

   Livermore Big Artificial Neural Network Toolkit

   C++ 219 80