Popular repositories

1. DeepSpeed DeepSpeed Public

   Forked from microsoft/DeepSpeed

   DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

   Python

2. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

3. AutoAWQ AutoAWQ Public

   Forked from casper-hansen/AutoAWQ

   AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference.

   C++

4. llama-cpp-python llama-cpp-python Public

   Forked from abetlen/llama-cpp-python

   Python bindings for llama.cpp

   Python

5. shotoku shotoku Public

   Rust

6. EETQ EETQ Public

   Forked from NetEase-FuXi/EETQ

   Easy and Efficient Quantization for Transformers

   C++