Pinned

1. bentoml/OpenLLM bentoml/OpenLLM Public

   Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.

   Python 8.8k 554

2. bentoml/BentoML bentoml/BentoML Public

   The most flexible way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Inference Graph/Pipelines, Compound AI systems, Multi-Modal, RAG as a Service, and more!

   Python 6.5k 738

3. huggingface/peft huggingface/peft Public

   🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

   Python 13.8k 1.3k

4. bazix bazix Public template

   Nix + Bazel = 🥰

   Starlark 7

5. whispercpp whispercpp Public

   Pybind11 bindings for Whisper.cpp

   C++ 298 52

6. sites sites Public

   generated source of aarnphm[dot]xyz

   HTML