Popular repositories

1. node-worker-farm node-worker-farm Public

   Forked from rvagg/node-worker-farm

   Distribute processing tasks to child processes with an über-simple API and baked-in durability & custom concurrency options.

   JavaScript

2. gpt_index gpt_index Public

   Forked from run-llama/llama_index

   LlamaIndex (GPT Index) is a project that provides a central interface to connect your LLM's with external data.

   Python

3. text-generation-inference text-generation-inference Public

   Forked from huggingface/text-generation-inference

   Large Language Model Text Generation Inference

   Python

4. llm-engine llm-engine Public

   Forked from scaleapi/llm-engine

   Scale LLM Engine public repository

   Python

5. lightllm lightllm Public

   Forked from ModelTC/lightllm

   LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

   Python

6. llama-cuda-graph-example llama-cuda-graph-example Public

   Forked from fw-ai/llama-cuda-graph-example

   Example of applying CUDA graphs to LLaMA-v2

   Python