Popular repositories Loading

1. FastVideo FastVideo Public

   FastVideo is a unified framework for accelerated video generation.

   Python 1.6k 112

2. LookaheadDecoding LookaheadDecoding Public

   [ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding

   Python 1.3k 74

3. Consistency_LLM Consistency_LLM Public

   [ICML 2024] CLLMs: Consistency Large Language Models

   Python 396 16

4. Dynasor Dynasor Public

   Simple extension on vLLM to help you speed up reasoning model without training.

   Python 168 23

5. MuxServe MuxServe Public

   Jupyter Notebook 64 6

6. vllm-ltr vllm-ltr Public

   [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank

   Python 50 13