Pinned Loading

1. mit-han-lab/qserve mit-han-lab/qserve Public

   QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving

   Python 401 19

2. mit-han-lab/llm-awq mit-han-lab/llm-awq Public

   [MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

   Python 2.3k 177

3. mit-han-lab/torchsparse mit-han-lab/torchsparse Public

   [MICRO'23, MLSys'22] TorchSparse: Efficient Training and Inference Framework for Sparse Convolution on GPUs.

   Cuda 1.2k 137

4. mit-han-lab/lmquant mit-han-lab/lmquant Public

   Python 102 6

5. ys-2020.github.io ys-2020.github.io Public

   CSS