Pinned Loading

1. nm-vllm-certs nm-vllm-certs Public

   General Information, model certifications, and benchmarks for nm-vllm enterprise distributions

   4 1

2. deepsparse deepsparse Public

   Sparsity-aware deep learning inference runtime for CPUs

   Python 3k 172

3. sparseml sparseml Public

   Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models

   Python 2k 143

4. docs docs Public

   Top-level directory for documentation and general content

   MDX 120 7

5. sparsezoo sparsezoo Public

   Neural network model repository for highly sparse and sparse-quantized models with matching sparsification recipes

   Python 364 24

6. guidellm guidellm Public

   Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

   Python 130 7