Skip to content

substratusai/helm

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

54 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Substratus AI Helm Charts

A collection of exquisitely crafted helm charts for LLMs:

  • vLLM
  • Text Generation Inference
  • Lingo

Enable Substratus Helm repo

helm repo add substratusai https://substratusai.github.io/helm
helm repo update

Usage guides

vLLM

Basic usage:

# Note by default the resource limit is set to 1 GPU
helm install mistral-7b-instruct substratusai/vllm \
  --set model=mistralai/Mistral-7B-Instruct-v0.1

For Advanced usage see: vLLM Chart Guide