model_demos

Model Demos

Short demos for a broad range of NLP and CV models.

Setup Instructions

Install requirements

First, create either a Python virtual environment with PyBuda installed or execute from a Docker container with PyBuda installed.

Installation instructions can be found at Install TT-Buda.

Next, install the model requirements:

pip install -r requirements.txt

Quick Start

With an activate Python environment and all dependencies installed, run:

export PYTHONPATH=.
python cv_demos/resnet/pytorch_resnet.py

Models Support Table

Model	Supported Hardware GS - Grayskull WH - Wormhole	Supported Release
ALBERT	GS, WH	v0.10.5
Autoencoder (convolutional)	GS, WH	v0.10.5
Autoencoder (linear)	GS, WH	v0.10.5
BeiT	GS, WH	v0.10.5
BERT	GS, WH	v0.10.5
CLIP	GS, WH	v0.10.5
CodeGen	GS, WH	v0.10.5
DeiT	GS, WH	v0.10.5
DenseNet	GS, WH	v0.10.5
DistilBERT	GS, WH	v0.10.5
DPR	GS, WH	v0.10.5
EfficientNet-Lite	WH	v0.10.5
Falcon-7B	WH	v0.10.5
FLAN-T5	GS, WH	v0.10.5
Fuyu-8B
GhostNet	GS, WH	v0.10.5
GoogLeNet	GS, WH	v0.10.5
GPT-2	GS, WH	v0.10.5
GPT Neo	GS, WH	v0.10.5
Hand Landmark	WH	v0.10.5
HRNet	GS, WH	v0.10.5
Inception-v4	GS, WH	v0.10.5
MLP-Mixer	GS, WH	v0.10.5
MobileNetSSD	WH	v0.10.5
MobileNetV1	GS, WH	v0.10.5
MobileNetV2	GS, WH	v0.10.5
MobileNetV3	GS, WH	v0.10.5
OpenPose	GS, WH	v0.10.5
OPT	GS, WH	v0.10.5
Pose Landmark	WH	v0.10.5
Perceiver IO	GS, WH	v0.10.9-alpha
ResNet	GS, WH	v0.10.5
ResNeXt	GS, WH	v0.10.5
RetinaNet	GS, WH	v0.10.5
RoBERTa	GS, WH	v0.10.5
SqueezeBERT	GS, WH	v0.10.5
Stable Diffusion	WH	v0.10.5
T5	GS, WH	v0.10.5
U-Net	GS, WH	v0.10.5
VGG	GS, WH	v0.10.5
ViT	GS, WH	v0.10.5
ViLT	GS, WH	v0.10.5
VoVNet	GS, WH	v0.10.5
WideResNet	GS, WH	v0.10.5
Whisper	GS, WH	v0.10.5
Xception	GS, WH	v0.10.5
XGLM	GS, WH	v0.10.5
YOLOv3	GS, WH	v0.10.5
YOLOv5	GS, WH	v0.10.5

Note:

Please note that alpha relases are not stable releases and may not support or have all functionality as the stable releaes. If full functionality is needed we suggest picking a stable relases.