GitHub - beam-cloud/examples: Examples for beam.cloud

In this example we are fine tuning gemma 2B using LORA. We will do this via huggingface's PEFT library. https://huggingface.co/google/gemma-2b https://huggingface.co/docs/peft/index The dataset being used is open assistant. https://huggingface.co/datasets/OpenAssistant/oasst1 This is a dataset of high quality user-assistant conversations.

Name		Name	Last commit message	Last commit date
Latest commit History 44 Commits
.github/workflows		.github/workflows
audio_and_transcription		audio_and_transcription
bioinformatics		bioinformatics
callbacks		callbacks
custom_images		custom_images
endpoints		endpoints
experimental/signals		experimental/signals
finetuning		finetuning
functions		functions
gpu_acceleration		gpu_acceleration
huggingface_inference		huggingface_inference
image_generation		image_generation
jupyter_notebooks		jupyter_notebooks
keep_warm		keep_warm
language_models		language_models
outputs		outputs
preload_models		preload_models
quickstart		quickstart
scaling_out		scaling_out
secrets		secrets
sharing_state		sharing_state
task_queues		task_queues
tests		tests
vllm		vllm
volumes		volumes
.beamignore		.beamignore
.beta9ignore		.beta9ignore
.gitignore		.gitignore
README.md		README.md
poetry.lock		poetry.lock
pyproject.toml		pyproject.toml
pytest.ini		pytest.ini

Provide feedback