Skip to content

The production toolkit for LLMs. Observability, analytics and evaluation.

License

Notifications You must be signed in to change notification settings

last-rev-llc/lunary

 
 

Repository files navigation

📈 lunary

Open-source observability & prompt platform for AI developers

website - docs - self host

npm version PyPI - Version GitHub last commit (by committer) GitHub commit activity (branch)

Features

Lunary helps AI devs take their apps in production, with features such as:

  • 💵 Analytics (cost, token, latency, ..)
  • 🔍 Monitoring (logs, traces, user tracking, ..)
  • ⛩️ Prompt Templates (versioning, team collaboration, ..)
  • 🏷️ Creat fine-tuning datasets
  • 🖲️ Chat & feedback tracking
  • 🧪 Evaluations

It also designed to be:

  • 🤖 Usable with any model, not just OpenAI
  • 📦 Easy to integrate (2 minutes)
  • 🧑‍💻 Simple to self-host (deploy to Vercel & Supabase)

Demo

demo720.mp4

⚙️ Integration

Modules available for:

Lunary natively supports:

Additionally you can use it with any framework by wrapping the relevant methods.

📚 Documentation

Full documentation is available on the website.

☁️ Hosted version

We offer a hosted version with a free plan of up to 1k requests / days.

With the hosted version:

  • 👷 don't worry about devops or managing updates
  • 🙋 get priority 1:1 support with our team
  • 🇪🇺 your data is stored safely in Europe

🙋 Support

Need help or have questions? Chat with us on the website or email one of the founders: vince [at] lunary.ai. We're here to support you every step of the way.

👨‍👩‍👧 Team

Made by @vincelwt and Hugh.

License

This project is licensed under the Apache 2.0 License.

About

The production toolkit for LLMs. Observability, analytics and evaluation.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • TypeScript 89.4%
  • PLpgSQL 10.0%
  • Other 0.6%