This repository is a Next.js project bootstrapped with create-next-app. It uses Vercel's AI SDK and Langchain to implement an LLM-powered chatbot with the llama3.1 model downloaded from Ollama.
I recommend using the Open WebUI project. It is an extensible, feature-rich, and user-friendly self-hosted WebUI designed to operate entirely offline. It supports various LLM runners, including Ollama and OpenAI-compatible APIs.
Install the packages:
npm installDownload Ollama and run the llama3.1 model:
ollama run llama3.1Run the development server:
npm run devOpen http://localhost:3000 with your browser to see the result.
You can edit the page by modifying app/page.tsx. The page auto-updates as you edit the file.
This project uses next/font to optimize and load Inter, a custom Google Font.
To learn more about Next.js, take a look at the following resources:
- Next.js Documentation - learn about Next.js features and API.
- Learn Next.js - an interactive Next.js tutorial.
You can check out the Next.js GitHub repository - your feedback and contributions are welcome!
The easiest way to deploy your Next.js app is to use the Vercel Platform from the Next.js creators.
Check out our Next.js deployment documentation for more details.