Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
In an attempt to make this repo more modular while retaining the use of some shared resources, I created a
chatbot
directory that contains an improved version of what was originally the only application in this repo, the gradio chat bot.summarizer
with amodel_service
andai_applications
subdirectories where we store the code for serving the local llm applications as well as demo interaction apps.README.md
to reflect the fact that it now contains multiple (and growing) local LLM examples.llamacpp_utils.py
file to contain the shared functions across the different examples.