feat(container): update image localai/localai to v2.20.1 #287
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
![renovate[bot]](https://avatars.githubusercontent.com/in/2740?s=60&v=4){kind=small}
renovate
bot
changed the title
renovate
bot
changed the title
renovate
bot
force-pushed
the
renovate/localai-localai-2.x
branch
from
ae30562
to
4b29c54
Compare
renovate
bot
changed the title
renovate
bot
changed the title
renovate
bot
force-pushed
the
renovate/localai-localai-2.x
branch
from
4b29c54
to
598c84d
Compare
renovate
bot
changed the title
renovate
bot
force-pushed
the
renovate/localai-localai-2.x
branch
3 times, most recently
from
3320f04
to
facb0b6
Compare
renovate
bot
changed the title
renovate
bot
force-pushed
the
renovate/localai-localai-2.x
branch
from
facb0b6
to
31e1c75
Compare
renovate
bot
changed the title
renovate
bot
force-pushed
the
renovate/localai-localai-2.x
branch
from
31e1c75
to
6cb8ef3
Compare
renovate
bot
changed the title
renovate
bot
force-pushed
the
renovate/localai-localai-2.x
branch
from
6cb8ef3
to
1cda5c7
Compare
renovate
bot
changed the title
renovate
bot
force-pushed
the
renovate/localai-localai-2.x
branch
from
1cda5c7
to
1162001
Compare
renovate
bot
changed the title
renovate
bot
force-pushed
the
renovate/localai-localai-2.x
branch
from
1162001
to
3bc7bf7
Compare
renovate
bot
changed the title
renovate
bot
force-pushed
the
renovate/localai-localai-2.x
branch
from
3bc7bf7
to
3016186
Compare
renovate
bot
changed the title
renovate
bot
force-pushed
the
renovate/localai-localai-2.x
branch
from
3016186
to
74662ed
Compare
renovate
bot
changed the title
renovate
bot
force-pushed
the
renovate/localai-localai-2.x
branch
from
74662ed
to
1195861
Compare
renovate
bot
changed the title
renovate
bot
force-pushed
the
renovate/localai-localai-2.x
branch
from
1195861
to
99b4ea2
Compare
renovate
bot
changed the title
renovate
bot
force-pushed
the
renovate/localai-localai-2.x
branch
from
99b4ea2
to
9033f91
Compare
renovate
bot
changed the title
renovate
bot
force-pushed
the
renovate/localai-localai-2.x
branch
from
9033f91
to
9a7c13d
Compare
renovate
bot
changed the title
renovate
bot
force-pushed
the
renovate/localai-localai-2.x
branch
from
9a7c13d
to
7879586
Compare
renovate
bot
changed the title
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR contains the following updates:
v2.13.0-cublas-cuda12-ffmpeg->v2.20.1-cublas-cuda12-ffmpegWarning
Some dependencies could not be looked up. Check the Dependency Dashboard for more information.
Release Notes
mudler/LocalAI (localai/localai)
v2.20.1Compare Source
It's that time again—I’m excited (and honestly, a bit proud) to announce the release of LocalAI v2.20! This one’s a biggie, with some of the most requested features and enhancements, all designed to make your self-hosted AI journey even smoother and more powerful.
TL;DR
gpt4all.cppandpetalsbackends deprecated🌍 Explorer and Global Community Pools
Now you can share your LocalAI instance with the global community or explore available instances by visiting explorer.localai.io. This decentralized network powers our demo instance, creating a truly collaborative AI experience.
How It Works
Using the Explorer, you can easily share or connect to clusters. For detailed instructions on creating new clusters or connecting to existing ones, check out our documentation.
👀 Demo Instance Now Available
Curious about what LocalAI can do? Dive right in with our live demo at demo.localai.io! Thanks to our generous sponsors, this instance is publicly available and configured via peer-to-peer (P2P) networks. If you'd like to connect, follow the instructions here.
🤗 Hugging Face Integration
I am excited to announce that LocalAI is now integrated within Hugging Face’s local apps! This means you can select LocalAI directly within Hugging Face to build and deploy models with the power and flexibility of our platform. Experience seamless integration with a single click!
This integration was made possible through this PR.
🎨 FLUX-1 Image Generation Support
FLUX-1 lands in LocalAI! With this update, LocalAI can now generate stunning images using FLUX-1, even in federated mode. Whether you're experimenting with new designs or creating production-quality visuals, FLUX-1 has you covered.
Try it out at demo.localai.io and see what LocalAI + FLUX-1 can do!
🐛 Diffusers and hipblas Fixes
Great news for AMD users! If you’ve encountered issues with the Diffusers backend or hipblas, those bugs have been resolved. We’ve transitioned to
uvfor managing Python dependencies, ensuring a smoother experience. For more details, check out Issue #1592.🏎️ Strict Mode for API Compliance
To stay up to date with OpenAI’s latest changes, now LocalAI have support as well for Strict Mode ( https://openai.com/index/introducing-structured-outputs-in-the-api/ ). This new feature ensures compatibility with the most recent API updates, enforcing stricter JSON outputs using BNF grammar rules.
To activate, simply set
strict: truein your API calls, even if it’s disabled in your configuration.Key Notes:
strict: trueenables grammar enforcement, even if disabled in your config.format_typeis set tojson_schema, BNF grammars will be automatically generated from the schema.🛑 Disable Gallery
Need to streamline your setup? You can now disable the gallery endpoint using
LOCALAI_DISABLE_GALLERY_ENDPOINT. For more options, check out the full list of commands with--help.🌞 P2P and Federation Enhancements
Several enhancements have been made to improve your experience with P2P and federated clusters:
LOCALAI_RANDOM_WORKERif needed).LOCALAI_TARGET_WORKER.💪 Run Multiple P2P Clusters in the Same Network
You can now run multiple clusters within the same network by specifying a network ID via CLI. This allows you to logically separate clusters while using the same shared token. Just set
LOCALAI_P2P_NETWORK_IDto a UUID that matches across instances.Please note, while this offers segmentation, it’s not fully secure—anyone with the network token can view available services within the network.
🧪 Deprecation Notice:
gpt4all.cppandpetalsBackendsAs we continue to evolve, we are officially deprecating the
gpt4all.cppandpetalsbackends. The newerllama.cppoffers a superior set of features and better performance, making it the preferred choice moving forward.From this release onward,
gpt4allmodels inggmlformat are no longer compatible. Additionally, thepetalsbackend has been deprecated as well. LocalAI’s new P2P capabilities now offer a comprehensive replacement for these features.What's Changed
Breaking Changes 🛠
Bug fixes 🐛
Exciting New Features 🎉
json_schemaformat type and strict mode by @mudler in https://github.com/mudler/LocalAI/pull/3193🧠 Models
📖 Documentation and examples
👒 Dependencies
7aec99bto8b14837by @dependabot in https://github.com/mudler/LocalAI/pull/31421e6f6554aa11fa10160a5fda689e736c3c34169fby @mudler in https://github.com/mudler/LocalAI/pull/318915fa07a5c564d3ed7e7eb64b73272cedb27e73ecby @localai-bot in https://github.com/mudler/LocalAI/pull/31976eac06759b87b50132a01be019e9250a3ffc8969by @localai-bot in https://github.com/mudler/LocalAI/pull/32033a14e00366399040a139c67dd5951177a8cb5695by @localai-bot in https://github.com/mudler/LocalAI/pull/3204b72942fac998672a79a1ae3c03b340f7e629980bby @localai-bot in https://github.com/mudler/LocalAI/pull/320881c999fe0a25c4ebbfef10ed8a1a96df9cfc10fdby @localai-bot in https://github.com/mudler/LocalAI/pull/32096e02327e8b7837358e0406bf90a4632e18e27846by @localai-bot in https://github.com/mudler/LocalAI/pull/32124134999e01f31256b15342b41c4de9e2477c4a6cby @localai-bot in https://github.com/mudler/LocalAI/pull/3218fc4ca27b25464a11b3b86c9dbb5b6ed6065965c2by @localai-bot in https://github.com/mudler/LocalAI/pull/324022fcd5fd110ba1ff592b4e23013d870831756259by @localai-bot in https://github.com/mudler/LocalAI/pull/323906943a69f678fb32829ff06d9c18367b17d4b361by @localai-bot in https://github.com/mudler/LocalAI/pull/32455fd89a70ead34d1a17015ddecad05aaa2490ca46by @localai-bot in https://github.com/mudler/LocalAI/pull/3248llama_add_bos_tokenby @mudler in https://github.com/mudler/LocalAI/pull/32538b3befc0e2ed8fb18b903735831496b8b0c80949by @localai-bot in https://github.com/mudler/LocalAI/pull/32572fb9267887d24a431892ce4dccc75c7095b0d54dby @localai-bot in https://github.com/mudler/LocalAI/pull/3260554b049068de24201d19dde2fa83e35389d4585dby @localai-bot in https://github.com/mudler/LocalAI/pull/32638b14837to82a5e98by @dependabot in https://github.com/mudler/LocalAI/pull/3274cfac111e2b3953cdb6b0126e67a2487687646971by @localai-bot in https://github.com/mudler/LocalAI/pull/3315d65786ea540a5aef21f67cacfa6f134097727780by @localai-bot in https://github.com/mudler/LocalAI/pull/33442f3c1466ff46a2413b0e363a5005c46538186ee6by @localai-bot in https://github.com/mudler/LocalAI/pull/3345fc54ef0d1c138133a01933296d50a36a1ab64735by @localai-bot in https://github.com/mudler/LocalAI/pull/33569e3c5345cd46ea718209db53464e426c3fe7a25eby @localai-bot in https://github.com/mudler/LocalAI/pull/3357Other Changes
New Contributors
Full Changelog: mudler/LocalAI@v2.19.4...v2.20.0
v2.20.0Compare Source
TL;DR
gpt4all.cppandpetalsbackends deprecated🌍 Explorer and Global Community Pools
Now you can share your LocalAI instance with the global community or explore available instances by visiting explorer.localai.io. This decentralized network powers our demo instance, creating a truly collaborative AI experience.
How It Works
Using the Explorer, you can easily share or connect to clusters. For detailed instructions on creating new clusters or connecting to existing ones, check out our documentation.
👀 Demo Instance Now Available
Curious about what LocalAI can do? Dive right in with our live demo at demo.localai.io! Thanks to our generous sponsors, this instance is publicly available and configured via peer-to-peer (P2P) networks. If you'd like to connect, follow the instructions here.
🤗 Hugging Face Integration
I am excited to announce that LocalAI is now integrated within Hugging Face’s local apps! This means you can select LocalAI directly within Hugging Face to build and deploy models with the power and flexibility of our platform. Experience seamless integration with a single click!
This integration was made possible through this PR.
🎨 FLUX-1 Image Generation Support
FLUX-1 lands in LocalAI! With this update, LocalAI can now generate stunning images using FLUX-1, even in federated mode. Whether you're experimenting with new designs or creating production-quality visuals, FLUX-1 has you covered.
Try it out at demo.localai.io and see what LocalAI + FLUX-1 can do!
🐛 Diffusers and hipblas Fixes
Great news for AMD users! If you’ve encountered issues with the Diffusers backend or hipblas, those bugs have been resolved. We’ve transitioned to
uvfor managing Python dependencies, ensuring a smoother experience. For more details, check out Issue #1592.🏎️ Strict Mode for API Compliance
To stay up to date with OpenAI’s latest changes, now LocalAI have support as well for Strict Mode ( https://openai.com/index/introducing-structured-outputs-in-the-api/ ). This new feature ensures compatibility with the most recent API updates, enforcing stricter JSON outputs using BNF grammar rules.
To activate, simply set
strict: truein your API calls, even if it’s disabled in your configuration.Key Notes:
strict: trueenables grammar enforcement, even if disabled in your config.format_typeis set tojson_schema, BNF grammars will be automatically generated from the schema.🛑 Disable Gallery
Need to streamline your setup? You can now disable the gallery endpoint using
LOCALAI_DISABLE_GALLERY_ENDPOINT. For more options, check out the full list of commands with--help.🌞 P2P and Federation Enhancements
Several enhancements have been made to improve your experience with P2P and federated clusters:
LOCALAI_RANDOM_WORKERif needed).LOCALAI_TARGET_WORKER.💪 Run Multiple P2P Clusters in the Same Network
You can now run multiple clusters within the same network by specifying a network ID via CLI. This allows you to logically separate clusters while using the same shared token. Just set
LOCALAI_P2P_NETWORK_IDto a UUID that matches across instances.Please note, while this offers segmentation, it’s not fully secure—anyone with the network token can view available services within the network.
🧪 Deprecation Notice:
gpt4all.cppandpetalsBackendsAs we continue to evolve, we are officially deprecating the
gpt4all.cppandpetalsbackends. The newerllama.cppoffers a superior set of features and better performance, making it the preferred choice moving forward.From this release onward,
gpt4allmodels inggmlformat are no longer compatible. Additionally, thepetalsbackend has been deprecated as well. LocalAI’s new P2P capabilities now offer a comprehensive replacement for these features.What's Changed
Breaking Changes 🛠
Bug fixes 🐛
Exciting New Features 🎉
json_schemaformat type and strict mode by @mudler in https://github.com/mudler/LocalAI/pull/3193🧠 Models
Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
🔕 Ignore: Close this PR and you won't be reminded about this update again.
This PR was generated by Mend Renovate. View the repository job log.