feat(container): update image localai/localai to v2.26.0

[renovate]

This PR contains the following updates:

Package	Update	Change
localai/localai	minor	v2.13.0-cublas-cuda12-ffmpeg -> v2.26.0-cublas-cuda12-ffmpeg

---

Warning

Some dependencies could not be looked up. Check the Dependency Dashboard for more information.

---

Release Notes

mudler/LocalAI (localai/localai)

v2.26.0

Compare Source

🦙 LocalAI v2.26.0!

Hey everyone - very excited about this release!

It contains several cleanups, performance improvements and few breaking changes: old backends that are now superseded have been removed (for example, vall-e-x), while new backends have been added to expand the range of model architectures that LocalAI can support. While most of the changes are tested, if you encounter issues with the new backends or migrated ones please file a new issue.

We also now have support for Nvidia L4T devices (for example, Nvidia AGX Orin) with specific container images. See the documentation for more details.

⚠️ Breaking Changes ⚠️

• Several backends have been dropped and replaced for improved performance and compatibility.
• Vall-e-x and Openvoice were deprecated and dropped.
• The stablediffusion-NCN backend was replaced with the stablediffusion-ggml implementation.
• Deprecated llama-ggml backend has been dropped in favor of GGUF support.

Check all details!

Backends that were dropped:

• Vall-e-x and Openvoice: These projects went silent, and there are better alternatives now. They have been completely superseded by the CoquiTTS community fork, Kokoro, and OutelTTS.
• Stablediffusion-NCN: This was the first variant shipped with LocalAI based on the ONNX runtime. It has now been superseded by the stablediffusion-ggml backend, which offers similar capabilities and wider support across more architectures.
• Llama-ggml backend: This was the pre-GGUF backend, which is now deprecated. Moving forward, LocalAI will support only GGUF models.

Notable Backend Changes:

• Mamba has moved to the transformers backend.
• Transformers-Musicgen has moved to the transformers backend.
• Sentencetransformers has moved to the transformers backend.

While LocalAI will try to alias to the transformers backend automatically when using these backends, there might be incompatibilies with your configuration files. Please open an issue if you face any problem!

New Backends:

• Kokoro (TTS): A new backend for text-to-speech.
• OuteTTS: A TTS backend with voice cloning capabilities.
• Fast-Whisper: A backend designed for faster whisper model inference.

New Features 🎉

• Lazy grammars (llama.cpp): Added grammar triggers for llama.cpp: this allow models trained with specific tokens to enable grammar generation when such tokens are seen: this allows precise JSON generation but also consistent output when the model does not need to answer with a tool. For example, in the config file of the model triggers can be specified as such:

  function:
    grammar:
      triggers:
        word: "<tool_call>"
        at_start: true

• Function Argument Parsing Using Named Regex: A new feature that allows parsing function arguments with named regular expressions, simplifying function calls.
• Support for New Backends: Added Kokoro, OutelTTS, and Fast-Whisper backends.
• Diffusers Update: Added support for Sana pipelines and image generation option overrides.
• Machine Tag and Inference Timing: Allows tracking machine performance during inference.
• Tokenization: Introduced tokenization support for llama.cpp to improve text processing.
• AVX512: There is now bundled support for CPUs supporting AVX512 instruction set
• Nvidia L4T: Support for Nvidia devices on arm64, for example Nvidia AGX Orin and alikes. See the documentation. TLDR; You can start container images ready to go with:

docker run -e DEBUG=true \
                    -p 8080:8080 \
                    -v $PWD/models:/build/models  \
                   -ti --restart=always --name local-ai \
                   --runtime nvidia --gpus all quay.io/go-skynet/local-ai:master-nvidia-l4t-arm64-core

Bug Fixes 🐛

• Multiple fixes to improve stability, including enabling SYCL support for stablediffusion-ggml and consistent OpenAI stop reason returns.
• Improved context shift handling for llama.cpp and fixed gallery store overrides.

🧠 Models:

I've fine-tuned a family of models based on o1-cot and function call datasets to work closely with all LocalAI features regarding function calling. The models are tailored to be conversational and execute function calls:

• llama3.2-1b version: https://huggingface.co/mudler/LocalAI-functioncall-llama3.2-1b-v0.4
• llama3.2-3b version: https://huggingface.co/mudler/LocalAI-functioncall-llama3.2-3b-v0.5
• phi-4 version: https://huggingface.co/mudler/LocalAI-functioncall-phi-4-v0.3
• qwen2.5 (7b) version: https://huggingface.co/mudler/LocalAI-functioncall-qwen2.5-7b-v0.5

Enjoy! All the models are available in the LocalAI gallery:

local-ai run LocalAI-functioncall-phi-4-v0.3
local-ai run LocalAI-functioncall-llama3.2-1b-v0.4
local-ai run LocalAI-functioncall-llama3.2-3b-v0.5
local-ai run localai-functioncall-qwen2.5-7b-v0.5

Other models

Numerous model updates and additions:

• New models like nightwing3-10b, rombos-qwen2.5-writer, and negative_llama_70b.
• Updated checksum for model galleries.
• Added icons and improved prompt templates for various models.
• Expanded model gallery with new additions like DeepSeek-R1, Mistral-small-24b, and more.

Full changelog 👇

👉 Click to expand 👈

Breaking Changes 🛠

• chore(vall-e-x): Drop backend by @​mudlhttps://github.com/mudler/LocalAI/pull/4619l/4619
• feat(transformers): merge musicgen functionalities to a single backend by @​mudlhttps://github.com/mudler/LocalAI/pull/4620l/4620
• feat(transformers): merge sentencetransformers backend by @​mudlhttps://github.com/mudler/LocalAI/pull/4624l/4624
• chore(stablediffusion-ncn): drop in favor of ggml implementation by @​mudlhttps://github.com/mudler/LocalAI/pull/4652l/4652
• feat(transformers): add support to Mamba by @​mudlhttps://github.com/mudler/LocalAI/pull/4669l/4669
• chore(openvoice): drop backend by @​mudlhttps://github.com/mudler/LocalAI/pull/4673l/4673
• chore: drop embedded models by @​mudlhttps://github.com/mudler/LocalAI/pull/4715l/4715
• chore(llama-ggml): drop deprecated backend by @​mudlhttps://github.com/mudler/LocalAI/pull/4775l/4775
• fix(llama.cpp): disable mirostat as default by @​mudlhttps://github.com/mudler/LocalAI/pull/2911l/2911

Bug fixes 🐛

• fix(stablediffusion-ggml): correctly enable sycl by @​mudlhttps://github.com/mudler/LocalAI/pull/4591l/4591
• fix(stablediffusion-ggml): enable oneapi before build by @​mudlhttps://github.com/mudler/LocalAI/pull/4593l/4593
• fix(docs): add missing -core suffix to sycl images by @​M0Rfhttps://github.com/mudler/LocalAI/pull/4630l/4630
• fix(stores): Stores fixes and testing by @​richiehttps://github.com/mudler/LocalAI/pull/4663l/4663
• fix(gallery): do not return overrides and additional config by @​mudlhttps://github.com/mudler/LocalAI/pull/4768l/4768
• fix(openai): consistently return stop reason by @​mudlhttps://github.com/mudler/LocalAI/pull/4771l/4771
• fix(llama.cpp): improve context shift handling by @​mudlhttps://github.com/mudler/LocalAI/pull/4820l/4820

Exciting New Features 🎉

• feat(stablediffusion-ggml): respect build type by @​mudlhttps://github.com/mudler/LocalAI/pull/4581l/4581
• feat(diffusers): add support for Sana pipelines by @​mudlhttps://github.com/mudler/LocalAI/pull/4603l/4603
• feat(tts): Add Kokoro backend by @​mudlhttps://github.com/mudler/LocalAI/pull/4616l/4616
• feat: add machine tag and inference timings by @​mintylehttps://github.com/mudler/LocalAI/pull/4577l/4577
• feat(transformers): add support to OuteTTS by @​mudlhttps://github.com/mudler/LocalAI/pull/4622l/4622
• Extra-Usage and Machine-Tag docs by @​mintylehttps://github.com/mudler/LocalAI/pull/4627l/4627
• chore: fix some function names in comment by @​petercovhttps://github.com/mudler/LocalAI/pull/4665l/4665
• feat(faster-whisper): add backend by @​mudlhttps://github.com/mudler/LocalAI/pull/4666l/4666
• chore: detect and enable avx512 builds by @​mudlhttps://github.com/mudler/LocalAI/pull/4675l/4675
• chore(downloader): support hf.co and hf:// URIs by @​mudlhttps://github.com/mudler/LocalAI/pull/4677l/4677
• feat: function argument parsing using named regex by @​mKenfenheuhttps://github.com/mudler/LocalAI/pull/4700l/4700
• feat(llama.cpp): Add support to grammar triggers by @​mudlhttps://github.com/mudler/LocalAI/pull/4733l/4733
• feat: tokenization with llama.cpp by @​shraddhazhttps://github.com/mudler/LocalAI/pull/4724l/4724
• feat(diffusers): allow to override image gen options by @​mudlhttps://github.com/mudler/LocalAI/pull/4807l/4807

🧠 Models

• chore(model-gallery): ⬆️ update checksum by @​localai-bhttps://github.com/mudler/LocalAI/pull/4580l/4580
• chore(model gallery): add nightwing3-10b-v0.1 by @​mudlhttps://github.com/mudler/LocalAI/pull/4582l/4582
• chore(model gallery): add qwq-32b-preview-ideawhiz-v1 by @​mudlhttps://github.com/mudler/LocalAI/pull/4583l/4583
• chore(model gallery): add rombos-qwen2.5-writer-32b by @​mudlhttps://github.com/mudler/LocalAI/pull/4584l/4584
• chore(model gallery): add sky-t1-32b-preview by @​mudlhttps://github.com/mudler/LocalAI/pull/4585l/4585
• chore(model gallery): add negative_llama_70b by @​mudlhttps://github.com/mudler/LocalAI/pull/4586l/4586
• chore(model gallery): add finemath-llama-3b by @​mudlhttps://github.com/mudler/LocalAI/pull/4587l/4587
• chore(model gallery): add LocalAI-functioncall-phi-4-v0.1 by @​mudlhttps://github.com/mudler/LocalAI/pull/4588l/4588
• chore(model gallery): add LocalAI-functioncall-phi-4-v0.2 by @​mudlhttps://github.com/mudler/LocalAI/pull/4589l/4589
• chore(model gallery): add LocalAI-functioncall-phi-4-v0.3 by @​mudlhttps://github.com/mudler/LocalAI/pull/4599l/4599
• chore(model gallery): add negative-anubis-70b-v1 by @​mudlhttps://github.com/mudler/LocalAI/pull/4600l/4600
• chore(model gallery): add qwen2.5-72b-rp-ink by @​mudlhttps://github.com/mudler/LocalAI/pull/4601l/4601
• chore(model gallery): add steiner-32b-preview by @​mudlhttps://github.com/mudler/LocalAI/pull/4602l/4602
• chore(model gallery): add qwerus-7b by @​mudlhttps://github.com/mudler/LocalAI/pull/4609l/4609
• chore(model gallery): add l3.3-ms-nevoria-70b by @​mudlhttps://github.com/mudler/LocalAI/pull/4610l/4610
• chore(model gallery): add lb-reranker-0.5b-v1.0 by @​mudlhttps://github.com/mudler/LocalAI/pull/4611l/4611
• chore(model gallery): add uwu-7b-instruct by @​mudlhttps://github.com/mudler/LocalAI/pull/4613l/4613
• chore(model gallery): add drt-o1-14b by @​mudlhttps://github.com/mudler/LocalAI/pull/4614l/4614
• chore(model gallery): add vikhr-qwen-2.5-1.5b-instruct by @​mudlhttps://github.com/mudler/LocalAI/pull/4615l/4615
• chore: remove deprecated tinydream backend by @​M0Rfhttps://github.com/mudler/LocalAI/pull/4631l/4631
• chore(model gallery): add MiniCPM-V-2.6-8b-q4_K_M by @​M0Rfhttps://github.com/mudler/LocalAI/pull/4633l/4633
• chore(model gallery): add InternLM3-8b-Q4_K_M by @​M0Rfhttps://github.com/mudler/LocalAI/pull/4637l/4637
• fix(model gallery): minicpm-v-2.6 is based on qwen2 by @​M0Rfhttps://github.com/mudler/LocalAI/pull/4638l/4638
• chore(model gallery): update icons and add missing ones by @​M0Rfhttps://github.com/mudler/LocalAI/pull/4639l/4639
• chore(model gallery): add wayfarer-12b by @​mudlhttps://github.com/mudler/LocalAI/pull/4641l/4641
• chore(model gallery): add l3.3-70b-magnum-v4-se by @​mudlhttps://github.com/mudler/LocalAI/pull/4642l/4642
• chore(model gallery): add l3.3-prikol-70b-v0.2 by @​mudlhttps://github.com/mudler/LocalAI/pull/4643l/4643
• chore(model gallery): remove dead icons and update LLAVA and DeepSeek ones by @​M0Rfhttps://github.com/mudler/LocalAI/pull/4645l/4645
• chore(model gallery): add sd-3.5-large-ggml by @​mudlhttps://github.com/mudler/LocalAI/pull/4647l/4647
• chore(model gallery): add Deepseek-R1-Distill models by @​M0Rfhttps://github.com/mudler/LocalAI/pull/4646l/4646
• chore(model gallery): add deepseek-r1-distill-qwen-7b by @​mudlhttps://github.com/mudler/LocalAI/pull/4660l/4660
• chore(model gallery): add sd-1.5-ggml and sd-3.5-medium-ggml by @​mudlhttps://github.com/mudler/LocalAI/pull/4664l/4664
• chore(model gallery): add MiniCPM-o-2.6-7.6b by @​M0Rfhttps://github.com/mudler/LocalAI/pull/4676l/4676
• chore(model gallery): add DeepSeek R1 14b, 32b and 70b by @​M0Rfhttps://github.com/mudler/LocalAI/pull/4679l/4679
• chore(model gallery): add flux.1, stablediffusion and whisper icons by @​M0Rfhttps://github.com/mudler/LocalAI/pull/4680l/4680
• chore(model gallery): update deepseek-r1 prompt template by @​M0Rfhttps://github.com/mudler/LocalAI/pull/4686l/4686
• chore(model gallery): add lamarck-14b-v0.7 by @​mudlhttps://github.com/mudler/LocalAI/pull/4687l/4687
• chore(model gallery): add art-v0-3b by @​mudlhttps://github.com/mudler/LocalAI/pull/4688l/4688
• chore(model gallery): add chuluun-qwen2.5-72b-v0.08 by @​mudlhttps://github.com/mudler/LocalAI/pull/4689l/4689
• chore(model gallery): add l3.3-nevoria-r1-70b by @​mudlhttps://github.com/mudler/LocalAI/pull/4691l/4691
• chore(model gallery): add dumpling-qwen2.5-32b by @​mudlhttps://github.com/mudler/LocalAI/pull/4692l/4692
• chore(model gallery): add deepseek-r1-qwen-2.5-32b-ablated by @​mudlhttps://github.com/mudler/LocalAI/pull/4693l/4693
• chore(model gallery): add confucius-o1-14b by @​mudlhttps://github.com/mudler/LocalAI/pull/4696l/4696
• chore(model gallery): add fuseo1-deepseekr1-qwen2.5-coder-32b-preview-v0.1 by @​mudlhttps://github.com/mudler/LocalAI/pull/4697l/4697
• chore(model gallery): add fuseo1-deepseekr1-qwen2.5-instruct-32b-preview by @​mudlhttps://github.com/mudler/LocalAI/pull/4698l/4698
• chore(model gallery): add fuseo1-deepseekr1-qwq-32b-preview by @​mudlhttps://github.com/mudler/LocalAI/pull/4699l/4699
• chore(model gallery): add specific message templates for llama3.2 based models by @​mKenfenheuhttps://github.com/mudler/LocalAI/pull/4707l/4707
• chore(model gallery): add virtuoso-lite by @​mudlhttps://github.com/mudler/LocalAI/pull/4718l/4718
• chore(model gallery): add selene-1-mini-llama-3.1-8b by @​mudlhttps://github.com/mudler/LocalAI/pull/4719l/4719
• chore(model gallery): add openthinker-7b by @​mudlhttps://github.com/mudler/LocalAI/pull/4720l/4720
• chore(model-gallery): ⬆️ update checksum by @​localai-bhttps://github.com/mudler/LocalAI/pull/4723l/4723
• chore(model gallery): add mistral-small-24b-instruct-2501 by @​mudlhttps://github.com/mudler/LocalAI/pull/4725l/4725
• chore(model gallery): add tinyswallow-1.5b-instruct by @​mudlhttps://github.com/mudler/LocalAI/pull/4726l/4726
• chore(model gallery): add taid-llm-1.5b by @​mudlhttps://github.com/mudler/LocalAI/pull/4727l/4727
• chore(model gallery): add fuseo1-deekseekr1-qwq-skyt1-32b-preview by @​mudlhttps://github.com/mudler/LocalAI/pull/4731l/4731
• chore(model gallery): add steelskull_l3.3-damascus-r1 by @​mudlhttps://github.com/mudler/LocalAI/pull/4737l/4737
• chore(model gallery): add thedrummer_gemmasutra-pro-27b-v1.1 by @​mudlhttps://github.com/mudler/LocalAI/pull/4738l/4738
• chore(model gallery): add uncensoredai_uncensoredlm-deepseek-r1-distill-qwen-14b by @​mudlhttps://github.com/mudler/LocalAI/pull/4739l/4739
• chore(model gallery): add LocalAI-functioncall-llama3.2-1b-v0.4 by @​mudlhttps://github.com/mudler/LocalAI/pull/4740l/4740
• chore(model gallery): add fblgit_miniclaus-qw1.5b-unamgs-grpo by @​mudlhttps://github.com/mudler/LocalAI/pull/4758l/4758
• chore(model gallery): add nohobby_l3.3-prikol-70b-v0.4 by @​mudlhttps://github.com/mudler/LocalAI/pull/4759l/4759
• chore(model gallery): add suayptalha_maestro-10b by @​mudlhttps://github.com/mudler/LocalAI/pull/4760l/4760
• chore(model gallery): add agi-0_art-skynet-3b by @​mudlhttps://github.com/mudler/LocalAI/pull/4763l/4763
• chore(model gallery): add rubenroy_gilgamesh-72b by @​mudlhttps://github.com/mudler/LocalAI/pull/4764l/4764
• chore(model gallery): add krutrim-ai-labs_krutrim-2-instruct by @​mudlhttps://github.com/mudler/LocalAI/pull/4765l/4765
• chore(model gallery): add LocalAI-functioncall-llama3.2-3b-v0.5 by @​mudlhttps://github.com/mudler/LocalAI/pull/4766l/4766
• chore(model gallery): add arliai_llama-3.3-70b-arliai-rpmax-v1.4 by @​mudlhttps://github.com/mudler/LocalAI/pull/4772l/4772
• chore(model gallery): add tiger-lab_qwen2.5-32b-instruct-cft by @​mudlhttps://github.com/mudler/LocalAI/pull/4773l/4773
• chore(model gallery): add black-ink-guild_pernicious_prophecy_70b by @​mudlhttps://github.com/mudler/LocalAI/pull/4774l/4774
• chore(model gallery): add nohobby_l3.3-prikol-70b-v0.5 by @​mudlhttps://github.com/mudler/LocalAI/pull/4777l/4777
• chore(model gallery): add cognitivecomputations_dolphin3.0-r1-mistral-24b by @​mudlhttps://github.com/mudler/LocalAI/pull/4778l/4778
• chore(model gallery): add cognitivecomputations_dolphin3.0-mistral-24b by @​mudlhttps://github.com/mudler/LocalAI/pull/4779l/4779
• chore(model gallery): add sicariussicariistuff_redemption_wind_24b by @​mudlhttps://github.com/mudler/LocalAI/pull/4781l/4781
• chore(model gallery): add huihui-ai_deepseek-r1-distill-llama-70b-abliterated by @​mudlhttps://github.com/mudler/LocalAI/pull/4790l/4790
• chore(model gallery): add subtleone_qwen2.5-32b-erudite-writer by @​mudlhttps://github.com/mudler/LocalAI/pull/4792l/4792
• chore(model gallery): add ilsp_llama-krikri-8b-instruct by @​mudlhttps://github.com/mudler/LocalAI/pull/4795l/4795
• feat: Centralized Request Processing middleware by @​dave-gray1https://github.com/mudler/LocalAI/pull/3847l/3847
• chore(model gallery): add localai-functioncall-qwen2.5-7b-v0.5 by @​mudlhttps://github.com/mudler/LocalAI/pull/4796l/4796
• chore(model gallery): add agentica-org_deepscaler-1.5b-preview by @​mudlhttps://github.com/mudler/LocalAI/pull/4804l/4804
• chore(model gallery): add simplescaling_s1.1-32b by @​mudlhttps://github.com/mudler/LocalAI/pull/4812l/4812
• chore(model gallery): add theskullery_l3.3-exp-unnamed-model-70b-v0.5 by @​mudlhttps://github.com/mudler/LocalAI/pull/4813l/4813
• chore(model gallery): add nvidia_aceinstruct-1.5b by @​mudlhttps://github.com/mudler/LocalAI/pull/4819l/4819
• chore(model gallery): add nvidia_aceinstruct-7b by @​mudlhttps://github.com/mudler/LocalAI/pull/4821l/4821
• chore(model gallery): add nvidia_aceinstruct-72b by @​mudlhttps://github.com/mudler/LocalAI/pull/4822l/4822
• chore(model gallery): add sicariussicariistuff_phi-lthy4 by @​mudlhttps://github.com/mudler/LocalAI/pull/4826l/4826
• chore(model gallery): add open-thoughts_openthinker-32b by @​mudlhttps://github.com/mudler/LocalAI/pull/4827l/4827
• chore(model gallery): add nousresearch_deephermes-3-llama-3-8b-preview by @​mudlhttps://github.com/mudler/LocalAI/pull/4828l/4828
• chore(model gallery): add rombo-org_rombo-llm-v3.0-qwen-32b by @​mudlhttps://github.com/mudler/LocalAI/pull/4830l/4830
• chore(model gallery): add pygmalionai_eleusis-12b by @​mudlhttps://github.com/mudler/LocalAI/pull/4832l/4832
• chore(model gallery): add davidbrowne17_llamathink-8b-instruct by @​mudlhttps://github.com/mudler/LocalAI/pull/4833l/4833

📖 Documentation and examples

• docs: update advanced-usage.md to reflect changes in #​4700 by @​mKenhttps://github.com/mudler/LocalAI/pull/4709AI/pull/4709

👒 Dependencies

• chore: ⬆️ Update ggerganov/llama.cpp to c05e8c9934f94fde49bc1bc9dc51eed282605150 by @​localai-bhttps://github.com/mudler/LocalAI/pull/4579l/4579
• chore(deps): bump llama.cpp to '924518e2e5726e81f3aeb2518fb85963a500e… by @​mudlhttps://github.com/mudler/LocalAI/pull/4592l/4592
• chore(deps): Bump securego/gosec from 2.21.4 to 2.22.0 by @​dependabhttps://github.com/mudler/LocalAI/pull/4594l/4594
• chore: ⬆️ Update ggerganov/llama.cpp to 504af20ee4eae72080a56d59d744f6774f7901ce by @​localai-bhttps://github.com/mudler/LocalAI/pull/4597l/4597
• chore: ⬆️ Update ggerganov/llama.cpp to b4d92a59a20eea400d8dd30844a339b76210daa0 by @​localai-bhttps://github.com/mudler/LocalAI/pull/4606l/4606
• chore: ⬆️ Update ggerganov/llama.cpp to adc5dd92e8aea98f5e7ac84f6e1bc15de35130b5 by @​localai-bhttps://github.com/mudler/LocalAI/pull/4612l/4612
• chore: ⬆️ Update ggerganov/llama.cpp to 4dbc8b9cb71876e005724f4e8f73a3544646bcf5 by @​localai-bhttps://github.com/mudler/LocalAI/pull/4618l/4618
• chore(deps): Bump scipy from 1.14.0 to 1.15.1 in /backend/python/transformers by @​dependabhttps://github.com/mudler/LocalAI/pull/4621l/4621
• chore(llama.cpp): update dependency by @​mudlhttps://github.com/mudler/LocalAI/pull/4628l/4628
• chore: ⬆️ Update leejet/stable-diffusion.cpp to 5eb15ef4d022bef4a391de4f5f6556e81fbb5024 by @​localai-bhttps://github.com/mudler/LocalAI/pull/4636l/4636
• chore: ⬆️ Update ggerganov/llama.cpp to a1649cc13f89946322358f92ea268ae1b7b5096c by @​localai-bhttps://github.com/mudler/LocalAI/pull/4635l/4635
• chore: ⬆️ Update ggerganov/llama.cpp to 92bc493917d43b83e592349e138b54c90b1c3ea7 by @​localai-bhttps://github.com/mudler/LocalAI/pull/4640l/4640
• chore(deps): Bump docs/themes/hugo-theme-relearn from 80e448e to 8dad5ee by @​dependabhttps://github.com/mudler/LocalAI/pull/4656l/4656
• chore: ⬆️ Update ggerganov/llama.cpp to aea8ddd5165d525a449e2fc3839db77a71f4a318 by @​localai-bhttps://github.com/mudler/LocalAI/pull/4657l/4657
• chore: ⬆️ Update ggerganov/llama.cpp to 6171c9d25820ccf676b243c172868819d882848f by @​localai-bhttps://github.com/mudler/LocalAI/pull/4661l/4661
• chore: ⬆️ Update ggerganov/llama.cpp to 6152129d05870cb38162c422c6ba80434e021e9f by @​localai-bhttps://github.com/mudler/LocalAI/pull/4668l/4668
• chore(parler-tts): drop backend by @​mudlhttps://github.com/mudler/LocalAI/pull/4672l/4672
• chore: ⬆️ Update ggerganov/llama.cpp to c5d9effb49649db80a52caf5c0626de6f342f526 by @​localai-bhttps://github.com/mudler/LocalAI/pull/4685l/4685
• chore: ⬆️ Update ggerganov/llama.cpp to 26771a1491f3a4c3d5b99c4c267b81aca9a7dfa0 by @​localai-bhttps://github.com/mudler/LocalAI/pull/4690l/4690
• chore: ⬆️ Update ggerganov/llama.cpp to 178a7eb952d211b8d4232d5e50ae1b64519172a9 by @​localai-bhttps://github.com/mudler/LocalAI/pull/4694l/4694
• chore(deps): Bump sentence-transformers from 3.3.1 to 3.4.0 in /backend/python/transformers by @​dependabhttps://github.com/mudler/LocalAI/pull/4702l/4702
• chore(deps): Bump docs/themes/hugo-theme-relearn from 8dad5ee to 5bcb9fe by @​dependabhttps://github.com/mudler/LocalAI/pull/4704l/4704
• chore: ⬆️ Update ggerganov/llama.cpp to a4417ddda98fd0558fb4d802253e68a933704b59 by @​localai-bhttps://github.com/mudler/LocalAI/pull/4705l/4705
• chore(deps): Bump dependabot/fetch-metadata from 2.2.0 to 2.3.0 by @​dependabhttps://github.com/mudler/LocalAI/pull/4701l/4701
• chore: ⬆️ Update ggerganov/llama.cpp to cae9fb4361138b937464524eed907328731b81f6 by @​localai-bhttps://github.com/mudler/LocalAI/pull/4711l/4711
• chore: ⬆️ Update ggerganov/llama.cpp to eb7cf15a808d4d7a71eef89cc6a9b96fe82989dc by @​localai-bhttps://github.com/mudler/LocalAI/pull/4717l/4717
• chore: ⬆️ Update ggerganov/llama.cpp to 8b576b6c55bc4e6be898b47522f0ef402b93ef62 by @​localai-bhttps://github.com/mudler/LocalAI/pull/4722l/4722
• chore: ⬆️ Update ggerganov/llama.cpp to aa6fb1321333fae8853d0cdc26bcb5d438e650a1 by @​localai-bhttps://github.com/mudler/LocalAI/pull/4728l/4728
• chore: ⬆️ Update ggerganov/llama.cpp to 53debe6f3c9cca87e9520a83ee8c14d88977afa4 by @​localai-bhttps://github.com/mudler/LocalAI/pull/4732l/4732
• chore: ⬆️ Update ggerganov/llama.cpp to 90f9b88afb6447d3929843a2aa98c0f11074762d by @​localai-bhttps://github.com/mudler/LocalAI/pull/4736l/4736
• chore(deps): Bump GrantBirki/git-diff-action from 2.7.0 to 2.8.0 by @​dependabhttps://github.com/mudler/LocalAI/pull/4746l/4746
• chore: ⬆️ Update ggerganov/llama.cpp to 5598f475be3e31430fbe17ebb85654ec90dc201e by @​localai-bhttps://github.com/mudler/LocalAI/pull/4757l/4757
• chore(deps): Bump sentence-transformers from 3.4.0 to 3.4.1 in /backend/python/transformers by @​dependabhttps://github.com/mudler/LocalAI/pull/4748l/4748
• chore(deps): Bump docs/themes/hugo-theme-relearn from 5bcb9fe to 66bc366 by @​dependabhttps://github.com/mudler/LocalAI/pull/4750l/4750
• chore: ⬆️ Update ggerganov/llama.cpp to 3ec9fd4b77b6aca03a3c2bf678eae3f9517d6904 by @​localai-bhttps://github.com/mudler/LocalAI/pull/4762l/4762
• chore: ⬆️ Update leejet/stable-diffusion.cpp to d46ed5e184b97c2018dc2e8105925bdb8775e02c by @​localai-bhttps://github.com/mudler/LocalAI/pull/4769l/4769
• chore: ⬆️ Update ggerganov/llama.cpp to d774ab3acc4fee41fbed6dbfc192b57d5f79f34b by @​localai-bhttps://github.com/mudler/LocalAI/pull/4770l/4770
• chore: ⬆️ Update ggerganov/llama.cpp to 8a59053f63fffc24e730cd3ea067760abfe4a919 by @​localai-bhttps://github.com/mudler/LocalAI/pull/4776l/4776
• chore: ⬆️ Update ggerganov/llama.cpp to d2fe216fb2fb7ca8627618c9ea3a2e7886325780 by @​localai-bhttps://github.com/mudler/LocalAI/pull/4780l/4780
• chore: ⬆️ Update ggerganov/llama.cpp to e6e658319952f7ad269dc11275b9edddc721fc6d by @​localai-bhttps://github.com/mudler/LocalAI/pull/4787l/4787
• chore: ⬆️ Update ggerganov/llama.cpp to 19d3c8293b1f61acbe2dab1d49a17950fd788a4a by @​localai-bhttps://github.com/mudler/LocalAI/pull/4793l/4793
• chore(deps): Bump docs/themes/lotusdocs from f5785a2 to 975da91 by @​dependabhttps://github.com/mudler/LocalAI/pull/4801l/4801
• chore: ⬆️ Update ggerganov/llama.cpp to 19b392d58dc08c366d0b29bd3b9c6991fa4e1662 by @​localai-bhttps://github.com/mudler/LocalAI/pull/4803l/4803
• chore: ⬆️ Update ggerganov/llama.cpp to 90e4dba461b07e635fd1daf3b491c978c7dd0013 by @​localai-bhttps://github.com/mudler/LocalAI/pull/4810l/4810
• chore: ⬆️ Update ggerganov/llama.cpp to 0fb77f821f6e70ad8b8247a97d1022f0fef78991 by @​localai-bhttps://github.com/mudler/LocalAI/pull/4814l/4814
• chore: ⬆️ Update ggerganov/llama.cpp to 8a8c4ceb6050bd9392609114ca56ae6d26f5b8f5 by @​localai-bhttps://github.com/mudler/LocalAI/pull/4825l/4825
• chore: ⬆️ Update ggerganov/llama.cpp to 300907b2110cc17b4337334dc397e05de2d8f5e0 by @​localai-bhttps://github.com/mudler/LocalAI/pull/4829l/4829

Other Changes

• docs: ⬆️ update docs version mudler/LocalAI by @​localai-bhttps://github.com/mudler/LocalAI/pull/4578l/4578
• chore(stablediffusion-ggml): disable sycl optimizations by @​mudlhttps://github.com/mudler/LocalAI/pull/4598l/4598
• chore: alias transformers-musicgen to transformers by @​mudlhttps://github.com/mudler/LocalAI/pull/4623l/4623
• feat(swagger): update swagger by @​localai-bhttps://github.com/mudler/LocalAI/pull/4625l/4625
• feat(swagger): update swagger by @​localai-bhttps://github.com/mudler/LocalAI/pull/4667l/4667
• chore(refactor): group cpu cap detection by @​mudlhttps://github.com/mudler/LocalAI/pull/4674l/4674
• chore(deps): bump grpcio to 1.70.0 by @​mudlhttps://github.com/mudler/LocalAI/pull/4682l/4682
• refactor: function argument parsing using named regex by @​mKenfenheuhttps://github.com/mudler/LocalAI/pull/4708l/4708
• fix(tests): pin to branch for config used in tests by @​mudlhttps://github.com/mudler/LocalAI/pull/4721l/4721
• feat(swagger): update swagger by @​localai-bhttps://github.com/mudler/LocalAI/pull/4735l/4735
• chore: migrate bruno request files to examples repo by @​dave-gray1https://github.com/mudler/LocalAI/pull/4788l/4788
• chore(tests): decrease parallelism for gRPC builds by @​mudlhttps://github.com/mudler/LocalAI/pull/4797l/4797
• chore(grpcio): bump to 1.70 by @​mudlhttps://github.com/mudler/LocalAI/pull/4798l/4798
• chore(grpcio): reduce parallelism by @​mudlhttps://github.com/mudler/LocalAI/pull/4799l/4799
• chore(swagger): update by @​mudlhttps://github.com/mudler/LocalAI/pull/4805l/4805
• Revert "chore(deps): Bump docs/themes/lotusdocs from f5785a2 to 975da91" by @​mudlhttps://github.com/mudler/LocalAI/pull/4808l/4808
• feat(swagger): update swagger by @​localai-bhttps://github.com/mudler/LocalAI/pull/4809l/4809

New Contributors

• @​petercover made their first contributihttps://github.com/mudler/LocalAI/pull/4665l/4665
• @​mKenfenheuer made their first contributihttps://github.com/mudler/LocalAI/pull/4700l/4700

Full Changelog: mudler/LocalAI@v2.25.0...v2.26.0

v2.25.0

Compare Source

What's Changed

Bug fixes 🐛

• chore(llava): update clip.patch by @​mudler in https://github.com/mudler/LocalAI/pull/4453

Exciting New Features 🎉

• feat(llama.cpp): expose cache_type_k and cache_type_v for quant of kv cache by @​mudler in https://github.com/mudler/LocalAI/pull/4329
• feat(template): read jinja templates from gguf files by @​mudler in https://github.com/mudler/LocalAI/pull/4332
• feat: stream tokens usage by @​mintyleaf in https://github.com/mudler/LocalAI/pull/4415
• feat(Dockerfile): allow to skip driver installation by @​mudler in https://github.com/mudler/LocalAI/pull/4447
• feat(ui): path prefix support via HTTP header by @​mgoltzsche in https://github.com/mudler/LocalAI/pull/4497
• feat(dowloader): resume partial downloads by @​Saavrm26 in https://github.com/mudler/LocalAI/pull/4537

🧠 Models

• chore(model gallery): add rp-naughty-v1.0c-8b by @​mudler in https://github.com/mudler/LocalAI/pull/4322
• chore(model gallery): add loki-v2.6-8b-1024k by @​mudler in https://github.com/mudler/LocalAI/pull/4321
• chore(model gallery): add math-iio-7b-instruct by @​mudler in https://github.com/mudler/LocalAI/pull/4323
• chore(model gallery): add llama-3.3-70b-instruct by @​mudler in https://github.com/mudler/LocalAI/pull/4333
• chore(model gallery): add mn-chunky-lotus-12b by @​mudler in https://github.com/mudler/LocalAI/pull/4337
• chore(model gallery): add virtuoso-small by @​mudler in https://github.com/mudler/LocalAI/pull/4338
• chore(model gallery): add bio-medical-llama-3-8b by @​mudler in https://github.com/mudler/LocalAI/pull/4339
• chore(model gallery): add qwen2.5-7b-homeranvita-nerdmix by @​mudler in https://github.com/mudler/LocalAI/pull/4343
• chore(model gallery): add impish_mind_8b by @​mudler in https://github.com/mudler/LocalAI/pull/4344
• chore(model gallery): add tulu-3.1-8b-supernova-smart by @​mudler in https://github.com/mudler/LocalAI/pull/4347
• chore(model gallery): add qwen2.5-math-14b-instruct by @​mudler in https://github.com/mudler/LocalAI/pull/4355
• chore(model gallery): add intellect-1-instruct by @​mudler in https://github.com/mudler/LocalAI/pull/4356
• chore(model gallery): add b-nimita-l3-8b-v0.02 by @​mudler in https://github.com/mudler/LocalAI/pull/4357
• chore(model gallery): add sailor2-1b-chat by @​mudler in https://github.com/mudler/LocalAI/pull/4363
• chore(model gallery): add sailor2-8b-chat by @​mudler in https://github.com/mudler/LocalAI/pull/4364
• chore(model gallery): add sailor2-20b-chat by @​mudler in https://github.com/mudler/LocalAI/pull/4365
• chore(model gallery): add 72b-qwen2.5-kunou-v1 by @​mudler in https://github.com/mudler/LocalAI/pull/4369
• chore(model gallery): add deepthought-8b-llama-v0.01-alpha by @​mudler in https://github.com/mudler/LocalAI/pull/4370
• chore(model gallery): add l3.3-70b-euryale-v2.3 by @​mudler in https://github.com/mudler/LocalAI/pull/4371
• chore(model gallery): add l3.3-ms-evayale-70b by @​mudler in https://github.com/mudler/LocalAI/pull/4374
• chore(model gallery): add evathene-v1.3 by @​mudler in https://github.com/mudler/LocalAI/pull/4375
• chore(model gallery): add hermes-3-llama-3.2-3b by @​mudler in https://github.com/mudler/LocalAI/pull/4376
• chore(model gallery): add fusechat-gemma-2-9b-instruct by @​mudler in https://github.com/mudler/LocalAI/pull/4379
• chore(model gallery): add fusechat-qwen-2.5-7b-instruct by @​mudler in https://github.com/mudler/LocalAI/pull/4380
• chore(model gallery): add chronos-gold-12b-1.0 by @​mudler in https://github.com/mudler/LocalAI/pull/4381
• fix: correct gallery/index.yaml by @​godsey in https://github.com/mudler/LocalAI/pull/4384
• chore(model gallery): add fusechat-llama-3.2-3b-instruct by @​mudler in https://github.com/mudler/LocalAI/pull/4386
• chore(model gallery): add fusechat-llama-3.1-8b-instruct by @​mudler in https://github.com/mudler/LocalAI/pull/4387
• chore(model gallery): add neumind-math-7b-instruct by @​mudler in https://github.com/mudler/LocalAI/pull/4388
• chore(model gallery): add naturallm-7b-instruct by @​mudler in https://github.com/mudler/LocalAI/pull/4392
• chore(model gallery): add marco-o1-uncensored by @​mudler in https://github.com/mudler/LocalAI/pull/4393
• chore(model gallery): add qwen2-7b-multilingual-rp by @​mudler in https://github.com/mudler/LocalAI/pull/4394
• chore(model gallery): add qwq-lcot-7b-instruct by @​mudler in https://github.com/mudler/LocalAI/pull/4419
• chore(model gallery): add llama-openreviewer-8b by @​mudler in https://github.com/mudler/LocalAI/pull/4422
• chore(model gallery): add falcon3-1b-instruct by @​mudler in https://github.com/mudler/LocalAI/pull/4423
• chore(model gallery): add falcon3-3b-instruct by @​mudler in https://github.com/mudler/LocalAI/pull/4424
• chore(model gallery): add qwen2-vl-72b-instruct by @​mudler in https://github.com/mudler/LocalAI/pull/4425
• chore(model gallery): add falcon3-10b-instruct by @​mudler in https://github.com/mudler/LocalAI/pull/4426
• chore(model gallery): add llama-song-stream-3b-instruct by @​mudler in https://github.com/mudler/LocalAI/pull/4431
• chore(model gallery): add llama-chat-summary-3.2-3b by @​mudler in https://github.com/mudler/LocalAI/pull/4432
• chore(model gallery): add tq2.5-14b-aletheia-v1 by @​mudler in https://github.com/mudler/LocalAI/pull/4440
• chore(model gallery): add tq2.5-14b-neon-v1 by @​mudler in https://github.com/mudler/LocalAI/pull/4441
• chore(model gallery): add orca_mini_v8_1_70b by @​mudler in https://github.com/mudler/LocalAI/pull/4444
• chore(model gallery): add anubis-70b-v1 by @​mudler in https://github.com/mudler/LocalAI/pull/4446
• chore(model gallery): add llama-3.3-70b-instruct-ablated by @​mudler in https://github.com/mudler/LocalAI/pull/4448
• chore(model-gallery): ⬆️ update checksum by @​localai-bot in https://github.com/mudler/LocalAI/pull/4487
• chore(model gallery): add l3.3-ms-evalebis-70b by @​mudler in https://github.com/mudler/LocalAI/pull/4488
• chore(model gallery): add tqwendo-36b by @​mudler in https://github.com/mudler/LocalAI/pull/4489
• chore(model gallery): add rombos-llm-70b-llama-3.3 by @​mudler in https://github.com/mudler/LocalAI/pull/4490
• chore(model-gallery): ⬆️ update checksum by @​localai-bot in https://github.com/mudler/LocalAI/pull/4492
• chore(model gallery): add fastllama-3.2-1b-instruct by @​mudler in https://github.com/mudler/LocalAI/pull/4493
• chore(model gallery): add dans-personalityengine-v1.1.0-12b by @​mudler in https://github.com/mudler/LocalAI/pull/4494
• chore(model gallery): add llama-3.1-8b-open-sft by @​mudler in https://github.com/mudler/LocalAI/pull/4495
• chore(model gallery): add qvq-72b-preview by @​mudler in https://github.com/mudler/LocalAI/pull/4498
• chore(model gallery): add teleut-7b-rp by @​mudler in https://github.com/mudler/LocalAI/pull/4499
• chore(model gallery): add falcon3-1b-instruct-abliterated by @​mudler in https://github.com/mudler/LocalAI/pull/4501
• chore(model gallery): add falcon3-3b-instruct-abliterated by @​mudler in https://github.com/mudler/LocalAI/pull/4502
• chore(model gallery): add falcon3-10b-instruct-abliterated by @​mudler in https://github.com/mudler/LocalAI/pull/4503
• chore(model gallery): add falcon3-7b-instruct-abliterated by @​mudler in https://github.com/mudler/LocalAI/pull/4504
• chore(model gallery): add control-nanuq-8b by @​mudler in https://github.com/mudler/LocalAI/pull/4506
• chore(model gallery): add miscii-14b-1028 by @​mudler in https://github.com/mudler/LocalAI/pull/4507
• chore(model gallery): add miscii-14b-1225 by @​mudler in https://github.com/mudler/LocalAI/pull/4508
• chore(model gallery): add qwen2.5-32b-rp-ink by @​mudler in https://github.com/mudler/LocalAI/pull/4517
• chore(model gallery): add huatuogpt-o1-8b by @​mudler in https://github.com/mudler/LocalAI/pull/4518
• chore(model gallery): add q2.5-veltha-14b-0.5 by @​mudler in https://github.com/mudler/LocalAI/pull/4519
• chore(model gallery): add smallthinker-3b-preview by @​mudler in https://github.com/mudler/LocalAI/pull/4521
• chore(model gallery): add mn-12b-mag-mell-r1-iq-arm-imatrix by @​mudler in https://github.com/mudler/LocalAI/pull/4522
• chore(model gallery): add captain-eris-diogenes_twilight-v0.420-12b by @​mudler in https://github.com/mudler/LocalAI/pull/4523
• chore(model gallery): add violet_twilight-v0.2 by @​mudler in https://github.com/mudler/LocalAI/pull/4524
• chore(model gallery): add qwenwify2.5-32b-v4.5 by @​mudler in https://github.com/mudler/LocalAI/pull/4525
• chore(model gallery): add sainemo-remix by @​mudler in https://github.com/mudler/LocalAI/pull/4526
• chore(model gallery): add l3.1-purosani-2-8b by @​mudler in https://github.com/mudler/LocalAI/pull/4527
• chore(model gallery): add nera_noctis-12b by @​mudler in https://github.com/mudler/LocalAI/pull/4530
• chore(model gallery): add drt-o1-7b by @​mudler in https://github.com/mudler/LocalAI/pull/4533
• chore(model gallery): add codepy-deepthink-3b by

---

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about these updates again.

---

• If you want to rebase/retry this PR, check this box

---

This PR was generated by Mend Renovate. View the repository job log.