v1.30.0

What's Changed

This is an exciting LocalAI release! Besides bug-fixes and enhancements this release brings the new backend to a whole new level by extending support to vllm and vall-e-x for audio generation!

Bug fixes 🐛

• fix(llama): resolve lora adapters correctly from the model file by @mudler in #964
• fix(diffusers): correctly check alpha by @mudler in #967
• fix(utf8): prevent multi-byte utf8 characters from being mangled by @samm81 in #981
• fix(vall-e-x): make audiopath relative to models by @mudler in #1012
• fix(vall-e-x): copy vall-e-x next to the local-ai binary in the container image by @mudler in #1082

Exciting New Features 🎉

• feat(diffusers): Add lora by @mudler in #965
• feat: expose all the jobs via /models/jobs endpoint by @Jirubizu in #983
• feat: Model Gallery Endpoint Refactor / Mutable Galleries Endpoints by @dave-gray101 in #991
• Allow to manually set the seed for the SD pipeline by @maxjcohen in #998
• feat: add vall-e-x by @mudler in #1007
• feat(vllm): Initial vllm backend implementation by @mudler in #1026
• feat(speculative-sampling): allow to specify a draft model in the model config by @mudler in #1052
• fix(vllm): set default top_p with vllm by @mudler in #1078
• feat(python-grpc): allow to set max workers with PYTHON_GRPC_MAX_WORKERS by @mudler in #1081
• feat(vllm): Allow to set quantization by @mudler in #1094

👒 Dependencies

• fix(deps): update github.com/go-skynet/go-llama.cpp digest to 9072315 by @renovate in #963
• ⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in #968
• fix(deps): update module github.com/gofiber/fiber/v2 to v2.49.0 by @renovate in #966
• fix(deps): update github.com/tmc/langchaingo digest to c85d396 by @renovate in #962
• fix(deps): update module github.com/valyala/fasthttp to v1.49.0 by @renovate in #971
• fix(deps): update go-llama.cpp by @mudler in #980
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to bf3f946 by @renovate in #979
• fix(deps): update module github.com/sashabaranov/go-openai to v1.15.1 by @renovate in #984
• fix(deps): update module github.com/shirou/gopsutil/v3 to v3.23.8 by @renovate in #989
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to b6e38d6 by @renovate in #988
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to c5622a8 by @renovate in #992
• ⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in #996
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to d8c8547 by @renovate in #997
• ⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in #1002
• fix(deps): update module github.com/gofiber/fiber/v2 to v2.49.1 by @renovate in #1001
• chore(deps): remove unused package by @appleboy in #1003
• ⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in #1005
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to 05dc4b6 by @renovate in #1004
• feat(llama.cpp): update by @mudler in #1024
• fix(deps): update module github.com/sashabaranov/go-openai to v1.15.2 by @renovate in #1022
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to 4145bd5 by @renovate in #1025
• ⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in #1027
• fix(deps): update github.com/tmc/langchaingo digest to 9c8845b by @renovate in #1029
• ⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in #1043
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to f0735ef by @renovate in #1034
• fix(deps): update module github.com/sashabaranov/go-openai to v1.15.3 by @renovate in #1035
• chore(deps): update docker/build-push-action action to v5 by @renovate in #1039
• chore(deps): update docker/login-action action to v3 by @renovate in #1040
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to cc8a123 by @renovate in #1041
• ⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in #1048
• chore(deps): update docker/metadata-action action to v5 by @renovate in #1045
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to cf4eb53 by @renovate in #1047
• ⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in #1062
• fix(deps): update module google.golang.org/grpc to v1.58.1 by @renovate in #1020
• fix(deps): update module github.com/gofiber/fiber/v2 to v2.49.2 by @renovate in #1049
• fix(deps): update module github.com/valyala/fasthttp to v1.50.0 by @renovate in #1060
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to b471eb7 by @renovate in #1050
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to e86c637 by @renovate in #1059
• ⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in #1084
• fix(llama.cpp): update, run go mod tidy by @mudler in #1088
• fix(deps): update module google.golang.org/grpc to v1.58.2 by @renovate in #1090
• fix(deps): update github.com/tmc/langchaingo digest to 2c309cf by @renovate in #1097

Other Changes

• [query_data example] max_chunk_overlap in PromptHelper must be in 0..1 range by @quoing in #1000
• feat(diffusers): don't set seed in params and respect device by @mudler in #1010
• Update README to reflect changes in Continue's config file by @rdeaton in #1014
• 1038 - Streamlit bot with LocalAI by @majoshi1 in #1072
• Cleaned up chatbot-ui READMEs by @jamesbraza in #1075
• Requested Changes from GPT4ALL to Luna-AI-Llama2 by @lunamidori5 in #1092
• Add the CONTRIBUTING.md by @Aisuko in #1098

New Contributors

• @Jirubizu made their first contribution in #983
• @maxjcohen made their first contribution in #998
• @appleboy made their first contribution in #1003
• @quoing made their first contribution in #1000
• @rdeaton made their first contribution in #1014
• @majoshi1 made their first contribution in #1072
• @jamesbraza made their first contribution in #1075
• @lunamidori5 made their first contribution in #1092

Full Changelog: v1.25.0...v2.0.0

v1.25.0

What's Changed

Breaking Changes 🛠

• feat: bump llama.cpp, add gguf support by @mudler in #943

Bug fixes 🐛

• fix: disable usage by default (still experimental) by @mudler in #929
• fix: drop racy code, refactor and group API schema by @mudler in #931

Exciting New Features 🎉

• feat(Makefile): allow to restrict backend builds by @mudler in #890
• feat(diffusers): various enhancements by @mudler in #895
• feat: make initializer accept gRPC delay times by @mudler in #900
• feat(diffusers): add DPMSolverMultistepScheduler++, DPMSolverMultistepSchedulerSDE++, guidance_scale by @mudler in #903
• feat(diffusers): overcome prompt limit by @mudler in #904
• feat(diffusers): add img2img and clip_skip, support more kernels schedulers by @mudler in #906
• Usage Features by @dave-gray101 in #863
• feat(diffusers): be consistent with pipelines, support also depthimg2img by @mudler in #926
• feat: add --single-active-backend to allow only one backend active at the time by @mudler in #925
• feat: add llama-stable backend by @mudler in #932
• feat: allow to customize rwkv tokenizer by @dave-gray101 in #937
• feat: backend monitor shutdown endpoint, process based by @dave-gray101 in #938
• feat: Allow to load lora adapters for llama.cpp by @mudler in #955

👒 Dependencies

• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #878
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to 4e55940 by @renovate in #893
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to 18f25c2 by @renovate in #894
• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #899
• fix(deps): update github.com/tmc/langchaingo digest to eb0cbd3 by @renovate in #902
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to f03869d by @renovate in #901
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to a630935 by @renovate in #898
• fix(deps): update module github.com/shirou/gopsutil/v3 to v3.23.7 - autoclosed by @renovate in #924
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to 36f7fb5 by @renovate in #908
• fix(deps): update github.com/tmc/langchaingo digest to fef0821 by @renovate in #922
• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #911
• fix(deps): update module github.com/google/uuid to v1.3.1 by @renovate in #936
• fix(deps): update module github.com/onsi/ginkgo/v2 to v2.12.0 by @renovate in #949
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to 27a8b02 by @renovate in #947
• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #953
• ⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in #954
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to bf63302 by @renovate in #930
• fix(deps): update github.com/tmc/langchaingo digest to 1e2a401 by @renovate in #948
• fix(deps): update module github.com/otiai10/openaigo to v1.6.0 by @renovate in #960

Other Changes

• infra: add setup-go@4, test against 1.20.x (go.mod) and stable (1.21) by @dave-gray101 in #935
• Example: Continue (dev) by @gruberdev in #940
• initial draft of an importable Insomnia profile for developers by @dave-gray101 in #942

New Contributors

• @gruberdev made their first contribution in #940

Full Changelog: v1.24.1...v1.25.0

v1.24.1

What's Changed

This is a patch release - images were not correctly pushed by the CI in 1.24.0

Other Changes

• fix(deps): update module github.com/sashabaranov/go-openai to v1.14.2 by @renovate in #884

Full Changelog: v.1.24.0...v1.24.1

v1.24.0

What's Changed

Bug fixes 🐛

• fix: upgrade pip by @mudler in #872
• fix: workaround exllama import error by @mudler in #885

Exciting New Features 🎉

• feat: add bark and AutoGPTQ by @mudler in #871
• feat: Add Diffusers by @mudler in #874
• feat: add API_KEY list support by @neboman11 in #877
• feat: Add exllama by @mudler in #881
• feat: pre-configure LocalAI galleries by @mudler in #886

👒 Dependencies

• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #870
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to 0f2bb50 by @renovate in #869
• fix(deps): update github.com/tmc/langchaingo digest to fd8b7f0 by @renovate in #882
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to 4d855af by @renovate in #875

Other Changes

• docs: base-Update comments in .env for cublas, openblas, clblas by @scott4290 in #867

New Contributors

• @scott4290 made their first contribution in #867
• @neboman11 made their first contribution in #877

Full Changelog: v1.23.2...v.1.24.0

v1.23.2

What's Changed

Bug fixes 🐛

• fix: do not break on newlines on function returns by @mudler in #864

Exciting New Features 🎉

• feat: "simple" chat/edit/completion template system prompt from config by @dave-gray101 in #856
• feat: add ngqa and RMSNormEps parameters by @mudler in #860
• feat: update integer, number and string rules - allow primitives as root types by @mudler in #862

👒 Dependencies

• fix(deps): update github.com/tmc/langchaingo digest to 271e9bd by @renovate in #857
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to c449b71 by @renovate in #858
• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #859
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to 50cee77 by @renovate in #861

Full Changelog: v1.23.1...v1.23.2

v1.23.1

What's Changed

Bug fixes 🐛

• Fix: Model Gallery Downloads by @dave-gray101 in #835
• fix(examples): use pinned versions in the k8sgpt example by @mudler in #845
• fix(gallery): preload from file should by in YAML format by @mudler in #846
• Revert ":arrow_up: Update go-skynet/go-llama.cpp" by @mudler in #850
• fix(gallery): use inline YAML by @mudler in #851

Exciting New Features 🎉

• feature: model list :: filter query string parameter by @dave-gray101 in #830

👒 Dependencies

• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #847

Other Changes

• fix(deps): update module github.com/rs/zerolog to v1.30.0 by @renovate in #836
• ⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in #824
• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #825
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to 8c51308 by @renovate in #822
• fix(deps): update github.com/tmc/langchaingo digest to 7df4fe5 by @renovate in #826
• refactor: Remove remaining uses of depreciated package io/ioutil by @dave-gray101 in #837
• Create .gitattributes to force git clone to keep the LF line endings on .sh files by @energynumbers in #838
• Added "BMO Chatbot" to "Projects already using LocalAI to run local models" section." by @longy2k in #828
• ✨📝 Add OpenOps to README's project list by @azigler in #832
• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #841
• fix(deps): update github.com/tmc/langchaingo digest to 8f10160 by @renovate in #843
• feat: Update logo by @mudler in #849
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to cbdcde8 by @renovate in #833
• Update to working k8sgpt + localai example in documentation by @tharpooljha in #852

New Contributors

• @energynumbers made their first contribution in #838
• @longy2k made their first contribution in #828
• @azigler made their first contribution in #832
• @tharpooljha made their first contribution in #852

Full Changelog: v1.23.0...v1.23.1

v1.23.0

What's Changed

Breaking Changes 🛠

• feat: add rope settings and negative prompt, drop grammar backend by @mudler in #797

Bug fixes 🐛

• fix missing openai_api_base on langchain-chroma example by @wendyliga in #818
• fix: add rope settings during model load, fix CUDA by @mudler in #821
• fix: select function calls if 'name' is set in the request by @mudler in #827
• fix: symlink libphonemize in the container by @mudler in #831

Exciting New Features 🎉

• Added CPU information to entrypoint.sh by @finger42 in #794
• feat: cancel stream generation if client disappears by @tmm1 in #792
• fix: use bytes in gRPC proto instead of strings by @mudler in #813

👒 Dependencies

• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #807
• fix(deps): update github.com/tmc/langchaingo digest to 7d5f9fd by @renovate in #768
• fix(deps): update github.com/donomii/go-rwkv.cpp digest to c898cd0 by @renovate in #748
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to 9100b2e by @renovate in #753
• fix(deps): update module github.com/sashabaranov/go-openai to v1.14.1 by @renovate in #783
• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #814
• fix(deps): update module google.golang.org/grpc to v1.57.0 by @renovate in #815
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to 6ba16de by @renovate in #820
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to 39acbc8 by @renovate in #817

Other Changes

• fix: update gitignore and make clean by @dave-gray101 in #798
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to 562d2b5 by @renovate in #766

New Contributors

• @finger42 made their first contribution in #794
• @tmm1 made their first contribution in #792
• @wendyliga made their first contribution in #818

Full Changelog: v1.22.0...v1.23.0

v1.22.0

What's Changed

Breaking Changes 🛠

• refactor: rename "llama-master" to "llama" and "llama" to "llama-grammar" by @mudler in #776

Bug fixes 🐛

• fix: move metal file to grpcs assets by @mudler in #777
• fix: make completions endpoint more close to OpenAI specification by @mudler in #790

Exciting New Features 🎉

• feat: add llama-master backend by @mudler in #752
• [build] pass build type to cmake on libtransformers.a build by @TonDar0n in #741
• feat: resolve JSONSchema refs (planners) by @mudler in #774
• feat: backends improvements by @mudler in #778
• feat(llama2): add template for chat messages by @dave-gray101 in #782

👒 Dependencies

• ⬆️ Update go-skynet/go-bert.cpp by @ci-robbot in #758
• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #759
• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #769
• ⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in #770
• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #775
• ⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in #723
• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #785

Other Changes

• example(functions): Add OpenAI functions example by @mudler in #767
• [Telegram-bot example] Fix lint for command docker-compose by @exsplashit in #787

New Contributors

• @TonDar0n made their first contribution in #741
• @exsplashit made their first contribution in #787

Full Changelog: v1.21.0...v1.22.0

v1.21.0 - LocalAI functions!

What's Changed

Bug fixes 🐛

• fix: make first stream message to send empty content by @mudler in #751

Exciting New Features 🎉

• feat: [whisper] Partial support for verbose_json format in transcribe endpoint by @ldotlopez in #721
• feat: LocalAI functions by @mudler in #726
• feat: gRPC-based backends by @mudler in #743
• feat: falcon support (7b and 40b) with ggllm.cpp by @mudler in #743

Other Changes

• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #704
• fix(deps): bump go-llama.cpp by @mudler in #719
• Create FUNDING.yml by @mudler in #725
• fix(deps): update module github.com/sashabaranov/go-openai to v1.13.0 by @renovate in #667
• fix(deps): update module github.com/otiai10/openaigo to v1.5.2 by @renovate in #731
• fix(deps): update github.com/tmc/langchaingo digest to a875e6b by @renovate in #700
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to ffa57fb by @renovate in #707
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to d611d10 by @renovate in #699
• Update README with sponsors section by @mudler in #732
• fix(deps): update github.com/go-skynet/go-ggml-transformers.cpp digest to 3fec197 by @renovate in #706
• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #705
• fix(deps): update module google.golang.org/protobuf to v1.31.0 by @renovate in #746
• fix(deps): update module github.com/sashabaranov/go-openai to v1.14.0 by @renovate in #739
• fix(deps): update module gopkg.in/yaml.v2 to v3 by @renovate in #299
• fix(deps): update github.com/go-skynet/go-ggml-transformers.cpp digest to ffb09d7 by @renovate in #744
• ⬆️ Update donomii/go-rwkv.cpp by @ci-robbot in #750
• fix(deps): update github.com/mudler/go-ggllm.cpp digest to 862477d by @renovate in #745
• fix(deps): update github.com/tmc/langchaingo digest to dcf7ecd by @renovate in #736
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to cfd70b6 by @renovate in #734
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to 6c97625 by @renovate in #733
• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #735
• ⬆️ Update go-skynet/go-ggml-transformers.cpp by @ci-robbot in #711
• fix(deps): update github.com/go-skynet/go-bert.cpp digest to 6abe312 by @renovate in #756
• fix(deps): update module github.com/gofiber/fiber/v2 to v2.48.0 by @renovate in #757

New Contributors

• @ldotlopez made their first contribution in #721

Full Changelog: v1.20.1...v1.21.0

v1.20.1

What's Changed

Other Changes

• Update README.md by @mudler in #694
• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #691
• ⬆️ Update ggerganov/whisper.cpp by @ci-robbot in #696
• fix(deps): update github.com/tmc/langchaingo digest to e510561 by @renovate in #695
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to 390994e by @renovate in #653
• ⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in #697
• fix(deps): update github.com/ggerganov/whisper.cpp/bindings/go digest to 85ed71a by @renovate in #669
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to 42ba448 by @renovate in #698
• fix: adapt whisper to bindings updates by @mudler in #702
• fix: split build threads from running threads by @mudler in #703

Full Changelog: v1.20.0...v1.20.1