Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cannot use parler-tts models #3941

Closed
rn3-sfos opened this issue Oct 23, 2024 · 2 comments · Fixed by #3954 or #4672
Closed

Cannot use parler-tts models #3941

rn3-sfos opened this issue Oct 23, 2024 · 2 comments · Fixed by #3954 or #4672
Assignees
Labels
bug Something isn't working

Comments

@rn3-sfos
Copy link

LocalAI version:
localai/localai:latest-gpu-nvidia-cuda-12 (sha256:ff0b3e63d517631b1660fb3f7dbf6cfbbe8f0df730573c6f9b7b6effa964af05)

Environment, CPU architecture, OS, and Version:
Linux 82a266e95db7 6.11.5-arch1-1 #1 SMP PREEMPT_DYNAMIC Tue, 22 Oct 2024 18:31:38 +0000 x86_64 x86_64 x86_64 GNU/Linux

Describe the bug
Parler-tts backend imports runtime_version from protobuf and fails.

To Reproduce

  1. Install parler-tts model from gallery
  2. Try to invoke the model
  3. curl -L http://localhost:8080/tts \ -H "Content-Type: application/json" \ -d '{ "model": "parler-tts", "input": "Hi there!" }' | aplay

Expected behavior
Model loads and generates audio for the text

Logs
7:11AM DBG Wait for the service to start up 7:11AM DBG GRPC(-127.0.0.1:34227): stdout Initializing libbackend for parler-tts 7:11AM DBG GRPC(-127.0.0.1:34227): stdout virtualenv activated 7:11AM DBG GRPC(-127.0.0.1:34227): stdout activated virtualenv has been ensured 7:11AM DBG GRPC(-127.0.0.1:34227): stderr Traceback (most recent call last): 7:11AM DBG GRPC(-127.0.0.1:34227): stderr File "/build/backend/python/parler-tts/backend.py", line 13, in <module> 7:11AM DBG GRPC(-127.0.0.1:34227): stderr import backend_pb2 7:11AM DBG GRPC(-127.0.0.1:34227): stderr File "/build/backend/python/parler-tts/backend_pb2.py", line 9, in <module> 7:11AM DBG GRPC(-127.0.0.1:34227): stderr from google.protobuf import runtime_version as _runtime_version 7:11AM DBG GRPC(-127.0.0.1:34227): stderr ImportError: cannot import name 'runtime_version' from 'google.protobuf' (/build/backend/python/parler-tts/venv/lib/python3.10/site-packages/google/protobuf/__init__.py)

@rn3-sfos rn3-sfos added bug Something isn't working unconfirmed labels Oct 23, 2024
@mudler
Copy link
Owner

mudler commented Oct 24, 2024

Should be covered by #3954 - we had a hacky workaround in place for workarounding descriptinc/audiotools#111

@mudler
Copy link
Owner

mudler commented Nov 7, 2024

Still present on master images. Needs deeper investigation

@mudler mudler reopened this Nov 7, 2024
@mudler mudler removed the unconfirmed label Nov 7, 2024
@mudler mudler self-assigned this Nov 7, 2024
mudler added a commit that referenced this issue Jan 23, 2025
We support at this point more extensive backends that are SOTA and
support also voice cloning, and many other features. This backend is
superseded and also poses significant maintenance burden as there is an
open issue #3941 which is still
open as it deps are pinning old versions of grpc.

Signed-off-by: Ettore Di Giacinto <[email protected]>
mudler added a commit that referenced this issue Jan 23, 2025
We support at this point more extensive backends that are SOTA and
support also voice cloning, and many other features. This backend is
superseded and also poses significant maintenance burden as there is an
open issue #3941 which is still
open as it deps are pinning old versions of grpc.

Closes #3941

Signed-off-by: Ettore Di Giacinto <[email protected]>
@mudler mudler closed this as completed in 318225f Jan 23, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
2 participants