Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issue with Mistral Small and greek characters #14307

Open
1 task done
myrulezzz opened this issue Mar 5, 2025 · 0 comments
Open
1 task done

Issue with Mistral Small and greek characters #14307

myrulezzz opened this issue Mar 5, 2025 · 0 comments
Labels
usage How to use vllm

Comments

@myrulezzz
Copy link

Your current environment


--model mistralai/Mistral-Small-24B-Instruct-2501 --tokenizer_mode mistral --config_format mistral --load_format mistral --tool-call-parser mistral --enable-auto-tool-choice

How would you like to use vllm

I run inference for the Mistral Small model with the parameters defined before i have issues with greek characters on llm responses.some of them are clear some are unkown characters.Using the same model with ollama greek is perfect without any issues. Can i use some other parameter for my usecase when inferencing with vllm?

Before submitting a new issue...

  • Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.
@myrulezzz myrulezzz added the usage How to use vllm label Mar 5, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
usage How to use vllm
Projects
None yet
Development

No branches or pull requests

1 participant