Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Doc]: Can not useTP PP in tihs Version #148

Open
shuowoshishui opened this issue Feb 24, 2025 · 3 comments
Open

[Doc]: Can not useTP PP in tihs Version #148

shuowoshishui opened this issue Feb 24, 2025 · 3 comments
Labels
bug Something isn't working question Further information is requested

Comments

@shuowoshishui
Copy link

📚 The doc issue

i wanna use TP=2 PP=4 in my infer model, but it doesn`t work.

Suggest a potential alternative/fix

No response
@shuowoshishui shuowoshishui added the documentation Improvements or additions to documentation label Feb 24, 2025
@shuowoshishui
Copy link
Author

Image

@wangxiyuan
Copy link
Collaborator

@MengqingCao Please take a look first. Thanks

@wangxiyuan wangxiyuan added bug Something isn't working question Further information is requested and removed documentation Improvements or additions to documentation labels Feb 24, 2025
@MengqingCao
Copy link
Contributor

MengqingCao commented Feb 24, 2025 •
edited by Yikun
Loading

I suppose you are using mismatched vllm and vllm-ascend. Please switch to use vllm v0.7.1

Pls see also: https://vllm-ascend.readthedocs.io/en/latest/installation.html as reference.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working question Further information is requested
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@wangxiyuan @shuowoshishui @MengqingCao