Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature]: 请问能不能适配支持一下Ascend910B(CANN-8.0.RC2)的pytorch2.3.1? torch2.5.1需要8.0.RC3 #165

Open
wzb1005 opened this issue Feb 26, 2025 · 4 comments
Labels
question Further information is requested

Comments

@wzb1005
Copy link

wzb1005 commented Feb 26, 2025

🚀 The feature, motivation and pitch

请问能不能适配支持一下Ascend910B(CANN-8.0.RC2)的pytorch2.3.1? torch2.5.1需要8.0.RC3

Alternatives

No response

Additional context

No response

@wangxiyuan
Copy link
Collaborator

Sorry, it's required by vLLM, we can do nothing

pytorch >=2.5.1 at least https://github.com/vllm-project/vllm/blob/v0.7.1/requirements-cpu.txt#L5-L6

@wangxiyuan wangxiyuan added question Further information is requested and removed feature request labels Feb 26, 2025
@wzb1005
Copy link
Author

wzb1005 commented Feb 26, 2025

能不能适配一个低一点的与pytorch2.3.1配套的vllm-asend版本?我感觉应该改动不大啊. 我找到了与torch2.3.1配套的版本:vllm-0.5.3

@wangxiyuan
Copy link
Collaborator

Sorry, vllm-ascend only works from vllm 0.7.1. The lower version of vllm doesn't support hardware plugin feature.

@Yikun
Copy link
Collaborator

Yikun commented Feb 27, 2025

@wzb1005 Just curious, why you want to use the 0.5.3, but not latest version? Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

3 participants