Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CANN]: Fix crash when running on multiple cann devices #9627

Merged
merged 1 commit into from
Sep 25, 2024

Conversation

bachelor-dou
Copy link
Contributor

This PR fixes a crash that occurred when llama-bench was run on multiple cann devices(#9250).

before the fix:
image

after the fix:
image

@bachelor-dou
Copy link
Contributor Author

@hipudding

@bachelor-dou
Copy link
Contributor Author

@znzjugod
Very sorry for confirming and fixing this bug after so long, the issue (#9250) was delayed due to being busy with other projects. This PR was tested using two NPUs and your CMD commands and I believe the issue has been resolved. Please get the latest code to try after this PR is merged in, thank you very much for your feedback.

@hipudding hipudding self-requested a review September 25, 2024 03:29
@hipudding hipudding added the Ascend NPU issues specific to Ascend NPUs label Sep 25, 2024
@hipudding hipudding merged commit 904837e into ggml-org:master Sep 25, 2024
53 checks passed
@bachelor-dou bachelor-dou deleted the bug-fix branch November 25, 2024 12:46
@bachelor-dou bachelor-dou restored the bug-fix branch November 25, 2024 12:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Ascend NPU issues specific to Ascend NPUs
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants