-
Notifications
You must be signed in to change notification settings - Fork 31.3k
Kernel mapping error resolve #42466
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Kernel mapping error resolve #42466
Conversation
9623bfe to
04e27cb
Compare
5a4a08a to
e328d0c
Compare
|
@Rocketknight1 I noticed that the run test issues that is occuring ColQwen2ForRetrieval: Tensor vlm.lm_head.weight seems to have nothing to do with the changes made in pr. |
|
cc @MekkCyber for kernels I think! also @Aaraviitkgp that |
|
@Rocketknight1 the test_processor and test_tokenization have similar issue they fail but no changes in pr related to them can you look into that aswell 😁. |
MekkCyber
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for fixing this !
47249c9 to
21eda55
Compare
MekkCyber
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks a lot! just one nit and good to go
0ea638d to
b744a09
Compare
MekkCyber
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks a lot for iterating !
|
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update. |
issue: #42451
This PR fixes a bug in KernelConfig.create_compatible_mapping where defining a kernel mapping for multiple devices (e.g., both cuda and rocm) caused the last defined device to overwrite the active device configuration.
@Rocketknight1 @MekkCyber