Commit 5ed3763
[v0.11.0-dev][Bugfix][cherry-pick]bugfix for weight load of kimi-k2 (vllm-project#4190)
### What this PR does / why we need it?
This is cherry-pick from vllm-project#3798
Fix kimi-k2 start bug, weight load
ERROR:vllm-project#3785
### Does this PR introduce _any_ user-facing change?
### How was this patch tested?
- vLLM version: v0.11.0rc3
- vLLM main:
vllm-project/vllm@c9461e0
---------
Signed-off-by: Levi-JQ <[email protected]>
Signed-off-by: menogrey <[email protected]>
Co-authored-by: Levi <[email protected]>
Co-authored-by: Levi-JQ <[email protected]>
Co-authored-by: zhaozx-cn <[email protected]>1 parent dded39f commit 5ed3763
File tree
2 files changed
+12
-1
lines changed- .github/workflows
- vllm_ascend/quantization
2 files changed
+12
-1
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
57 | 57 | | |
58 | 58 | | |
59 | 59 | | |
60 | | - | |
| 60 | + | |
| 61 | + | |
| 62 | + | |
| 63 | + | |
| 64 | + | |
| 65 | + | |
| 66 | + | |
61 | 67 | | |
62 | 68 | | |
63 | 69 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
193 | 193 | | |
194 | 194 | | |
195 | 195 | | |
| 196 | + | |
| 197 | + | |
| 198 | + | |
| 199 | + | |
| 200 | + | |
196 | 201 | | |
197 | 202 | | |
198 | 203 | | |
| |||
0 commit comments