Commit 847d12a
authored
[BugFix]Fix moe load problems in torchair when using dynamic eplb (#3381)
### What this PR does / why we need it?
When using dynamic eplb, moe load is not imported. We fix this problem
by modifying the return value of hidden states in torchair.
### Does this PR introduce _any_ user-facing change?
### How was this patch tested?
DeepseekV3 in A3.
- vLLM version: v0.11.0rc3
- vLLM main: https://github.com/vllm-project/vllm/commit/v0.11.0
---------
Signed-off-by: daishixun <[email protected]>1 parent cd69385 commit 847d12a
File tree
2 files changed
+12
-4
lines changed- vllm_ascend/torchair
- ops
- quantization
2 files changed
+12
-4
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1279 | 1279 | | |
1280 | 1280 | | |
1281 | 1281 | | |
1282 | | - | |
| 1282 | + | |
| 1283 | + | |
1283 | 1284 | | |
1284 | 1285 | | |
1285 | 1286 | | |
1286 | 1287 | | |
1287 | | - | |
1288 | | - | |
| 1288 | + | |
| 1289 | + | |
| 1290 | + | |
1289 | 1291 | | |
1290 | 1292 | | |
1291 | 1293 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
220 | 220 | | |
221 | 221 | | |
222 | 222 | | |
| 223 | + | |
223 | 224 | | |
224 | 225 | | |
225 | 226 | | |
| |||
354 | 355 | | |
355 | 356 | | |
356 | 357 | | |
| 358 | + | |
| 359 | + | |
| 360 | + | |
357 | 361 | | |
358 | 362 | | |
359 | 363 | | |
| |||
832 | 836 | | |
833 | 837 | | |
834 | 838 | | |
| 839 | + | |
835 | 840 | | |
836 | 841 | | |
837 | 842 | | |
| |||
994 | 999 | | |
995 | 1000 | | |
996 | 1001 | | |
997 | | - | |
| 1002 | + | |
| 1003 | + | |
998 | 1004 | | |
999 | 1005 | | |
1000 | 1006 | | |
| |||
0 commit comments