Skip to content

Commit 45889a6

Browse files
authored
[Bugfix] Pass vllm_config to kv_connector_no_forward in NPUModelRunner (#4970)
### What this PR does / why we need it? The newest version crashes in PD separation scenarios because the function is missing the `vllm_config` parameter. - vLLM version: v0.12.0 - vLLM main: vllm-project/vllm@ad32e3e Signed-off-by: Jade Zheng <[email protected]>
1 parent fa367e3 commit 45889a6

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

vllm_ascend/worker/model_runner_v1.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1444,7 +1444,8 @@ def execute_model(
14441444
)
14451445
# Return empty ModelRunnerOuptut if there's no work to do.
14461446
return EMPTY_MODEL_RUNNER_OUTPUT
1447-
return self.kv_connector_no_forward(scheduler_output)
1447+
return self.kv_connector_no_forward(scheduler_output,
1448+
self.vllm_config)
14481449

14491450
if self.dynamic_eplb:
14501451
self.eplb_updator.forward_before()

0 commit comments

Comments
 (0)