Skip to content

Commit bb462a9

Browse files
committed
fix finalize
Signed-off-by: Alex Sun <[email protected]>
1 parent b584b1b commit bb462a9

File tree

1 file changed

+3
-0
lines changed

1 file changed

+3
-0
lines changed

vllm/model_executor/layers/fused_moe/mori_prepare_finalize.py

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -81,7 +81,10 @@ def finalize(
8181
self,
8282
output: torch.Tensor,
8383
fused_expert_output: torch.Tensor,
84+
topk_weights: torch.Tensor,
8485
topk_ids: torch.Tensor,
86+
apply_router_weight_on_input: None,
87+
weight_and_reduce_impl: None,
8588
) -> None:
8689
num_token = output.shape[0]
8790
result = self.mori_op.combine(

0 commit comments

Comments
 (0)