Skip to content

Commit 310e960

Browse files
committed
fix: fix incorrect attribute for CPU sequence lengths
I'm just so tired of fixing these. Signed-off-by: Yizhou Liu <[email protected]>
1 parent 2d60e27 commit 310e960

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm_ascend/spec_decode/mtp_proposer.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1107,7 +1107,7 @@ def prepare_inputs_padded(
11071107
spec_common_attn_metadata = AscendCommonAttentionMetadata(
11081108
query_start_loc=common_attn_metadata.query_start_loc,
11091109
query_start_loc_cpu=query_start_loc_cpu,
1110-
seq_lens_cpu=common_attn_metadata.seq_lens,
1110+
seq_lens_cpu=common_attn_metadata.seq_lens_cpu,
11111111
num_reqs=common_attn_metadata.num_reqs,
11121112
num_actual_tokens=total_num_tokens,
11131113
num_input_tokens=common_attn_metadata.num_input_tokens,

0 commit comments

Comments
 (0)