Skip to content

Commit 012f221

Browse files
committed
tiny fix
Signed-off-by: MengqingCao <[email protected]>
1 parent 24d2a20 commit 012f221

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm_ascend/worker/model_runner_v1.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2837,7 +2837,7 @@ def _allocate_kv_cache_tensors(
28372837
and "linear_attn" not in layer_name_inner):
28382838
kv_cache_raw_tensors[layer_name_inner] = (k_tensor, v_tensor) if \
28392839
not self.use_sparse else (k_tensor, v_tensor, k_cache_tensor)
2840-
break
2840+
break
28412841

28422842
layer_names = set()
28432843
for group in kv_cache_config.kv_cache_groups:

0 commit comments

Comments
 (0)