Skip to content

Commit 0e7ff1b

Browse files
committed
tiny fix
Signed-off-by: MengqingCao <[email protected]>
1 parent 1fe3431 commit 0e7ff1b

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm_ascend/worker/model_runner_v1.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2862,7 +2862,7 @@ def _allocate_kv_cache_tensors(
28622862
and "linear_attn" not in layer_name_inner):
28632863
kv_cache_raw_tensors[layer_name_inner] = (k_tensor, v_tensor) if \
28642864
not self.use_sparse else (k_tensor, v_tensor, k_cache_tensor)
2865-
break
2865+
break
28662866

28672867
layer_names = set()
28682868
for group in kv_cache_config.kv_cache_groups:

0 commit comments

Comments
 (0)