Skip to content

Commit 53be4a8

Browse files
authored
[V1] Allow sliding window + prefix caching (vllm-project#13069)
Signed-off-by: Woosuk Kwon <[email protected]>
1 parent f5d3acd commit 53be4a8

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/config.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1146,7 +1146,7 @@ def _verify_prefix_caching(self) -> None:
11461146
if not self.enable_prefix_caching:
11471147
return
11481148

1149-
if self.sliding_window is not None:
1149+
if self.sliding_window is not None and not envs.VLLM_USE_V1:
11501150
raise NotImplementedError(
11511151
"Prefix caching is not supported with sliding window. "
11521152
"Run with --disable-sliding-window to use prefix caching.")

0 commit comments

Comments
 (0)