Commit 63561d6
authored
[Fix] Sorts aclgraph batch sizes in ascending order (#4230)
### What this PR does / why we need it?
Sorts aclgraph batch sizes in ascending order, corresponding to vLLM
[#26016](vllm-project/vllm#26016)
Ensures batch sizes for aclgraph are sorted ascending when aclgraph mode
is enabled, improving consistency and compatibility with later logic
that may depend on order.
### Does this PR introduce _any_ user-facing change?
None.
### How was this patch tested?
Waiting for #3886
- vLLM version: v0.11.0
- vLLM main:
vllm-project/vllm@2918c1b
Signed-off-by: Yizhou Liu <[email protected]>1 parent e985432 commit 63561d6
1 file changed
+8
-3
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
521 | 521 | | |
522 | 522 | | |
523 | 523 | | |
524 | | - | |
525 | | - | |
| 524 | + | |
| 525 | + | |
| 526 | + | |
| 527 | + | |
| 528 | + | |
| 529 | + | |
526 | 530 | | |
527 | 531 | | |
528 | 532 | | |
| |||
4101 | 4105 | | |
4102 | 4106 | | |
4103 | 4107 | | |
4104 | | - | |
| 4108 | + | |
| 4109 | + | |
4105 | 4110 | | |
4106 | 4111 | | |
4107 | 4112 | | |
| |||
0 commit comments