Skip to content

Commit e2bc5c9

Browse files
committed
triton code add notations for rejection_sampler.py
Signed-off-by: yuxingcyx <[email protected]>
1 parent b4cbe62 commit e2bc5c9

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm_ascend/sample/rejection_sampler.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -156,7 +156,7 @@ def rejection_sample(
156156
BLOCK_SIZE = 2
157157
grid = triton.cdiv(n, BLOCK_SIZE)
158158
if n >= 40:
159-
grid = 40
159+
grid = 40 # Empirically tuned value
160160
BLOCK_SIZE = triton.next_power_of_2(n // grid)
161161

162162
if min(num_draft_tokens) == 1 and max(

0 commit comments

Comments
 (0)