Skip to content

Commit 7f4e3b1

Browse files
committed
triton code modify rejection_sampler.py
Signed-off-by: yuxingcyx <[email protected]>
1 parent 242f084 commit 7f4e3b1

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm_ascend/sample/rejection_sampler.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -616,7 +616,7 @@ def rejection_greedy_sample_spec_len_1_triton(
616616
target_argmax_id = tl.load(target_argmax_ptr + offset, mask)
617617
tl.store(output_token_ids_ptr + offset * 2, target_argmax_id, mask)
618618

619-
for pos in tl.arange(0, BLOCK_SIZE):
619+
for pos in tl.range(0, BLOCK_SIZE):
620620
draft_token_id1 = tl.get_element(draft_token_id, (pos, ))
621621
target_argmax1 = tl.get_element(target_argmax_id, (pos, ))
622622
position = block_idx * BLOCK_SIZE + pos

0 commit comments

Comments
 (0)