Commit 0d8c0f1
[Bugfix] Fix out-of-bounds access to token_id due to uninitialized logprobs (#4248)
### What this PR does / why we need it?
The logprobs_tensor was not initialized before accessing its token_id
member, leading to a crash when tokenizer.decode() is called by passing
a negative token_id
### How was this patch tested?
Constructed an inference request with two prompts and set
SamplingParams(prompt_logprobs=<non-None value>) (e.g.,
prompt_logprobs=1).
After applying the fix (proper initialization of logprobs_tensor), the
same request completed successfully without errors, and the returned
logprobs matched expected values.
- vLLM version: v0.12.0
- vLLM main:
vllm-project/vllm@ad32e3e
Signed-off-by: jiangweixiang <[email protected]>
Co-authored-by: jiangweixiang <[email protected]>
Co-authored-by: Mengqing Cao <[email protected]>1 parent bd8be2e commit 0d8c0f1
1 file changed
+3
-2
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
4276 | 4276 | | |
4277 | 4277 | | |
4278 | 4278 | | |
4279 | | - | |
4280 | | - | |
| 4279 | + | |
| 4280 | + | |
| 4281 | + | |
4281 | 4282 | | |
4282 | 4283 | | |
4283 | 4284 | | |
| |||
0 commit comments