-
Notifications
You must be signed in to change notification settings - Fork 653
[Doc][Example][Bugfix] Elements in local_device_ids should be casted … #3782
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
…to int type before referred. Signed-off-by: paulyu12 <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Code Review
This pull request fixes a bug in the gen_ranktable.py example script where device IDs from the --local-device-ids argument were not converted to integers, causing errors in subsequent arithmetic operations. The fix is correct in its intent. My review includes a suggestion to make the implementation more robust by adding error handling for invalid inputs. This will prevent the script from crashing and provide a more user-friendly error message if a non-integer value is provided.
|
👋 Hi! Thank you for contributing to the vLLM Ascend project. The following points will speed up your PR merge:
If CI fails, you can run linting and testing checks locally according Contributing and Testing. |
|
Except for Gemini's review, LGTM |
…to int type before referred. Signed-off-by: paulyu12 <[email protected]>
|
I've adjusted according to the Gemini's review. |
vllm-project#3782) ### What this PR does / why we need it? It's a tiny bugfix in the `gen_ranktable.py` script. The script is an util to help setup an example case. It is used to prepare a ranktable before disaggregated prefill deployment. Elements in `local_device_ids` list should be casted to `int` type before referred for a MOD math operation. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? No. - vLLM version: v0.11.0 - vLLM main: vllm-project/vllm@c9461e0 --------- Signed-off-by: paulyu12 <[email protected]> Signed-off-by: luolun <[email protected]>
vllm-project#3782) ### What this PR does / why we need it? It's a tiny bugfix in the `gen_ranktable.py` script. The script is an util to help setup an example case. It is used to prepare a ranktable before disaggregated prefill deployment. Elements in `local_device_ids` list should be casted to `int` type before referred for a MOD math operation. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? No. - vLLM version: v0.11.0 - vLLM main: vllm-project/vllm@c9461e0 --------- Signed-off-by: paulyu12 <[email protected]> Signed-off-by: hwhaokun <[email protected]>
vllm-project#3782) ### What this PR does / why we need it? It's a tiny bugfix in the `gen_ranktable.py` script. The script is an util to help setup an example case. It is used to prepare a ranktable before disaggregated prefill deployment. Elements in `local_device_ids` list should be casted to `int` type before referred for a MOD math operation. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? No. - vLLM version: v0.11.0 - vLLM main: vllm-project/vllm@c9461e0 --------- Signed-off-by: paulyu12 <[email protected]> Signed-off-by: nsdie <[email protected]>
vllm-project#3782) ### What this PR does / why we need it? It's a tiny bugfix in the `gen_ranktable.py` script. The script is an util to help setup an example case. It is used to prepare a ranktable before disaggregated prefill deployment. Elements in `local_device_ids` list should be casted to `int` type before referred for a MOD math operation. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? No. - vLLM version: v0.11.0 - vLLM main: vllm-project/vllm@c9461e0 --------- Signed-off-by: paulyu12 <[email protected]>
What this PR does / why we need it?
It's a tiny bugfix in the
gen_ranktable.pyscript. The script is an util to help setup an example case. It is used to prepare a ranktable before disaggregated prefill deployment.Elements in
local_device_idslist should be casted tointtype before referred for a MOD math operation.Does this PR introduce any user-facing change?
No.
How was this patch tested?
No.