-
Notifications
You must be signed in to change notification settings - Fork 624
[MM][Model] Remove Qwen2-VL modeling files #4534
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
👋 Hi! Thank you for contributing to the vLLM Ascend project. The following points will speed up your PR merge:
If CI fails, you can run linting and testing checks locally according Contributing and Testing. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Code Review
This pull request aims to unify the Qwen2-VL and Qwen2.5-VL modeling files by removing the dedicated qwen2_vl.py and merging its Ascend-specific optimizations into patch_qwen2_5_vl.py. The overall approach is sound, but I've identified a critical issue: a test file for the removed code has not been deleted, which will cause the build to fail. Additionally, there's some dead code in the patch file that should be cleaned up to improve maintainability.
Signed-off-by: shen-shanshan <[email protected]>
Signed-off-by: shen-shanshan <[email protected]>
Signed-off-by: shen-shanshan <[email protected]>
Signed-off-by: shen-shanshan <[email protected]>
Signed-off-by: shen-shanshan <[email protected]>
Signed-off-by: shen-shanshan <[email protected]>
|
The CI failed due to OOM: tests/e2e/singlecard/spec_decode_v1/test_v1_spec_decode.py::test_ngram_correctness |
### What this PR does / why we need it? Fix Qwen2.5-Omni-7B accuarcy test issue:#4480 Depends on : #4534 - vLLM version: v0.11.2 - vLLM main: https://github.com/vllm-project/vllm/commit/v0.11.2 Signed-off-by: hfadzxy <[email protected]>
### What this PR does / why we need it? Following vllm-project#4349, remove Qwen2-VL modeling files. - vLLM version: v0.11.2 - vLLM main: https://github.com/vllm-project/vllm/commit/v0.11.2 --------- Signed-off-by: shen-shanshan <[email protected]>
### What this PR does / why we need it? Fix Qwen2.5-Omni-7B accuarcy test issue:vllm-project#4480 Depends on : vllm-project#4534 - vLLM version: v0.11.2 - vLLM main: https://github.com/vllm-project/vllm/commit/v0.11.2 Signed-off-by: hfadzxy <[email protected]>
### What this PR does / why we need it? Following vllm-project#4349, remove Qwen2-VL modeling files. - vLLM version: v0.11.2 - vLLM main: https://github.com/vllm-project/vllm/commit/v0.11.2 --------- Signed-off-by: shen-shanshan <[email protected]> Signed-off-by: Che Ruan <[email protected]>
### What this PR does / why we need it? Fix Qwen2.5-Omni-7B accuarcy test issue:vllm-project#4480 Depends on : vllm-project#4534 - vLLM version: v0.11.2 - vLLM main: https://github.com/vllm-project/vllm/commit/v0.11.2 Signed-off-by: hfadzxy <[email protected]> Signed-off-by: Che Ruan <[email protected]>
### What this PR does / why we need it? Following vllm-project#4349, remove Qwen2-VL modeling files. - vLLM version: v0.11.2 - vLLM main: https://github.com/vllm-project/vllm/commit/v0.11.2 --------- Signed-off-by: shen-shanshan <[email protected]> Signed-off-by: Che Ruan <[email protected]>
### What this PR does / why we need it? Fix Qwen2.5-Omni-7B accuarcy test issue:vllm-project#4480 Depends on : vllm-project#4534 - vLLM version: v0.11.2 - vLLM main: https://github.com/vllm-project/vllm/commit/v0.11.2 Signed-off-by: hfadzxy <[email protected]> Signed-off-by: Che Ruan <[email protected]>
What this PR does / why we need it?
Following #4349, remove Qwen2-VL modeling files.
Does this PR introduce any user-facing change?
How was this patch tested?