Commit a5163c8
[Feat]enable sfa cp for dsv3.2 (#4702)
### What this PR does / why we need it?
RFC: vllm-project/vllm#30055
### How was this patch tested?
1. enable flashcommon1
export VLLM_ASCEND_ENABLE_FLASHCOMM1=1
2. enable sfa-cp
--additional-config '{ "enable_sfa_cp": true }' \
- vLLM version: v0.12.0
- vLLM main:
vllm-project/vllm@ad32e3e
Signed-off-by: AlvisGong <[email protected]>
Co-authored-by: clrs97 <[email protected]>
Co-authored-by: zzhx1 <[email protected]>
Co-authored-by: hwhaokun <[email protected]>
Co-authored-by: wangxiyuan <[email protected]>1 parent 4bd1030 commit a5163c8
File tree
4 files changed
+565
-55
lines changed- vllm_ascend
- attention
- distributed
- ops
4 files changed
+565
-55
lines changed
0 commit comments