Skip to content

Commit d75e16f

Browse files
authored
fix ascend awq (#204)
1 parent 67a1e18 commit d75e16f

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

dlinfer/framework/lmdeploy_ext/quants/ascend_awq.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -137,6 +137,7 @@ def AscendMergedAwqLinear__init__(
137137
replicate = tuple(False for _ in all_out_features)
138138

139139
self.split_section_s = all_out_features
140+
self.is_tp = is_tp
140141
elem_per_int = 32 // w_bit
141142
self.split_section_wz = [size // elem_per_int for size in all_out_features]
142143

0 commit comments

Comments
 (0)