Skip to content

Commit 206fe00

Browse files
committed
fix(bug): consider some fused_moe quant_methods do not have group_size attr
Signed-off-by: zhoux77899 <[email protected]>
1 parent 1655a7b commit 206fe00

File tree

1 file changed

+3
-2
lines changed

1 file changed

+3
-2
lines changed

vllm_ascend/quantization/quant_config.py

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -444,8 +444,9 @@ def create_weights(
444444
{"quant_method": FusedMoeWeightScaleSupported.CHANNEL.value})
445445
per_group_param = [
446446
"weight_scale_second", "weight_offset_second", "scale_bias"
447-
] + ["weight_scale", "weight_offset"
448-
] if self.quant_method.group_size > 0 else []
447+
] + ["weight_scale", "weight_offset"] if hasattr(
448+
self.quant_method,
449+
"group_size") and self.quant_method.group_size > 0 else []
449450
dynamic_quant_param = self.quant_method.get_dynamic_quant_param(
450451
num_experts, intermediate_size_per_partition, hidden_size,
451452
params_dtype)

0 commit comments

Comments
 (0)