Skip to content

Commit 7027439

Browse files
author
刘哲续
committed
modify nz in bf16
Signed-off-by: 刘哲续 <[email protected]>
1 parent a462fcd commit 7027439

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm_ascend/ops/common_fused_moe.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -89,7 +89,7 @@ def process_weights_after_loading(self, layer):
8989
w2_data = self._maybe_pad_weight(layer.w2_weight.data)
9090
layer.w2_weight = torch.nn.Parameter(w2_data, requires_grad=False)
9191

92-
if not is_310p() and is_enable_nz(layer.w13_weight.data.type):
92+
if not is_310p() and is_enable_nz(layer.w13_weight.data.dtype):
9393
layer.w13_weight.data = torch_npu.npu_format_cast(
9494
layer.w13_weight.data, ACL_FORMAT_FRACTAL_NZ)
9595
layer.w2_weight.data = torch_npu.npu_format_cast(

0 commit comments

Comments
 (0)