Skip to content

Commit 9526a0d

Browse files
debugging
Signed-off-by: Daniel Korzekwa <[email protected]>
1 parent 675dca4 commit 9526a0d

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

tests/gpu/torch/prune/plugins/test_mcore_gpt_minitron_pruning.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -87,6 +87,7 @@ def _get_model(initialize_megatron=True):
8787
normalization=normalization,
8888
num_layers_in_first_pipeline_stage=num_layers_in_first_pipeline_stage,
8989
num_layers_in_last_pipeline_stage=num_layers_in_last_pipeline_stage,
90+
use_cpu_initialization=True, # Ensure deterministic weight init across CUDA versions
9091
).cuda()
9192
return model
9293

0 commit comments

Comments
 (0)