Skip to content

Commit 889eb4b

Browse files
debugging
Signed-off-by: Daniel Korzekwa <[email protected]>
1 parent b5de20a commit 889eb4b

File tree

1 file changed

+3
-0
lines changed

1 file changed

+3
-0
lines changed

tests/gpu/torch/prune/plugins/test_mcore_gpt_minitron_pruning.py

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -96,6 +96,9 @@ def _get_model(initialize_megatron=True):
9696
# (get_mcore_gpt_model calls initialize_for_megatron which sets seed=1234)
9797
torch.manual_seed(1234)
9898
torch.cuda.manual_seed_all(1234)
99+
# Enable deterministic behavior for cuDNN
100+
torch.backends.cudnn.deterministic = True
101+
torch.backends.cudnn.benchmark = False
99102

100103
sd = model.state_dict()
101104

0 commit comments

Comments
 (0)