Skip to content

Commit 61c0e74

Browse files
committed
Fix FSDP2 params and add test
1 parent b6a9f0b commit 61c0e74

File tree

1 file changed

+0
-1
lines changed

1 file changed

+0
-1
lines changed

src/transformers/training_args.py

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2773,7 +2773,6 @@ def _process_fsdp_args(self):
27732773
# to unexpected behaviour during training, thus throwing error here to prevent it.
27742774
raise ValueError('`sync_module_states` must be `"True"` if `cpu_ram_efficient_loading` is `"True"`')
27752775

2776-
27772776
# we need to set the env here as otherwise we get a warning in accelerate + we need to set it for transformers
27782777
fsdp_plugin_args["cpu_ram_efficient_loading"] = str_to_bool(cpu_ram_efficient_loading)
27792778
os.environ["FSDP_CPU_RAM_EFFICIENT_LOADING"] = cpu_ram_efficient_loading

0 commit comments

Comments
 (0)