Skip to content

Commit ea07cad

Browse files
Frankstein73dest1n1s
authored andcommitted
feat(trainer): add some new extra log info for mixcoder
1 parent 6a30e5e commit ea07cad

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

src/lm_saes/trainer.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -273,7 +273,7 @@ def fit(
273273
activation_in, activation_out = batch[sae.cfg.hook_point_in], batch[sae.cfg.hook_point_out]
274274

275275
if self.wandb_logger is not None:
276-
self._log(sae, log_info, {"input": activation_in, "output": activation_out})
276+
self._log(sae, log_info, {"input": activation_in, "output": activation_out, "tokens": batch["tokens"]})
277277

278278
if eval_fn is not None and (self.cur_step + 1) % self.cfg.eval_frequency == 0:
279279
eval_fn(sae)

0 commit comments

Comments
 (0)