Save periodic LoRA weight checkpoints
This commit is contained in:
@@ -1154,6 +1154,16 @@ it be evaluated on official test `Sessions_1--3`. A second controlled run may
|
||||
omit `--freeze-head` and use `--head-learning-rate 1e-5`; all other settings
|
||||
must remain identical.
|
||||
|
||||
For a continuous five-epoch run, set
|
||||
`TOTAL_STEPS=$((5 * MAX_STEPS))` and pass
|
||||
`--max-steps "${TOTAL_STEPS}" --save-every-steps "${MAX_STEPS}"`. The trainer
|
||||
keeps one AdamW/cosine-scheduler trajectory and writes evaluation-ready
|
||||
`adapter/` plus `turn_head.pt` pairs under `checkpoint-step-MAX_STEPS`,
|
||||
`checkpoint-step-2*MAX_STEPS`, through the fifth epoch. The top-level adapter
|
||||
and head duplicate the final fifth checkpoint. Evaluate all five intermediate
|
||||
checkpoints only on held-out `Session_12`, select one, then run that checkpoint
|
||||
once on `Sessions_1--3`.
|
||||
|
||||
### Frozen-Thinker sparse head-only control
|
||||
|
||||
To determine whether the regression comes from transition-sparse sampling or
|
||||
|
||||
Reference in New Issue
Block a user