diff --git a/TODO.impl/03-headwise-muon.md b/TODO.impl/03-headwise-muon.md index 92c9b96..1e792e2 100644 --- a/TODO.impl/03-headwise-muon.md +++ b/TODO.impl/03-headwise-muon.md @@ -32,6 +32,14 @@ not an architecture change — single-variable, cheap to ablate. - [ ] Flag-on path exercised end-to-end in a smoke run - [ ] TODO.arabic/18 updated to point here +## VERDICT (2026-10-01): NEGATIVE — separated. 4.8164 vs 2.1's 4.5701 + +Full-set windowed protocol, teacher 2.2890 reproduced exactly, labels +e70ce991. Paired between-students bootstrap on final_preds: delta ++0.2267pp, CI95 [+0.016, +0.411], p=0.017. Head-wise Muon (positive +at DeepSeek's 671B) is significantly HARMFUL on a 300M byte-student +distillation — scale-boundary recorded. 2.1 stands. + ## Status - [x] Module built (gpu/muon.py: add_headwise_group, per-slice diff --git a/TODO.impl/06-sinkhorn-update.md b/TODO.impl/06-sinkhorn-update.md index 7718d56..1bb8233 100644 --- a/TODO.impl/06-sinkhorn-update.md +++ b/TODO.impl/06-sinkhorn-update.md @@ -34,6 +34,13 @@ carries to the row/col normalizations here if magnitudes get small). - [ ] Spec entry (off by default) for the optional measurement run - [ ] No change to any shipped run's reproducibility +## VERDICT (2026-10-01): FLAT — 4.5547, not separated from 2.1's 4.5701 + +Paired delta -0.0903pp, CI95 [-0.267, +0.069], p=0.858. The +Sinkhorn-balanced embedding update is indistinguishable from AdamW on +the tied tables at this scale. The module stands (Engram side-opt); +the recipe lever is closed. + ## Status - [x] Implementation (gpu/sinkhorn_update.py: SinkhornUpdate +