From ec752fdce902cb173b893370659fed45c99573b8 Mon Sep 17 00:00:00 2001 From: Ronald Tse Date: Thu, 22 Oct 2026 20:50:38 +0800 Subject: [PATCH] =?UTF-8?q?docs(WO64):=20r8=20stage-2=20interim=20verdict?= =?UTF-8?q?=20=E2=80=94=20DER-CE=207.13,=20negative;=20oepoch-0=20control?= =?UTF-8?q?=20queued?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- TODO.sota/64-b3-arabic-sota.md | 10 ++++++++++ 1 file changed, 10 insertions(+) diff --git a/TODO.sota/64-b3-arabic-sota.md b/TODO.sota/64-b3-arabic-sota.md index cbf6e79a..b53de9c2 100644 --- a/TODO.sota/64-b3-arabic-sota.md +++ b/TODO.sota/64-b3-arabic-sota.md @@ -1,5 +1,15 @@ # WO64 — B3: Arabic to external SOTA (DER < 2.0, WikiNews < 8) +**Stage-2 verdict (2026-10-22, INTERIM — oepoch-0 control pending):** +the r8 noisy-student continuation finished all 36,321 steps (loss +0.001-0.003) but scores **DER-CE 7.13** on the SadeedDiac-25 protocol +(1,200 paragraphs, interscript-ml-tools scoring) — worse than the v1 +lineage (teacher 2.29, rung-2.0 4.82, rung-2.1 4.57) and far off the +< 2.0 target. Suspected cause: the continuation overfit the +oracle-relabeled targets (suspiciously low train loss + eval +regression). oepoch-0 (end of continuation-epoch 1) eval queued as the +control; the r8 student line ships NOTHING at this number. + Status: IN_PROGRESS (r8 stage 2 training 2026-10-22, stage-3 SadeedDiac eval auto-chained; VRR closure = WO81) Goal: SadeedDiac DER < 2.0 (canonical 2.29), WikiNews multiref WER < 8 (news specialist 8.85). VRR reported.