From b4fd632888b4e77cdd5a81e949ba9c4120f906af Mon Sep 17 00:00:00 2001 From: Ronald Tse Date: Fri, 30 Oct 2026 18:43:54 +0800 Subject: [PATCH] =?UTF-8?q?docs:=20WO68=20=E2=80=94=20expansion=20stage=20?= =?UTF-8?q?B=20negative=20(target-surface=20mis-design),=20B2=20corrected?= =?UTF-8?q?=20run?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- TODO.sota/68-b7-khmer-lexicon.md | 27 +++++++++++++++++++++++++++ 1 file changed, 27 insertions(+) diff --git a/TODO.sota/68-b7-khmer-lexicon.md b/TODO.sota/68-b7-khmer-lexicon.md index 1aa95c0..db8af9f 100644 --- a/TODO.sota/68-b7-khmer-lexicon.md +++ b/TODO.sota/68-b7-khmer-lexicon.md @@ -118,3 +118,30 @@ retrains; the Khmer regime (tiny gold, huge unlabeled) is the case weak supervision exists for, with held-out validation mandatory against the WO64 correlated-teacher negative. This path makes CER < 15 reachable without SEAlang / Chuon Nath. + + +### Expansion attempt 2 — stage A done, stage B negative (mis-design), B2 in flight (2026-10-30) + +SBBIC 75,039-word list labeled with the shipped khm-phonemic-1.0 teacher +(house runtime, checkpointed rotating parts): **73,954 labels** persisted +(bucket khmer-expansion/sbbic-labeled.jsonl, 4.56 MB; 10,046 resume dupes +dropped; 1,038 unique words dropped by the labeler's empty-output guard — +words where the teacher emits nothing; 1.4%, acceptable). + +**Stage B NEGATIVE — an artifact of target-convention mismatch** (my +script bug, recorded so it is never re-read as evidence): it trained on +the teacher's Latin romanizations (SBBIC weak labels) but evaluated +against the Chuon Nath IPA holdout. CER 0.735 / EM 0 vs the 0.245 +reference measures the Latin-vs-IPA convention gap, not expansion value. +NO_BETTER_THAN_TEACHER from that run carries no information. + +**Stage B2 (corrected, running as run-082d-khm-expansion2)**: matched +surface — SBBIC weak Latin labels + the translit corpus train anchor +(exact run-081 protocol: sorted pairs, seed-42 shuffle, 5/5/90), with +translit words dropped from the weak set (contamination control). The +teacher is scored on the IDENTICAL 895-row translit test split in-job +(house runtime on the shipped artifact), so the verdict is +student-vs-teacher on the same rows and surface. Gate: student CER < +teacher CER on that split -> EXPANSION_PAYS. Note the translit test's +anchor CER band is ~27.4 (run-081 reproduction); the teacher's own CER +on the same rows is the number that matters.