From b62b66393aa611fc8b111d50182a03bf0ee45d8d Mon Sep 17 00:00:00 2001
From: Ronald Tse <ronald.tse@gmail.com>
Date: Thu, 22 Oct 2026 22:31:43 +0800
Subject: [PATCH] =?UTF-8?q?data(WO67):=20tha-phonemic-v3=20=E2=80=94=20130?=
 =?UTF-8?q?,906=20train=20pairs,=20wiki=20tier=20dual-engine=20validated?=
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit

Wiki tier: 120k thwiki articles, frequency-filtered vocab, readings
from two independent deterministic engines; only dual-agreement rows
ship (61,561 of 61,953 types; 100.0% agreement on the 40,624 shared
words). Only novel types (20,937) join train — v2's dev/test are
byte-identical, so v2-arm vs v3-arm is a controlled comparison. No
LLM teacher anywhere.
---
 corpora/tha-phonemic-v3.yaml | 21 +++++++++++++++++++++
 1 file changed, 21 insertions(+)
 create mode 100644 corpora/tha-phonemic-v3.yaml

diff --git a/corpora/tha-phonemic-v3.yaml b/corpora/tha-phonemic-v3.yaml
new file mode 100644
index 00000000..006b0ea0
--- /dev/null
+++ b/corpora/tha-phonemic-v3.yaml
@@ -0,0 +1,21 @@
+id: tha-phonemic-v3
+task: g2p
+sources:
+  # v3 = v2 (three Apache-2.0 pythainlp lexicons x royin 5.3.5) + the
+  # wiki self-expansion tier: 120k Thai Wikipedia articles (CC-BY-SA),
+  # frequency-filtered vocabulary, readings cross-validated by TWO
+  # independent deterministic engines (pythainlp royin + tltk th2ipa);
+  # only dual-engine-agreement rows ship. On the 40,624 shared words
+  # the engines agree 100.0% — the pipeline is validated by engine
+  # independence. Only novel types join train (20,937); v2's dev/test
+  # splits are byte-identical, so v2-arm vs v3-arm numbers are directly
+  # comparable. No LLM teacher anywhere.
+  - kind: bucket
+    id: Interscript/isx-training/run-080-thai-lexicon-v3
+    revision: run-080-thai-lexicon-v3
+    license: Apache-2.0
+    mount: /data-tha
+splits:
+  train: {path: tha-phonemic-v3-train.jsonl, rows: 130906, sha256: ac0cbea1506550a9596f01720f970f3442d53689870ce8c1f73d1a67f38d0ccb}
+  dev: {path: tha-phonemic-v3-dev.jsonl, rows: 1223, sha256: ed3e193ee0a99df255f588e46e735a8a45f42bb9829f29f2bf7734752d155106}
+  test: {path: tha-phonemic-v3-test.jsonl, rows: 11119, sha256: e0e58034365324ba2585024ad3a7737f3380a8974d06d30aae9d489e5ca342da}