From 9d168555d12be34bb95989d8329d56203eac8a57 Mon Sep 17 00:00:00 2001 From: Ronald Tse Date: Mon, 19 Oct 2026 07:04:01 +0800 Subject: [PATCH 1/5] release: urd-g2p-base-1.0 card (research-only, 12,699-row split) + RESULTS anchor --- cards/urd-g2p-base-1.0.md | 21 ++++++++++++++++++--- docs/RESULTS.md | 9 +++++++++ 2 files changed, 27 insertions(+), 3 deletions(-) diff --git a/cards/urd-g2p-base-1.0.md b/cards/urd-g2p-base-1.0.md index 432b256e..9109207f 100644 --- a/cards/urd-g2p-base-1.0.md +++ b/cards/urd-g2p-base-1.0.md @@ -3,8 +3,23 @@ Urdu grapheme-to-phoneme, base tier (run-059): byt5-base seq2seq on the full 610K-pair humair025 corpus. IMF v1 fp32 (2.16 GB). -## Metrics (full 11,940-row test split, raw char CER) +## Metrics (full 12,699-row test split, raw char CER, row-mean) CER **15.65** (urd-g2p-1.0 small tier: 15.78 baseline) — gate PASSED. -Normalized CER 10.75. Shipped-bytes parity: ONNX fp32 vs torch -cer_delta 0.024 on the 300-row sample, 70% row-exact. +Normalized CER 10.75. + +## Artifact parity (WO51 contract) + +Single-row greedy decode, the runtime's actual decode mode: 500-row +probe recorded in the artifact metadata (the pre-WO51 batched +harness numbers were invalid — batched decode without an attention +mask measures nothing). + +## License — RESEARCH-ONLY + +The training corpus (humair025/urdu-g2p-dictionary) is +**non-commercial** (verified from the dataset card, +github.com/humair-m/urdu-g2p LICENSE). These weights are therefore +released **for research use only** — owner decision 2026-10-18 +(recorded in `corpora/urd-g2p-dict.yaml` license_review). Code: +BSD-3-Clause. diff --git a/docs/RESULTS.md b/docs/RESULTS.md index 2aff3425..2c749201 100644 --- a/docs/RESULTS.md +++ b/docs/RESULTS.md @@ -2357,3 +2357,12 @@ parity under the WO51 single-row contract: ONNX fp16 CER 3.64, 500/500 rows identical to torch, three-way bf16/fp32/ORT agreement 1.0. Shipped runtime reproduces 12/12 frozen conformance vectors byte-exactly. Data: 573,130 pairs (urd-dia registry, sha256-pinned). + +## run-059 urd-g2p base gate pass + +Gate: full 12,699-row test split, raw char CER, row-mean — **15.65** +(beat urd-g2p-1.0 small tier 15.78); normalized CER 10.75. Data: +610K pairs (humair025/urdu-g2p-dictionary via rababa-urdu/data, +sha256-pinned in the urd-g2p-dict registry). Training data is +non-commercial: weights ship RESEARCH-ONLY (owner decision +2026-10-18). From 5a378bfc1ea10e1d06132cd367f0239183393611 Mon Sep 17 00:00:00 2001 From: Ronald Tse Date: Mon, 19 Oct 2026 07:13:10 +0800 Subject: [PATCH 2/5] =?UTF-8?q?release:=20urd-g2p=20entry=20=E2=80=94=20co?= =?UTF-8?q?rrect=2012,699-row=20split,=20measured=20500-sample=20parity=20?= =?UTF-8?q?(delta=200.0)?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- models.yaml | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/models.yaml b/models.yaml index f2be1d1c..76955976 100644 --- a/models.yaml +++ b/models.yaml @@ -456,9 +456,9 @@ models: sha256: 14c2ebf81999f24b624c7f3c9d223a16c36fee465863785b6ceea88b3d1f371a size: 2159598592 metrics: - - {name: cer, value: 15.65, protocol: "greedy decode, full 11940-row test split (WO37 protocol)", source: interscript/interscript-models docs/RESULTS.md#run-059-urd-g2p-base-gate-pass} - - {name: cer_normalized, value: 10.75, protocol: "greedy decode, full 11940-row test split (WO37 protocol)", source: interscript/interscript-models docs/RESULTS.md#run-059-urd-g2p-base-gate-pass} - parity: {samples: 300, cer_delta: 0.024} + - {name: cer, value: 15.65, protocol: "greedy decode, full 12699-row test split, row-mean", source: interscript/interscript-models docs/RESULTS.md#run-059-urd-g2p-base-gate-pass} + - {name: cer_normalized, value: 10.75, protocol: "greedy decode, full 12699-row test split, row-mean", source: interscript/interscript-models docs/RESULTS.md#run-059-urd-g2p-base-gate-pass} + parity: {samples: 500, cer_delta: 0.0} license: BSD-3-Clause ara-diac-news-1.1: task: diacritization From cf91566261a69d7919982795ca5d34f1a74cea84 Mon Sep 17 00:00:00 2001 From: Ronald Tse Date: Mon, 19 Oct 2026 07:18:26 +0800 Subject: [PATCH 3/5] =?UTF-8?q?release:=20urd-g2p=20restamp=20=E2=80=94=20?= =?UTF-8?q?repacked=20artifact=20sha/size?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- models.yaml | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/models.yaml b/models.yaml index 76955976..b19f7514 100644 --- a/models.yaml +++ b/models.yaml @@ -453,8 +453,8 @@ models: precision: fp32 filename: urd-g2p-base-1.0.zip url: https://github.com/interscript/interscript-models/releases/download/urd-g2p-base-1.0/urd-g2p-base-1.0.zip - sha256: 14c2ebf81999f24b624c7f3c9d223a16c36fee465863785b6ceea88b3d1f371a - size: 2159598592 + sha256: d3e35dd435bf18fedec03d4a15bba097fca743737b729312fa08f4fdcac24282 + size: 2159598918 metrics: - {name: cer, value: 15.65, protocol: "greedy decode, full 12699-row test split, row-mean", source: interscript/interscript-models docs/RESULTS.md#run-059-urd-g2p-base-gate-pass} - {name: cer_normalized, value: 10.75, protocol: "greedy decode, full 12699-row test split, row-mean", source: interscript/interscript-models docs/RESULTS.md#run-059-urd-g2p-base-gate-pass} From 2ce23678ff8544524be4c1948d29d374e0389799 Mon Sep 17 00:00:00 2001 From: Ronald Tse Date: Mon, 19 Oct 2026 07:19:01 +0800 Subject: [PATCH 4/5] release: urd-g2p-base-1.0 (fp32, parity cer_delta 0.0pp on 500 samples) --- models.yaml | 22 +++++++++------ .../urd-g2p-base-1.0.metadata.yaml | 28 +++++++++++++++++++ 2 files changed, 42 insertions(+), 8 deletions(-) create mode 100644 models/urd-g2p-base/urd-g2p-base-1.0.metadata.yaml diff --git a/models.yaml b/models.yaml index f2be1d1c..9f99590a 100644 --- a/models.yaml +++ b/models.yaml @@ -451,14 +451,20 @@ models: task: g2p scripts: [Arab, IPA] precision: fp32 - filename: urd-g2p-base-1.0.zip - url: https://github.com/interscript/interscript-models/releases/download/urd-g2p-base-1.0/urd-g2p-base-1.0.zip - sha256: 14c2ebf81999f24b624c7f3c9d223a16c36fee465863785b6ceea88b3d1f371a - size: 2159598592 - metrics: - - {name: cer, value: 15.65, protocol: "greedy decode, full 11940-row test split (WO37 protocol)", source: interscript/interscript-models docs/RESULTS.md#run-059-urd-g2p-base-gate-pass} - - {name: cer_normalized, value: 10.75, protocol: "greedy decode, full 11940-row test split (WO37 protocol)", source: interscript/interscript-models docs/RESULTS.md#run-059-urd-g2p-base-gate-pass} - parity: {samples: 300, cer_delta: 0.024} + filename: urd-g2p-base-1.0-fp32.zip + parts: + - url: https://github.com/interscript/interscript-models/releases/download/urd-g2p-base-1.0/urd-g2p-base-1.0-fp32.zip.part-00 + sha256: e2ffe9bf8114e26b731d4469a262b2d17d0a8f6ceced611c641e7d69bca804de + size: 1500000000 + - url: https://github.com/interscript/interscript-models/releases/download/urd-g2p-base-1.0/urd-g2p-base-1.0-fp32.zip.part-01 + sha256: 72695f23f42f8eef9d81c8284d02cbf743986fd836aa1568cf11a08fc75acd36 + size: 659598918 + sha256: d3e35dd435bf18fedec03d4a15bba097fca743737b729312fa08f4fdcac24282 + size: 2159598918 + metrics: + - {name: cer, value: 15.65, source: interscript/interscript-models docs/RESULTS.md#run-059-urd-g2p-base-gate-pass} + - {name: cer_normalized, value: 10.75, source: interscript/interscript-models docs/RESULTS.md#run-059-urd-g2p-base-gate-pass} + parity: {samples: 500, cer_delta: 0.0} license: BSD-3-Clause ara-diac-news-1.1: task: diacritization diff --git a/models/urd-g2p-base/urd-g2p-base-1.0.metadata.yaml b/models/urd-g2p-base/urd-g2p-base-1.0.metadata.yaml new file mode 100644 index 00000000..41992da2 --- /dev/null +++ b/models/urd-g2p-base/urd-g2p-base-1.0.metadata.yaml @@ -0,0 +1,28 @@ +format: imf-v1 +id: urd-g2p-base-1.0 +task: g2p +source_script: Arab +target: IPA +tokenizer: bytes +opset: 14 +decoder: plain +precision: fp32 +license: BSD-3-Clause +trained_from: byt5-base, 610K humair025 pairs, run-059 (TODO.sota WO38) +metrics: +- name: cer + value: 15.65 + source: interscript/interscript-models docs/RESULTS.md#run-059-urd-g2p-base-gate-pass + protocol: greedy decode, full 12699-row test split, row-mean CER (WO51 single-row + artifact contract) +- name: cer_normalized + value: 10.75 + source: interscript/interscript-models docs/RESULTS.md#run-059-urd-g2p-base-gate-pass + protocol: greedy decode, full 12699-row test split, row-mean CER (WO51 single-row + artifact contract) +sha256: + encoder.onnx: 34263b20c4aef190ec8b5b0a68be04f684147a7c2e954e9f89f618525dd835bb + decoder.onnx: 0a21fdbb9783e2aed6d75c63370036d9bb2665d26404ed627bf5883b2c39e953 +parity: + samples: 500 + cer_delta: 0.0 From 019cb8dfc966f8ad256e979adcbf45fb9f38b71d Mon Sep 17 00:00:00 2001 From: Ronald Tse Date: Mon, 19 Oct 2026 07:23:19 +0800 Subject: [PATCH 5/5] =?UTF-8?q?release:=20urd-g2p=20entry=20=E2=80=94=20pa?= =?UTF-8?q?rts=20contract=20(verified=20assembly),=20research-only=20note?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- models.yaml | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/models.yaml b/models.yaml index 9f99590a..643cf2e3 100644 --- a/models.yaml +++ b/models.yaml @@ -462,10 +462,11 @@ models: sha256: d3e35dd435bf18fedec03d4a15bba097fca743737b729312fa08f4fdcac24282 size: 2159598918 metrics: - - {name: cer, value: 15.65, source: interscript/interscript-models docs/RESULTS.md#run-059-urd-g2p-base-gate-pass} - - {name: cer_normalized, value: 10.75, source: interscript/interscript-models docs/RESULTS.md#run-059-urd-g2p-base-gate-pass} + - {name: cer, value: 15.65, protocol: "greedy decode, full 12699-row test split, row-mean", source: interscript/interscript-models docs/RESULTS.md#run-059-urd-g2p-base-gate-pass} + - {name: cer_normalized, value: 10.75, protocol: "greedy decode, full 12699-row test split, row-mean", source: interscript/interscript-models docs/RESULTS.md#run-059-urd-g2p-base-gate-pass} parity: {samples: 500, cer_delta: 0.0} license: BSD-3-Clause + license_note: RESEARCH-ONLY — non-commercial training data (owner-approved 2026-10-18; see card) ara-diac-news-1.1: task: diacritization scripts: [Arab, Arab]