Repository navigation
WF-1 pilots: Thai leading-vowel machinery as shared ruleset + per-map overrides - #261
Merged
Merged
Conversation
…ed ruleset The Thai leading-vowel digraph machinery (เ แ โ ไ ใ precede their consonant but romanize after it, encoded as one C+vowel row per consonant) existed twice: alalc-tha-Thai-Latn-2011 (738 digraph rows) and bgnpcgn-tha-Thai-Latn-2002 (344 rows), with 327 from-strings common to both — 159 byte-identical, 168 differing by convention (ALA-LC c-cedilla/circumflex forms č/ē/ō vs BGN/PCGN plain ch/e/o). New dependency library libs/thai-latn.isc carries those 327 rows (BGN/ PCGN forms) as ruleset leading_vowel_digraphs, one parallel block. bgnpcgn-tha replaces its whole digraph pass with a use of the ruleset plus its 17 map-only rows in the override block; alalc-tha does the same with the 168 ALA-LC forms as child-wins replacements and its 1196 map-only rows as additions. Spec amendment (§4.2.6): pin where O lands — overrides join the expansion's trailing parallel block so the whole expansion shares one longest-match pass; otherwise they append as stage-level rows. Verification: compiled IR before/after is set-identical per pass for both maps (alalc 5 passes, bgnpcgn 9, row multisets equal); all 11,048 golden-capture rows re-transliterated through the refactored corpus show zero new deltas (the only 5 deltas are the known alalc-ell-2010 constraint rows, tracked in interscript-ts#124).
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
ISC-WF-1 corpus pilot (WO16 step 6): the ALA-LC / BGN/PCGN Thai leading-vowel machinery becomes one shared ruleset with per-map overrides.
libs/thai-latn.isc:ruleset leading_vowel_digraphs— the 327 from-strings common toalalc-tha-Thai-Latn-2011(738 digraph rows) andbgnpcgn-tha-Thai-Latn-2002(344 rows): 159 byte-identical rows plus the 168 convention-differing rows in BGN/PCGN form (ALA-LC uses the c-cedilla/circumflex forms č/ē/ō; BGN/PCGN the plain ch/e/o).bgnpcgn-tha-Thai-Latn-2002: its whole digraph pass becomesuse thailatn.leading_vowel_digraphs override { 17 map-only rows }.alalc-tha-Thai-Latn-2011:use ... override { 168 ALA-LC replacement rows + 1196 map-only rows }— child-wins replacement on byte-exact from-equality (§4.2), all in one pass (§4.2.5).Verification