Skip to content

feat(WO64/B3): r8 noisy-student synthesis script - #134

Closed
ronaldtse wants to merge 1 commit into
mainfrom
wo64-r8-noisy
Closed

ronaldtse wants to merge 1 commit into
mainfrom
wo64-r8-noisy

Conversation

@ronaldtse

Copy link
Copy Markdown
Contributor

Thin variant of distill_oracle_hf for the r8 chain (WO64): single canonical-teacher decode over the exact run-047 corpus recipe, writing noisy-targets.jsonl to the bucket for the stage-2 retrain. Reuses the proven durable machinery (internal resume, forced bucket syncs) instead of duplicating it.

…lver

Single-teacher (p047) decode over run-047's exact corpus recipe;
teacher output becomes the r8 training target (2.29-DER teacher
refines ~3%-WER QCRI silver). Reuses distill_oracle_hf's durable
decode_arm/build_rows/sync_to_bucket (resume + bucket sync are
canonical there).
@ronaldtse

Copy link
Copy Markdown
Contributor Author

Wrong base: the script imports distill_oracle_hf (the ara campaign machinery), which lives on the training/wo31-wo36-campaign-scripts branch, not main. Reopening against that base.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant