Repository navigation

Add AutoTP training to rollout weight sync example - #1021

Draft

jinyouzhi wants to merge 3 commits into

deepspeedai:masterfrom

jinyouzhi:autotp-rollout-e2e

Draft

Add AutoTP training to rollout weight sync example#1021
jinyouzhi wants to merge 3 commits into
deepspeedai:masterfrom
jinyouzhi:autotp-rollout-e2e

Commits on Oct 22, 2026
- Add AutoTP training to rollout weight sync example
  
  jinyouzhi
  and
  Copilot
  committed
  1c517a6
- Read unsharded Hugging Face checkpoints in the AutoTP rollout example
  
  jinyouzhi
  and
  Copilot
  committed
  243c0c2
- Release gathered ZeRO-3 parameters before an affine sync
  
  jinyouzhi
  and
  Copilot
  committed
  d2644cb