Skip to content

About

SONIC Original checkpoint adapter for reproducible MotionChallenge evaluation.

Resources

Stars

0 stars

Watchers

0 watching

Forks

Latest commit

 

History

39 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

MotionChallenge · sonic-original

G1 29-DoF motion tracking with GPU-batched policy inference and MJWarp simulation. Model source · Checkpoint · Provenance

Run

Use Linux, Python 3.12 and a CUDA GPU. This repository pins Core as its Git submodule; Core pins the simulation and inference dependencies.

git clone --recurse-submodules https://github.com/MotionChallenge-Project/MotionChallenge-sonic-original.git
cd MotionChallenge-sonic-original
uv sync --locked
uv run evaluate.py --dataset lafan --data /path/to/datasets/lafan --device cuda:0
uv run evaluate.py --dataset seed --data /path/to/datasets/seed/g1.tar.gz --device cuda:0

Download LAFAN G1 CSVs or the original BONES-SEED G1 archive and keep the files locally. SEED uses Core's single public inclusion list. The command prepares these local motion files, downloads the public checkpoint and required auxiliary model files, verifies their SHA-256 hashes, converts the weights into the cache, completes evaluation and independently verifies every recorded pose trace on CPU. --data-format lerobot-v3 selects a locally prepared LeRobot v3 dataset.

--cache PATH selects the cache; --output PATH selects the result directory. --weights PATH --offline uses a local original checkpoint. For local SONIC encoder files, add --artifact encoder=/path/to/model_encoder.onnx. The converter extracts the original tensors to safetensors and checks outputs against original ONNX inference. The default world count is min(motion count, 4096): 40 for the LAFAN suite and 4096 for the SEED suite. --slots N overrides it. Inference runs the complete world batch in one forward call. --verify-jobs N controls independent CPU trace verification.

Policy and evaluation

SONIC uses its G1 motion encoder, scalar quantizer and action decoder. The adapter retains the released ten-frame observation history, reference orientation convention and per-motion reset state.

The policy receives joint positions and velocities, root orientation, angular velocity, gravity and its own action history. Actual global position and actual linear velocity are excluded. Motion references supply root/joint information, timing and reference derivatives; the adapter computes its additional features.

Control and scoring run every 20 ms, with four 5 ms physics steps. Contact sliding friction is 1.0 and the Newton solver uses at most 50 iterations. Core precomputes reference FK for scoring and reads actual body poses from the simulator. Each full motion reports success, completion, joint error and MPKPE with world, XY and XY+yaw alignment, for both full-motion and first-failure-prefix scopes.

BONES-SEED evaluation uses a feasibility-filtered subset of the original G1 motion data. Download the original archive; Core applies one public inclusion list of 129,561 motions shared by every model.

Validation files

Current validation results list inference evidence, full dataset scores and clean-run comparisons.

result.json and pose traces are saved to the selected output directory. Independent trace verification checks metrics against the recorded trajectories. A separate clean-cache run and comparison establish reproduction; its dataset-specific report is kept separately from inference admission.

Current evaluation evidence

LAFAN1 full evaluation · BONES-SEED full evaluation

Metric

MPKPE (Mean Per-Keypoint Position Error) measures the 3D Euclidean distance between actual and reference keypoint positions. The protocol defines these keypoints at robot body-frame origins: 14 points for G1. Errors are averaged over keypoints and scoring samples within each motion, then motions are weighted equally. Results report full-motion and first-failure-prefix scores with no alignment, XY alignment, and XY + yaw alignment. XY alignment removes pelvis horizontal translation while retaining height error. Leaderboard values are reported in millimetres (mm).

About

SONIC Original checkpoint adapter for reproducible MotionChallenge evaluation.

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages