Repository navigation

All pull requests

Labels (9)Milestones (0)New pull request

Open

(22)

Closed

(2)

[WIP] Adapter: vimgolf-gym
#28zinengtang opened Oct 13, 2026
[Ready for Review] Adapter: AMA-Bench
#27boqiny opened Oct 12, 2026
Use resolved issues in Multi-SWE-bench prompts
#26JinnanDuan opened Oct 11, 2026
[WIP] Adapter: healthbench-professional
#24Mike-7777777 opened Oct 8, 2026
fix(swesmith): preserve trailing blank lines in golden patches
#23mightma opened Oct 8, 2026
feat(swebench): support generating arm64 tasks
#22mightma opened Oct 8, 2026
Migrate RedCode-Exec adapter and matched-parity evidence
#21DabDans opened Oct 8, 2026
[WIP] Migrate GitGoodBench merge adapter (reference validation)
#20DabDans opened Oct 8, 2026
[Ready for Review] Adapter: SWE-bench Multimodal
#19joe1chief opened Oct 7, 2026
1
[Ready for Review] Adapter: BioCoder
#18joe1chief opened Oct 7, 2026
1
[Ready for Review] Adapter: SciCode-Verified
#17joe1chief opened Oct 7, 2026
1
swebench, swebench_multilingual, swesmith: cap swebench below 5
#15Mike-7777777 opened Oct 7, 2026
Itbench aa adapter
#14DanielBlei opened Oct 7, 2026
[Ready for review] Adapter: swe-rebench
#13delphikettle opened Oct 7, 2026
fix(tau3): migrate authoritative runtime evaluation
#11zimuwang-real opened Oct 7, 2026
swegym: cap swebench below 5 and name the published image in task.toml
#10Mike-7777777 opened Oct 7, 2026
[WIP] Adapter: DiscoverPhysics
#9Randl opened Oct 6, 2026
[Ready for Review] Adapter: contractbench
#8JeremyJC67 opened Oct 6, 2026
[WIP] Adapter: JaxBench
#6liulehui opened Oct 4, 20263 of 6 tasks
[WIP] Adapter: ResearchRubrics
#5CatherineYin1213 opened Oct 3, 20263 of 6 tasks
Align adapter CI and documentation around a versioned contract
#3anson627 opened Sep 30, 2026
Pin adapter reviews to the validated PR revision
#2anson627 opened Sep 30, 2026
3

Pull requests