Issues

• Profiling categories need to be updated for recent free-threading builds

  faster-cpython/bench_runner#457 · Filter by author mdboom opened on Jun 25, 2025

• Mirroring to public seems to fail more often than not lately

  faster-cpython/bench_runner#455 · Filter by author mdboom opened on Jun 23, 2025

• Re-running a base doesn't always overwrite any existing results

  faster-cpython/bench_runner#452 · Filter by author mdboom opened on Jun 20, 2025

• Do compilation on GitHub-hosted runners, transfer as artifacts to self-hosted runners for benchmarking

  faster-cpython/bench_runner#446 · Filter by author mdboom opened on Jun 12, 2025
  1

  

• Move analysis tools (such as plotting) to pyperf

  faster-cpython/bench_runner#380 · Filter by author mdboom opened on Mar 26, 2025
  3

• Remove support for benchmarking with the Tier 2 interpreter

  faster-cpython/bench_runner#357 · Filter by author mdboom opened on Feb 11, 2025
  1

  

• Use the new perf_record hook in pyperf when doing a perf run

  faster-cpython/bench_runner#353 · Filter by author mdboom opened on Feb 5, 2025
  

• Generated violin plots sometimes cannot be rendered inline in GitHub

  faster-cpython/bench_runner#349 · Filter by author mpage opened on Jan 23, 2025
  1

• Benchmark runners may commit results that contain merge conflicts

  faster-cpython/bench_runner#323 · Filter by author mpage opened on Dec 23, 2024
  3

• Run all benchmarks, even ignored ones, on weekly builds

  faster-cpython/bench_runner#320 · Filter by author mdboom opened on Dec 18, 2024
  1

• Reduce time spent in each benchmark

  faster-cpython/bench_runner#318 · Filter by author mdboom opened on Dec 11, 2024
  5

• Investigate ways to speed up venv creation

  faster-cpython/bench_runner#317 · Filter by author mdboom opened on Dec 11, 2024
  10

• Collect pystats in subprocesses

  faster-cpython/bench_runner#263 · Filter by author mdboom opened on Sep 5, 2024
  4

  

• Self hosted runners running out of disk space

  faster-cpython/bench_runner#244 · Filter by author mdboom opened on Aug 1, 2024
  2

  

• Allow for individually selecting machines

  faster-cpython/bench_runner#185 · Filter by author mdboom opened on May 3, 2024
  5

• Fix benchmarks that don't currently run on CPython main

  faster-cpython/bench_runner#145 · Filter by author mdboom opened on Mar 5, 2024
  1

• Produce Github Pages, so we can do better than Github code browsing for a UI

  faster-cpython/bench_runner#85 · Filter by author mdboom opened on Nov 16, 2023

• Consider including warmups in the timings

  faster-cpython/bench_runner#61 · Filter by author mdboom opened on Oct 26, 2023