Skip to content

About

Drop-in C++ accelerator for the rectpack 2D packing library: identical output, 5x to 246x faster.

Topics

Resources

Contributing

Security policy

Stars

0 stars

Watchers

0 watching

Forks

Repository files navigation

fastrectpack

PyPI ci wheels License: Apache-2.0 Python 3.9 to 3.15

A drop-in accelerator for rectpack, the pure-Python 2D rectangle packing library. The MaxRects packing algorithms are re-implemented in C++17 and produce exactly the same packings as the original, 5x to 246x faster on the 14 integer benchmark workloads and more on large single-bin jobs. Sizes can be Python ints, floats, numpy.float64 or numpy.int64.

# before
from rectpack import newPacker
# after: nothing else changes
from fastrectpack import newPacker

Headline numbers

Default newPacker() settings. Times are the best recorded run; full method and all 14 cases are in BENCHMARKS.md.

Workload Rectangles Original rectpack Pure-Python fixes only fastrectpack (C++) Speedup
random sizes 1,000 3.525 s 0.473 s 0.0144 s 246x
random sizes 5,000 21.123 s 3.738 s 0.1364 s 155x
few large, many small 1,000 1.360 s 0.243 s 0.0102 s 133x
sprite sizes 2,000 1.500 s 0.322 s 0.0177 s 85x
sheet cutting, 100 bins 2,000 0.415 s 0.214 s 0.0780 s 5x

Two things to read from this table:

  • Part of the win needs no C++. A better algorithm in plain Python gives 1.7x to 7.5x on its own (the "Pure-Python fixes only" column). The C++ port supplies the rest.
  • The gain depends on the workload. Jobs that spread rectangles over many bins gain about 5x, because the bin-selection loop is still Python. See "What is not faster" below.

Float and numpy sizes (new in 0.2.0)

One bin, MaxRectsBlsf, no rotation: the settings the gdsfactory chip-layout package uses, which passes integer rectangle sizes and a numpy.float64 bin size. Best of 7 interleaved rounds (3 at 1,000 rectangles).

Input Rectangles Original rectpack fastrectpack (C++) Speedup
int rectangles, numpy.float64 bin (gdsfactory) 300 0.633 s 0.0022 s 284x
int rectangles, numpy.float64 bin (gdsfactory) 1,000 20.612 s 0.0173 s 1193x
float rectangles and bin 1,000 20.272 s 0.0148 s 1374x
numpy.int64 rectangles, int bin 1,000 27.063 s 0.0156 s 1734x

The output is identical, including the type of every number. These ratios are larger than the ones above because everything goes into a single bin, where the original's cost grows fastest. gdsfactory's own _pack_single_bin function, run unmodified with fastrectpack in place of rectpack, returned identical results 12x (50 rectangles) to 335x (500 rectangles) faster, timed once each.

The benchmark machine is a laptop that drops into slow phases (probably thermal throttling), so absolute seconds vary by up to about 2.3x. Best-time speedup ratios agreed to roughly 10% between full runs.

Dumbbell chart of the speedup over the original rectpack for 14 workloads, log scale. Pure-Python fixes alone give 1.7x to 7.5x; the C++ version gives 5x to 246x, with output identical in every case. Jobs that spread rectangles over many bins gain about 5x. The same numbers are in the tables in this README and in BENCHMARKS.md.

Install

pip install fastrectpack

Prebuilt wheels cover CPython 3.9 to 3.15 on Linux (x86_64 and ARM64, both glibc and Alpine/musl), Windows x86_64 and macOS (Apple silicon and Intel). Anything else (Windows on ARM, 32-bit systems, free-threaded Python builds) is untested and builds from the source distribution, which needs CMake 3.15+ and a C++17 compiler (MSVC 2019+, GCC 9+ or Clang 10+). From a checkout: pip install .. rectpack==0.2.2 is installed as a dependency.

Usage

Identical to rectpack:

from fastrectpack import newPacker

packer = newPacker()
for width, height in [(100, 30), (40, 60), (30, 30), (70, 70), (100, 50), (30, 30)]:
    packer.add_rect(width, height)
packer.add_bin(300, 450)
packer.pack()

for bin_index, x, y, w, h, rid in packer.rect_list():
    print(bin_index, x, y, w, h)

fastrectpack re-exports everything rectpack exports. MaxRectsBl, MaxRectsBssf, MaxRectsBaf and MaxRectsBlsf are replaced by accelerated subclasses of the originals; everything else is the original object.

Speeding up a library you cannot edit

Some packages call rectpack internally, so you cannot change their import. Call install() once and rectpack itself hands out the accelerated classes for the rest of the process:

import fastrectpack
fastrectpack.install()

import gdsfactory as gf   # or any other package that uses rectpack

rectpack.newPacker() and the four rectpack.MaxRects* names then give the fastrectpack classes. Packings are identical. With install() active, gdsfactory's own _pack_single_bin function (copied from its source, not edited) packed 400 rectangles in 0.012 s instead of 3.06 s, with the same result; that is one timing on one laptop, and gdsfactory itself was not installed.

  • Call it before the code you want to speed up runs.
  • A class that a module already imported by name (from rectpack import MaxRectsBssf, before the call) keeps pointing at the original. newPacker is updated either way.
  • It changes rectpack for everything in the process. fastrectpack.uninstall() reverses it.

How it works

The four MaxRects classes subclass the originals and run the algorithm in a small C++17 core while every size is a Python int, a Python float, a numpy.float64 or a numpy.int64. Results have the same values and the same types as the original returns. Anything else falls back, for good, to the original Python code for that object.

Profiling the original showed about 90% of its time in one step that compares every pair of free rectangles after each placement. The port compares only the pairs that involve newly created rectangles, which is valid because the list left by the previous step contains no rectangle that contains another. docs/DESIGN.md covers the design, exactly what "identical" means, and the known gaps.

What is accelerated

Accelerated
MaxRects algorithms (Bl, Bssf, Baf, Blsf), with or without rotation Yes
All bin heuristics (BNF, BFF, BBF, Global), online and offline modes, all sort orders Yes, when used with a MaxRects algorithm
Sizes given as plain Python int, up to 2^30 Yes
Sizes given as float, numpy.float64 or numpy.int64, in any mix with int (new in 0.2.0) Yes, up to 2^30 (2^26 for MaxRectsBaf)
Sizes given as Decimal, Fraction, bool, numpy.float32 or other numpy integer types No: handled by the original code, same result, same speed as rectpack
Skyline and Guillotine algorithms No: unchanged original code

When an accelerated object meets an input outside the fast path, it hands its state to the original Python implementation and continues there, so results and error messages stay the same.

What is not faster

  • Many-bin workloads. With 100 open bins, most of the time goes to the Python loop that asks every bin how well a rectangle fits. That loop was left in Python, so the gain there is about 5x.
  • Decimal, numpy.float32 and numpy integers other than numpy.int64. These fall back to the original code, so there is no speedup. The fallback costs nothing extra: it makes 0.007% more Python function calls than plain rectpack and takes the same time. An earlier version of this README reported the fallback as about 2x slower than rectpack. That was a measurement artifact (two timings taken one after the other on a laptop whose speed drifts), not a defect; results/fallback_slowdown.txt has the evidence.
  • Skyline and Guillotine. Not ported.

How correctness was checked

  • Exact parity. After every single placement, the tests compare the fitness value, the placement and the complete list of free rectangles (including its order) against the original. 1,045 tests, including three Hypothesis property tests (300, 150 and 400 generated cases) and all 200 packer configurations that use a MaxRects algorithm, run once with integer sizes and once with mixed types.
  • Types as well as values. Every comparison records the type of each number, so 5, 5.0 and numpy.float64(5.0) count as different results. On the float path the tests also check that the work stayed in C++.
  • Edge cases. Decimals, NaN, infinity, zero and negative sizes, booleans, strings, None, unsupported numpy types, sizes beyond the native range, exact fits, pieces larger than the bin, floats that do not round cleanly. Results and exceptions match the original.
  • Benchmark outputs. Every benchmark run hashes the full result of all three variants; all 14 cases are identical.
  • Sanitizers. The suite passes under AddressSanitizer and UndefinedBehaviorSanitizer, both locally (GCC 15.2 in WSL) and on a GitHub Actions Ubuntu runner.
  • Mutation check. Eleven deliberate bugs were injected into the C++, five of them in the float and numpy handling. The tests caught all eleven.
  • Platforms and Python versions. In GitHub Actions the full suite of 1,045 tests, with numpy installed, ran inside each of the 49 wheels: Python 3.9 to 3.15 on Linux x86_64 and ARM64 (glibc and musl), Windows x86_64, and macOS arm64 and x86_64 (the Intel wheels were tested under Rosetta on an Apple silicon runner, not on Intel hardware). Locally it also passes on Windows with numpy 1.26, 2.4 and 2.5.

Run them yourself:

pip install ".[test]"
pytest
python bench/run_bench.py --quick     # about a minute
python bench/run_bench.py             # full benchmark, several minutes
python bench/run_mixed.py --quick     # float and numpy input

Behaviour inherited from rectpack

These were found while porting. They are reproduced on purpose, not fixed, so that results match (research/original_bugs.py demonstrates each):

  • validate_packing() never compares the last rectangle with the others, so an overlap involving it goes undetected.
  • MaxRectsBl documents a smallest-x tie-break but takes the first candidate.
  • With the BBF bin heuristic, online add_rect returns True/False instead of the rectangle.

Limitations

  • Speed was measured on one Windows laptop only. Correctness is checked in CI on Linux, Windows and macOS, but speed on those systems has not been measured.
  • The package subclasses rectpack internals and pins rectpack==0.2.2. A new rectpack release would need re-checking.
  • An unpickled or deep-copied packer continues on the original Python code path: correct, but not accelerated.

Contributing and security

Issues and pull requests are welcome; see CONTRIBUTING.md. The most useful report is a real workload where it is still slow. Please report security problems privately, as described in SECURITY.md.

Credits and licence

Apache-2.0, the same licence as rectpack, of which this is a derivative work. rectpack is by SecNot. The MaxRects algorithms come from Jukka Jylänki, "A Thousand Ways to Pack the Bin" (2010). See NOTICE.

About

Drop-in C++ accelerator for the rectpack 2D packing library: identical output, 5x to 246x faster.

Topics

Resources

Contributing

Security policy

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Used by

Contributors

Languages