Repository navigation
int_proxy: a proxy half-join tactic over a backend - #1019
Closed
frankmcsherry wants to merge 1 commit into
Closed
frankmcsherry wants to merge 1 commit into
frankmcsherry wants to merge 1 commit into
Conversation
The half join had no seam between its time logic and its data: dogs3's HalfJoinTactic reads the arrangement's batches itself. ProxyHalfJoinTactic owns the total-order comparison, strictness, the output time rule (the update's own time, and its data time joined with the arranged time) and blocking; ProxyHalfJoinBackend owns key matching, value proxies and output containers, like the join and reduce backends. Matches are pairs of positions into the block's two presented sides, which `cross` is handed back, so a backend evaluates the time rule in its own layout; a time per match in the tactic measured at a third of a half-join-heavy tick. Arranged times are presented as stored: advancing them by a frontier moves them in the total order relative to incomparable stream times, so the backend is given no lower bound to advance by. The arranged side is a bridge with the join's contract, sorted and consolidated by ((key, val), time); the stream side is in key order only. VecHalfJoinBackend is the reference backend. The test checks the tactic against the definition over product times, strict and not, several block sizes, and colliding hashes. Co-Authored-By: Claude Fable 5.1 <[email protected]> Claude-Session: https://claude.ai/code/session_019XsakwFGwtESwZ1gSYwG4o
This was referenced Oct 24, 2026
Member
Author
|
Replaced by #1022, which moves the proxy half-join tactic into dogs3, built on int_proxy's public surface. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
The half join had no seam between its time logic and its data: dogs3's
HalfJoinTacticreads the arrangement's batches itself, so nothing can wrap it, for example to read an arrangement as of a frontier. This addsProxyHalfJoinTacticover aProxyHalfJoinBackend, in the shape of the proxy join and reduce.The tactic owns the comparison of times, strictness, cutting work into blocks of keys, the diff product, and the rule for output times: the update's own time, carrying its data time joined with the arranged time.
The backend owns staging the released updates, presenting each block of both sides by key, comparing real keys where the key proxy is a hash, and building output containers.
Notes:
Ord, whichTimestamppromises is a linear extension of the partial order. Nothing needsTotalOrder, so product times work.lower = {(1, 0)},(0, 5)sorts before(1, 0), but advances to(1, 5), which sorts after it. So the backend is given no lower bound to advance by.((key, val), time). The stream side is in key order only.crossis handed back, so a backend can evaluate the time rule in its own layout. Materializing two times per match in the tactic cost about a third of a half-join-heavy tick on DDIR times.VecHalfJoinBackendis the reference backend. The new test checks the tactic against the definition overProduct<u64, u64>times, strict and not, at several block sizes, and with colliding hashes.tests/int_proxy.rs: 19 passed.The dogs3
HalfJoinTacticimpl and the DDIR port follow in separate PRs that build on this one.🤖 Generated with Claude Code
https://claude.ai/code/session_019XsakwFGwtESwZ1gSYwG4o