Repository navigation
Phase 2: umf-core <0.11, tag-driven release, pages.yml, quickstart in CI, short AGENTS.md - #58
Merged
Merged
Conversation
…README quickstart executed in CI, short AGENTS.md Co-Authored-By: Claude Sonnet 5.5 <[email protected]>
Co-Authored-By: Claude Sonnet 5.5 <[email protected]>
Co-Authored-By: Claude Sonnet 5.5 <[email protected]>
Co-Authored-By: Claude Sonnet 5.5 <[email protected]>
Co-Authored-By: Claude Sonnet 5.5 <[email protected]>
…se doc Co-Authored-By: Claude Sonnet 5.5 <[email protected]>
Co-Authored-By: Claude Sonnet 5.5 <[email protected]>
…deadlocks xdist workers) Co-Authored-By: Claude Sonnet 5.5 <[email protected]>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Phase 2 for tablespec (phase 1 #57 is merged).
umf-core range and test results
umf-core>=0.10.0,<=0.10.3->>=0.10.0,<0.11;uv.lockmoves umf-core 0.10.3 -> 0.10.10. No code changes were needed.Failed: Timeoutin thespark_sessionfixture (no JDK on that machine).fullrun on Linux CI (dispatch on this branch, run 43084749655): 4407 passed, 43 skipped, 1 failed (same format error), 47 errors (54 min). 45 errors were againTimeout >600sin the Spark session fixture, 2 were collection errors for the two deleted test files below. Root cause of the 20 failures / 4 errors seen earlier is not Spark itself:tests/conftest.py::spark_sessiontakes an exclusivefcntl.flockon a shared lock file for the whole session, so with xdist-n 2the second worker blocks on its first Spark test until the 600 s timeout and every later Spark test in that worker errors. Fix (this PR): the nightly job runs non-Spark tests with-n autoand the Spark tests (-m spark_only) in one process (-n 0, Java 17 from the runner image), then the umf-core 0.10.0 lower-bound check.fullrun (run 43093467919, after the fix): every step succeeded: non-Spark parallel suite, Spark suite in one process, lower-bound umf-core 0.10.0 check, artifact upload. (GitHub's API was returning 502 for the job log when I finished, so I cannot quote the exact pass counts for this run; see the run page.)tests/unit/test_distribution_identity.pyandtests/unit/test_pypi_publication.py, which only exercised the removed release-verification scripts (plan section 2).Workflows (8 -> 3)
release.ymlrewritten (tagv*.*.*only; no dispatch recovery): reusesci.yml(lint + fast suite + README quickstart),build(uv build,twine check, sdist < 5 MB, wheel/sdist versions equal the tag, plugin manifests equal the tag),smoke(fresh venv install of the built wheel,tablespec --help, README quickstart:tablespec generateto SQL, PySpark and JSON Schema),integration(latest umf-core in range; shared-UMF, conformance, golden, encapsulation tests),publish(tag only; environmentpypi;pypa/gh-action-pypi-publish, trusted publishing),github-release(SHA256SUMS, attestation, notes from CHANGELOG). A manual dispatch is a dry run that never publishes. Verified with a temporary push trigger on this branch (removed): lint, fast, quickstart, build, smoke, integration all green; publish/github-release skipped.pages.ymlreplacesmicrosite.ymlandpublish-microsite.yml: builds Hugo, link-checks under/tablespec/, runstests/website; deploys only onrelease: publishedor dispatch. The/simple/PEP 503 index is retired (install from PyPI); removedbuild_pages_artifact.py,verify_release_artifacts.py,verify_pypi_release.py,publish-pypi.yml, and the Playwright visual-snapshot spec with its darwin/linux baselines (the link-check spec stays).ci.yml: added aquickstartjob (builds the wheel, installs it in a fresh venv, runs the README commands via.github/run_quickstart.py).tablespec <version>(HUGO_PARAMS_VERSIONfrom the release tag; checked locally).Docs
README quickstart is now an executed
tablespec generateexample (the old one wrote a single-file YAML that the CLI refuses as legacy); install section is plain PyPI with the aarch64umf-core==0.10.0note.AGENTS.md319 -> 45 lines (CLAUDE.mdpoints to it);CHANGELOG.mdadded;docs/release-publishing.mdrewritten for the new flow; website pages no longer reference the Pages index orumf-core==0.10.3.docs/helixstays (open owner decision). Tracked files 1707 -> 1698, tree 32.3 MB.Known failures
None known. Not verified:
publish/github-release/pagesdeploy (need owner setup and a tag); macOS (CI is Linux-only; locally Spark tests cannot run without a JDK).Not in this PR
docs/helixremoval; mkdocs removal; demo media move; theumf-core>=0.10.11floor (waits for umf 0.10.11 - follow-up: bump the floor,uv lock --upgrade-package umf-core, rerunfull); version bump/tag 0.0.17; deleting stale remote branches.Owner actions before the first release
umf-tablespec-> Publishing: add a trusted publisher for repositoryDocumentDrivenDX/tablespec, workflowrelease.yml, environmentpypi(the existing publisher is bound to the now-deletedpublish-pypi.yml; delete it).pypiexists (it already does forpublish-pypi.yml).vX.Y.Z. Publishing the GitHub Release (created by the workflow) triggerspages.yml.🤖 Generated with Claude Code