Skip to content

release v0.10.0 (#144) - #144

Draft
georgeRobertson wants to merge 25 commits into
mainfrom
release_v010
Draft

release v0.10.0 (#144)#144
georgeRobertson wants to merge 25 commits into
mainfrom
release_v010

Conversation

@georgeRobertson

@georgeRobertson georgeRobertson commented Aug 25, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

TLDR of changes

Features

  • feat: added new section within the dischema to store entity hierarchy information
  • feat: add orphan record identification and removal
  • feat: group rejections for mandatory primary keys
  • feat: add empty_entity check post filters for mandatory entities
  • feat: add facility to add additional checks at end of file transformation stage

Fixes

  • fix: add user feedback message for unsupported file type
  • fix: change record rej ct to be eq to records processed when file rejected
  • fix: add entity into data contract details to deal with duplicate column definitions
  • fix: ensure that original entity details persisted in feedback messages for further processing
  • fix: ensure network and load_dtd are disabled in xml reading

Refactors

  • refactor: remove original entities

Build

  • build: upgrade duckdb to v1.4
  • build: upgrade jdk for dev

Docs

  • docs: added json schema for entity relationships
  • docs: add dev classifier
  • docs: add documentation around entity relationships

What kind of changes does this PR introduce?

Tick all that apply

  • fix: A bug fix. Correlates with PATCH in SemVer
  • feat: A new feature. Correlates with MINOR in SemVer
  • docs: Documentation only changes
  • style: Changes that do not affect the meaning of the code (white-space, formatting, missing semi-colons, etc)
  • refactor: A code change that neither fixes a bug nor adds a feature
  • perf: A code change that improves performance
  • test: Adding missing or correcting existing tests
  • build: Changes that affect the build system or external dependencies (example scopes: pip, docker, npm)
  • ci: Changes to CI configuration files and scripts (example scopes: GitLabCI)

Please check if the PR fulfills these requirements

  • I have read and followed the Contributing guidance
  • Docs have been added / updated
  • Tests and Linting in the CI are passing
  • Changes have been reviewed and approved by a Project Maintainer

@stevenhsd
feature: add entity hierarchy handling (#143)
de08575 
* feat: added proposals for new models and objects to store entity hierarchy information

* docs: added json schema for entity relationships
@georgeRobertson georgeRobertson changed the title feature: add entity hierarchy handling (#143) release v0.10.0 (#144) Aug 25, 2026
georgeRobertson and others added 24 commits August 27, 2026 11:41
@georgeRobertson
build: upgrade duckdb to v1.4
42fb3e4
@georgeRobertson
docs: add dev classifier
a9c0872
@georgeRobertson
build: upgrade duckdb to v1.4 (#147)
5c1e11b 
build: upgrade duckdb to v1.4
@georgeRobertson
feat: add orphan record identification and removal (#150)
a3cafe7
@stevenhsd
refactor: unify HierarchyNode and ChildHierarchyNode also tweaked ba…
de4e44d 
…ckground writer queue type and use in orphaned records implementation (#153)
@georgeRobertson
fix: add user feedback message for unsupported file type (#142)
516e5e4
@georgeRobertson
fix: change record rej ct to be eq to records processed when file rej…
c2b8cf5 
…ected (#154)
@stevenhsd
refactor: tweak hierarchy node design to allow iteration both directi…
a6b6154 
…ons on hierarchies (#155)
@georgeRobertson
feat: group rejections for mandatory primary keys (#152)
7792d41 
* docs: update jsonschema for entity relationships to include group rej code+message
@georgeRobertson
fix: revert change to SubStats population in error reports (#156)
b63c2ac
@georgeRobertson
build: upgrade java runtime for dev (#158)
a817759
@stevenhsd
fix: ensure missing parent and group rejection records are being remo…
49290bb 
…ved (#160)
@georgeRobertson
fix: add message templating to error messages on orph+group rej (#161)
41b9020
@georgeRobertson
fix: add entity into data contract details to deal with duplicate co…
51a9c07 
…lumn definitions (#159)
@stevenhsd
docs: add entity relationships detail to docs (#157)
3eca2f1
@stevenhsd
fix: raise processing error where filter is materialising null values (…
43c428f 
…#162)
@georgeRobertson
feat: add empty_entity check post filters for mandatory entities (#163)
21043db
@georgeRobertson
refactor: remove original entities (#164)
1a0beb6 
redundant in the grand scheme of things and was increasing the I/O overhead
@georgeRobertson
perf: only check for orphaned records on entities with at least one r…
a51254d 
…ecord (#166)
@georgeRobertson
fix: ensure network and load_dtd are disabled in xml reading (#167)
b3e03b4
@stevenhsd
fix: ensure that original entity detials persisted in feedback messag…
8f5e1ae 
…es for further processing (#168)
@georgeRobertson
docs: update docs around entity relationships for root entities (#169)
e2a9c16 
* build: bump zensical to 0.0.63
@stevenhsd
feat: add facility to add additional checks at end of file transforma… (
2092879 
#165)
@georgeRobertson
perf: remove orphan tracker as it's causing significant performance d…
e4dab57 
…egradation (#170)
@sonarqubecloud

sonarqubecloud Bot commented Sep 30, 2026

Copy link
Copy Markdown

Quality Gate Passed Quality Gate passed

Issues
30 New issues
1 Accepted issue

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@georgeRobertson @stevenhsd