Skip to content

Explicit configuration of schema extraction #374

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Conversation

stellasia
Copy link
Contributor

Description

schema_ parameter can be configured with a string "NO_EXTRACTION" or "AUTO_EXTRACTION". Internally, this is changed to either an empty schema or None, so that the rest of the process is unchanged.

Type of Change

  • New feature
  • Bug fix
  • Breaking change
  • Documentation update
  • Project configuration change

Complexity

Complexity: Low

How Has This Been Tested?

  • Unit tests
  • E2E tests
  • Manual tests

Checklist

The following requirements should have been met (depending on the changes in the branch):

  • Documentation has been updated
  • Unit tests have been updated
  • E2E tests have been updated
  • Examples have been updated
  • New files have copyright header
  • CLA (https://neo4j.com/developer/cla/) has been signed
  • CHANGELOG.md updated if appropriate

@stellasia stellasia requested a review from a team as a code owner July 1, 2025 08:39
@stellasia stellasia requested a review from NathalieCharbel July 1, 2025 08:57
@@ -138,6 +138,14 @@ def test_simple_kg_pipeline_config_manual_schema() -> None:
assert isinstance(config._get_schema(), SchemaBuilder)


def test_simple_kg_pipeline_config_literal_schema_validation() -> None:
config = SimpleKGPipelineConfig(schema="NO_EXTRACTION") # type: ignore
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looking at it here, I am wondering if "NO_EXTRACTION" is the best term to use? when putting it next to "AUTO_EXTRACTION" it makes sense but here it is a bit ambiguous? would "NO_SCHEMA" or "NO_GUIDING_SCHEMA" be better? as it does not only cover not being extracted but not provided at all? I am not strongly opinionated about it though as it is well-documented...

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated after private discussion

@stellasia stellasia requested a review from NathalieCharbel July 1, 2025 12:14
Copy link
Contributor

@NathalieCharbel NathalieCharbel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome :)

@stellasia stellasia merged commit a07cd9c into neo4j:main Jul 1, 2025
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants