Skip to content

fix: validate smart extraction bulk writes#852

Open
TurboTheTurtle wants to merge 1 commit into
CortexReach:masterfrom
TurboTheTurtle:codex/issue-693-extraction-validation
Open

fix: validate smart extraction bulk writes#852
TurboTheTurtle wants to merge 1 commit into
CortexReach:masterfrom
TurboTheTurtle:codex/issue-693-extraction-validation

Conversation

@TurboTheTurtle
Copy link
Copy Markdown
Contributor

Summary

  • wrap smart-extractor final bulkStore with before/after count validation
  • warn when accepted entries or returned IDs indicate partial persistence
  • keep public ExtractionStats unchanged

Fixes #693

Tests

  • node --test test/smart-extractor-bulk-store-validation.test.mjs
  • node --test test/smart-extractor-scope-filter.test.mjs
  • node test/smart-extractor-branches.mjs
  • npm run build

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

fix: add LanceDB row-count validation after extraction to prevent poison state

1 participant