Skip to content

feat: add partitioned context namespace helper#94

Open
dcfocus wants to merge 3 commits into
lance-format:mainfrom
dcfocus:worktree-issue-90-partitioned-namespace-impl
Open

feat: add partitioned context namespace helper#94
dcfocus wants to merge 3 commits into
lance-format:mainfrom
dcfocus:worktree-issue-90-partitioned-namespace-impl

Conversation

@dcfocus

@dcfocus dcfocus commented Jun 15, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • add the issue 90 partitioned namespace design document
  • add typed tenant/source fields across records, DTOs, storage, REST conversions, and Python APIs
  • add a Phase 1 ContextNamespace resolver that records full selector mappings in a __manifest table and opens selector partitions as normal ContextStore datasets
  • preserve legacy tenant/source metadata filter compatibility and expose a Python ContextNamespace wrapper

Fixes #90

Testing

  • cargo fmt --all -- --check
  • cargo clippy --workspace --all-targets -- -D warnings
  • cargo test --workspace

Note: local Rust checks required PROTOC and PROTOC_INCLUDE to point at the Python environment's protoc/grpc include paths.

dcfocus and others added 3 commits June 13, 2026 20:08
lance-format#90)

Proposes scoped isolation via a Lance Partitioned Namespace over the single
ContextRecord schema, rather than table families + an information_schema.
Aligns with maintainer guidance on lance-format#37: one schema to maintain, many
physically isolated partitions, optional unified cross-partition view, and
the __manifest table as the registry (no DB/catalog we own).

Covers: partition-vs-record dimension placement, recommended partition specs
and naming/URI conventions, a thin (catalog-free) ContextNamespace helper
sketch, when-to-partition guidance, migration and partition-spec evolution,
interaction with existing features, alternatives, and a docs-first phased
rollout mapped to the lance-format#90 acceptance criteria.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Explore partitioned namespace layout for scoped agent context

1 participant