feat(dataset-authoring): initial draft implementation#1673

Draft

fubhy wants to merge 25 commits intomainfrom

dataset-authoring

Commits on Feb 4, 2026

feat(dataset-authoring): dataset authoring and packaging
fubhy
committed
docs: expand dataset-authoring IPC refactor plan with gap analysis

fubhy
and
claude
committed
docs(dataset-authoring): add file annotations and playground task to SPEC

fubhy
and
claude
committed
docs(dataset-authoring): add status tracking and expand gap analysis

fubhy
and
claude
committed
docs(dataset-authoring): refine gap analysis with accurate line refs

fubhy
and
claude
committed
docs(dataset-authoring): verify gap analysis and add file annotations
fubhy
committed
feat(dataset-authoring): add Arrow IPC schema I/O module

fubhy
and
claude
committed
docs: mark Phase 1 (Arrow IPC Module) complete in SPEC.md

fubhy
and
claude
committed
feat(dataset-authoring): rename TableDef schema -> ipc, make sql optional

fubhy
and
claude
committed
docs: mark Phase 5 (Manifest Table Shape Changes) complete in SPEC.md

fubhy
and
claude
committed
feat(dataset-authoring): rename `models` -> `tables` config field and discovery

fubhy
and
claude
committed
feat(dataset-authoring): update path references sql/ -> tables/

fubhy
and
claude
committed
docs: mark Phase 3 (Build Output Layout) complete in SPEC.md

fubhy
and
claude
committed
feat(ampctl): update dataset build to use tables/ and IPC schemas

fubhy
and
claude
committed
docs: update Phase 3 checklist with task completion status

fubhy
and
claude
committed
feat(dataset-authoring): refactor schema inference to return Arrow SchemaRef

fubhy
and
claude
committed
feat(dataset-authoring): update bridge to read IPC schema files
fubhy
committed
feat(dataset-authoring): add LegacyAdapter for legacy-to-package conversion

fubhy
and
claude
committed
feat(dataset-authoring): use LegacyAdapter for API manifest parsing
fubhy
committed
feat(dataset-authoring): add CachedPackage for full package access
fubhy
committed
docs(dataset-authoring): update feature doc for tables/ipc refactor

fubhy
and
claude
committed
fix(dataset-authoring): update test fixtures and docs for tables/ipc refactor

fubhy
and
claude
committed
docs(dataset-authoring): update docstrings and playground for tables/ipc refactor

fubhy
and
claude
committed
docs(spec): mark Phase 8 complete - all refactor tasks done

fubhy
and
claude
committed
docs(spec): mark arrow_json.rs retention as complete

fubhy
and
claude
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Comments

feat(dataset-authoring): initial draft implementation#1673

feat(dataset-authoring): initial draft implementation#1673
fubhy wants to merge 25 commits intomainfrom
dataset-authoring

Commits on Feb 4, 2026

feat(dataset-authoring): dataset authoring and packaging

docs: expand dataset-authoring IPC refactor plan with gap analysis

docs(dataset-authoring): add file annotations and playground task to SPEC

docs(dataset-authoring): add status tracking and expand gap analysis

docs(dataset-authoring): refine gap analysis with accurate line refs

docs(dataset-authoring): verify gap analysis and add file annotations

feat(dataset-authoring): add Arrow IPC schema I/O module

docs: mark Phase 1 (Arrow IPC Module) complete in SPEC.md

feat(dataset-authoring): rename TableDef schema -> ipc, make sql optional

docs: mark Phase 5 (Manifest Table Shape Changes) complete in SPEC.md

feat(dataset-authoring): rename `models` -> `tables` config field and discovery

feat(dataset-authoring): update path references sql/ -> tables/

docs: mark Phase 3 (Build Output Layout) complete in SPEC.md

feat(ampctl): update dataset build to use tables/ and IPC schemas

docs: update Phase 3 checklist with task completion status

feat(dataset-authoring): refactor schema inference to return Arrow SchemaRef

feat(dataset-authoring): update bridge to read IPC schema files

feat(dataset-authoring): add LegacyAdapter for legacy-to-package conversion

feat(dataset-authoring): use LegacyAdapter for API manifest parsing

feat(dataset-authoring): add CachedPackage for full package access

docs(dataset-authoring): update feature doc for tables/ipc refactor

fix(dataset-authoring): update test fixtures and docs for tables/ipc refactor

docs(dataset-authoring): update docstrings and playground for tables/ipc refactor

docs(spec): mark Phase 8 complete - all refactor tasks done

docs(spec): mark arrow_json.rs retention as complete