feat(realtime): add primary-key in-memory support - #5

Draft

HaHaJeff wants to merge 44 commits into

mainfrom

jeff/pk-realtime-v1

Commits on Aug 19, 2026

feat(read): support file index and predicate pushdown for data evolution (#215)
lxy-9602
authored
7ff1855
chore(build): reformat arrow.diff patch sections (#217)
lucasfang
authored
ec85415
feat(prefetch): support read-ahead cache for Parquet reads (#209)
lucasfang
authored
223e566

Commits on Aug 20, 2026

feat(parquet): support vector type storage (#198)
ChaomingZhangCN
authored
c7f23c6
fix: optimize shared-shredding read & fix ORC read-size estimation for nested columns (#216)
lszskye
authored
afc8471
fix(parquet): pass ReadHints into VECTOR ParquetFileBatchReader tests (#223)
ChaomingZhangCN
authored
b0e411b
feat(file-index): support writing file indexes (#210)
zjw1111
authored
8a110d4
perf(parquet): reuse leaf column index set across fields in page-filtered reads (#207)
zhf999
authored
dbdce8f
perf(scan): lazily decode manifest bucket entries (#212)
gripleaf
authored
aa60634

Commits on Aug 21, 2026

Commits on Aug 24, 2026

fix(rest): support libcurl versions before 7.49 (#237)
wangyong9999
authored
3b93d6a
perf: avoid shared pointer contention in manifest and Avro decode (#239)
gripleaf
authored
d602c2c
feat(realtime): improve append table lifecycle and query support (#213)
lxy-9602
authored
15d079a
chore: remove required status checks in .asf.yaml (#241)
zjw1111
authored
6650b42
feat(realtime): add primary-key in-memory writes
HaHaJeff
committed
3a19320
feat(read): merge primary-key realtime memory with snapshots
HaHaJeff
committed
789da66
test(realtime): cover primary-key realtime lifecycle
HaHaJeff
committed
03ede35
refactor(realtime): consolidate PK state and validation
HaHaJeff
committed
3e25630
fix(read): close PK realtime query readers
HaHaJeff
committed
9f6c99d
fix(realtime): close rejected plugin readers
HaHaJeff
committed
15d7c91
fix(read): preserve PK reader metrics after close
HaHaJeff
committed
2df7b78
refactor(realtime): colocate PK realtime option validation
HaHaJeff
committed
7148081
test(realtime): improve primary key coverage
HaHaJeff
committed
8273045
fix(realtime): prevent sequence reuse and align nested projections
HaHaJeff
committed
728b97e
fix(realtime): align PK reads across schema changes
HaHaJeff
committed
f3df0e3
fix(realtime): align PK projections by field ID
HaHaJeff
committed
3358304
refactor(mergetree): accept sorted key-value readers
HaHaJeff
committed
8d96153
feat(realtime): adapt prepared primary-key batches
HaHaJeff
committed
df322c1
refactor(realtime): prepare primary-key batches in framework
HaHaJeff
committed
87e4548
refactor(realtime): simplify primary-key write preparation
HaHaJeff
committed
ea90f89
test(mergetree): reuse reader failure mock
HaHaJeff
committed
53f6b02
fix(realtime): preserve PK sequence across writer handoff
HaHaJeff
committed
141099c
refactor(realtime): simplify primary key merge readers
HaHaJeff
committed
a4f9a0c
fix(realtime): validate PK reader contracts
HaHaJeff
committed
d983089
refactor(realtime): simplify reader lifecycle cleanup
HaHaJeff
committed
a9aaa4e
fix(realtime): harden primary-key prepared batches
HaHaJeff
committed
8ab9817
refactor(realtime): simplify primary-key contracts
HaHaJeff
committed
75f959a
fix(realtime): strengthen primary-key recovery coverage
HaHaJeff
committed
3f0efba

Commits on Aug 25, 2026