feat(reader): support late materialization with probe/payload two-phase reads - #243

Open

zhf999 wants to merge 29 commits into

apache:mainfrom

Commits on Aug 21, 2026

feat: support lat-mat (not tested)
zhf999
committed
31736ef
cache and forward read ranges
zhf999
committed
c57e1c3
fix: not use the bitmap from inner read
zhf999
committed
76b8317
fix: support SeekToRow
zhf999
committed
4a5fa3b
test: add test cases
zhf999
committed
b74258d

Commits on Aug 24, 2026

test: add projection feature for MockFileBatchReader
zhf999
committed
4b0a106
fix: set read ranges only when read range are not empty
zhf999
committed
f7fa513
style: refractor code and add comments
zhf999
committed
428a567
fix: support memory pool
zhf999
committed
2d81627
fix: support calling NextBatch
zhf999
committed
7507692
style: add TODOs
zhf999
committed
0325f65
feat: add support LM builder
zhf999
committed
e5e2a6a
feat: install LM reader below PrefetchFileBatchReader
zhf999
committed
1ab5805
fix: normalize arrow array after slicing
zhf999
committed
913f222
feat: enable context options for LatMat
zhf999
committed
19bb106
pre-commit
zhf999
committed
7f44acd

Commits on Aug 25, 2026

fix: forward PrefetchFileBatchReader::PreBufferRange to fix cache issues
zhf999
committed
95fe958
fix: diable lat-mat in previout tests and add new tests for lat-mat
zhf999
committed
dc124e2
fix: lat-mat not controlled by enable-prefetch
zhf999
committed
369d97f
refractor
zhf999
committed
f0a7f75
style: add comments
zhf999
committed
4925c4e
fix: lat-mat silently fails when format is avro or blob
zhf999
committed
f1f1c76
fix: minor issues in LM reader
zhf999
committed
708dadf
fix: predicate issues
zhf999
committed
029e5e1
fix: clang-tidy
zhf999
committed
660be34
add TODOs
zhf999
committed
66916f3
test: restore behavior of merge_file_split_read_test
zhf999
committed
d366c12
pre-commit
zhf999
committed
9215628
Merge branch 'main' into lat-mat
zhf999
committed
99854b4