[core] Fix dedicated-format bundle write path#7598
[core] Fix dedicated-format bundle write path#7598QuakeWang wants to merge 1 commit intoapache:masterfrom
Conversation
|
Can you explain what went wrong? |
The old dedicated-format That becomes problematic in the dedicated fan-out path, where one logical bundle has to be written to projected main/blob/vector writers. This patch makes those constraints explicit: replayable bundles can be passed through safely, non-replayable bundles are materialized once, and dedicated row-data writers preserve the row-level side effects after bundle writes. So the issue was not that the old row-by-row fallback always corrupted data. The issue was that the dedicated-format bundle path could not preserve bundle semantics safely and correctly once a single bundle needed to be fanned out to multiple writers. |
Purpose
Fix the dedicated-format writeBundle path so bundle writes remain correct when data is fanned out to main/blob/vector writers.
This change:
Tests
Added or updated tests in paimon-core:
These cover: