[python][ray] Incrementally commit update_by_row_id file groups#8826

Open

XiaoHongbo-Hope wants to merge 25 commits into

apache:masterfrom

XiaoHongbo-Hope:update_by_row_id_incremental_commit

Commits on Jul 27, 2026

[python] Keep commit() outcome authoritative over close() failure
XiaoHongbo-Hope
committed
[python][ray] Give each file group its own reduce task for incremental commit
XiaoHongbo-Hope
committed
[python] Preserve SnapshotCommit context-manager lifecycle on commit
XiaoHongbo-Hope
committed
[python][ray] Isolate failing update_by_row_id groups by encoding errors as data
XiaoHongbo-Hope
committed
[python] Pass commit exception triple to SnapshotCommit __exit__
XiaoHongbo-Hope
committed
[python][ray] Flush successful update groups before surfacing a group failure
XiaoHongbo-Hope
committed
[python][ray] Protect committed incremental update windows from concurrent overwrite
XiaoHongbo-Hope
committed
[python][ray] Return 4-tuple from distributed_update_apply on empty planner
XiaoHongbo-Hope
committed
[python][ray] Skip protected-scope rescan when no external snapshot landed
XiaoHongbo-Hope
committed
[python] Classify SnapshotCommit __enter__ failure as a commit failure
XiaoHongbo-Hope
committed
[python][ray] Prune dead own-snapshot ids after advancing the checkpoint
XiaoHongbo-Hope
committed
[python][ray] Condense comments on the incremental-commit changes
XiaoHongbo-Hope
committed
[python][ray] Consolidate incremental-commit tests via shared helpers
XiaoHongbo-Hope
committed
[python][ray] Treat an existing empty snapshot as an empty merge target
XiaoHongbo-Hope
committed
[python] Abort staged files on a deterministic commit rejection
XiaoHongbo-Hope
committed
[python] Tighten comments on the deterministic-rejection abort fix
XiaoHongbo-Hope
committed
[python] Update table_update deterministic-rejection test for new type
XiaoHongbo-Hope
committed
[python] Merge scope-isolation tests and tighten a comment
XiaoHongbo-Hope
committed
[python] Merge the enter/close-failure outcome tests via subTest
XiaoHongbo-Hope
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[python][ray] Incrementally commit update_by_row_id file groups#8826

[python][ray] Incrementally commit update_by_row_id file groups#8826
XiaoHongbo-Hope wants to merge 25 commits into
apache:masterfrom
XiaoHongbo-Hope:update_by_row_id_incremental_commit

Commits on Jul 26, 2026

[python][ray] Incrementally commit update_by_row_id file groups

[python] Fix row-id overwrite conflict handling

[python] Fix row-id fallback and DV merging

[python] Fix row-id conflict scopes and cleanup

[python] Clean up manifests after atomic rejection

[python] Handle close failure after rejected commit

Commits on Jul 27, 2026

[python] Keep commit() outcome authoritative over close() failure

[python][ray] Give each file group its own reduce task for incremental commit

[python] Preserve SnapshotCommit context-manager lifecycle on commit

[python][ray] Isolate failing update_by_row_id groups by encoding errors as data

[python] Pass commit exception triple to SnapshotCommit exit

[python][ray] Flush successful update groups before surfacing a group failure

[python][ray] Protect committed incremental update windows from concurrent overwrite

[python][ray] Return 4-tuple from distributed_update_apply on empty planner

[python][ray] Skip protected-scope rescan when no external snapshot landed

[python] Classify SnapshotCommit enter failure as a commit failure

[python][ray] Prune dead own-snapshot ids after advancing the checkpoint

[python][ray] Condense comments on the incremental-commit changes

[python][ray] Consolidate incremental-commit tests via shared helpers

[python][ray] Treat an existing empty snapshot as an empty merge target

[python] Abort staged files on a deterministic commit rejection

[python] Tighten comments on the deterministic-rejection abort fix

[python] Update table_update deterministic-rejection test for new type

[python] Merge scope-isolation tests and tighten a comment

[python] Merge the enter/close-failure outcome tests via subTest