Skip to content

[core] Fix incomplete large file filtering in append only compaction#8120

Draft
ArnavBalyan wants to merge 1 commit into
apache:masterfrom
ArnavBalyan:arnavb/append-compact-large-filter
Draft

[core] Fix incomplete large file filtering in append only compaction#8120
ArnavBalyan wants to merge 1 commit into
apache:masterfrom
ArnavBalyan:arnavb/append-compact-large-filter

Conversation

@ArnavBalyan
Copy link
Copy Markdown
Member

@ArnavBalyan ArnavBalyan commented Jun 4, 2026

Purpose

  • Append compactor is buggy and only drops large files at queue front.
  • Trailing large files survive and skew compaction decisions.
  • Use iterator pass to filter large files everywhere.

Tests

  • UT

@ArnavBalyan ArnavBalyan force-pushed the arnavb/append-compact-large-filter branch from d75d35e to 76c3718 Compare June 4, 2026 12:47
@ArnavBalyan ArnavBalyan marked this pull request as draft June 4, 2026 17:15
@ArnavBalyan
Copy link
Copy Markdown
Member Author

Not ready for review yet

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant