Skip to content

Copy limits before repartitions#20736

Draft
avantgardnerio wants to merge 1 commit intoapache:mainfrom
coralogix:brent/limit_before_repartition
Draft

Copy limits before repartitions#20736
avantgardnerio wants to merge 1 commit intoapache:mainfrom
coralogix:brent/limit_before_repartition

Conversation

@avantgardnerio
Copy link
Contributor

@avantgardnerio avantgardnerio commented Mar 6, 2026

Which issue does this PR close?

Rationale for this change

Described in issue.

What changes are included in this PR?

  1. optimizer rule + unit tests
  2. slt tests showing behavior is the same, plus demonstrating plan changes
  3. feature flag
  4. criterion benchmark
  5. fixes to existing slt plan assertions

Are these changes tested?

With unit tests & slts.

Are there any user-facing changes?

Some queries should go faster

Note: AI assistance was used in this PR

@avantgardnerio avantgardnerio requested a review from Dandandan March 6, 2026 01:33
@github-actions github-actions bot added optimizer Optimizer rules core Core DataFusion crate sqllogictest SQL Logic Tests (.slt) common Related to common crate labels Mar 6, 2026
@github-actions github-actions bot added the documentation Improvements or additions to documentation label Mar 6, 2026
@avantgardnerio avantgardnerio force-pushed the brent/limit_before_repartition branch from a1f6d5a to f4704a2 Compare March 6, 2026 11:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

common Related to common crate core Core DataFusion crate documentation Improvements or additions to documentation optimizer Optimizer rules sqllogictest SQL Logic Tests (.slt)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Minimize data copy when repartitioning if repartition key is a subset of the sort key

1 participant