What is the problem the feature request solves?
CometIcebergNativeScanExec.scala hardcodes outputOrdering to Nil:
override lazy val outputOrdering: Seq[SortOrder] = Nil
Ref apache/iceberg#16430
We can update it to :
override lazy val outputOrdering: Seq[SortOrder] =
if (originalPlan != null) originalPlan.outputOrdering else Nil
originalPlan is the wrapped BatchScanExec. Once Iceberg implements SupportsReportOrdering, BatchScanExec.outputOrdering returns the correct sort order and Comet inherits it
This wil eliminate CometSortExec above Iceberg native scans for sort-merge joins .
Describe the potential solution
No response
Additional context
No response
What is the problem the feature request solves?
CometIcebergNativeScanExec.scala hardcodes outputOrdering to Nil:
Ref apache/iceberg#16430
We can update it to :
originalPlan is the wrapped BatchScanExec. Once Iceberg implements SupportsReportOrdering, BatchScanExec.outputOrdering returns the correct sort order and Comet inherits it
This wil eliminate CometSortExec above Iceberg native scans for sort-merge joins .
Describe the potential solution
No response
Additional context
No response