berkaysynnada commented on PR #15770: URL: https://github.com/apache/datafusion/pull/15770#issuecomment-2865349477
Update: I tried to re-order the rules like: 1) EnforceSorting 2) FilterPushdown 3) EnforceDistribution 4) CombinePartialFinalAggregate ... 5) CoalesceBatches The issue here is fixed, but some others came up (related with EnforceSorting and EnforceDistribution swap). I will further debug that issue. EnforceSorting and EnforceDistribution are initially designed to operate orthogonally, and there are many tests for that. But it seems somehow we broke it. Unless I can figure out easily to recover that orthogonality feature, I'll manually implement FilterPushdown rule to eliminate ``` CoalesceBatches --Repartition ``` patterns -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
