AdamGS commented on PR #17020: URL: https://github.com/apache/datafusion/pull/17020#issuecomment-3148366663
My understanding is that it should be beneficial in queries where the different partitions of the physical plan have heavy skew, allowing "lighter" partitions to pick up more work, which should both reduce the effect of these long-tail anomalies and reduce memory usage in cases where some producers are faster then their upstream consumer. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
