Dandandan commented on issue #932: URL: https://github.com/apache/datafusion-ballista/issues/932#issuecomment-2688994389
One strategy to reduce message size we used is pruning the partitions before encoding them as task. This makes the message size pretty constant however how many partitions there might be in the query (and also saves on some decoding / encoding and bandwidth). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
