Kontinuation commented on PR #677: URL: https://github.com/apache/sedona-db/pull/677#issuecomment-3997094072
It applies to all the test cases, the original implementation didn't work and I have not added assertions to verify that RepartitionExec should be present on the probe side. This patch updated the common test method for running spatial join to verify that `ProbeShuffleExec` presents in every spatial join queries. `ProbeShuffleExec` has significant impact on the the CPU utilization of SpatialBench Q10 and Q11. I see 10% performance improvement for non-spilled runs and 70%+ for spilled runs. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
