pwrliang commented on PR #465: URL: https://github.com/apache/sedona-db/pull/465#issuecomment-3757801393
Hi @zhangfengcdt @paleolimbot, the GPU-based spatial join has been completely rewritten. The initial version wrapped both the filtering and refinement stages into the same interface (C library). However, that approach suffered from build-side parsing overhead because it could not be shared across partitions. I have redesigned it to match the CPU-based join, where the two stages are separated. This version runs faster and takes less memory. It also supports WHERE clauses (which the initial version did not). The implementation is based on @Kontinuation 's spatial-join, so please give me some advice if you can. I realize this PR is large, but the structural changes were necessary. Please review it when you have time. Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
