Kontinuation opened a new pull request, #277:
URL: https://github.com/apache/sedona-db/pull/277
This PR refactors the structure of spatial join code to make it easier to
add new features, such as out-of-core spatial joins. The main changes are:
* Breaks the largest source file index.rs in rust/sedona-spatial-join into
several smaller modules:
* `collect`: Collecting build side batches from the build side stream and
evaluating the expressions for computing the joined spatial column
* `index`: Splitted into spatial index, spatial index builder and a
knn_adapter module for geometry distance computation.
* Move top-level utility modules into `utils` module
* Memory reservation for prepared geometries held by the refiners happens
only once before probing. The refiners needs to estimate the maximum amount of
memory for holding prepared geometry objects. This is for avoiding reserving
memory in probe phase, where memory reservation is very likely to happen when
there are downstream memory-consuming operators.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
