Kontinuation commented on issue #379:
URL: https://github.com/apache/sedona-db/issues/379#issuecomment-3590996274
Seems that `EnforceSorting` did something bad. The `ProjectionExec` was
moved below the sort, but the ordinal of column reference in
`sd_order(geometry@13)` was not updated.
```
| physical_plan after EnforceDistribution |
OutputRequirementExec: order_by=[], dist_by=Unspecified
| |
DataSinkExec: sink=ParquetSink(file_groups=[])
| |
CoalescePartitionsExec
| |
ProjectionExec: expr=[OBJECTID@0 as OBJECTID, OBJECTID_1@1 as OBJECTID_1,
FEAT_CODE@2 as FEAT_CODE, ZVALUE@3 as ZVALUE, MINZ@4 as MINZ, MAXZ@5 as MAXZ,
POLY_CLASS@6 as POLY_CLASS, NAMEID_1@7 as NAMEID_1, NAME_1@8 as NAME_1, HID@9
as HID, SHAPE_LENG@10 as SHAPE_LENG, SHAPE_AREA@11 as SHAPE_AREA, SHAPE_LEN@12
as SHAPE_LEN, geoparquet_bbox(geometry@13) as bbox, geometry@13 as geometry]
| |
RepartitionExec: partitioning=RoundRobinBatch(10), input_partitions=1
| |
SortExec: expr=[sd_order(geometry@13) ASC NULLS LAST],
preserve_partitioning=[false]
| |
CoalescePartitionsExec
| |
DataSourceExec: file_groups={10 groups:
[[Users/bopeng/workspace/wherobots/sedona-db/submodules/geoarrow-data/ns-water/files/ns-water_water-poly_geo.parquet:0..22637237],
[Users/bopeng/workspace/wherobots/sedona-db/submodules/geoarrow-data/ns-water/files/ns-water_water-poly_geo.parquet:22637237..45274474],
[Users/bopeng/workspace/wherobots/sedona-db/submodules/geoarrow-data/ns-water/files/ns-water_water-poly_geo.parquet:45274474..67911711],
[Users/bopeng/workspace/wherobots/sedona-db/submodules/geoarrow-data/ns-water/files/ns-water_water-poly_geo.parquet:67911711..90548948],
[Users/bopeng/workspace/wherobots/sedona-db/submodules/geoarrow-data/ns-water/files/ns-water_water-poly_geo.parquet:90548948..113186185],
[Users/bopeng/workspace/wherobots/sedona-db/submodules/geoarrow-data/ns-water/files/ns-water_water-poly_geo.parquet:113186185..135823422],
[Users/bopeng/workspace/wherobots/sedona-db/submodules/geoa
rrow-data/ns-water/files/ns-water_water-poly_geo.parquet:135823422..158460659],
[Users/bopeng/workspace/wherobots/sedona-db/submodules/geoarrow-data/ns-water/files/ns-water_water-poly_geo.parquet:158460659..181097896],
[Users/bopeng/workspace/wherobots/sedona-db/submodules/geoarrow-data/ns-water/files/ns-water_water-poly_geo.parquet:181097896..203735133],
[Users/bopeng/workspace/wherobots/sedona-db/submodules/geoarrow-data/ns-water/files/ns-water_water-poly_geo.parquet:203735133..226372364]]},
projection=[OBJECTID, OBJECTID_1, FEAT_CODE, ZVALUE, MINZ, MAXZ, POLY_CLASS,
NAMEID_1, NAME_1, HID, SHAPE_LENG, SHAPE_AREA, SHAPE_LEN, geometry],
file_type=parquet
| |
| physical_plan after CombinePartialFinalAggregate | SAME TEXT AS
ABOVE
| physical_plan after EnforceSorting |
OutputRequirementExec: order_by=[], dist_by=Unspecified
| |
DataSinkExec: sink=ParquetSink(file_groups=[])
| | SortExec:
expr=[sd_order(geometry@13) ASC NULLS LAST], preserve_partitioning=[false]
| |
CoalescePartitionsExec
| |
ProjectionExec: expr=[OBJECTID@0 as OBJECTID, OBJECTID_1@1 as OBJECTID_1,
FEAT_CODE@2 as FEAT_CODE, ZVALUE@3 as ZVALUE, MINZ@4 as MINZ, MAXZ@5 as MAXZ,
POLY_CLASS@6 as POLY_CLASS, NAMEID_1@7 as NAMEID_1, NAME_1@8 as NAME_1, HID@9
as HID, SHAPE_LENG@10 as SHAPE_LENG, SHAPE_AREA@11 as SHAPE_AREA, SHAPE_LEN@12
as SHAPE_LEN, geoparquet_bbox(geometry@13) as bbox, geometry@13 as geometry]
| |
DataSourceExec: file_groups={10 groups:
[[Users/bopeng/workspace/wherobots/sedona-db/submodules/geoarrow-data/ns-water/files/ns-water_water-poly_geo.parquet:0..22637237],
[Users/bopeng/workspace/wherobots/sedona-db/submodules/geoarrow-data/ns-water/files/ns-water_water-poly_geo.parquet:22637237..45274474],
[Users/bopeng/workspace/wherobots/sedona-db/submodules/geoarrow-data/ns-water/files/ns-water_water-poly_geo.parquet:45274474..67911711],
[Users/bopeng/workspace/wherobots/sedona-db/submodules/geoarrow-data/ns-water/files/ns-water_water-poly_geo.parquet:67911711..90548948],
[Users/bopeng/workspace/wherobots/sedona-db/submodules/geoarrow-data/ns-water/files/ns-water_water-poly_geo.parquet:90548948..113186185],
[Users/bopeng/workspace/wherobots/sedona-db/submodules/geoarrow-data/ns-water/files/ns-water_water-poly_geo.parquet:113186185..135823422],
[Users/bopeng/workspace/wherobots/sedona-db/submodules/geoarrow
-data/ns-water/files/ns-water_water-poly_geo.parquet:135823422..158460659],
[Users/bopeng/workspace/wherobots/sedona-db/submodules/geoarrow-data/ns-water/files/ns-water_water-poly_geo.parquet:158460659..181097896],
[Users/bopeng/workspace/wherobots/sedona-db/submodules/geoarrow-data/ns-water/files/ns-water_water-poly_geo.parquet:181097896..203735133],
[Users/bopeng/workspace/wherobots/sedona-db/submodules/geoarrow-data/ns-water/files/ns-water_water-poly_geo.parquet:203735133..226372364]]},
projection=[OBJECTID, OBJECTID_1, FEAT_CODE, ZVALUE, MINZ, MAXZ, POLY_CLASS,
NAMEID_1, NAME_1, HID, SHAPE_LENG, SHAPE_AREA, SHAPE_LEN, geometry],
file_type=parquet
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
