Using gdal-master conda packages, trying to use the new ADBC driver for
libduckdb integration, I’m able to connect to a parquet dataset (only if it has
the parquet extension) but the geometry is not being recognized.
Seems to take a long time to load compared with duckdb. So, I must be doing
something wrong.
Note private s3 bucket.
CPL_DEBUG=on ogrinfo
ADBC:"s3://private-bucket/overture-base/overture-places.parquet" -oo
ADBC_DRIVER=libduckdb -oo PRELUDE_STATEMENTS="INSTALL httpfs" -oo
PRELUDE_STATEMENTS="load httpfs" -oo PRELUDE_STATEMENTS="INSTALL parquet" -oo
PRELUDE_STATEMENTS="load parquet" -oo PRELUDE_STATEMENTS="install aws" -oo
PRELUDE_STATEMENTS="load aws" -oo PRELUDE_STATEMENTS="CREATE SECRET ( TYPE
S3,PROVIDER CREDENTIAL_CHAIN)"
GDAL: On-demand registering
/Users/rdcrlmds/mambaforge/envs/gdalmaster/lib/gdalplugins/ogr_ADBC.dylib using
RegisterOGRADBC.
GDAL: GDALOpen(ADBC:s3://private-bucket/overture-base/overture-places.parquet,
this=0x13a70a000) succeeds as ADBC.
INFO: Open of `ADBC:s3://private-bucket/overture-base/overture-places.parquet'
using driver `ADBC' successful.
OGR: GetLayerCount() = 1
1: overture-places (None)
GDAL: GDALClose(ADBC:s3://private-bucket/overture-base/overture-places.parquet,
this=0x13a70a000)
GDAL: In GDALDestroy - unloading GDAL shared library.
time CPL_DEBUG=on ogrinfo
ADBC:"s3://private-bucket/overture-base/overture-places.parquet" -oo
ADBC_DRIVER=libduckdb -oo PRELUDE_STATEMENTS="INSTALL spatial" -oo
PRELUDE_STATEMENTS="load spatial" -oo PRELUDE_STATEMENTS="INSTALL httpfs" -oo
PRELUDE_STATEMENTS="load httpfs" -oo PRELUDE_STATEMENTS="INSTALL parquet" -oo
PRELUDE_STATEMENTS="load parquet" -oo PRELUDE_STATEMENTS="install aws" -oo
PRELUDE_STATEMENTS="load aws" -oo PRELUDE_STATEMENTS="CREATE SECRET ( TYPE
S3,PROVIDER CREDENTIAL_CHAIN)"
GDAL: On-demand registering
/Users/rdcrlmds/mambaforge/envs/gdalmaster/lib/gdalplugins/ogr_ADBC.dylib using
RegisterOGRADBC.
GDAL: GDALOpen(ADBC:s3://private-bucket/overture-base/overture-places.parquet,
this=0x129e15350) succeeds as ADBC.
INFO: Open of `ADBC:s3://private-bucket/overture-base/overture-places.parquet'
using driver `ADBC' successful.
OGR: GetLayerCount() = 1
1: overture-places (None)
GDAL: GDALClose(ADBC:s3://private-bucket/overture-base/overture-places.parquet,
this=0x129e15350)
GDAL: In GDALDestroy - unloading GDAL shared library.
CPL_DEBUG=on ogrinfo -oo ADBC_DRIVER=libduckdb -oo -oo -oo -oo -oo -oo
90.25s user 22.43s system 41% cpu 4:29.75 total
--
Michael Smith
Remote Sensing/GIS Center
US Army Corps of Engineers
_______________________________________________
gdal-dev mailing list
gdal-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/gdal-dev
