Re: [gdal-dev] discussion on xarray and the missing abstract-grid specification

2024-04-03 Thread Michael Sumner via gdal-dev
ah thanks Even, I understand that and it was the first example that Ryan acknowledged was a problem a while back - he'd seen the Float32 problem in GHRSST. Excellent to get your take and the details. I've written up a small description of how this affects GHRSST, and my still-undecided next step t

Re: [gdal-dev] discussion on xarray and the missing abstract-grid specification

2024-04-03 Thread Even Rouault via gdal-dev
Hi, Not that I've a strong opinion on what GeoZarr/XArray should do, but yes 1D coordinate arrays are a bit of a pain to deal with, when they actually just encode a regularly spaced grid. This is something I've hit in the bridge between the GDAL multidimensional API (roughly netCDF based) and

Re: [gdal-dev] LAUNDER option for geopackages

2024-04-03 Thread Even Rouault via gdal-dev
Hi, I've given this a crack at https://github.com/OSGeo/gdal/pull/9609 The newly introduced LAUNDER option for GeoPackage is indeed quite "extreme" compared to the existing ones, hence I've defaulted it to NO. I've also added a LAUNDER_ASCII option to PG/PGDump to do something similar to Geo

[gdal-dev] discussion on xarray and the missing abstract-grid specification

2024-04-03 Thread Michael Sumner via gdal-dev
Here's an (ahem) extremely important discussion on the prospects for xarray to extend from the coordinates-only model (like that of netcdf) for geo reference: https://discourse.pangeo.io/t/example-which-highlights-the-limitations-of-netcdf-style-coordinates-for-large-geospatial-rasters/ I'm heart

Re: [gdal-dev] CVE-2024-3094 (aka "xz hackdoor") and GDAL

2024-04-03 Thread Sean Gillies via gdal-dev
Thank you for the analysis, Even! I've made similar announcements for the fiona and rasterio projects and plagiarized your subject line. Fiona and rasterio wheels on PyPI include versions of liblzma no more recent than 5.4.4 and do not include libarchive. https://github.com/Toblerity/Fiona/discus

Re: [gdal-dev] LAUNDER option for geopackages

2024-04-03 Thread Rahkonen Jukka via gdal-dev
Hi, The GeoPackage standard recommends some laundering to be done by the clients: Implementers should be aware of the fact that SQLite table names are not case sensitive and that table names in sqlite_master and gpkg_extensions may not have the same case. When searching for table name references,

[gdal-dev] LAUNDER option for geopackages

2024-04-03 Thread Robert Hewlett via gdal-dev
Hi, Is there a LAUNDER for geopackages? I ask this because at the following site: https://www.geopackage.org/guidance/getting-started.html Gives this specific guidance: Note: *For maximum interoperability,* start your database identifiers (table names, column names, etc.) with a lowercase char

Re: [gdal-dev] Gdaladdo and external mask band

2024-04-03 Thread Rahkonen Jukka via gdal-dev
Hi, Great, I just found 21000 .msk files without overviews from my computer. My scanned map files are so small that I have not noticed that they are unnecessary slow to view. Only trying someone else's data with 7 by 8 pixels draw my attention. -Jukka- Lähettäjä: Even Rouault Lähetet

Re: [gdal-dev] STACIT and limit

2024-04-03 Thread Michael Sumner via gdal-dev
Oh, my bad. It's documented to split into SDS for multiple CRS. Ouch that's not how I thought it was working, but it makes sense. Thanks, Mike On Thu, Apr 4, 2024 at 1:26 AM Michael Sumner wrote: > this works for me, there are ten items in the filelist: > > gdalinfo "STACIT:\" > https://eart

Re: [gdal-dev] HDF5 and identified fields / primary dimension

2024-04-03 Thread Michael Sumner via gdal-dev
> For that particular file, I see that the "feature_id" variable > (corresponding to the "feature_id" dimension) has a cf_role = > "timeseries_id" attribute, and that the global metadata has a > featureType = "timeSeries" attribute. So given > > https://cfconventions.org/Data/cf-conventions/cf-conv

[gdal-dev] STACIT and limit

2024-04-03 Thread Michael Sumner via gdal-dev
this works for me, there are ten items in the filelist: gdalinfo "STACIT:\" https://earth-search.aws.element84.com/v1/search?collections=sentinel-2-c1-l2a&bbox=0,0,10,10&datetime=2023-01-01T00:00:00Z/2023-12-31T23:59:59Z\":asset=visual"; -oo MAX_ITEMS=10 and with 20 it's also fine, filelist of 20

Re: [gdal-dev] Gdaladdo and external mask band

2024-04-03 Thread Even Rouault via gdal-dev
Hi Jukka, I've realized this behaviour was actually documented in https://gdal.org/drivers/raster/gtiff.html#overviews-and-nodata-masks : "Internal overviews, external nodata mask: when running BuildOverviews() in update mode on the .tif file, only the overviews of the main bands will be gene

Re: [gdal-dev] GDAL under cygwin doesn't read geotiff

2024-04-03 Thread Laurențiu Nicola via gdal-dev
Hi, Someone reported on IRC a similar crash about two weeks ago. As far as I can tell, that one is up to the Cygwin maintainers, so you should report it on their mailing list https://cygwin.com/lists.html#cygwin. Not sure about the Cygwin error and how well-tested GDAL is on that platform. The

[gdal-dev] GDAL under cygwin doesn't read geotiff

2024-04-03 Thread Nejia Ben Nasr via gdal-dev
Hi, I downloaded the last version of GDAL package. gdalinfo on any tiff file give "Segmentation fault". $ gdalinfo --version GDAL 3.8.3, released 2024/01/04 $ gdalinfo test.tif --config CPL_DEBUG ON GDAL: GDALOpen(test.tif, this=0xa000bbe70) succeeds as GTiff. Driver: GTiff/GeoTIFF Segmentation

[gdal-dev] Gdaladdo and external mask band

2024-04-03 Thread Rahkonen Jukka via gdal-dev
Hi, I was making some tests with filegdb raster from Region 5 - State (usda.gov), file https://usfs-public.box.com/shared/static/q96eev9gnsa9hw5bwpmwpmxerbdat0vi.zip I converted the data into GeoTIFF, added overviews, and no