Re: [gdal-dev] GDAL 3.11.0 "Eganville" beta1 available for testing

On the following page: https://gdal.org/en/latest/programs/gdal_raster_calc.html#gdal-raster-calc-subcommand Example 3 at the very bottom has: gdal_calc -i I think it should be: gdal raster calc -i ...like example 1 and 2? Scott On 4/17/25 12:03, Even Rouault via gdal-dev wrote: Hi

Re: [gdal-dev] GeoJSON with "id" in properties and SQLite dialect

As a work around, this seems to work: ogr2ogr -preserve_fid idtest1.geojson idtest.json ogrinfo -dialect sqlite -sql "select * from main" idtest1.geojson On 4/7/25 13:43, Rahkonen Jukka via gdal-dev wrote: Hi, I notised this question on gis.stackexchange https://gis.stackexchange.com/question

Re: [gdal-dev] GTI: override SRS of source tiles (disable reprojection)

If your rasters are invalid with bad projections or unreadable by gdalinfo, disregard the following. One way to create massive tile index's with individual rasters having 2 or more different projections is to use good old gdaltileindex. It will create an index of tiles (raster files) and bound

Re: [gdal-dev] FlatGeobuf Layer vs Feature Columns

If your using ogr2ogr try using the switch -emptyStrAsNull if you're not. On 3/6/25 15:39, Patrick Young via gdal-dev wrote: Hello, I translated some geojson to flatgeobuf where the geojson features have a variable number of properties (e.g. some features have a bunch of translations for the

Re: [gdal-dev] How to wrap a zarr in a zip and read it with vsizip?

There's GDAL's sozip (Search Optimized Zip) utility as well. I have no idea if it works with .zarr. I'm sure someone will correct me! ;) cd nczarr_v2.zarr sozip ../nczarr_v2.zarr.zip . sozip -l /vsizip/../nczarr_v2.zarr.zip On 2/24/25 10:09, Kurt Schwehr via gdal-dev wrote: Hi all, I seem to

Re: [gdal-dev] gdalbuildvrt Max Value / Pixel Function

WOW! Game changer. Any preliminary documentation on this? On 2/13/25 13:00, Daniel Baston via gdal-dev wrote: the next release of GDAL should have a replacement "gdal_calc" that would take multiple inputs and write a VRT that applies an expression to those inputs ___

Re: [gdal-dev] adding points to geometries

Hey Javier, Maybe create 2 geometries, southern and northern hemisphere, then do an intersection of both with your source geometries. You would have to create new fid as the new geom's would the same fid. Untested, something like this: ogr2ogr -dialect sqlite -sql @newGeom.sql target.gpkg so

Re: [gdal-dev] Seeking SQL wizardry

Hey Jesse, I *think* I simplified your query a bit. Untested, but it may work. delete from {label_name} where gdal_get_pixel_value('{raster_fp}', {ndvi_band_num}, 'georef', ST_X(st_centroid(geom)), ST_Y(st_centroid(geom))) < 600 Scott On 1/8/25 12:53, Meyer, Jesse R. (GSFC-618.0)[SCIENCE SYS

Re: [gdal-dev] DuckDB queries in GDAL/OGR master branch

Yes, s3 (httpfs) and of course local (filesystem) both have read/write capabilities. httpfs is the reason duckdb works over network. http(s) is the most ubiquitous internet protocol/data storage. geoparquet files on a web server http(s) *will not work*. Drop FGB on any http* server and it just

Re: [gdal-dev] DuckDB queries in GDAL/OGR master branch

Thanks for the example Michael! Will this work with geoparquet files on an out of the box apache web server? Will I need to replace my simple apache server(s) with httpfs/hdfs/hadoop or forced to use public, proprietary cloud storage? If I *only* need to filter by bbox, FlatGeoBuf (FGB) for

Re: [gdal-dev] EXTERNAL: Re: [EXTERNAL] Shape update/addition for Ceres

PM To: Reynolds, Scott mailto:sc...@agi.com>> Cc: Hare, Trent M mailto:th...@usgs.gov>> Subject: Re: [EXTERNAL] [gdal-dev] Shape update/addition for Ceres check with Trent Hare at USGS ________________ From: gdal-dev mailto:gdal-dev-boun...@lists.osgeo.org>> on behalf

[gdal-dev] Shape update/addition for Ceres

As a user of GDAL in some of our products I'm trying to find a contact, probably/possibly at Esri, that could add a new entry for Ceres that uses the oblate parameters defined here (487.3km, 446km). ESRI:104972

Re: [gdal-dev] Issue with the STACIT usage examples

Well, I hit send on that a bit too soon. The solution that works for me is wrapping everything in single quotes: gdalinfo 'STACIT:"someurl":asset=image' Yes, the -sd is sooo much nicer! I don't have access to a windows box, but I expect it will function the same. On 11/21/24 14:01, Scott wro

Re: [gdal-dev] Call for review on RFC 104: Adding a "gdal" front-end command line interface

Question, Is there any plan to incorporate the python utilities, such as, gdal_calc? That would be extremely handy with the PDAL like pipelines. Scott On 11/18/24 09:58, Even Rouault via gdal-dev wrote: Hi, Please review https://github.com/OSGeo/gdal/pull/11216 : Adding a "gdal" front-end c

[gdal-dev] ogrtindex, gdaltindex feature request

The whole, new GTI format got by me until Michael Sumner mentioned it on slack, which I visit extremely rarely. (Thanks Michael). I've been doing it in an entirely different way. The feature request is based on that. The feature request is this: gdaltindex -co GDALINFO=mymeta catalog.fgb *.

Re: [gdal-dev] How to locate where the raster min and max values are?

It ain't pretty or efficient, but it's cheap. Here's min value. Remove 'r' from sort for max value: gdal2xyz.py -csv -skipnodata source.tif /dev/stdout | grep -v done | sort -rnk 3,3 -t "," | tail -1 result: -116.9916667,36.5417,46 On 10/29/24 17:31, Rahkonen Jukka via gdal-dev wrote: H

Re: [gdal-dev] [EXTERNAL] Re: GPKG geometry column name expectations with sqlite dialect

What is the srid of your geometry? On 9/30/24 12:18, Meyer, Jesse R. (GSFC-618.0)[SCIENCE SYSTEMS AND APPLICATIONS INC] via gdal-dev wrote: /f/"select count(ST_Area('{lyr_name + '.' + geom_column_name}'))". (same outcome if re-arranged as count(…) from lyr_name instead) _

Re: [gdal-dev] [BULK] Re: [EXTERNAL] Re: GPKG geometry column name expectations with sqlite dialect

Using st_setsrid(geom, null) gives a count of 0. Setting it to 6931 gives a count. Just for fun, run "select st_srid(geometry_column) from layername" On 9/30/24 12:28, Meyer, Jesse R. (GSFC-618.0)[SCIENCE SYSTEMS AND APPLICATIONS INC] wrote: EPSG:6931, so projected in meters.  Expecting a tota

Re: [gdal-dev] GPKG geometry column name expectations with sqlite dialect

"Geometry Column = ..." in ogrinfo output. If the method returns an empty string then a special name "_ogr_geometry_" must be used. That's from the OGR driver docs: https://gdal.org/en/latest/user/ogr_sql_dialect.html I've always found it a bit weird as well. If I'm not sure I'll try, geom, ge

Re: [gdal-dev] gdal_edit.py question

Thanks Even! The NETCDF file(s) I'm working with have hundreds of sub data sets. Initially, I was breaking out all of them to .vrt's as you suggested, but it got a bit messy. Counting the sub-datasets with gdalinfo iteratively then using gdal_create -bands N was a lot cleaner. Passing dozens

[gdal-dev] gdal_edit.py question

Greetings, I need some help with gdal_edit. If I add meta data each time I add a band to a raster, only the last meta edit is present. Here's the scenario GDAL 3.9.1, gdal_edit.py is 3.6.2, Debian 12: # create empty 2-band raster with existing prototype: gdal_create -if src1.tif -bands 2 resu

Re: [gdal-dev] Motion: Renew Even Rouault GDAL Maintainer Contract

Only a year? Someone chain him to his desk already. You can't be too cautious. ;) Scott On 9/11/24 19:23, Howard Butler via gdal-dev wrote: PSC, I am motioning to renew Even's maintainer contract through the GDAL Sponsorship Program that is hosted by NumFOCUS for another year. /me starts wi

Re: [gdal-dev] Extending GDAL Color Interpretation enumeration for infra-red bands (+ band wavelength) ?

Given so many possible uses of band data, promote the use of meta data embedded in the image to suggest how the image should be rendered. There is no way to make everyone happy. To me, a raster is multidimensional data storage and has absolutely nothing to do with the data source. Trying to an

Re: [gdal-dev] Attribute filter on remote Parquet file is slow

I could be completely wrong here. My understanding is duckdb uses httpfs or possibly some variant of fsspec. I believe /vsis3 uses only libcurl, which doesn't *appear* to have support for httpfs. Again, I could be wildly wrong. On 8/28/24 09:45, Daniel Baston via gdal-dev wrote: Hello, I'm

Re: [gdal-dev] Question about gdal-dev archive - searching for information on reading HDF, SAR_CEOS metadata

Hey Shawn, In google try something like: hdf4 site:lists.osgeo.org/pipermail/gdal-dev You may be able to narrow things down. On 8/15/24 12:15, Fox, Shawn D (US) via gdal-dev wrote: Is there any way to search the archive?  So far, I have only found a way to show the threads for a particular mo

Re: [gdal-dev] GDAL 3.9.2 release candidate available

Ideally, it would be real nice to have an option that returns the coord and value on a single line. On 8/11/24 17:19, Scott via gdal-dev wrote: Looking at the news file, specifically about gdallocationinfo: gdallocationinfo: avoid extra newline character in -valonly mode if coordinate is

Re: [gdal-dev] GDAL 3.9.2 release candidate available

Looking at the news file, specifically about gdallocationinfo: gdallocationinfo: avoid extra newline character in -valonly mode if coordinate is outside raster extent (3.9.0 regression) Having that new-line character is imperative. For instance, say I have a file called coords.txt with the va

Re: [gdal-dev] Building GDAL documentation with ReadTheDocs

This is wildly important for systems without internet access. On 7/23/24 10:18, Greg Troxel via gdal-dev wrote: In my view, docs should be part of a package build and installed so they are available on the computer with the software. ___ gdal-dev mail

Re: [gdal-dev] Error linking srsinfo in 3.9.1 (rc1 or rc2)

On debian 12: /usr/include/c++/12/cstdlib, line 75. Context: // Need to ensure this finds the C library's not a libstdc++ // wrapper that might already be installed later in the include search path. #define _GLIBCXX_INCLUDE_NEXT_C_HEADERS #include_next #undef _GLIBCXX_INCLUDE_NEXT_C_HEADERS #i

Re: [gdal-dev] Error linking srsinfo in 3.9.1 (rc1 or rc2)

#include_next is part of the c++ version 12. You can find it's usage here on debian 12: /usr/include/c++/12/cstdlib, line 75 On 6/24/24 11:03, Scott via gdal-dev wrote: Yes, I saw that. It's the default code. I tried changing it to just 'include' early on and got a who

Re: [gdal-dev] Error linking srsinfo in 3.9.1 (rc1 or rc2)

y DeZonia wrote: Scott, is it that you are using #include_next instead of #include? #include_next makes assumptions about the environment that #include does not. On Mon, Jun 24, 2024 at 12:53 PM Scott via gdal-dev mailto:gdal-dev@lists.osgeo.org>> wrote: Thanks for the docker instru

Re: [gdal-dev] Error linking srsinfo in 3.9.1 (rc1 or rc2)

https://www.google.com/search?q=fatal+error%3A+stdlib.h%3A+No+such+file+or+directory+"; shows that this error message is quite common, although on quick reading, I couldn't spot a common point/solution between all those occurrences Even Le 24/06/2024 à 18:39, Scott via gdal-dev a é

Re: [gdal-dev] Error linking srsinfo in 3.9.1 (rc1 or rc2)

ommon, although on quick reading, I couldn't spot a common point/solution between all those occurrences Even Le 24/06/2024 à 18:39, Scott via gdal-dev a écrit : When building 3.9.1 rc1/r2 I get the following when linking. If I comment srsinfo out of the makefile, all other gdal/ogr apps build

[gdal-dev] Error linking srsinfo in 3.9.1 (rc1 or rc2)

When building 3.9.1 rc1/r2 I get the following when linking. If I comment srsinfo out of the makefile, all other gdal/ogr apps build fine with no issues. uname -a: Linux MyHost 6.1.0-21-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.90-1 (2024-05-03) x86_64 GNU/Linux Thanks! Build output below: [

Re: [gdal-dev] Python code with gdal_calc

https://gdal.org/programs/gdal_calc.html see the examples at the bottom. There are a number of numpy.* statements. On 6/6/24 21:48, lefsky--- via gdal-dev wrote: I know gdal_calc calculates using "python syntax" but I've never seen documentation for using numpy functions within the calc stateme

Re: [gdal-dev] GDAL 3.9.0 rc1 is available

Thanks for the -E, -field_sep and -ignore_extra_input in gdallocationinfo! It means we no longer have to pipe the input/output through paste -d or sed On 5/6/24 06:43, Even Rouault via gdal-dev wrote: Hi, I have prepared a GDAL/OGR 3.9.0 release candidate. NEWS at:   https://github.com/OSGe

Re: [gdal-dev] Efficient raster bounding box transformation?

The bbox is created using the xmin,ymin,xmax,ymax found in the geometry. Assuming every pixel can be represented as a geometry, that's your bbox. On 5/3/24 13:18, Simon Eves via gdal-dev wrote: Yes, but that's just the corners. Consider, say, a raster that contains a satellite sweep which is n

Re: [gdal-dev] Best way to GTiff options for hyperspectral data

You might create a Cloud Optimized GeoTiff (COG) from ENVI for frequently use band combinations, such as: gdalwarp -f COG -co COMPRESSION=DEFLATE -t_srs EPSG:4326 \ -src_band 23 -dst_band 1 \ -src_band 130 -dst_band 2 \ -src_band 420 -dst_band 3 \ [envi file] new.tif Now, you have a CO

Re: [gdal-dev] Feature Request: New -oo for VRT

en Le 20/03/2024 à 17:24, Scott via gdal-dev a écrit : It would be nice to have an open option to substitute a string of text with some other value, treating .vrt something like a template. Such as:    -oo REPLACE="'sourceString'='targetSt

[gdal-dev] Feature Request: New -oo for VRT

It would be nice to have an open option to substitute a string of text with some other value, treating .vrt something like a template. Such as: -oo REPLACE="'sourceString'='targetString'" Thoughts? Thanks for listening! Scott -- www.postholer.com

[gdal-dev] WriteBlock() not supported using JP2ECW driver?

Hi, I'm trying to create a JPEG2000 file using the JP2ECW driver, but I'm getting "WriteBlock() not supported...". The same code works using the PNM driver. What am I missing? Thanks, Scott Disclaimer The information contained in this electronic message and any attachments to this message ar

Re: [gdal-dev] gdal_translate shifted values

I'd check both files *before* all the processing. Something like: gdallocationinfo -l_srs EPSG:4326 gribFile -110 40 gdallocationinfo -l_srs EPSG:4326 tiffFile -110 40 That will tell narrow it down. On 1/31/24 15:53, Furuya, Takahiro via gdal-dev wrote: Hi gdal-dev, I am Takahiro, a student

Re: [gdal-dev] Passing Python PixelFunctionArguments or kwargs from command line?

. Thanks! Scott On 1/29/24 02:54, Even Rouault via gdal-dev wrote: Hi, no, the values of pixel function arguments are hardcoded in the VRT. If someone wanted to implement what you mention, that should rather be done as open option (-oo) of the VRT driver Even Le 29/01/2024 à 08:29, Scott v

[gdal-dev] Passing Python PixelFunctionArguments or kwargs from command line?

With a python pixel function in a .vrt file, is it possible to pass values from the command line? Example: gdal_translate ... -lco PixelFunctionArguments=? or -lco -kwargs=? Basically I want to change the 'min' and 'max' values on the command line: Thanks! Scott _

Re: [gdal-dev] Convert alpha to nodata?

+10 I'll buy them a 12 pack of their favorite micro-brew. On 1/19/24 09:32, Even Rouault via gdal-dev wrote: A nice exercice for (Pythonist) contributors would be to add a -f VRT capability to gdal_calc.py that would essentially automate the writing of such VRT using Python pixel functions. Ju

Re: [gdal-dev] slow translate with OVERVIEW_LEVEL=NONE when no overviews exist

Over the network it takes 23 seconds: time gdal_translate -oo OVERVIEW_LEVEL=NONE -outsize 219 226 /vsicurl/https://github.com/mdsumner/cog-example/raw/main/cog/sentinel-image.tif net.tif real 0m23.909s user 0m4.374s sys 0m1.021s Saving the file locally and translating it's fractional sec

Re: [gdal-dev] GDAL 3.8.0 is released

Yee haw! Thanks guys for all your hard work! On 11/13/23 09:48, Even Rouault via gdal-dev wrote: Hi, On behalf of the GDAL/OGR development team and community, I am pleased to announce the release of GDAL/OGR 3.8.0. GDAL/OGR is a C++ geospatial data access library for raster and vector file for

Re: [gdal-dev] Segfault with ogr2ogr and Parquet

Thanks for the info Even! On 11/5/23 13:26, Even Rouault wrote: Scott, I don't reproduce anymore on master, and I strongly suspect this is the same issue as https://lists.osgeo.org/pipermail/gdal-dev/2023-November/057856.html which I fixed post-beta1 Even Le 05/11/2023 à 19:57, Scot

Re: [gdal-dev] Segfault with ogr2ogr and Parquet

Check that. This is only on 3.8beta. Apologies. On 11/5/23 09:35, Scott via gdal-dev wrote: On debian 10 linux, using gdal 3.7.1 or 3.8beta, built with apache arrow 12.0, I get a segfault immediately after running either of these commands: ogr2ogr tst.gpkg PARQUET:"/vsicurl/

[gdal-dev] Segfault with ogr2ogr and Parquet

On debian 10 linux, using gdal 3.7.1 or 3.8beta, built with apache arrow 12.0, I get a segfault immediately after running either of these commands: ogr2ogr tst.gpkg PARQUET:"/vsicurl/https://overturemapswestus2.blob.core.windows.net/release/2023-10-19-alpha.0/theme=admins"; ogr2ogr tst.gpkg

Re: [gdal-dev] GDAL 3.7.3 RC1 available

Looking at the release notes did #8262 make it in? https://github.com/OSGeo/gdal/pull/8262 On 10/30/23 09:15, Even Rouault via gdal-dev wrote: Hi, I have prepared a GDAL/OGR 3.7.3 release candidate. Pick up an archive among the following ones (by ascending size):   https://download.osgeo.o

Re: [gdal-dev] help needed with pygdaltools library, documentation sparse

ions.  My first attempt was with adding skipfailures, but I can't add any of the options I have listed because I have no idea how to.  I thought it would be gdal_tools.config_options() but I get pylint tells me it is not callable -Original Message- From: gdal-dev <mailto:gda

Re: [gdal-dev] help needed with pygdaltools library, documentation sparse

-nln is being ignored because the data layer you're -updating -appending to exists. You can't rename a layer if it has a name. Remove -nln option Next you are trying to write a collection as a linestring. Use -explodecollections (if exists in your install) and/or use -nlt PROMOTE_TO_MULTI Tr

[gdal-dev] VSIGetMemFileBuffer Returns NULL When Copying Vector Dataset to Vsimem

Hi, I'm integrating GDAL in C++ with a system that defines its own asset types stored on disk, and am writing a wrapper for datasets using this asset system. To 'import' a dataset I call GDALOpenEx on it, CreateCopy() it to some "/vsimem/foo.shp" path, GDALClose() the datasets to flush it, and cal

Re: [gdal-dev] Using ogr2ogr with limited memory

On Thu, Sep 28, 2023 at 3:18 PM Scott via gdal-dev mailto:gdal-dev@lists.osgeo.org>> wrote: Thanks for digging into that Even! Can I create my new .fgb in sections? If I limit the number of source rows with -sql, doing that multiple times with -update, will it still build t

Re: [gdal-dev] Using ogr2ogr with limited memory

.7221139302758,-64.639696737462 3 17.7221065273415,-64.639698399651 17.7221299263498,-64.6398064310524 17.7221228777942,-64.6398022655579 17.7220642396531,-64.6397672401299 17.7220665249078)) On 9/28/23 10:03, Even Rouault wrote: Le 28/09/2023 à 18:47, Scott via gdal-dev a écrit : I should have b

Re: [gdal-dev] Using ogr2ogr with limited memory

I get the same error on OS AWS Linux 2. Also, on either OS with source .parquet instead of .fgb. On 9/28/23 10:17, Scott via gdal-dev wrote: USA.fgb is 36 GB. I've renamed it from its original source which can be found here: https://beta.source.coop/vida/google-microsoft-open-buil

Re: [gdal-dev] Using ogr2ogr with limited memory

,-64.6398022655579 17.7220642396531,-64.6397672401299 17.7220665249078)) On 9/28/23 10:03, Even Rouault wrote: Le 28/09/2023 à 18:47, Scott via gdal-dev a écrit : I should have been more specific. One particular machine has 8GB of memory. When I try to do the most simple ogr2ogr comma

Re: [gdal-dev] Using ogr2ogr with limited memory

I should have been more specific. One particular machine has 8GB of memory. When I try to do the most simple ogr2ogr command on large files, the host runs out of memory (vmstat shows this) and ogr2ogr terminates with 'Killed', nothing more. The data formats I have experienced this with are

Re: [gdal-dev] GDAL Interpolation Help

Averaging rasters is a common task. Often I see developers write many lines of python to do simple tasks like this. The following GDAL command should give you the results you're looking for: gdal_calc.py -A input1.tif -B input2.tif --outfile=result.tif --calc="(A+B)/2" The above command was

[gdal-dev] Using ogr2ogr with limited memory

Any tips for using ogr2ogr to use only a specified amount of RAM? I'm not having any luck. ___ gdal-dev mailing list gdal-dev@lists.osgeo.org https://lists.osgeo.org/mailman/listinfo/gdal-dev