Re: [DISCUSS] SPIP: Add geospatial types to Spark

Thanks Menelaos, this is exciting ! Is there a google doc we can comment, or just on the JIRA? Thanks Szehon On Fri, Mar 28, 2025 at 1:41 PM Ángel Álvarez Pascua < angel.alvarez.pas...@gmail.com> wrote: > Sorry, I only had a quick look at the proposal, looked for WKT and didn't > find anything.

Re: [DISCUSS] SPIP: Add geospatial types to Spark

+1 (non-binding) El vie, 28 mar 2025, 18:48, Menelaos Karavelas escribió: > Dear Spark community, > > I would like to propose the addition of new geospatial data types > (GEOMETRY and GEOGRAPHY) which represent geospatial values as recently > added as new logical types in the Parquet specificati

Re: [DISCUSS] SPIP: Add geospatial types to Spark

Dear Menelaos, Thanks for bringing this up again. I’ve seen similar proposals come up on the mailing list before, and I’d like to offer some thoughts. For full transparency, I’m Jia Yu, PMC Chair of Apache Sedona (https://github.com/apache/sedona), a widely used open-source cluster computing f

Re: [DISCUSS] SPIP: Add geospatial types to Spark

Sorry, I only had a quick look at the proposal, looked for WKT and didn't find anything. It's been years since I worked on geospatial projects and I'm not an expert (at all). Maybe starting with something simple but useful like conversion WKT<=>WKB? El vie, 28 mar 2025, 21:27, Menelaos Karavelas

Re: [DISCUSS] SPIP: Add geospatial types to Spark

In the SPIP Jira the proposal is to add the expressions ST_AsBinary, ST_GeomFromWKB, and ST_GeogFromWKB. Is there anything else that you think should be added? Regarding WKT, what do you think should be added? - Menelaos > On Mar 28, 2025, at 1:02 PM, Ángel Álvarez Pascua > wrote: > > What

Re: [DISCUSS] SPIP: Add geospatial types to Spark

What about adding support for WKT / WKB ? El vie, 28 mar 2025 a las 20:50, Ángel Álvarez Pascua (< angel.alvarez.pas...@gmail.com>)

[DISCUSS] SPIP: Add geospatial types to Spark

Dear Spark community, I would like to propose the addition of new geospatial data types (GEOMETRY and GEOGRAPHY) which represent geospatial values as recently added as new logical types in the Parquet specification. The new types should improve Spark’s ability to read the new Parquet logical t

[VOTE][RESULT] SPIP: Constraints in DSv2

The vote passes with 18 +1s (8 binding +1s) and 1 -1s (no binding -1s). Thanks to all who helped with the vote! (* = binding) +1: Gengliang Wang (*) Denny Lee Huaxin Gao (*) L.C. Hsieh (*) Zhou Jiang Jules Damji Szehon Ho DB Tsai (*) Peter Toth Yuming Wang (*) Anurag Mantripragada Serge Rielau Ju