Hi Mridul, Thanks for bringing this up. This is Jia Yu from Apache Sedona. I casted my vote as +0 (non-binding). This means "I don't feel strongly about it, but I'm okay with this." according to the ASF definition: https://www.apache.org/foundation/voting.html
In my opinion, Spark could just delegate its spatial support to Sedona and we just need to figure out how to better integrate Spark and Sedona for Iceberg Geo and Parquet Geo types support. That said, I won't get in the way if the Spark community really wants to do it. I think the SPIP doc provides a reasonable path forward. The Sedona community will work with the Spark community to make sure this will not create any compatibility issues. Regards, Jia Yu On Tue, May 6, 2025 at 9:45 AM Menelaos Karavelas < menelaos.karave...@gmail.com> wrote: > Hi Mridul, > > Just wanted to add that we intent to work with the Apache Sedona community > anyways going forward. > > - Menelaos > > > On May 6, 2025, at 6:45 AM, Wenchen Fan <cloud0...@gmail.com> wrote: > > Hi Mridul, > > The conclusion is that we will standardize the basic geo data types in > Spark, which allows third-party data sources and user-defined functions to > support geo data types natively when integrating with Spark. The majority > of geo processing functions will still be in Apache Sedona (or other Spark > plugin projects) instead of Spark itself. @Jia Yu <ji...@apache.org> feel > free to correct me if I missed anything. > > On Tue, May 6, 2025 at 11:51 AM Mridul Muralidharan <mri...@gmail.com> > wrote: > >> Hi, >> >> What was the conclusion of the discussion with Apache Sedona project ? >> Are they aligned with leveraging the support being built here ? >> >> Regards, >> Mridul >> >> On Mon, May 5, 2025 at 10:22 PM Gengliang Wang <ltn...@gmail.com> wrote: >> >>> +1 >>> >>> On Mon, May 5, 2025 at 6:54 PM Ruifeng Zheng <ruife...@apache.org> >>> wrote: >>> >>>> +1 >>>> >>>> On Tue, May 6, 2025 at 9:51 AM Xiao Li <gatorsm...@gmail.com> wrote: >>>> >>>>> +1 >>>>> >>>>> On Mon, May 5, 2025 at 18:35 Yuming Wang <yumw...@apache.org> wrote: >>>>> >>>>>> +1 >>>>>> >>>>>> On Tue, May 6, 2025 at 9:12 AM Denny Lee <denny.g....@gmail.com> >>>>>> wrote: >>>>>> >>>>>>> +1 (non-binding) >>>>>>> >>>>>>> On Mon, May 5, 2025 at 18:03 Wenchen Fan <cloud0...@gmail.com> >>>>>>> wrote: >>>>>>> >>>>>>>> +1 >>>>>>>> >>>>>>>> On Tue, May 6, 2025 at 3:40 AM Reynold Xin >>>>>>>> <r...@databricks.com.invalid> wrote: >>>>>>>> >>>>>>>>> +1 >>>>>>>>> >>>>>>>>> >>>>>>>>> On Mon, May 5, 2025 at 12:37 PM Bjørn Jørgensen < >>>>>>>>> bjornjorgen...@gmail.com> wrote: >>>>>>>>> >>>>>>>>>> +1 >>>>>>>>>> >>>>>>>>>> man. 5. mai 2025 kl. 21:28 skrev Milan Stefanovic < >>>>>>>>>> stefanovic.mila...@gmail.com>: >>>>>>>>>> >>>>>>>>>>> +1 (non-binding) >>>>>>>>>>> >>>>>>>>>>> Thanks, >>>>>>>>>>> Milan >>>>>>>>>>> >>>>>>>>>>> On Mon, 5 May 2025 at 21:25, Jia Yu <ji...@apache.org> wrote: >>>>>>>>>>> >>>>>>>>>>>> Thanks for putting this together. >>>>>>>>>>>> >>>>>>>>>>>> +0 (non-binding) from my side. Happy to see geospatial data is >>>>>>>>>>>> getting attention but we need to make it right. >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> Jia Yu >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> On Mon, May 5, 2025 at 12:15 PM Szehon Ho < >>>>>>>>>>>> szehon.apa...@gmail.com> wrote: >>>>>>>>>>>> >>>>>>>>>>>>> +1 (non binding) >>>>>>>>>>>>> >>>>>>>>>>>>> Thanks >>>>>>>>>>>>> Szehon >>>>>>>>>>>>> >>>>>>>>>>>>> On Mon, May 5, 2025 at 11:17 AM DB Tsai <dbt...@dbtsai.com> >>>>>>>>>>>>> wrote: >>>>>>>>>>>>> >>>>>>>>>>>>>> +1, geospatial types will be a great feature for Spark. >>>>>>>>>>>>>> Thanks for working on it. >>>>>>>>>>>>>> >>>>>>>>>>>>>> On May 5, 2025, at 11:04 AM, Menelaos Karavelas < >>>>>>>>>>>>>> menelaos.karave...@gmail.com> wrote: >>>>>>>>>>>>>> >>>>>>>>>>>>>> I started the discussion on adding geospatial types to Spark >>>>>>>>>>>>>> on March 28th. >>>>>>>>>>>>>> Since then there has been some discussion in the dev mailing >>>>>>>>>>>>>> list, as well as in the SPIP doc. >>>>>>>>>>>>>> >>>>>>>>>>>>>> At this point I would like to move to a formal vote on adding >>>>>>>>>>>>>> support for geospatial types to Spark. >>>>>>>>>>>>>> >>>>>>>>>>>>>> *Discussion thread:* >>>>>>>>>>>>>> >>>>>>>>>>>>>> https://lists.apache.org/thread/07ozv8ccfddd5tnfl8t74dr4tvnjdkpg >>>>>>>>>>>>>> >>>>>>>>>>>>>> *SPIP:* >>>>>>>>>>>>>> >>>>>>>>>>>>>> https://docs.google.com/document/d/1cYSNPGh95OjnpS0k_KDHGM9Ae3j-_0Wnc_eGBZL4D3w/edit?tab=t.0 >>>>>>>>>>>>>> >>>>>>>>>>>>>> *JIRA:* >>>>>>>>>>>>>> https://issues.apache.org/jira/browse/SPARK-51658 >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> Please vote on the SPIP for the next 72 hours: >>>>>>>>>>>>>> >>>>>>>>>>>>>> [ ] +1: Accept the proposal as an official SPIP >>>>>>>>>>>>>> [ ] +0 >>>>>>>>>>>>>> [ ] -1: I don’t think this is a good idea because >>>>>>>>>>>>>> >>>>>>>>>>>>>> Menelaos Karavelas >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>> >>>>>>>>>> -- >>>>>>>>>> Bjørn Jørgensen >>>>>>>>>> Vestre Aspehaug 4, 6010 Ålesund >>>>>>>>>> <https://www.google.com/maps/search/Vestre+Aspehaug+4,+6010+%C3%85lesund++Norge?entry=gmail&source=g> >>>>>>>>>> Norge >>>>>>>>>> <https://www.google.com/maps/search/Vestre+Aspehaug+4,+6010+%C3%85lesund++Norge?entry=gmail&source=g> >>>>>>>>>> >>>>>>>>>> +47 480 94 297 >>>>>>>>>> >>>>>>>>> >
