Thanks for the details and clarification. Great to see both communities working together to help our users !
+1 on the proposal. Regards, Mridul On Tue, May 6, 2025 at 5:12 PM Jia Yu <ji...@apache.org> wrote: > Hi Mridul, > > Thanks for bringing this up. This is Jia Yu from Apache Sedona. I casted > my vote as +0 (non-binding). This means "I don't feel strongly about it, > but I'm okay with this." according to the ASF definition: > https://www.apache.org/foundation/voting.html > > In my opinion, Spark could just delegate its spatial support to Sedona and > we just need to figure out how to better integrate Spark and Sedona for > Iceberg Geo and Parquet Geo types support. That said, I won't get in the > way if the Spark community really wants to do it. I think the SPIP doc > provides a reasonable path forward. The Sedona community will work with the > Spark community to make sure this will not create any compatibility issues. > > Regards, > Jia Yu > > On Tue, May 6, 2025 at 9:45 AM Menelaos Karavelas < > menelaos.karave...@gmail.com> wrote: > >> Hi Mridul, >> >> Just wanted to add that we intent to work with the Apache Sedona >> community anyways going forward. >> >> - Menelaos >> >> >> On May 6, 2025, at 6:45 AM, Wenchen Fan <cloud0...@gmail.com> wrote: >> >> Hi Mridul, >> >> The conclusion is that we will standardize the basic geo data types in >> Spark, which allows third-party data sources and user-defined functions to >> support geo data types natively when integrating with Spark. The majority >> of geo processing functions will still be in Apache Sedona (or other Spark >> plugin projects) instead of Spark itself. @Jia Yu <ji...@apache.org> feel >> free to correct me if I missed anything. >> >> On Tue, May 6, 2025 at 11:51 AM Mridul Muralidharan <mri...@gmail.com> >> wrote: >> >>> Hi, >>> >>> What was the conclusion of the discussion with Apache Sedona project ? >>> Are they aligned with leveraging the support being built here ? >>> >>> Regards, >>> Mridul >>> >>> On Mon, May 5, 2025 at 10:22 PM Gengliang Wang <ltn...@gmail.com> wrote: >>> >>>> +1 >>>> >>>> On Mon, May 5, 2025 at 6:54 PM Ruifeng Zheng <ruife...@apache.org> >>>> wrote: >>>> >>>>> +1 >>>>> >>>>> On Tue, May 6, 2025 at 9:51 AM Xiao Li <gatorsm...@gmail.com> wrote: >>>>> >>>>>> +1 >>>>>> >>>>>> On Mon, May 5, 2025 at 18:35 Yuming Wang <yumw...@apache.org> wrote: >>>>>> >>>>>>> +1 >>>>>>> >>>>>>> On Tue, May 6, 2025 at 9:12 AM Denny Lee <denny.g....@gmail.com> >>>>>>> wrote: >>>>>>> >>>>>>>> +1 (non-binding) >>>>>>>> >>>>>>>> On Mon, May 5, 2025 at 18:03 Wenchen Fan <cloud0...@gmail.com> >>>>>>>> wrote: >>>>>>>> >>>>>>>>> +1 >>>>>>>>> >>>>>>>>> On Tue, May 6, 2025 at 3:40 AM Reynold Xin >>>>>>>>> <r...@databricks.com.invalid> wrote: >>>>>>>>> >>>>>>>>>> +1 >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> On Mon, May 5, 2025 at 12:37 PM Bjørn Jørgensen < >>>>>>>>>> bjornjorgen...@gmail.com> wrote: >>>>>>>>>> >>>>>>>>>>> +1 >>>>>>>>>>> >>>>>>>>>>> man. 5. mai 2025 kl. 21:28 skrev Milan Stefanovic < >>>>>>>>>>> stefanovic.mila...@gmail.com>: >>>>>>>>>>> >>>>>>>>>>>> +1 (non-binding) >>>>>>>>>>>> >>>>>>>>>>>> Thanks, >>>>>>>>>>>> Milan >>>>>>>>>>>> >>>>>>>>>>>> On Mon, 5 May 2025 at 21:25, Jia Yu <ji...@apache.org> wrote: >>>>>>>>>>>> >>>>>>>>>>>>> Thanks for putting this together. >>>>>>>>>>>>> >>>>>>>>>>>>> +0 (non-binding) from my side. Happy to see geospatial data is >>>>>>>>>>>>> getting attention but we need to make it right. >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> Jia Yu >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> On Mon, May 5, 2025 at 12:15 PM Szehon Ho < >>>>>>>>>>>>> szehon.apa...@gmail.com> wrote: >>>>>>>>>>>>> >>>>>>>>>>>>>> +1 (non binding) >>>>>>>>>>>>>> >>>>>>>>>>>>>> Thanks >>>>>>>>>>>>>> Szehon >>>>>>>>>>>>>> >>>>>>>>>>>>>> On Mon, May 5, 2025 at 11:17 AM DB Tsai <dbt...@dbtsai.com> >>>>>>>>>>>>>> wrote: >>>>>>>>>>>>>> >>>>>>>>>>>>>>> +1, geospatial types will be a great feature for Spark. >>>>>>>>>>>>>>> Thanks for working on it. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> On May 5, 2025, at 11:04 AM, Menelaos Karavelas < >>>>>>>>>>>>>>> menelaos.karave...@gmail.com> wrote: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> I started the discussion on adding geospatial types to >>>>>>>>>>>>>>> Spark on March 28th. >>>>>>>>>>>>>>> Since then there has been some discussion in the dev mailing >>>>>>>>>>>>>>> list, as well as in the SPIP doc. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> At this point I would like to move to a formal vote on >>>>>>>>>>>>>>> adding support for geospatial types to Spark. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> *Discussion thread:* >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> https://lists.apache.org/thread/07ozv8ccfddd5tnfl8t74dr4tvnjdkpg >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> *SPIP:* >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> https://docs.google.com/document/d/1cYSNPGh95OjnpS0k_KDHGM9Ae3j-_0Wnc_eGBZL4D3w/edit?tab=t.0 >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> *JIRA:* >>>>>>>>>>>>>>> https://issues.apache.org/jira/browse/SPARK-51658 >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Please vote on the SPIP for the next 72 hours: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> [ ] +1: Accept the proposal as an official SPIP >>>>>>>>>>>>>>> [ ] +0 >>>>>>>>>>>>>>> [ ] -1: I don’t think this is a good idea because >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Menelaos Karavelas >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> -- >>>>>>>>>>> Bjørn Jørgensen >>>>>>>>>>> Vestre Aspehaug 4, 6010 Ålesund >>>>>>>>>>> <https://www.google.com/maps/search/Vestre+Aspehaug+4,+6010+%C3%85lesund++Norge?entry=gmail&source=g> >>>>>>>>>>> Norge >>>>>>>>>>> <https://www.google.com/maps/search/Vestre+Aspehaug+4,+6010+%C3%85lesund++Norge?entry=gmail&source=g> >>>>>>>>>>> >>>>>>>>>>> +47 480 94 297 >>>>>>>>>>> >>>>>>>>>> >>
