Hi Mridul, The conclusion is that we will standardize the basic geo data types in Spark, which allows third-party data sources and user-defined functions to support geo data types natively when integrating with Spark. The majority of geo processing functions will still be in Apache Sedona (or other Spark plugin projects) instead of Spark itself. @Jia Yu <[email protected]> feel free to correct me if I missed anything.
On Tue, May 6, 2025 at 11:51 AM Mridul Muralidharan <[email protected]> wrote: > Hi, > > What was the conclusion of the discussion with Apache Sedona project ? > Are they aligned with leveraging the support being built here ? > > Regards, > Mridul > > On Mon, May 5, 2025 at 10:22 PM Gengliang Wang <[email protected]> wrote: > >> +1 >> >> On Mon, May 5, 2025 at 6:54 PM Ruifeng Zheng <[email protected]> wrote: >> >>> +1 >>> >>> On Tue, May 6, 2025 at 9:51 AM Xiao Li <[email protected]> wrote: >>> >>>> +1 >>>> >>>> On Mon, May 5, 2025 at 18:35 Yuming Wang <[email protected]> wrote: >>>> >>>>> +1 >>>>> >>>>> On Tue, May 6, 2025 at 9:12 AM Denny Lee <[email protected]> >>>>> wrote: >>>>> >>>>>> +1 (non-binding) >>>>>> >>>>>> On Mon, May 5, 2025 at 18:03 Wenchen Fan <[email protected]> wrote: >>>>>> >>>>>>> +1 >>>>>>> >>>>>>> On Tue, May 6, 2025 at 3:40 AM Reynold Xin >>>>>>> <[email protected]> wrote: >>>>>>> >>>>>>>> +1 >>>>>>>> >>>>>>>> >>>>>>>> On Mon, May 5, 2025 at 12:37 PM Bjørn Jørgensen < >>>>>>>> [email protected]> wrote: >>>>>>>> >>>>>>>>> +1 >>>>>>>>> >>>>>>>>> man. 5. mai 2025 kl. 21:28 skrev Milan Stefanovic < >>>>>>>>> [email protected]>: >>>>>>>>> >>>>>>>>>> +1 (non-binding) >>>>>>>>>> >>>>>>>>>> Thanks, >>>>>>>>>> Milan >>>>>>>>>> >>>>>>>>>> On Mon, 5 May 2025 at 21:25, Jia Yu <[email protected]> wrote: >>>>>>>>>> >>>>>>>>>>> Thanks for putting this together. >>>>>>>>>>> >>>>>>>>>>> +0 (non-binding) from my side. Happy to see geospatial data is >>>>>>>>>>> getting attention but we need to make it right. >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> Jia Yu >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> On Mon, May 5, 2025 at 12:15 PM Szehon Ho < >>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>> >>>>>>>>>>>> +1 (non binding) >>>>>>>>>>>> >>>>>>>>>>>> Thanks >>>>>>>>>>>> Szehon >>>>>>>>>>>> >>>>>>>>>>>> On Mon, May 5, 2025 at 11:17 AM DB Tsai <[email protected]> >>>>>>>>>>>> wrote: >>>>>>>>>>>> >>>>>>>>>>>>> +1, geospatial types will be a great feature for Spark. Thanks >>>>>>>>>>>>> for working on it. >>>>>>>>>>>>> >>>>>>>>>>>>> On May 5, 2025, at 11:04 AM, Menelaos Karavelas < >>>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>>> >>>>>>>>>>>>> I started the discussion on adding geospatial types to Spark >>>>>>>>>>>>> on March 28th. >>>>>>>>>>>>> Since then there has been some discussion in the dev mailing >>>>>>>>>>>>> list, as well as in the SPIP doc. >>>>>>>>>>>>> >>>>>>>>>>>>> At this point I would like to move to a formal vote on adding >>>>>>>>>>>>> support for geospatial types to Spark. >>>>>>>>>>>>> >>>>>>>>>>>>> *Discussion thread:* >>>>>>>>>>>>> >>>>>>>>>>>>> https://lists.apache.org/thread/07ozv8ccfddd5tnfl8t74dr4tvnjdkpg >>>>>>>>>>>>> >>>>>>>>>>>>> *SPIP:* >>>>>>>>>>>>> >>>>>>>>>>>>> https://docs.google.com/document/d/1cYSNPGh95OjnpS0k_KDHGM9Ae3j-_0Wnc_eGBZL4D3w/edit?tab=t.0 >>>>>>>>>>>>> >>>>>>>>>>>>> *JIRA:* >>>>>>>>>>>>> https://issues.apache.org/jira/browse/SPARK-51658 >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> Please vote on the SPIP for the next 72 hours: >>>>>>>>>>>>> >>>>>>>>>>>>> [ ] +1: Accept the proposal as an official SPIP >>>>>>>>>>>>> [ ] +0 >>>>>>>>>>>>> [ ] -1: I don’t think this is a good idea because >>>>>>>>>>>>> >>>>>>>>>>>>> Menelaos Karavelas >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>> >>>>>>>>> -- >>>>>>>>> Bjørn Jørgensen >>>>>>>>> Vestre Aspehaug 4, 6010 Ålesund >>>>>>>>> <https://www.google.com/maps/search/Vestre+Aspehaug+4,+6010+%C3%85lesund++Norge?entry=gmail&source=g> >>>>>>>>> Norge >>>>>>>>> <https://www.google.com/maps/search/Vestre+Aspehaug+4,+6010+%C3%85lesund++Norge?entry=gmail&source=g> >>>>>>>>> >>>>>>>>> +47 480 94 297 >>>>>>>>> >>>>>>>>
