Re: [VOTE] SPIP: Add geospatial types to Spark

2025-05-06 Thread Mridul Muralidharan
Thanks for the details and clarification. Great to see both communities working together to help our users ! +1 on the proposal. Regards, Mridul On Tue, May 6, 2025 at 5:12 PM Jia Yu wrote: > Hi Mridul, > > Thanks for bringing this up. This is Jia Yu from Apache Sedona. I casted > my vote as

Re: [VOTE] SPIP: Add geospatial types to Spark

2025-05-06 Thread Jia Yu
Hi Mridul, Thanks for bringing this up. This is Jia Yu from Apache Sedona. I casted my vote as +0 (non-binding). This means "I don't feel strongly about it, but I'm okay with this." according to the ASF definition: https://www.apache.org/foundation/voting.html In my opinion, Spark could just dele

Re: [DISCUSS] SPARK-51318: Remove `jar` files from Apache Spark repository and disable affected tests

2025-05-06 Thread Rozov, Vlad
I open https://issues.apache.org/jira/browse/SPARK-52018 to track the long term solution. I added one sub-task (https://issues.apache.org/jira/browse/SPARK-52020) for the hive-test-udfs.jar and open https://github.com/apache/spark/pull/50790. Please take a look. If it passes the community vote

Re: [VOTE] Release Apache Spark Connect Swift Client 0.1.0 (RC1)

2025-05-06 Thread Rozov, Vlad
+1 (non-binding) On May 6, 2025, at 6:33 AM, Sakthi wrote: +1 (non-binding) On Tue, May 6, 2025 at 2:00 AM Jungtaek Lim mailto:kabhwan.opensou...@gmail.com>> wrote: +1 (non-binding) Nice addition on Spark Connect! On Tue, May 6, 2025 at 5:47 PM Peter Toth mailto:peter.t...@gmail.com>> wrote

Re: [VOTE] SPIP: Add geospatial types to Spark

2025-05-06 Thread Menelaos Karavelas
Hi Mridul, Just wanted to add that we intent to work with the Apache Sedona community anyways going forward. - Menelaos > On May 6, 2025, at 6:45 AM, Wenchen Fan wrote: > > Hi Mridul, > > The conclusion is that we will standardize the basic geo data types in Spark, > which allows third-par

Re: [VOTE] Release Apache Spark Connect Swift Client 0.1.0 (RC1)

2025-05-06 Thread Dongjoon Hyun
Could you file a JIRA issue with the description of your steps, Martin? Dongjoon. On 2025/05/05 10:32:13 Martin Grund wrote: > Not sure this counts as -1, but by cursory checking the code, I found that > the way the TLS connection is set up is not always working: > > https://github.com/apache/sp

Re: [VOTE] Release Apache Spark K8s Operator 0.1.0 (RC1)

2025-05-06 Thread Dongjoon Hyun
To Rozov, we use "Apache SkyWalking Eyes" in our GitHub Action. - https://github.com/apache/skywalking-eyes - https://github.com/apache/spark-kubernetes-operator/blob/6116bb08c282911389fe2f5af49794a456111e97/.github/workflows/build_and_test.yml#L24 In addition, you can download RAT jar manually

Re: [VOTE] SPIP: Add geospatial types to Spark

2025-05-06 Thread Dongjoon Hyun
+1 Dongjoon On 2025/05/06 14:05:13 "Rozov, Vlad" wrote: > +1 (non-binding) > > > On May 6, 2025, at 6:34 AM, Sakthi wrote: > > +1 (non-binding) > > On Tue, May 6, 2025 at 1:30 AM Max Gekk > mailto:max.g...@gmail.com>> wrote: > +1 > > On Tue, May 6, 2025 at 9:59 AM Yang Jie > mailto:yangji

Re: [VOTE] SPIP: Add geospatial types to Spark

2025-05-06 Thread Rozov, Vlad
+1 (non-binding) On May 6, 2025, at 6:34 AM, Sakthi wrote: +1 (non-binding) On Tue, May 6, 2025 at 1:30 AM Max Gekk mailto:max.g...@gmail.com>> wrote: +1 On Tue, May 6, 2025 at 9:59 AM Yang Jie mailto:yangji...@apache.org>> wrote: +1 On 2025/05/06 03:25:21 "L. C. Hsieh" wrote: > +1 > > On

Re: [VOTE] SPIP: Add geospatial types to Spark

2025-05-06 Thread Wenchen Fan
Hi Mridul, The conclusion is that we will standardize the basic geo data types in Spark, which allows third-party data sources and user-defined functions to support geo data types natively when integrating with Spark. The majority of geo processing functions will still be in Apache Sedona (or othe

Re: [VOTE] Release Apache Spark K8s Operator 0.1.0 (RC1)

2025-05-06 Thread Sakthi
+1 (non-binding) On Tue, May 6, 2025 at 12:56 AM Yang Jie wrote: > +1, Thanks Dongjoon > > On 2025/05/06 02:45:40 Kent Yao wrote: > > +1, Thank you Dongjoon. > > > > Kent Yao > > > > Hyukjin Kwon 于2025年5月6日周二 10:31写道: > > > > > +1 > > > > > > On Tue, 6 May 2025 at 10:55, Ruifeng Zheng > wrote:

Re: [VOTE] SPIP: Add geospatial types to Spark

2025-05-06 Thread Sakthi
+1 (non-binding) On Tue, May 6, 2025 at 1:30 AM Max Gekk wrote: > +1 > > On Tue, May 6, 2025 at 9:59 AM Yang Jie wrote: > >> +1 >> >> On 2025/05/06 03:25:21 "L. C. Hsieh" wrote: >> > +1 >> > >> > On Mon, May 5, 2025 at 8:22 PM Gengliang Wang wrote: >> > > >> > > +1 >> > > >> > > On Mon, May 5,

Re: [VOTE] Release Apache Spark Connect Swift Client 0.1.0 (RC1)

2025-05-06 Thread Sakthi
+1 (non-binding) On Tue, May 6, 2025 at 2:00 AM Jungtaek Lim wrote: > +1 (non-binding) Nice addition on Spark Connect! > > On Tue, May 6, 2025 at 5:47 PM Peter Toth wrote: > >> +1 >> >> On Tue, May 6, 2025 at 9:59 AM Yang Jie wrote: >> >>> +1, A big thank you to Dongjoon for all the hard work

Re: [VOTE] Release Apache Spark Connect Swift Client 0.1.0 (RC1)

2025-05-06 Thread Jungtaek Lim
+1 (non-binding) Nice addition on Spark Connect! On Tue, May 6, 2025 at 5:47 PM Peter Toth wrote: > +1 > > On Tue, May 6, 2025 at 9:59 AM Yang Jie wrote: > >> +1, A big thank you to Dongjoon for all the hard work you've put into >> this! >> >> On 2025/05/05 18:19:33 DB Tsai wrote: >> > +1, it’s

Re: [VOTE] Release Apache Spark Connect Swift Client 0.1.0 (RC1)

2025-05-06 Thread Peter Toth
+1 On Tue, May 6, 2025 at 9:59 AM Yang Jie wrote: > +1, A big thank you to Dongjoon for all the hard work you've put into this! > > On 2025/05/05 18:19:33 DB Tsai wrote: > > +1, it’s exciting to see Spark Connect Swift client, showcasing Spark > Connect > > as a truly language-agnostic protocol,

Re: [VOTE] SPIP: Add geospatial types to Spark

2025-05-06 Thread Max Gekk
+1 On Tue, May 6, 2025 at 9:59 AM Yang Jie wrote: > +1 > > On 2025/05/06 03:25:21 "L. C. Hsieh" wrote: > > +1 > > > > On Mon, May 5, 2025 at 8:22 PM Gengliang Wang wrote: > > > > > > +1 > > > > > > On Mon, May 5, 2025 at 6:54 PM Ruifeng Zheng > wrote: > > >> > > >> +1 > > >> > > >> On Tue, May

Re: [VOTE] Release Apache Spark Connect Swift Client 0.1.0 (RC1)

2025-05-06 Thread Yang Jie
+1, A big thank you to Dongjoon for all the hard work you've put into this! On 2025/05/05 18:19:33 DB Tsai wrote: > +1, it’s exciting to see Spark Connect Swift client, showcasing Spark Connect > as a truly language-agnostic protocol, and also powering Swift users to use > Spark! > > > > Sent

Re: [VOTE] Release Apache Spark K8s Operator 0.1.0 (RC1)

2025-05-06 Thread Yang Jie
+1, Thanks Dongjoon On 2025/05/06 02:45:40 Kent Yao wrote: > +1, Thank you Dongjoon. > > Kent Yao > > Hyukjin Kwon 于2025年5月6日周二 10:31写道: > > > +1 > > > > On Tue, 6 May 2025 at 10:55, Ruifeng Zheng wrote: > > > >> +1 > >> > >> On Tue, May 6, 2025 at 9:00 AM Wenchen Fan wrote: > >> > >>> +1, t