Re: [VOTE] Release Spark 3.3.0 (RC2)

2022-05-19 Thread Wenchen Fan
I think it should have been fixed by https://github.com/apache/spark/commit/0fdb6757946e2a0991256a3b73c0c09d6e764eed . Maybe the fix is not completed... On Thu, May 19, 2022 at 2:16 PM Kent Yao wrote: > Thanks, Maxim. > > Leave my -1 for this release candidate. > > Unfortunately, I don't know w

Final reminder: ApacheCon North America call for presentations closing soon

2022-05-19 Thread Rich Bowen
[Note: You're receiving this because you are subscribed to one or more Apache Software Foundation project mailing lists.] This is your final reminder that the Call for Presetations for ApacheCon North America 2022 will close at 00:01 GMT on Monday, May 23rd, 2022. Please don't wait! Get your talk

Re: [VOTE] Release Spark 3.3.0 (RC2)

2022-05-19 Thread Gengliang Wang
Hi Kent and Wenchen, Thanks for reporting. I just created https://github.com/apache/spark/pull/36609 to fix the issue. Gengliang On Thu, May 19, 2022 at 5:40 PM Wenchen Fan wrote: > I think it should have been fixed by > https://github.com/apache/spark/commit/0fdb6757946e2a0991256a3b73c0c09d6

Re: [VOTE] Release Spark 3.3.0 (RC2)

2022-05-19 Thread Kent Yao
Thanks for the quick fix, Gengliang. BR, Kent Gengliang Wang 于2022年5月19日周四 18:25写道: > > Hi Kent and Wenchen, > > Thanks for reporting. I just created > https://github.com/apache/spark/pull/36609 to fix the issue. > > Gengliang > > On Thu, May 19, 2022 at 5:40 PM Wenchen Fan wrote: >> >> I thin

Re: [VOTE] Release Spark 3.3.0 (RC2)

2022-05-19 Thread Emil Ejbyfeldt
Hi, When testing out Spark 3.3.0 on our production spark workload it was noticed that https://issues.apache.org/jira/browse/SPARK-38681 is actually a regression from 3.2 (I did not know this a the time of creating the ticket) seem like the bug was introduced in https://github.com/apache/spark

Re:Re: Unable to create view due to up cast error when migrating from Hive to Spark

2022-05-19 Thread beliefer
Thank you for the reply ! At 2022-05-18 20:27:27, "Wenchen Fan" wrote: A view is essentially a SQL query. It's fragile to share views between Spark and Hive because different systems have different SQL dialects. They may interpret the view SQL query differently and introduce unexpected beha

Re: Introducing "Pandas API on Spark" component in JIRA, and use "PS" PR title component

2022-05-19 Thread Bryan Cutler
+1, sounds good On Wed, May 18, 2022 at 9:16 PM Dongjoon Hyun wrote: > +1 > > Thank you for the suggestion, Hyukjin. > > Dongjoon. > > On Wed, May 18, 2022 at 11:08 AM Bjørn Jørgensen > wrote: > >> +1 >> But can will have PR Title and PR label the same, PS >> >> ons. 18. mai 2022 kl. 18:57 skr

Re: Introducing "Pandas API on Spark" component in JIRA, and use "PS" PR title component

2022-05-19 Thread L. C. Hsieh
+1. Thanks Hyukjin. On Thu, May 19, 2022 at 10:14 AM Bryan Cutler wrote: > > +1, sounds good > > On Wed, May 18, 2022 at 9:16 PM Dongjoon Hyun wrote: >> >> +1 >> >> Thank you for the suggestion, Hyukjin. >> >> Dongjoon. >> >> On Wed, May 18, 2022 at 11:08 AM Bjørn Jørgensen >> wrote: >>> >>> +

Spark on Kubernetes focused workshops

2022-05-19 Thread Agarwal, Janak
Team, is there a meetup or workshop focused on Spark on Kubernetes? If not, any interest in creating a once a month sync to exchange notes and best practices? Thanks, Janak

Re: [VOTE] Release Spark 3.3.0 (RC2)

2022-05-19 Thread Maxim Gekk
Hi All, The voting for Spark 3.3.0 RC2 has failed since there aren't enough +1 and due to reported bugs. I will prepare RC3 at the beginning of next week. All known issues have been resolved in 3.3 already (at least the issues reported in the thread). Please, test the current branch-3.3 and repor