Re: 回复: [VOTE] Release Spark 3.3.0 (RC6)

2022-06-13 Thread Jungtaek Lim
+1 (non-binding) Checked signature and checksum. Confirmed SPARK-39412 is resolved. Built source tgz with JDK 11. Thanks Max for driving the efforts of this huge release! On Tue, Jun 14, 2022 at 2:51 PM huaxin gao wrote: > +1 (non-binding) >

Stickers and Swag

2022-06-13 Thread Xiao Li
Hi, all, The ASF has an official store at RedBubble that Apache Community Development (ComDev) runs. If you are interested in buying Spark Swag, 70 products featuring the Spark logo are available: https://www.redbubble.com/shop/ap/113203780 Go Spark!

Re: 回复: [VOTE] Release Spark 3.3.0 (RC6)

2022-06-13 Thread huaxin gao
+1 (non-binding) On Mon, Jun 13, 2022 at 10:47 PM Kent Yao wrote: > +1, non-binding > > Xiao Li 于2022年6月14日周二 13:11写道: > > > > +1 > > > > Xiao > > > > beliefer 于2022年6月13日周一 20:04写道: > >> > >> +1 AFAIK, no blocking issues now. > >> Glad to hear to release 3.3.0 ! > >> > >> > >> 在 2022-06-14 09

Re: 回复: [VOTE] Release Spark 3.3.0 (RC6)

2022-06-13 Thread Kent Yao
+1, non-binding Xiao Li 于2022年6月14日周二 13:11写道: > > +1 > > Xiao > > beliefer 于2022年6月13日周一 20:04写道: >> >> +1 AFAIK, no blocking issues now. >> Glad to hear to release 3.3.0 ! >> >> >> 在 2022-06-14 09:38:35,"Ruifeng Zheng" 写道: >> >> +1 (non-binding) >> >> Maxim, thank you for driving this release

Re: 回复: [VOTE] Release Spark 3.3.0 (RC6)

2022-06-13 Thread Xiao Li
+1 Xiao beliefer 于2022年6月13日周一 20:04写道: > +1 AFAIK, no blocking issues now. > Glad to hear to release 3.3.0 ! > > > 在 2022-06-14 09:38:35,"Ruifeng Zheng" 写道: > > +1 (non-binding) > > Maxim, thank you for driving this release! > > thanks, > ruifeng > > > > -- 原始邮件 --

Re: Spark32 + Java 11 . Reading parquet java.lang.NoSuchMethodError: 'sun.misc.Cleaner sun.nio.ch.DirectBuffer.cleaner()'

2022-06-13 Thread Pralabh Kumar
Hi Steve / Dev team Thx for the help . Have a quick question , How can we fix the above error in Hadoop 3.1 . - Spark docker file have (Java 11) https://github.com/apache/spark/blob/branch-3.2/resource-managers/kubernetes/docker/src/main/dockerfiles/spark/Dockerfile - Now if we build

Re:回复: [VOTE] Release Spark 3.3.0 (RC6)

2022-06-13 Thread beliefer
+1 AFAIK, no blocking issues now. Glad to hear to release 3.3.0 ! 在 2022-06-14 09:38:35,"Ruifeng Zheng" 写道: +1 (non-binding) Maxim, thank you for driving this release! thanks, ruifeng -- 原始邮件 -- 发件人: "Chao Sun" ; 发送时间: 2022年6月14日(星期二) 上午8:45 收件人: "Ch

?????? [VOTE] Release Spark 3.3.0 (RC6)

2022-06-13 Thread Ruifeng Zheng
+1 (non-binding) Maxim, thank you for driving this release! thanks, ruifeng --  -- ??: "Chao Sun"

?????? [VOTE][SPIP] Spark Connect

2022-06-13 Thread Ruifeng Zheng
+1 --  -- ??: "huaxin gao"

Re: [VOTE][SPIP] Spark Connect

2022-06-13 Thread huaxin gao
+1 On Mon, Jun 13, 2022 at 5:42 PM L. C. Hsieh wrote: > +1 > > On Mon, Jun 13, 2022 at 5:41 PM Chao Sun wrote: > > > > +1 (non-binding) > > > > On Mon, Jun 13, 2022 at 5:11 PM Hyukjin Kwon > wrote: > >> > >> +1 > >> > >> On Tue, 14 Jun 2022 at 08:50, Yuming Wang wrote: > >>> > >>> +1. > >>> >

Re: [VOTE] Release Spark 3.3.0 (RC6)

2022-06-13 Thread Chao Sun
+1 (non-binding) Thanks, Chao On Mon, Jun 13, 2022 at 5:37 PM Cheng Su wrote: > +1 (non-binding). > > > > Thanks, > > Cheng Su > > > > *From: *L. C. Hsieh > *Date: *Monday, June 13, 2022 at 5:13 PM > *To: *dev > *Subject: *Re: [VOTE] Release Spark 3.3.0 (RC6) > > +1 > > On Mon, Jun 13, 2022 a

Re: [VOTE][SPIP] Spark Connect

2022-06-13 Thread L. C. Hsieh
+1 On Mon, Jun 13, 2022 at 5:41 PM Chao Sun wrote: > > +1 (non-binding) > > On Mon, Jun 13, 2022 at 5:11 PM Hyukjin Kwon wrote: >> >> +1 >> >> On Tue, 14 Jun 2022 at 08:50, Yuming Wang wrote: >>> >>> +1. >>> >>> On Tue, Jun 14, 2022 at 2:20 AM Matei Zaharia >>> wrote: +1, very excit

Re: [VOTE][SPIP] Spark Connect

2022-06-13 Thread Chao Sun
+1 (non-binding) On Mon, Jun 13, 2022 at 5:11 PM Hyukjin Kwon wrote: > +1 > > On Tue, 14 Jun 2022 at 08:50, Yuming Wang wrote: > >> +1. >> >> On Tue, Jun 14, 2022 at 2:20 AM Matei Zaharia >> wrote: >> >>> +1, very excited about this direction. >>> >>> Matei >>> >>> On Jun 13, 2022, at 11:07 AM

Re: [VOTE] Release Spark 3.3.0 (RC6)

2022-06-13 Thread Cheng Su
+1 (non-binding). Thanks, Cheng Su From: L. C. Hsieh Date: Monday, June 13, 2022 at 5:13 PM To: dev Subject: Re: [VOTE] Release Spark 3.3.0 (RC6) +1 On Mon, Jun 13, 2022 at 5:07 PM Holden Karau wrote: > > +1 > > On Mon, Jun 13, 2022 at 4:51 PM Yuming Wang wrote: >> >> +1 (non-binding) >> >>

Re: [VOTE] Release Spark 3.3.0 (RC6)

2022-06-13 Thread L. C. Hsieh
+1 On Mon, Jun 13, 2022 at 5:07 PM Holden Karau wrote: > > +1 > > On Mon, Jun 13, 2022 at 4:51 PM Yuming Wang wrote: >> >> +1 (non-binding) >> >> On Tue, Jun 14, 2022 at 7:41 AM Dongjoon Hyun >> wrote: >>> >>> +1 >>> >>> Thanks, >>> Dongjoon. >>> >>> On Mon, Jun 13, 2022 at 3:54 PM Chris Nauro

Re: [VOTE][SPIP] Spark Connect

2022-06-13 Thread Hyukjin Kwon
+1 On Tue, 14 Jun 2022 at 08:50, Yuming Wang wrote: > +1. > > On Tue, Jun 14, 2022 at 2:20 AM Matei Zaharia > wrote: > >> +1, very excited about this direction. >> >> Matei >> >> On Jun 13, 2022, at 11:07 AM, Herman van Hovell < >> her...@databricks.com.INVALID> wrote: >> >> Let me kick off the

Re: [VOTE] Release Spark 3.3.0 (RC6)

2022-06-13 Thread Holden Karau
+1 On Mon, Jun 13, 2022 at 4:51 PM Yuming Wang wrote: > +1 (non-binding) > > On Tue, Jun 14, 2022 at 7:41 AM Dongjoon Hyun > wrote: > >> +1 >> >> Thanks, >> Dongjoon. >> >> On Mon, Jun 13, 2022 at 3:54 PM Chris Nauroth >> wrote: >> >>> +1 (non-binding) >>> >>> I repeated all checks I described

Re: [VOTE][SPIP] Spark Connect

2022-06-13 Thread Yuming Wang
+1. On Tue, Jun 14, 2022 at 2:20 AM Matei Zaharia wrote: > +1, very excited about this direction. > > Matei > > On Jun 13, 2022, at 11:07 AM, Herman van Hovell < > her...@databricks.com.INVALID> wrote: > > Let me kick off the voting... > > +1 > > On Mon, Jun 13, 2022 at 2:02 PM Herman van Hovell

Re: [VOTE] Release Spark 3.3.0 (RC6)

2022-06-13 Thread Yuming Wang
+1 (non-binding) On Tue, Jun 14, 2022 at 7:41 AM Dongjoon Hyun wrote: > +1 > > Thanks, > Dongjoon. > > On Mon, Jun 13, 2022 at 3:54 PM Chris Nauroth wrote: > >> +1 (non-binding) >> >> I repeated all checks I described for RC5: >> >> https://lists.apache.org/thread/ksoxmozgz7q728mnxl6c2z7ncmo87v

Re: [VOTE] Release Spark 3.3.0 (RC6)

2022-06-13 Thread Dongjoon Hyun
+1 Thanks, Dongjoon. On Mon, Jun 13, 2022 at 3:54 PM Chris Nauroth wrote: > +1 (non-binding) > > I repeated all checks I described for RC5: > > https://lists.apache.org/thread/ksoxmozgz7q728mnxl6c2z7ncmo87vls > > Maxim, thank you for your dedication on these release candidates. > > Chris Naurot

Re: [VOTE] Release Spark 3.3.0 (RC6)

2022-06-13 Thread Chris Nauroth
+1 (non-binding) I repeated all checks I described for RC5: https://lists.apache.org/thread/ksoxmozgz7q728mnxl6c2z7ncmo87vls Maxim, thank you for your dedication on these release candidates. Chris Nauroth On Mon, Jun 13, 2022 at 3:21 PM Mridul Muralidharan wrote: > > +1 > > Signatures, dige

Re: [VOTE] Release Spark 3.3.0 (RC6)

2022-06-13 Thread Mridul Muralidharan
+1 Signatures, digests, etc check out fine. Checked out tag and build/tested with -Pyarn -Pmesos -Pkubernetes The test "SPARK-33084: Add jar support Ivy URI in SQL" in sql.SQLQuerySuite fails; but other than that, rest looks good. Regards, Mridul On Mon, Jun 13, 2022 at 4:25 PM Tom Graves wr

Re: [VOTE] Release Spark 3.3.0 (RC6)

2022-06-13 Thread Tom Graves
+1 Tom On Thursday, June 9, 2022, 11:27:50 PM CDT, Maxim Gekk wrote: Please vote on releasing the following candidate as Apache Spark version 3.3.0. The vote is open until 11:59pm Pacific time June 14th and passes if a majority +1 PMC votes are cast, with a minimum of 3 +1 votes. [ ]

Re: [VOTE] Release Spark 3.3.0 (RC6)

2022-06-13 Thread Sean Owen
+1 still looks good, same as last results. On Thu, Jun 9, 2022 at 11:27 PM Maxim Gekk wrote: > Please vote on releasing the following candidate as > Apache Spark version 3.3.0. > > The vote is open until 11:59pm Pacific time June 14th and passes if a > majority +1 PMC votes are cast, with a mini

Re: [VOTE][SPIP] Spark Connect

2022-06-13 Thread Matei Zaharia
+1, very excited about this direction. Matei > On Jun 13, 2022, at 11:07 AM, Herman van Hovell > wrote: > > Let me kick off the voting... > > +1 > > On Mon, Jun 13, 2022 at 2:02 PM Herman van Hovell > wrote: > Hi all, > > I’d like to start a vote for SPIP: "Sp

Re: [VOTE][SPIP] Spark Connect

2022-06-13 Thread Herman van Hovell
Let me kick off the voting... +1 On Mon, Jun 13, 2022 at 2:02 PM Herman van Hovell wrote: > Hi all, > > I’d like to start a vote for SPIP: "Spark Connect" > > The goal of the SPIP is to introduce a Dataframe based client/server API > for Spark > > Please also refer to: > > - Previous discussion

[VOTE][SPIP] Spark Connect

2022-06-13 Thread Herman van Hovell
Hi all, I’d like to start a vote for SPIP: "Spark Connect" The goal of the SPIP is to introduce a Dataframe based client/server API for Spark Please also refer to: - Previous discussion in dev mailing list: [DISCUSS] SPIP: Spark Connect - A client and server interface for Apache Spark.

Re: [VOTE] Release Spark 3.3.0 (RC6)

2022-06-13 Thread Gengliang Wang
+1 (non-binding) On Mon, Jun 13, 2022 at 10:20 AM Herman van Hovell wrote: > +1 > > On Mon, Jun 13, 2022 at 12:53 PM Wenchen Fan wrote: > >> +1, tests are all green and there are no more blocker issues AFAIK. >> >> On Fri, Jun 10, 2022 at 12:27 PM Maxim Gekk >> wrote: >> >>> Please vote on rel

Re: [VOTE] Release Spark 3.3.0 (RC6)

2022-06-13 Thread Herman van Hovell
+1 On Mon, Jun 13, 2022 at 12:53 PM Wenchen Fan wrote: > +1, tests are all green and there are no more blocker issues AFAIK. > > On Fri, Jun 10, 2022 at 12:27 PM Maxim Gekk > wrote: > >> Please vote on releasing the following candidate as >> Apache Spark version 3.3.0. >> >> The vote is open un

Re: [VOTE] Release Spark 3.3.0 (RC6)

2022-06-13 Thread Wenchen Fan
+1, tests are all green and there are no more blocker issues AFAIK. On Fri, Jun 10, 2022 at 12:27 PM Maxim Gekk wrote: > Please vote on releasing the following candidate as > Apache Spark version 3.3.0. > > The vote is open until 11:59pm Pacific time June 14th and passes if a > majority +1 PMC v

Re: Spark32 + Java 11 . Reading parquet java.lang.NoSuchMethodError: 'sun.misc.Cleaner sun.nio.ch.DirectBuffer.cleaner()'

2022-06-13 Thread Pralabh Kumar
Steve . Thx for your help ,please ignore last comment. Regards Pralabh Kumar On Mon, 13 Jun 2022, 15:43 Pralabh Kumar, wrote: > Hi steve > > Thx for help . We are on Hadoop3.2 ,however we are building Hadoop3.2 with > Java 8 . > > Do you suggest to build Hadoop with Java 11 > > Regards > Pralab

Re: Spark32 + Java 11 . Reading parquet java.lang.NoSuchMethodError: 'sun.misc.Cleaner sun.nio.ch.DirectBuffer.cleaner()'

2022-06-13 Thread Pralabh Kumar
Hi steve Thx for help . We are on Hadoop3.2 ,however we are building Hadoop3.2 with Java 8 . Do you suggest to build Hadoop with Java 11 Regards Pralabh kumar On Mon, 13 Jun 2022, 15:25 Steve Loughran, wrote: > > > On Mon, 13 Jun 2022 at 08:52, Pralabh Kumar > wrote: > >> Hi Dev team >> >> I

Re: Spark32 + Java 11 . Reading parquet java.lang.NoSuchMethodError: 'sun.misc.Cleaner sun.nio.ch.DirectBuffer.cleaner()'

2022-06-13 Thread Steve Loughran
On Mon, 13 Jun 2022 at 08:52, Pralabh Kumar wrote: > Hi Dev team > > I have a spark32 image with Java 11 (Running Spark on K8s) . While > reading a huge parquet file via spark.read.parquet("") . I am getting > the following error . The same error is mentioned in Spark docs > https://spark.apac

Spark32 + Java 11 . Reading parquet java.lang.NoSuchMethodError: 'sun.misc.Cleaner sun.nio.ch.DirectBuffer.cleaner()'

2022-06-13 Thread Pralabh Kumar
Hi Dev team I have a spark32 image with Java 11 (Running Spark on K8s) . While reading a huge parquet file via spark.read.parquet("") . I am getting the following error . The same error is mentioned in Spark docs https://spark.apache.org/docs/latest/#downloading but w.r.t to apache arrow.