Re: [VOTE][RESULT] Release Spark 3.3.0 (RC6)

2022-06-14 Thread Dongjoon Hyun
Great! Thank you so much, Maxim. Dongjoon. On Tue, Jun 14, 2022 at 10:47 PM Maxim Gekk wrote: > The vote passes with 16 +1s (8 binding +1s). > Thanks to all who helped with the release! > > (* = binding) > +1: > Wenchen Fan (*) > Herman van Hovell (*) > Gengliang Wang > Sean Owen (*) > Tom Gr

[VOTE][RESULT] Release Spark 3.3.0 (RC6)

2022-06-14 Thread Maxim Gekk
The vote passes with 16 +1s (8 binding +1s). Thanks to all who helped with the release! (* = binding) +1: Wenchen Fan (*) Herman van Hovell (*) Gengliang Wang Sean Owen (*) Tom Graves (*) Mridul Muralidharan (*) Chris Nauroth Dongjoon Hyun (*) Yuming Wang Holden Karau (*) L. C. Hsieh (*) Cheng Su

Re: [VOTE] Release Spark 3.3.0 (RC6)

2022-06-14 Thread Maxim Gekk
Hi All, Here are the results of voting for RC6. +1: Wenchen Fan (*) Herman van Hovell (*) Gengliang Wang Sean Owen (*) Tom Graves (*) Mridul Muralidharan (*) Chris Nauroth Dongjoon Hyun (*) Yuming Wang Holden Karau (*) L. C. Hsieh (*) Cheng Su Chao Sun Martin Grigorov Peter Toth Max Gekk 8 (bin

Re: Stickers and Swag

2022-06-14 Thread Qian Sun
GOOD! Could these are mailed to China? > 2022年6月14日 下午2:04,Xiao Li 写道: > > Hi, all, > > The ASF has an official store at RedBubble > that Apache Community > Development (ComDev) runs. If you are interested in buying Spark Swag, 70 > products fe

Re: Stickers and Swag

2022-06-14 Thread Reynold Xin
Nice! Going to order a few items myself ... On Tue, Jun 14, 2022 at 7:54 PM, Gengliang Wang < ltn...@gmail.com > wrote: > > FYI now you can find the shopping information on https:/ / spark. apache. org/ > community ( https://spark.apache.org/community ) as well :) > > > > Gengliang > > > >

Re: Stickers and Swag

2022-06-14 Thread Gengliang Wang
FYI now you can find the shopping information on https://spark.apache.org/community as well :) Gengliang > On Jun 14, 2022, at 7:47 PM, Hyukjin Kwon wrote: > > Woohoo > > On Tue, 14 Jun 2022 at 15:04, Xiao Li > wrote: > Hi

Re: Stickers and Swag

2022-06-14 Thread Hyukjin Kwon
Woohoo On Tue, 14 Jun 2022 at 15:04, Xiao Li wrote: > Hi, all, > > The ASF has an official store at RedBubble > that Apache Community > Development (ComDev) runs. If you are interested in buying Spark Swag, 70 > products featuring the Spark logo are

Re: Spark32 + Java 11 . Reading parquet java.lang.NoSuchMethodError: 'sun.misc.Cleaner sun.nio.ch.DirectBuffer.cleaner()'

2022-06-14 Thread Pralabh Kumar
Thx for the reply @Steve Loughran @Martin . It helps . However just a minor suggestion - Should we update the documentation https://spark.apache.org/docs/latest/#downloading , which talks about java.nio.DirectByteBuffer . We can add another case , where user will get the same error f

Re: [VOTE] Release Spark 3.3.0 (RC6)

2022-06-14 Thread Peter Toth
+1 Martin Grigorov ezt írta (időpont: 2022. jún. 14., K, 13:23): > Hi, > > [X] +1 Release this package as Apache Spark 3.3.0 > > Tested: > - make local distribution from sources (with ./dev/make-distribution.sh > --tgz --name with-volcano -Pkubernetes,volcano,hadoop-3) > - create a Docker image

Re: [VOTE] Release Spark 3.3.0 (RC6)

2022-06-14 Thread Martin Grigorov
Hi, [X] +1 Release this package as Apache Spark 3.3.0 Tested: - make local distribution from sources (with ./dev/make-distribution.sh --tgz --name with-volcano -Pkubernetes,volcano,hadoop-3) - create a Docker image (with JDK 11) - run Pi example on -- local -- Kubernetes with default scheduler --

Re: Spark32 + Java 11 . Reading parquet java.lang.NoSuchMethodError: 'sun.misc.Cleaner sun.nio.ch.DirectBuffer.cleaner()'

2022-06-14 Thread Steve Loughran
hadoop 3.2.x is the oldest of the hadoop branch 3 branches which gets active security patches, as was done last month. I would strongly recommend using it unless there are other compatibility issues (hive?) On Tue, 14 Jun 2022 at 05:31, Pralabh Kumar wrote: > Hi Steve / Dev team > > Thx for the

Re:Re: [VOTE][SPIP] Spark Connect

2022-06-14 Thread beliefer
+1 Yeah, I tried to use Apache Livy, so as we can runing interactive query. But the Spark Driver in Livy looks heavy. The SPIP may resolve the issue. At 2022-06-14 18:11:21, "Wenchen Fan" wrote: +1 On Tue, Jun 14, 2022 at 9:38 AM Ruifeng Zheng wrote: +1 -- 原始邮件

Re: [VOTE][SPIP] Spark Connect

2022-06-14 Thread Wenchen Fan
+1 On Tue, Jun 14, 2022 at 9:38 AM Ruifeng Zheng wrote: > +1 > > > -- 原始邮件 -- > *发件人:* "huaxin gao" ; > *发送时间:* 2022年6月14日(星期二) 上午8:47 > *收件人:* "L. C. Hsieh"; > *抄送:* "Spark dev list"; > *主题:* Re: [VOTE][SPIP] Spark Connect > > +1 > > On Mon, Jun 13, 2022 at 5:42

Re: Spark32 + Java 11 . Reading parquet java.lang.NoSuchMethodError: 'sun.misc.Cleaner sun.nio.ch.DirectBuffer.cleaner()'

2022-06-14 Thread Martin Grigorov
Hi Pralabh, The Dockerfile defines and ARG for the JDK version: https://github.com/apache/spark/blob/861df43e8d022f51727e0a12a7cca5e119e3c4cc/resource-managers/kubernetes/docker/src/main/dockerfiles/spark/Dockerfile#L17 That means you could use --build-arg to overwrite it when building the image.