RE: Release Spark 2.3.4

2019-08-16 Thread Dilip Biswal
+1   Regards,Dilip BiswalTel: 408-463-4980dbis...@us.ibm.com     - Original message -From: John Zhuge To: Xiao Li Cc: Takeshi Yamamuro , Spark dev list , Kazuaki Ishizaki Subject: [EXTERNAL] Re: Release Spark 2.3.4Date: Fri, Aug 16, 2019 4:33 PM  +1  On Fri, Aug 16, 2019 at 4:25 PM Xiao Li

Data Property Accumulators

2019-08-16 Thread Holden Karau
Are folks interested in seeing data property accumulators for RDDs? I made a proposal for this back in Spark 2016 ( https://docs.google.com/document/d/1lR_l1g3zMVctZXrcVjFusq2iQVpr4XvRK_UUDsDr6nk/edit ) but ABI compatibility was a stumbling block I couldn't design around. I can look at reviving it

Re: Release Spark 2.3.4

2019-08-16 Thread John Zhuge
+1 On Fri, Aug 16, 2019 at 4:25 PM Xiao Li wrote: > +1 > > On Fri, Aug 16, 2019 at 4:11 PM Takeshi Yamamuro > wrote: > >> +1, too >> >> Bests, >> Takeshi >> >> On Sat, Aug 17, 2019 at 7:25 AM Dongjoon Hyun >> wrote: >> >>> +1 for 2.3.4 release as the last release for `branch-2.3` EOL. >>> >>>

Re: Release Spark 2.3.4

2019-08-16 Thread Xiao Li
+1 On Fri, Aug 16, 2019 at 4:11 PM Takeshi Yamamuro wrote: > +1, too > > Bests, > Takeshi > > On Sat, Aug 17, 2019 at 7:25 AM Dongjoon Hyun > wrote: > >> +1 for 2.3.4 release as the last release for `branch-2.3` EOL. >> >> Also, +1 for next week release. >> >> Bests, >> Dongjoon. >> >> >> On Fr

Re: Release Spark 2.3.4

2019-08-16 Thread Takeshi Yamamuro
+1, too Bests, Takeshi On Sat, Aug 17, 2019 at 7:25 AM Dongjoon Hyun wrote: > +1 for 2.3.4 release as the last release for `branch-2.3` EOL. > > Also, +1 for next week release. > > Bests, > Dongjoon. > > > On Fri, Aug 16, 2019 at 8:19 AM Sean Owen wrote: > >> I think it's fine to do these in p

Re: Release Spark 2.3.4

2019-08-16 Thread Dongjoon Hyun
+1 for 2.3.4 release as the last release for `branch-2.3` EOL. Also, +1 for next week release. Bests, Dongjoon. On Fri, Aug 16, 2019 at 8:19 AM Sean Owen wrote: > I think it's fine to do these in parallel, yes. Go ahead if you are > willing. > > On Fri, Aug 16, 2019 at 9:48 AM Kazuaki Ishizak

Re: [build system] jenkins slow to respond

2019-08-16 Thread R. Tyler Croy
(replies inline) On Fri, 16 Aug 2019, Shane Knapp wrote: > i kicked apache, and the number of active connections dropped from ~500 to > ~100...  things are much snappier now. Hiya! I maintain ci.jenkins.io for the Jenkins project (among other things) and have some snippets of code you can use

Re: [build system] jenkins slow to respond

2019-08-16 Thread Shane Knapp
i kicked apache, and the number of active connections dropped from ~500 to ~100... things are much snappier now. On Fri, Aug 16, 2019 at 1:05 PM Shane Knapp wrote: > it's that time of the year again when jenkins decides to take it's time > serving pages. > > i will post any updates/etc when i g

[build system] jenkins slow to respond

2019-08-16 Thread Shane Knapp
it's that time of the year again when jenkins decides to take it's time serving pages. i will post any updates/etc when i get them. shane -- Shane Knapp UC Berkeley EECS Research / RISELab Staff Technical Lead https://rise.cs.berkeley.edu

Re: Release Spark 2.3.4

2019-08-16 Thread Sean Owen
I think it's fine to do these in parallel, yes. Go ahead if you are willing. On Fri, Aug 16, 2019 at 9:48 AM Kazuaki Ishizaki wrote: > > Hi, All. > > Spark 2.3.3 was released six months ago (15th February, 2019) at > http://spark.apache.org/news/spark-2-3-3-released.html. And, about 18 months >

Release Spark 2.3.4

2019-08-16 Thread Kazuaki Ishizaki
Hi, All. Spark 2.3.3 was released six months ago (15th February, 2019) at http://spark.apache.org/news/spark-2-3-3-released.html. And, about 18 months have been passed after Spark 2.3.0 has been released (28th February, 2018). As of today (16th August), there are 103 commits (69 JIRAs) in `bran

Re: Release Apache Spark 2.4.4

2019-08-16 Thread Dongjoon Hyun
Thank you, Kazuaki. Bests, Dongjoon. On Fri, Aug 16, 2019 at 3:10 AM Kazuaki Ishizaki wrote: > Sure, I will launch a separate e-mail thread for discussing 2.3.4 later. > > Regards, > Kazuaki Ishizaki, Ph.D. > > > > From:Dongjoon Hyun > To:Sean Owen , Kazuaki Ishizaki > Cc:

Re: Release Apache Spark 2.4.4

2019-08-16 Thread Kazuaki Ishizaki
Sure, I will launch a separate e-mail thread for discussing 2.3.4 later. Regards, Kazuaki Ishizaki, Ph.D. From: Dongjoon Hyun To: Sean Owen , Kazuaki Ishizaki Cc: dev Date: 2019/08/16 05:10 Subject:[EXTERNAL] Re: Release Apache Spark 2.4.4 +1 for that. Kazuaki volunte

Re: Ask for ARM CI for spark

2019-08-16 Thread bo zhaobo
Hi Sean, Thanks for reply. And very apologize for making you confused. I know the dependencies will be downloaded from SBT or Maven. But the Spark QA job also exec "mvn clean package", why the log didn't print "downloading some jar from Maven central [1] and build very fast. Is the reason that Spar