Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-28 Thread Michael Gummelt
+1 I know this is cancelled, but FYI, RC3 passes mesos/spark integration tests On Wed, Sep 28, 2016 at 2:52 AM, Sean Owen wrote: > (Process-wise there's no problem with that. The vote is open for at > least 3 days and ends when the RM says it ends. So it's valid anyway > as the vote is still op

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-28 Thread Sean Owen
(Process-wise there's no problem with that. The vote is open for at least 3 days and ends when the RM says it ends. So it's valid anyway as the vote is still open.) On Tue, Sep 27, 2016 at 8:37 PM, Reynold Xin wrote: > So technically the vote has passed, but IMHO it does not make sense to > relea

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-27 Thread Reynold Xin
So technically the vote has passed, but IMHO it does not make sense to release this and then immediately release 2.0.2. I will work on a new RC once SPARK-17666 and SPARK-17673 are fixed. Please shout if you disagree. On Tue, Sep 27, 2016 at 2:05 PM, Mark Hamstra wrote: > If we're going to cut

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-27 Thread Mark Hamstra
If we're going to cut another RC, then it would be good to get this in as well (assuming that it is merged shortly): https://github.com/apache/spark/pull/15213 It's not a regression, and it shouldn't happen too often, but when failed stages don't get resubmitted it is a fairly significant issue.

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-27 Thread Reynold Xin
Actually I'm going to have to -1 the release myself. Sorry for crashing the party, but I saw two super critical issues discovered in the last 2 days: https://issues.apache.org/jira/browse/SPARK-17666 -- this would eventually hang Spark when running against S3 (and many other storage systems) htt

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-27 Thread Mark Hamstra
I've got a couple of build niggles that should really be investigated at some point (what look to be OOM issues in spark-repl when building and testing with mvn in a single pass instead of in two passes with -DskipTests first; the killing of ssh sessions by YarnClusterSuite), but these aren't anyth

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-27 Thread Suresh Thalamati
+1 (non-binding) -suresh > On Sep 26, 2016, at 11:11 PM, Jagadeesan As wrote: > > +1 (non binding) > > Cheers, > Jagadeesan A S > > > > > From:Jean-Baptiste Onofré > To:dev@spark.apache.org > Date:27-09-16 11:27 AM >

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-26 Thread Jagadeesan As
+1 (non binding) Cheers, Jagadeesan A S From: Jean-Baptiste Onofré To: dev@spark.apache.org Date: 27-09-16 11:27 AM Subject:Re: [VOTE] Release Apache Spark 2.0.1 (RC3) +1 (non binding) Regards JB On 09/27/2016 07:51 AM, Hyukjin Kwon wrote: > +1 (non-binding) > >

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-26 Thread Jean-Baptiste Onofré
+1 (non binding) Regards JB On 09/27/2016 07:51 AM, Hyukjin Kwon wrote: +1 (non-binding) 2016-09-27 13:22 GMT+09:00 Denny Lee mailto:denny.g@gmail.com>>: +1 on testing with Python2. On Mon, Sep 26, 2016 at 3:13 PM Krishna Sankar mailto:ksanka...@gmail.com>> wrote: I do

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-26 Thread Holden Karau
+1 (non-binding) PySpark Core, ML, MLlib, SQL tests pass w/Python3 on Ubuntu 14.04 - some intermittent weird failures when running the streaming suite but seem to be flaky test issue & not a real issue, which is makes sense given how some of the Python streaming tests are structured. On Mon, Sep 2

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-26 Thread Hyukjin Kwon
+1 (non-binding) 2016-09-27 13:22 GMT+09:00 Denny Lee : > +1 on testing with Python2. > > > On Mon, Sep 26, 2016 at 3:13 PM Krishna Sankar > wrote: > >> I do run both Python and Scala. But via iPython/Python2 with my own test >> code. Not running the tests from the distribution. >> Cheers >> >>

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-26 Thread Denny Lee
+1 on testing with Python2. On Mon, Sep 26, 2016 at 3:13 PM Krishna Sankar wrote: > I do run both Python and Scala. But via iPython/Python2 with my own test > code. Not running the tests from the distribution. > Cheers > > > On Mon, Sep 26, 2016 at 11:59 AM, Holden Karau > wrote: > >> I'm seei

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-26 Thread Yanbo Liang
+1 On Mon, Sep 26, 2016 at 4:53 PM, akchin wrote: > +1 (non-bind) > -Pyarn -Phadoop-2.7 -Phive -Phive-thriftserver -Psparkr > CentOS 7.2 / openjdk version "1.8.0_101" > > > > > - > IBM Spark Technology Center > -- > View this message in context: http://apache-spark- > developers-list.1001551

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-26 Thread akchin
+1 (non-bind) -Pyarn -Phadoop-2.7 -Phive -Phive-thriftserver -Psparkr CentOS 7.2 / openjdk version "1.8.0_101" - IBM Spark Technology Center -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/VOTE-Release-Apache-Spark-2-0-1-RC3-tp19044p19093.html Se

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-26 Thread Krishna Sankar
I do run both Python and Scala. But via iPython/Python2 with my own test code. Not running the tests from the distribution. Cheers On Mon, Sep 26, 2016 at 11:59 AM, Holden Karau wrote: > I'm seeing some test failures with Python 3 that could definitely be > environmental (going to rebuild my vi

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-26 Thread Xiao Li
+1 2016-09-26 11:59 GMT-07:00 Holden Karau : > I'm seeing some test failures with Python 3 that could definitely be > environmental (going to rebuild my virtual env and double check), I'm just > wondering if other people are also running the Python tests on this release > or if everyone is focused

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-26 Thread Holden Karau
I'm seeing some test failures with Python 3 that could definitely be environmental (going to rebuild my virtual env and double check), I'm just wondering if other people are also running the Python tests on this release or if everyone is focused on the Scala tests? On Mon, Sep 26, 2016 at 11:48 AM

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-26 Thread Maciej Bryński
+1 At last :) 2016-09-26 19:56 GMT+02:00 Sameer Agarwal : > +1 (non-binding) > > On Mon, Sep 26, 2016 at 9:54 AM, Davies Liu wrote: > >> +1 (non-binding) >> >> On Mon, Sep 26, 2016 at 9:36 AM, Joseph Bradley >> wrote: >> > +1 >> > >> > On Mon, Sep 26, 2016 at 7:47 AM, Denny Lee >> wrote: >> >>

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-26 Thread Sameer Agarwal
+1 (non-binding) On Mon, Sep 26, 2016 at 9:54 AM, Davies Liu wrote: > +1 (non-binding) > > On Mon, Sep 26, 2016 at 9:36 AM, Joseph Bradley > wrote: > > +1 > > > > On Mon, Sep 26, 2016 at 7:47 AM, Denny Lee > wrote: > >> > >> +1 (non-binding) > >> On Sun, Sep 25, 2016 at 23:20 Jeff Zhang wrote

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-26 Thread Davies Liu
+1 (non-binding) On Mon, Sep 26, 2016 at 9:36 AM, Joseph Bradley wrote: > +1 > > On Mon, Sep 26, 2016 at 7:47 AM, Denny Lee wrote: >> >> +1 (non-binding) >> On Sun, Sep 25, 2016 at 23:20 Jeff Zhang wrote: >>> >>> +1 >>> >>> On Mon, Sep 26, 2016 at 2:03 PM, Shixiong(Ryan) Zhu >>> wrote: >>

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-26 Thread Joseph Bradley
+1 On Mon, Sep 26, 2016 at 7:47 AM, Denny Lee wrote: > +1 (non-binding) > On Sun, Sep 25, 2016 at 23:20 Jeff Zhang wrote: > >> +1 >> >> On Mon, Sep 26, 2016 at 2:03 PM, Shixiong(Ryan) Zhu < >> shixi...@databricks.com> wrote: >> >>> +1 >>> >>> On Sun, Sep 25, 2016 at 10:43 PM, Pete Lee >>> wrot

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-26 Thread Denny Lee
+1 (non-binding) On Sun, Sep 25, 2016 at 23:20 Jeff Zhang wrote: > +1 > > On Mon, Sep 26, 2016 at 2:03 PM, Shixiong(Ryan) Zhu < > shixi...@databricks.com> wrote: > >> +1 >> >> On Sun, Sep 25, 2016 at 10:43 PM, Pete Lee wrote: >> >>> +1 >>> >>> >>> On Sun, Sep 25, 2016 at 3:26 PM, Herman van Höve

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-25 Thread Jeff Zhang
+1 On Mon, Sep 26, 2016 at 2:03 PM, Shixiong(Ryan) Zhu wrote: > +1 > > On Sun, Sep 25, 2016 at 10:43 PM, Pete Lee wrote: > >> +1 >> >> >> On Sun, Sep 25, 2016 at 3:26 PM, Herman van Hövell tot Westerflier < >> hvanhov...@databricks.com> wrote: >> >>> +1 (non-binding) >>> >>> On Sun, Sep 25, 201

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-25 Thread Shixiong(Ryan) Zhu
+1 On Sun, Sep 25, 2016 at 10:43 PM, Pete Lee wrote: > +1 > > > On Sun, Sep 25, 2016 at 3:26 PM, Herman van Hövell tot Westerflier < > hvanhov...@databricks.com> wrote: > >> +1 (non-binding) >> >> On Sun, Sep 25, 2016 at 2:05 PM, Ricardo Almeida < >> ricardo.alme...@actnowib.com> wrote: >> >>> +

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-25 Thread Pete Lee
+1 On Sun, Sep 25, 2016 at 3:26 PM, Herman van Hövell tot Westerflier < hvanhov...@databricks.com> wrote: > +1 (non-binding) > > On Sun, Sep 25, 2016 at 2:05 PM, Ricardo Almeida < > ricardo.alme...@actnowib.com> wrote: > >> +1 (non-binding) >> >> Built and tested on >> - Ubuntu 16.04 / OpenJDK 1

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-25 Thread Luciano Resende
+1 (non-binding) On Sat, Sep 24, 2016 at 3:08 PM, Reynold Xin wrote: > Please vote on releasing the following candidate as Apache Spark version > 2.0.1. The vote is open until Tue, Sep 27, 2016 at 15:30 PDT and passes if > a majority of at least 3+1 PMC votes are cast. > > [ ] +1 Release this pa

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-25 Thread vaquar khan
+1 (non-binding) Regards, Vaquar khan On 25 Sep 2016 20:41, "Kousuke Saruta" wrote: > +1 (non-binding) > > On 2016年09月26日 07:26, Herman van Hövell tot Westerflier wrote: > > +1 (non-binding) > > On Sun, Sep 25, 2016 at 2:05 PM, Ricardo Almeida < > ricardo.alme...@actnowib.com> wrote: > >> +1 (n

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-25 Thread Kousuke Saruta
+1 (non-binding) On 2016年09月26日 07:26, Herman van Hövell tot Westerflier wrote: +1 (non-binding) On Sun, Sep 25, 2016 at 2:05 PM, Ricardo Almeida mailto:ricardo.alme...@actnowib.com>> wrote: +1 (non-binding) Built and tested on - Ubuntu 16.04 / OpenJDK 1.8.0_91 - CentOS /

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-25 Thread Herman van Hövell tot Westerflier
+1 (non-binding) On Sun, Sep 25, 2016 at 2:05 PM, Ricardo Almeida < ricardo.alme...@actnowib.com> wrote: > +1 (non-binding) > > Built and tested on > - Ubuntu 16.04 / OpenJDK 1.8.0_91 > - CentOS / Oracle Java 1.7.0_55 > (-Phadoop-2.7 -Dhadoop.version=2.7.3 -Phive -Phive-thriftserver -Pyarn) > > >

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-25 Thread Ricardo Almeida
+1 (non-binding) Built and tested on - Ubuntu 16.04 / OpenJDK 1.8.0_91 - CentOS / Oracle Java 1.7.0_55 (-Phadoop-2.7 -Dhadoop.version=2.7.3 -Phive -Phive-thriftserver -Pyarn) On 25 September 2016 at 22:35, Matei Zaharia wrote: > +1 > > Matei > > On Sep 25, 2016, at 1:25 PM, Josh Rosen wrote:

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-25 Thread Matei Zaharia
+1 Matei > On Sep 25, 2016, at 1:25 PM, Josh Rosen wrote: > > +1 > > On Sun, Sep 25, 2016 at 1:16 PM Yin Huai > wrote: > +1 > > On Sun, Sep 25, 2016 at 11:40 AM, Dongjoon Hyun > wrote: > +1 (non binding) > > RC3 is compiled and teste

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-25 Thread Josh Rosen
+1 On Sun, Sep 25, 2016 at 1:16 PM Yin Huai wrote: > +1 > > On Sun, Sep 25, 2016 at 11:40 AM, Dongjoon Hyun > wrote: > >> +1 (non binding) >> >> RC3 is compiled and tested on the following two systems, too. All tests >> passed. >> >> * CentOS 7.2 / Oracle JDK 1.8.0_77 / R 3.3.1 >>with -Pyar

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-25 Thread Yin Huai
+1 On Sun, Sep 25, 2016 at 11:40 AM, Dongjoon Hyun wrote: > +1 (non binding) > > RC3 is compiled and tested on the following two systems, too. All tests > passed. > > * CentOS 7.2 / Oracle JDK 1.8.0_77 / R 3.3.1 >with -Pyarn -Phadoop-2.7 -Pkinesis-asl -Phive -Phive-thriftserver > -Dsparkr >

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-25 Thread Dongjoon Hyun
+1 (non binding) RC3 is compiled and tested on the following two systems, too. All tests passed. * CentOS 7.2 / Oracle JDK 1.8.0_77 / R 3.3.1 with -Pyarn -Phadoop-2.7 -Pkinesis-asl -Phive -Phive-thriftserver -Dsparkr * CentOS 7.2 / Open JDK 1.8.0_102 with -Pyarn -Phadoop-2.7 -Pkinesis-asl -

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-25 Thread Jacek Laskowski
+1 Ship it! Pozdrawiam, Jacek Laskowski https://medium.com/@jaceklaskowski/ Mastering Apache Spark 2.0 http://bit.ly/mastering-apache-spark Follow me at https://twitter.com/jaceklaskowski On Sun, Sep 25, 2016 at 12:08 AM, Reynold Xin wrote: > Please vote on releasing the following candida

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-25 Thread Sean Owen
+1 binding. Same as for RC2 -- it all checks out, from license to sigs to compile and test. We have no issues of any kind targeted for 2.0.1. I do have one test failure that I have seen with some regularity in Ubuntu but not on any Jenkins machines. One of the YARN tests will just kill all my ssh

[VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-24 Thread Reynold Xin
Please vote on releasing the following candidate as Apache Spark version 2.0.1. The vote is open until Tue, Sep 27, 2016 at 15:30 PDT and passes if a majority of at least 3+1 PMC votes are cast. [ ] +1 Release this package as Apache Spark 2.0.1 [ ] -1 Do not release this package because ... The