[RESULT] [VOTE] Release Apache Spark 1.3.1 (RC3)

2015-04-14 Thread Patrick Wendell
This vote passes with 10 +1 votes (5 binding) and no 0 or -1 votes. +1: Sean Owen* Reynold Xin* Krishna Sankar Denny Lee Mark Hamstra* Sean McNamara* Sree V Marcelo Vanzin GuoQiang Li Patrick Wendell* 0: -1: I will work on packaging this release in the next 48 hours. - Patrick ---

Re: [VOTE] Release Apache Spark 1.3.1 (RC3)

2015-04-14 Thread Patrick Wendell
+1 from myself as well On Mon, Apr 13, 2015 at 8:35 PM, GuoQiang Li wrote: > +1 (non-binding) > > > -- Original -- > From: "Patrick Wendell";; > Date: Sat, Apr 11, 2015 02:05 PM > To: "dev@spark.apache.org"; > Subj

Re: [VOTE] Release Apache Spark 1.3.1 (RC3)

2015-04-13 Thread GuoQiang Li
+1 (non-binding) -- Original -- From: "Patrick Wendell";; Date: Sat, Apr 11, 2015 02:05 PM To: "dev@spark.apache.org"; Subject: [VOTE] Release Apache Spark 1.3.1 (RC3) Please vote on releasing the following candidate as Apache Spark

Re: [VOTE] Release Apache Spark 1.3.1 (RC3)

2015-04-13 Thread Marcelo Vanzin
+1 (non-binding) Tested 2.6 build with standalone and yarn (no external shuffle service this time, although it does come up). On Fri, Apr 10, 2015 at 11:05 PM, Patrick Wendell wrote: > Please vote on releasing the following candidate as Apache Spark version > 1.3.1! > > The tag to be voted on i

Re: [VOTE] Release Apache Spark 1.3.1 (RC3)

2015-04-13 Thread Sree V
+1builds - checktests - checkinstalls and sample run - check Thanking you. With Regards Sree On Friday, April 10, 2015 11:07 PM, Patrick Wendell wrote: Please vote on releasing the following candidate as Apache Spark version 1.3.1! The tag to be voted on is v1.3.1-rc2 (commit 3e8

Re: [VOTE] Release Apache Spark 1.3.1 (RC3)

2015-04-13 Thread Sean McNamara
+1 Sean > On Apr 11, 2015, at 12:07 AM, Patrick Wendell wrote: > > Please vote on releasing the following candidate as Apache Spark version > 1.3.1! > > The tag to be voted on is v1.3.1-rc2 (commit 3e83913): > https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=3e8391327ba586eaf544

Re: [VOTE] Release Apache Spark 1.3.1 (RC3)

2015-04-12 Thread Mark Hamstra
+1 On Fri, Apr 10, 2015 at 11:05 PM, Patrick Wendell wrote: > Please vote on releasing the following candidate as Apache Spark version > 1.3.1! > > The tag to be voted on is v1.3.1-rc2 (commit 3e83913): > > https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=3e8391327ba586eaf54447043b

Re: [VOTE] Release Apache Spark 1.3.1 (RC3)

2015-04-11 Thread Denny Lee
+1 (non-binding) On Sat, Apr 11, 2015 at 11:48 AM Krishna Sankar wrote: > +1. All tests OK (same as RC2) > Cheers > > > On Fri, Apr 10, 2015 at 11:05 PM, Patrick Wendell > wrote: > > > Please vote on releasing the following candidate as Apache Spark version > > 1.3.1! > > > > The tag to be vo

Re: [VOTE] Release Apache Spark 1.3.1 (RC3)

2015-04-11 Thread Krishna Sankar
+1. All tests OK (same as RC2) Cheers On Fri, Apr 10, 2015 at 11:05 PM, Patrick Wendell wrote: > Please vote on releasing the following candidate as Apache Spark version > 1.3.1! > > The tag to be voted on is v1.3.1-rc2 (commit 3e83913): > > https://git-wip-us.apache.org/repos/asf?p=spark.git;a

Re: [VOTE] Release Apache Spark 1.3.1 (RC3)

2015-04-11 Thread Reynold Xin
+1 On Fri, Apr 10, 2015 at 11:07 PM -0700, "Patrick Wendell" wrote: Please vote on releasing the following candidate as Apache Spark version 1.3.1! The tag to be voted on is v1.3.1-rc2 (commit 3e83913): https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=3e8391327ba586

Re: [VOTE] Release Apache Spark 1.3.1 (RC3)

2015-04-11 Thread Sean Owen
+1 same result as last time. On Sat, Apr 11, 2015 at 7:05 AM, Patrick Wendell wrote: > Please vote on releasing the following candidate as Apache Spark version > 1.3.1! > > The tag to be voted on is v1.3.1-rc2 (commit 3e83913): > https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=3e8

[VOTE] Release Apache Spark 1.3.1 (RC3)

2015-04-10 Thread Patrick Wendell
Please vote on releasing the following candidate as Apache Spark version 1.3.1! The tag to be voted on is v1.3.1-rc2 (commit 3e83913): https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=3e8391327ba586eaf54447043bd526d919043a44 The list of fixes present in this release can be found at:

[RESULT] [VOTE] Release Apache Spark 1.3.1 (RC2)

2015-04-10 Thread Patrick Wendell
This vote is cancelled in favor of RC3, due to SPARK-6851. On Fri, Apr 10, 2015 at 1:38 PM, Michael Armbrust wrote: > -1 (binding) > > We just were alerted to a pretty serious regression since 1.3.0 ( > https://issues.apache.org/jira/browse/SPARK-6851). Should have a fix > shortly. > > Michael >

Re: [VOTE] Release Apache Spark 1.3.1 (RC2)

2015-04-10 Thread Michael Armbrust
-1 (binding) We just were alerted to a pretty serious regression since 1.3.0 ( https://issues.apache.org/jira/browse/SPARK-6851). Should have a fix shortly. Michael On Fri, Apr 10, 2015 at 6:10 AM, Corey Nolet wrote: > +1 (non-binding) > > - Verified signatures > - built on Mac OSX > - built

Re: [VOTE] Release Apache Spark 1.3.1 (RC2)

2015-04-09 Thread Sean McNamara
+1 tested on OS X Sean > On Apr 7, 2015, at 11:46 PM, Patrick Wendell wrote: > > Please vote on releasing the following candidate as Apache Spark version > 1.3.1! > > The tag to be voted on is v1.3.1-rc2 (commit 7c4473a): > https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=7c4473

Re: [VOTE] Release Apache Spark 1.3.1 (RC2)

2015-04-08 Thread Denny Lee
+1 (non-binding) Tested Scala, SparkSQL, and MLLib on OSX against Hadoop 2.6 On Wed, Apr 8, 2015 at 5:35 PM Joseph Bradley wrote: > +1 tested ML-related items on Mac OS X > > On Wed, Apr 8, 2015 at 7:59 PM, Krishna Sankar > wrote: > > > +1 (non-binding, of course) > > > > 1. Compiled OSX 10.10

Re: [VOTE] Release Apache Spark 1.3.1 (RC2)

2015-04-08 Thread Joseph Bradley
+1 tested ML-related items on Mac OS X On Wed, Apr 8, 2015 at 7:59 PM, Krishna Sankar wrote: > +1 (non-binding, of course) > > 1. Compiled OSX 10.10 (Yosemite) OK Total time: 14:16 min > mvn clean package -Pyarn -Dyarn.version=2.6.0 -Phadoop-2.4 > -Dhadoop.version=2.6.0 -Phive -DskipTests -

Re: [VOTE] Release Apache Spark 1.3.1 (RC2)

2015-04-08 Thread Krishna Sankar
+1 (non-binding, of course) 1. Compiled OSX 10.10 (Yosemite) OK Total time: 14:16 min mvn clean package -Pyarn -Dyarn.version=2.6.0 -Phadoop-2.4 -Dhadoop.version=2.6.0 -Phive -DskipTests -Dscala-2.11 2. Tested pyspark, mlib - running as well as compare results with 1.3.0 pyspark works well

Re: [VOTE] Release Apache Spark 1.3.1 (RC2)

2015-04-08 Thread Sandy Ryza
+1 Built against Hadoop 2.6 and ran some jobs against a pseudo-distributed YARN cluster. -Sandy On Wed, Apr 8, 2015 at 12:49 PM, Patrick Wendell wrote: > Oh I see - ah okay I'm guessing it was a transient build error and > I'll get it posted ASAP. > > On Wed, Apr 8, 2015 at 3:41 PM, Denny Lee

Re: [VOTE] Release Apache Spark 1.3.1 (RC2)

2015-04-08 Thread Patrick Wendell
Oh I see - ah okay I'm guessing it was a transient build error and I'll get it posted ASAP. On Wed, Apr 8, 2015 at 3:41 PM, Denny Lee wrote: > Oh, it appears the 2.4 bits without hive are there but not the 2.4 bits with > hive. Cool stuff on the 2.6. > On Wed, Apr 8, 2015 at 12:30 Patrick Wendell

Re: [VOTE] Release Apache Spark 1.3.1 (RC2)

2015-04-08 Thread Denny Lee
Oh, it appears the 2.4 bits without hive are there but not the 2.4 bits with hive. Cool stuff on the 2.6. On Wed, Apr 8, 2015 at 12:30 Patrick Wendell wrote: > Hey Denny, > > I beleive the 2.4 bits are there. The 2.6 bits I had done specially > (we haven't merge that into our upstream build scrip

Re: [VOTE] Release Apache Spark 1.3.1 (RC2)

2015-04-08 Thread Patrick Wendell
Hey Denny, I beleive the 2.4 bits are there. The 2.6 bits I had done specially (we haven't merge that into our upstream build script). I'll do it again now for RC2. - Patrick On Wed, Apr 8, 2015 at 1:53 PM, Timothy Chen wrote: > +1 Tested on 4 nodes Mesos cluster with fine-grain and coarse-grai

Re: [VOTE] Release Apache Spark 1.3.1 (RC2)

2015-04-08 Thread Timothy Chen
+1 Tested on 4 nodes Mesos cluster with fine-grain and coarse-grain mode. Tim On Wed, Apr 8, 2015 at 9:32 AM, Denny Lee wrote: > The RC2 bits are lacking Hadoop 2.4 and Hadoop 2.6 - was that intended > (they were included in RC1)? > > > On Wed, Apr 8, 2015 at 9:01 AM Tom Graves > wrote: > >> +1

Re: [VOTE] Release Apache Spark 1.3.1 (RC2)

2015-04-08 Thread Denny Lee
The RC2 bits are lacking Hadoop 2.4 and Hadoop 2.6 - was that intended (they were included in RC1)? On Wed, Apr 8, 2015 at 9:01 AM Tom Graves wrote: > +1. Tested spark on yarn against hadoop 2.6. > Tom > > > On Wednesday, April 8, 2015 6:15 AM, Sean Owen > wrote: > > > Still a +1 from me

Re: [VOTE] Release Apache Spark 1.3.1 (RC2)

2015-04-08 Thread Tom Graves
+1. Tested spark on yarn against hadoop 2.6. Tom On Wednesday, April 8, 2015 6:15 AM, Sean Owen wrote: Still a +1 from me; same result (except that now of course the UISeleniumSuite test does not fail) On Wed, Apr 8, 2015 at 1:46 AM, Patrick Wendell wrote: > Please vote on releasin

Re: [VOTE] Release Apache Spark 1.3.1 (RC2)

2015-04-08 Thread Matei Zaharia
+1. Tested on Mac OS X and verified that some of the bugs were fixed. Matei > On Apr 8, 2015, at 7:13 AM, Sean Owen wrote: > > Still a +1 from me; same result (except that now of course the > UISeleniumSuite test does not fail) > > On Wed, Apr 8, 2015 at 1:46 AM, Patrick Wendell wrote: >> Ple

Re: [VOTE] Release Apache Spark 1.3.1 (RC2)

2015-04-08 Thread Sean Owen
Still a +1 from me; same result (except that now of course the UISeleniumSuite test does not fail) On Wed, Apr 8, 2015 at 1:46 AM, Patrick Wendell wrote: > Please vote on releasing the following candidate as Apache Spark version > 1.3.1! > > The tag to be voted on is v1.3.1-rc2 (commit 7c4473a):

[VOTE] Release Apache Spark 1.3.1 (RC2)

2015-04-07 Thread Patrick Wendell
Please vote on releasing the following candidate as Apache Spark version 1.3.1! The tag to be voted on is v1.3.1-rc2 (commit 7c4473a): https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=7c4473aa5a7f5de0323394aaedeefbf9738e8eb5 The list of fixes present in this release can be found at:

[RESULT] [VOTE] Release Apache Spark 1.3.1

2015-04-07 Thread Patrick Wendell
This vote is cancelled in favor of RC2. On Tue, Apr 7, 2015 at 8:13 PM, Josh Rosen wrote: > The leak will impact long running streaming jobs even if they don't write > Hadoop files, although the problem may take much longer to manifest itself > for those jobs. > > I think we currently leak an e

Re: [VOTE] Release Apache Spark 1.3.1

2015-04-07 Thread Josh Rosen
The leak will impact long running streaming jobs even if they don't write Hadoop files, although the problem may take much longer to manifest itself for those jobs. I think we currently leak an empty HashMap per stage submitted in the common case, so it could take a very long time for this to t

Re: [VOTE] Release Apache Spark 1.3.1

2015-04-07 Thread Patrick Wendell
Hey All, Today SPARK-6737 came to my attention. This is a bug that causes a memory leak for any long running program that repeatedly saves data out to a Hadoop FileSystem. For that reason, it is problematic for Spark Streaming. My sense is that this is severe enough to cut another RC once the fix

Re: [VOTE] Release Apache Spark 1.3.1

2015-04-07 Thread Marcelo Vanzin
+1 (non-binding) Ran standalone and yarn tests on the hadoop-2.6 tarball, with and without the external shuffle service in yarn mode. On Sat, Apr 4, 2015 at 5:09 PM, Patrick Wendell wrote: > Please vote on releasing the following candidate as Apache Spark version > 1.3.1! > > The tag to be vote

Re: [VOTE] Release Apache Spark 1.3.1

2015-04-06 Thread Sean McNamara
+1 > On Apr 4, 2015, at 6:11 PM, Patrick Wendell wrote: > > Please vote on releasing the following candidate as Apache Spark version > 1.3.1! > > The tag to be voted on is v1.3.1-rc1 (commit 0dcb5d9f): > https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=0dcb5d9f31b713ed90bcec63ebc

Re: [VOTE] Release Apache Spark 1.3.1

2015-04-06 Thread Mark Hamstra
+1 On Sat, Apr 4, 2015 at 5:09 PM, Patrick Wendell wrote: > Please vote on releasing the following candidate as Apache Spark version > 1.3.1! > > The tag to be voted on is v1.3.1-rc1 (commit 0dcb5d9f): > > https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=0dcb5d9f31b713ed90bcec63ebc

Re: [VOTE] Release Apache Spark 1.3.1

2015-04-06 Thread Hari Shreedharan
Ah, ok. It was missing in the list of jiras. So +1. Thanks, Hari On Mon, Apr 6, 2015 at 11:36 AM, Patrick Wendell wrote: > I believe TD just forgot to set the fix version on the JIRA. There is > a fix for this in 1.3: > https://github.com/apache/spark/commit/03e263f5b527cf574f4ffcd5cd886f772

Re: [VOTE] Release Apache Spark 1.3.1

2015-04-06 Thread Patrick Wendell
I believe TD just forgot to set the fix version on the JIRA. There is a fix for this in 1.3: https://github.com/apache/spark/commit/03e263f5b527cf574f4ffcd5cd886f7723e3756e - Patrick On Mon, Apr 6, 2015 at 2:31 PM, Mark Hamstra wrote: > Is that correct, or is the JIRA just out of sync, since TD

Re: [VOTE] Release Apache Spark 1.3.1

2015-04-06 Thread Mark Hamstra
Is that correct, or is the JIRA just out of sync, since TD's PR was merged? https://github.com/apache/spark/pull/5008 On Mon, Apr 6, 2015 at 11:10 AM, Hari Shreedharan wrote: > It does not look like https://issues.apache.org/jira/browse/SPARK-6222 > made it. It was targeted towards this release.

Re: [VOTE] Release Apache Spark 1.3.1

2015-04-06 Thread Hari Shreedharan
It does not look like https://issues.apache.org/jira/browse/SPARK-6222 made it. It was targeted towards this release.  Thanks, Hari On Mon, Apr 6, 2015 at 11:04 AM, York, Brennon wrote: > +1 (non-binding) > Tested GraphX, build infrastructure, & core test suite on OSX 10.9 w/ Java > 1.7/1.8

Re: [VOTE] Release Apache Spark 1.3.1

2015-04-06 Thread York, Brennon
+1 (non-binding) Tested GraphX, build infrastructure, & core test suite on OSX 10.9 w/ Java 1.7/1.8 On 4/6/15, 5:21 AM, "Sean Owen" wrote: >SPARK-6673 is not, in the end, relevant for 1.3.x I believe; we just >resolved it for 1.4 anyway. False alarm there. > >I back-ported SPARK-6205 into the 1

Re: [VOTE] Release Apache Spark 1.3.1

2015-04-06 Thread Sean Owen
SPARK-6673 is not, in the end, relevant for 1.3.x I believe; we just resolved it for 1.4 anyway. False alarm there. I back-ported SPARK-6205 into the 1.3 branch for next time. We'll pick it up if there's another RC, but by itself is not something that needs a new RC. (I will give the same treatmen

Re: [VOTE] Release Apache Spark 1.3.1

2015-04-05 Thread Denny Lee
+1 (non-binding) Verified various DataFrame functions, Hive integration, MLlib, etc. on OSX. On Sun, Apr 5, 2015 at 9:16 PM Xiangrui Meng wrote: > +1 Verified some MLlib bug fixes on OS X. -Xiangrui > > On Sun, Apr 5, 2015 at 1:24 AM, Sean Owen wrote: > > Signatures and hashes are good. > > LI

Re: [VOTE] Release Apache Spark 1.3.1

2015-04-05 Thread Xiangrui Meng
+1 Verified some MLlib bug fixes on OS X. -Xiangrui On Sun, Apr 5, 2015 at 1:24 AM, Sean Owen wrote: > Signatures and hashes are good. > LICENSE, NOTICE still check out. > Compiles for a Hadoop 2.6 + YARN + Hive profile. > > I still see the UISeleniumSuite test failure observed in 1.3.0, which >

Re: [VOTE] Release Apache Spark 1.3.1

2015-04-05 Thread Sean Owen
Signatures and hashes are good. LICENSE, NOTICE still check out. Compiles for a Hadoop 2.6 + YARN + Hive profile. I still see the UISeleniumSuite test failure observed in 1.3.0, which is minor and already fixed. I don't know why I didn't back-port it: https://issues.apache.org/jira/browse/SPARK-62

Re: [VOTE] Release Apache Spark 1.3.1

2015-04-04 Thread GuoQiang Li
+1 (non-binding) I have a simple test of ALS(Implicit), LR(SGD,L-BFGS) algorithm. Looks no problem‍ -- Original -- From: "Patrick Wendell";; Date: Sun, Apr 5, 2015 08:09 AM To: "dev@spark.apache.org"; Subject: [VOTE] Releas

Re: [VOTE] Release Apache Spark 1.3.1

2015-04-04 Thread Krishna Sankar
+1 (non-binding, of course) 1. Compiled OSX 10.10 (Yosemite) OK Total time: 15:04 min mvn clean package -Pyarn -Dyarn.version=2.6.0 -Phadoop-2.4 -Dhadoop.version=2.6.0 -Phive -DskipTests -Dscala-2.11 2. Tested pyspark, mlib - running as well as compare results with 1.3.0 pyspark works well

Re: [VOTE] Release Apache Spark 1.3.1

2015-04-04 Thread Reynold Xin
+1 Tested some DataFrame functions locally on Mac OS X. On Sat, Apr 4, 2015 at 5:09 PM, Patrick Wendell wrote: > Please vote on releasing the following candidate as Apache Spark version > 1.3.1! > > The tag to be voted on is v1.3.1-rc1 (commit 0dcb5d9f): > > https://git-wip-us.apache.org/repos/

[VOTE] Release Apache Spark 1.3.1

2015-04-04 Thread Patrick Wendell
Please vote on releasing the following candidate as Apache Spark version 1.3.1! The tag to be voted on is v1.3.1-rc1 (commit 0dcb5d9f): https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=0dcb5d9f31b713ed90bcec63ebc4e530cbb69851 The list of fixes present in this release can be found at