Re: [VOTE] Designating maintainers for some Spark components

2014-11-06 Thread Sean McNamara
+1 Sean On Nov 5, 2014, at 6:32 PM, Matei Zaharia wrote: > Hi all, > > I wanted to share a discussion we've been having on the PMC list, as well as > call for an official vote on it on a public list. Basically, as the Spark > project scales up, we need to define a model to make sure there is

Re: [VOTE] Release Apache Spark 1.2.0 (RC2)

2014-12-13 Thread Sean McNamara
+1 tested on OS X and deployed+tested our apps via YARN into our staging cluster. Sean > On Dec 11, 2014, at 10:40 AM, Reynold Xin wrote: > > +1 > > Tested on OS X. > > On Wednesday, December 10, 2014, Patrick Wendell wrote: > >> Please vote on releasing the following candidate as Apache

Re: Which committers care about Kafka?

2014-12-19 Thread Sean McNamara
Please feel free to correct me if I’m wrong, but I think the exactly once spark streaming semantics can easily be solved using updateStateByKey. Make the key going into updateStateByKey be a hash of the event, or pluck off some uuid from the message. The updateFunc would only emit the message i

Re: [VOTE] Release Apache Spark 1.2.1 (RC1)

2015-01-27 Thread Sean McNamara
We’re using spark on scala 2.11 /w hadoop2.4. Would it be practical / make sense to build a bin version of spark against scala 2.11 for versions other than just hadoop1 at this time? Cheers, Sean > On Jan 27, 2015, at 12:04 AM, Patrick Wendell wrote: > > Please vote on releasing the follow

Re: [VOTE] Release Apache Spark 1.2.1 (RC1)

2015-01-27 Thread Sean McNamara
eters such as whether hive is included, etc). We can revisit this > in future feature releases, but .1 releases like this are reserved for > bug fixes. > > - Patrick > > On Tue, Jan 27, 2015 at 10:31 AM, Sean McNamara > wrote: >> We're using spark on scala 2.11 /w h

Re: [VOTE] Release Apache Spark 1.3.0 (RC3)

2015-03-09 Thread Sean McNamara
+1 Ran local tests and tested our spark apps on a spark+yarn cluster. Cheers, Sean > On Mar 8, 2015, at 11:51 PM, Sandy Ryza wrote: > > +1 (non-binding, doc and packaging issues aside) > > Built from source, ran jobs and spark-shell against a pseudo-distributed > YARN cluster. > > On Sun,

Re: [VOTE] Release Apache Spark 1.3.1

2015-04-06 Thread Sean McNamara
+1 > On Apr 4, 2015, at 6:11 PM, Patrick Wendell wrote: > > Please vote on releasing the following candidate as Apache Spark version > 1.3.1! > > The tag to be voted on is v1.3.1-rc1 (commit 0dcb5d9f): > https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=0dcb5d9f31b713ed90bcec63ebc

Re: [VOTE] Release Apache Spark 1.3.1 (RC2)

2015-04-09 Thread Sean McNamara
+1 tested on OS X Sean > On Apr 7, 2015, at 11:46 PM, Patrick Wendell wrote: > > Please vote on releasing the following candidate as Apache Spark version > 1.3.1! > > The tag to be voted on is v1.3.1-rc2 (commit 7c4473a): > https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=7c4473

Re: [VOTE] Release Apache Spark 1.3.1 (RC3)

2015-04-13 Thread Sean McNamara
+1 Sean > On Apr 11, 2015, at 12:07 AM, Patrick Wendell wrote: > > Please vote on releasing the following candidate as Apache Spark version > 1.3.1! > > The tag to be voted on is v1.3.1-rc2 (commit 3e83913): > https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=3e8391327ba586eaf544

Re: [VOTE] Release Apache Spark 1.2.2

2015-04-15 Thread Sean McNamara
Ran tests on OS X +1 Sean > On Apr 14, 2015, at 10:59 PM, Patrick Wendell wrote: > > I'd like to close this vote to coincide with the 1.3.1 release, > however, it would be great to have more people test this release > first. I'll leave it open for a bit longer and see if others can give > a +

Re: [VOTE] Release Apache Spark 1.4.0 (RC4)

2015-06-09 Thread Sean McNamara
+1 tested /w OS X + deployed one of our streaming apps onto a staging yarn cluster. Sean > On Jun 2, 2015, at 9:54 PM, Patrick Wendell wrote: > > Please vote on releasing the following candidate as Apache Spark version > 1.4.0! > > The tag to be voted on is v1.4.0-rc3 (commit 22596c5): > htt

Re: [VOTE] Release Apache Spark 1.4.1 (RC4)

2015-07-10 Thread Sean McNamara
+1 Sean > On Jul 8, 2015, at 11:55 PM, Patrick Wendell wrote: > > Please vote on releasing the following candidate as Apache Spark version > 1.4.1! > > This release fixes a handful of known issues in Spark 1.4.0, listed here: > http://s.apache.org/spark-1.4.1 > > The tag to be voted on is v1

Re: [VOTE] Release Apache Spark 1.5.1 (RC1)

2015-09-24 Thread Sean McNamara
Ran tests + built/ran an internal spark streaming app /w 1.5.1 artifacts. +1 Cheers, Sean On Sep 24, 2015, at 1:28 AM, Reynold Xin mailto:r...@databricks.com>> wrote: Please vote on releasing the following candidate as Apache Spark version 1.5.1. The vote is open until Sun, Sep 27, 2015 at

Re: [VOTE] Release Apache Spark 1.5.2 (RC2)

2015-11-08 Thread Sean McNamara
+1 Sean On Nov 3, 2015, at 4:28 PM, Reynold Xin mailto:r...@databricks.com>> wrote: Please vote on releasing the following candidate as Apache Spark version 1.5.2. The vote is open until Sat Nov 7, 2015 at 00:00 UTC and passes if a majority of at least 3 +1 PMC votes are cast. [ ] +1 Releas

Re: [VOTE] Release Apache Spark 1.6.2 (RC2)

2016-06-22 Thread Sean McNamara
+1 On Jun 22, 2016, at 1:14 PM, Michael Armbrust mailto:mich...@databricks.com>> wrote: +1 On Wed, Jun 22, 2016 at 11:33 AM, Jonathan Kelly mailto:jonathaka...@gmail.com>> wrote: +1 On Wed, Jun 22, 2016 at 10:41 AM Tim Hunter mailto:timhun...@databricks.com>> wrote: +1 This release passes al

Re: [VOTE] Release Apache Spark 1.0.0 (RC11)

2014-05-28 Thread Sean McNamara
Pulled down, compiled, and tested examples on OS X and ubuntu. Deployed app we are building on spark and poured data through it. +1 Sean On May 26, 2014, at 8:39 AM, Tathagata Das wrote: > Please vote on releasing the following candidate as Apache Spark version > 1.0.0! > > This has a few i

Re: balancing RDDs

2014-06-25 Thread Sean McNamara
unless task scheduling time > beats spark.locality.wait. Can cause overall low performance for all > subsequent tasks. > > Mayur Rustagi > Ph: +1 (760) 203 3257 > http://www.sigmoidanalytics.com > @mayur_rustagi <https://twitter.com/mayur_rustagi> > > > > O

Re: [VOTE] Release Apache Spark 0.9.2 (RC1)

2014-07-18 Thread Sean McNamara
+1 On Jul 18, 2014, at 2:08 AM, Andrew Or wrote: > +1, tested on standalone cluster and ran spark shell, pyspark and SparkPi > > > 2014-07-18 0:03 GMT-07:00 Patrick Wendell : > >> +1 >> >> - Looked through the release commits >> - Looked through JIRA issues >> - Ran the audit tests (one iss

RE: [VOTE] Release Apache Spark 1.1.0 (RC3)

2014-09-02 Thread Sean McNamara
+1 From: Patrick Wendell [pwend...@gmail.com] Sent: Saturday, August 30, 2014 4:08 PM To: dev@spark.apache.org Subject: [VOTE] Release Apache Spark 1.1.0 (RC3) Please vote on releasing the following candidate as Apache Spark version 1.1.0! The tag to be vo

accumulators

2014-10-16 Thread Sean McNamara
Accumulators on the stage info page show the rolling life time value of accumulators as well as per task which is handy. I think it would be useful to add another field to the “Accumulators” table that also shows the total for the stage you are looking at (basically just a merge of the accumula