Re: Consistent recommendation for submitting spark apps to YARN, -master yarn --deploy-mode x vs -master yarn-x'

Following up on this thread to see if anyone has some thoughts or opinions on the mentioned approach. Guru Medasani gdm...@gmail.com > On Aug 3, 2015, at 10:20 PM, Guru Medasani wrote: > > Hi, > > I was looking at the spark-submit and spark-shell --help on both (Spark &g

Consistent recommendation for submitting spark apps to YARN, -master yarn --deploy-mode x vs -master yarn-x'

spark-submit and spark-shell help pages. Any thoughts which direction we should go? Guru Medasani gdm...@gmail.com

Re: PSA: Maven 3.3.3 now required to build

Maven Version: 3.2.5 is not in the allowed range 3.3.3. [WARNING] Rule 1: org.apache.maven.plugins.enforcer.RequireJavaVersion failed with message: Detected JDK Version: 1.6.0-36 is not in the allowed range 1.7. Guru Medasani gdm...@gmail.com > On Aug 3, 2015, at 2:38 PM, Sean Owen wrote: &

Re: PSA: Maven 3.3.3 now required to build

build/mvn starting from Spark 1.4.1 or Spark version 1.5? Guru Medasani gdm...@gmail.com > On Aug 3, 2015, at 1:01 PM, Sean Owen wrote: > > If you use build/mvn or are already using Maven 3.3.3 locally (i.e. > via brew on OS X), then this won't affect you, but I wanted to ca

Re: Welcoming some new committers

Congratulations to all the new committers! Guru Medasani gdm...@gmail.com > On Jun 17, 2015, at 5:12 PM, Matei Zaharia wrote: > > Hey all, > > Over the past 1.5 months we added a number of new committers to the project, > and I wanted to welcome them now that all of thei

Re: Reporting serialized task size after task broadcast change?

I thought we could see this on the Spark Web UI storage tab. May be I was looking at something else too. On Sep 11, 2014, at 8:47 PM, Sandy Ryza wrote: > Hmm, well I can't find it now, must have been hallucinating. Do you know > off the top of your head where I'd be able to find the size to lo

RE: Welcoming two new committers

Congrats Joey and Andrew! Sent from my Windows Phone From: Andrew Or Sent: ‎8/‎9/‎2014 2:43 AM To: Prashant Sharma Cc: Xiangrui Meng; Christopher Nguyen; Jo