Re: YARN Maven build questions

2014-03-05 Thread Usman Ghani
Tom, I tried the command line you used and it didn't work for me. On Fri, Feb 28, 2014 at 6:05 AM, Tom Graves wrote: > what build command are you using?What do you mean when you say YARN > branch? > > The yarn builds have been working fine for me with maven. Build command > I use against

Re: YARN Maven build questions

2014-03-04 Thread Sandy Ryza
Hi Lars, Unfortunately, due to some incompatible changes we pulled in to be closer to YARN trunk, Spark-on-YARN does not work against CDH 4.4+ (but does work against CDH5) -Sandy On Tue, Mar 4, 2014 at 6:33 AM, Tom Graves wrote: > What is your question about Any hints? > The maven build worke

Re: YARN Maven build questions

2014-03-04 Thread Tom Graves
What is your question about Any hints? The maven build worked for me yesterday again fine.  You should create a jira for any pull request like the documentation states.   The jira thing is new so I think people are still getting used to it. Tom On Tuesday, March 4, 2014 2:51 AM, Lars Francke

Re: YARN Maven build questions

2014-03-04 Thread Lars Francke
Hi, sorry to bother again. As a newbie to the project it's hard to judge whether I'm doing anything wrong, the documentation is outdated or the Maven/SBT files have diverged from the actual code by defining older/now incompatible versions or something else going wrong. Any hints? Also an unrela

Re: YARN Maven build questions

2014-02-28 Thread Lars Francke
Hey, so currently it doesn't work because of IntelliJ reports a lot of warnings with default settings and I haven't found a way to tell IntellJ to use different Hadoop versions yet. mvn clean compile -Pyarn fails as well (compilation

Re: YARN Maven build questions

2014-02-28 Thread Tom Graves
what build command are you using?    What do you mean when you say YARN branch?  The yarn builds have been working fine for me with maven.   Build command I use against hadoop 2.2 or higher: mvn -Dyarn.version=2.2.0 -Dhadoop.version=2.2.0 -Pyarn clean package -DskipTests Tom On Friday, Febru

YARN Maven build questions

2014-02-28 Thread Lars Francke
Hey, I'm trying to dig into Spark's code but am running into a couple of problems. 1) The yarn-common directory is not included in the Maven build causing things to fail because the dependency is missing. If I see the history correct it used to be a Maven module but is not anymore. 2) When I try