Re: Apache Spark, Hadoop 2.2.0 without Yarn Integration

2015-01-04 Thread Sandy Ryza
Compiling with YARN set to true is not required for Spark working with Hadoop 2.2.0 in standalone mode. -Sandy On Fri, Jan 2, 2015 at 12:06 PM, Moep wrote: > Well that's confusing. I have the same issue. So you're saying I have to > compile Spark with Yarn set to true to make it work with Hadoo

Re: Apache Spark, Hadoop 2.2.0 without Yarn Integration

2015-01-02 Thread Moep
Well that's confusing. I have the same issue. So you're saying I have to compile Spark with Yarn set to true to make it work with Hadoop 2.2.0 in Standalone mode? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Apache-Spark-Hadoop-2-2-0-without-Yarn-Integrat

Re: Apache Spark, Hadoop 2.2.0 without Yarn Integration

2014-07-09 Thread Nick R. Katsipoulakis
Krishna, Ok, thank you. I just wanted to make sure that this can be done. Cheers, Nick On Wed, Jul 9, 2014 at 3:30 PM, Krishna Sankar wrote: > Nick, >AFAIK, you can compile with yarn=true and still run spark in stand > alone cluster mode. > Cheers > > > > On Wed, Jul 9, 2014 at 9:27 AM,

Re: Apache Spark, Hadoop 2.2.0 without Yarn Integration

2014-07-09 Thread Krishna Sankar
Nick, AFAIK, you can compile with yarn=true and still run spark in stand alone cluster mode. Cheers On Wed, Jul 9, 2014 at 9:27 AM, Nick R. Katsipoulakis wrote: > Hello, > > I am currently learning Apache Spark and I want to see how it integrates > with an existing Hadoop Cluster. > > My cu

Apache Spark, Hadoop 2.2.0 without Yarn Integration

2014-07-09 Thread Nick R. Katsipoulakis
Hello, I am currently learning Apache Spark and I want to see how it integrates with an existing Hadoop Cluster. My current Hadoop configuration is version 2.2.0 without Yarn. I have build Apache Spark (v1.0.0) following the instructions in the README file. Only setting the SPARK_HADOOP_VERSION=1