Re: How could I start new spark cluster with hadoop2.0.2

There is no --hadoop-minor-version, but you can try --hadoop-major-version=2.0.2 Does it break anything if you use 2.0.0 version of hadoop? Thanks Best Regards On Wed, Oct 8, 2014 at 8:44 PM, st553 wrote: > Hi, > > Were you able to figure out how to choose a specific version? Im having the > sa

Re: How could I start new spark cluster with hadoop2.0.2

Hi, Were you able to figure out how to choose a specific version? Im having the same issue. Thanks. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-could-I-start-new-spark-cluster-with-hadoop2-0-2-tp10450p15939.html Sent from the Apache Spark User Lis

Re: How could I start new spark cluster with hadoop2.0.2

Hi It seems I can only give --hadoop-major-version=2 . it is taking 2.0.0. How could I say it should use 2.0.2 is there any --hadoop-minor-version variable I can use? Thanks, D. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-could-I-start-new-spark-

Re: How could I start new spark cluster with hadoop2.0.2

Thanks Akhil -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-could-I-start-new-spark-cluster-with-hadoop2-0-2-tp10450p10514.html Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: How could I start new spark cluster with hadoop2.0.2

AFAIK you can use the --hadoop-major-version parameter with the spark-ec2 script to switch the hadoop version. Thanks Best Regards On Wed, Jul 23, 2014 at 6:07 AM, durga wrote: > Hi, > > I am trying to create spark cluster using sp

How could I start new spark cluster with hadoop2.0.2

Hi, I am trying to create spark cluster using spark-ec2 file under spark1.0.1 directory. 1) I noticed that It is always creating hadoop version 1.0.4.Is there a way I can override that?I would like to have hadoop2.0.2 2) I also wants install Oozie along with. Is there any scrips available along