Re: Running Spark on Gateway - Connecting to Resource Manager Retries

I'm experimenting the same issue with spark 1.3.1 I verified that hadoop works (ie: running hadoop's pi example) It seems like hadoop conf is in the classpath (/opt/test/service/hadoop/etc/hadoop ) SPARK_PRINT_LAUNCH_COMMAND=1 ./bin/spark-shell --master yarn-client Spark Command: /usr/lib/jvm/jr

Re: Running Spark on Gateway - Connecting to Resource Manager Retries

Hi Akhil, Its running fine when running through Namenode(RM) but fails while running through Gateway, if I add hadoop-core jars to the hadoop directory(/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/hadoop/) it works fine. Its really strange that I am running the job through Spark-Submit an

Re: Running Spark on Gateway - Connecting to Resource Manager Retries

Make sure your yarn service is running on 8032. Thanks Best Regards On Tue, Apr 14, 2015 at 12:35 PM, Vineet Mishra wrote: > Hi Team, > > I am running Spark Word Count example( > https://github.com/sryza/simplesparkapp), if I go with master as local it > works fine. > > But when I change the ma

Re: Running Spark on Gateway - Connecting to Resource Manager Retries

Your Yarn access is not configured. 0.0.0.0:8032 this is default yarn address. I guess you don't have yarn-site.xml in your classpath. -Neal From: Vineet Mishra mailto:clearmido...@gmail.com>> Date: Tuesday, April 14, 2015 at 12:05 AM To: "user@spark.apache.org