Re: Yarn-Client Python

2014-10-28 Thread TJ Klein
Hi Andrew, thanks for trying to help. However, I am a bit confused now. I'm not setting any 'spark.driver.host', particularly spark-defaults.conf is empty/non-exisiting. I thought this is only required when running Spark standalone mode. Isn't it the case, when using YARN all the configuration nee

Re: Yarn-Client Python

2014-10-28 Thread Andrew Or
Hey TJ, It appears that your ApplicationMaster thinks it's on the same node as your driver. Are you setting "spark.driver.host" by any chance? Can you post the value of this config here? (You can access it through the SparkUI) 2014-10-28 12:50 GMT-07:00 TJ Klein : > Hi there, > > I am trying to