Re: Spark with YARN

2016-12-13 Thread Jeff Zhang
Hi Saif, HDP works well for me. What version of HDP and zeppelin do you use. And could you paste the full interpreter log ? Hyung Sung Shim 于2016年12月14日周三 上午8:36写道: > Hello. Saif. > > I believe pre-build Spark binary includes YARN. > Please refer to [0] for yarn setting, if doesn't work please

Re: Spark with YARN

2016-12-13 Thread Hyung Sung Shim
Hello. Saif. I believe pre-build Spark binary includes YARN. Please refer to [0] for yarn setting, if doesn't work please share your *conf/zeppelin-env.sh* and logs. [0] http://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/install/spark_cluster_mode.html#4-configure-spark-interpreter-in-zeppelin 2016-

Spark with YARN

2016-12-13 Thread Saif.A.Ellafi
Hello all, I am trying to setup a Spark interpreter who hits YARN on Zeppelin. We have both HDP and Standalone Spark running. Stand alone Spark works fine but fails if interpreter is set to yarn master (YARN log): Error: Could not find or load main class org.apache.spark.deploy.yarn.ExecutorL