Runtime Exception while trying to connect to remote spark interpreters, (In yarn-cluster mode in Zeppelin-0.8.0)

2018-11-19 Thread Sarthak Sharma
Hi, We already have a zeppelin-0.7.3 setup which runs fine and is in use currently but we are looking into the yarn cluster mode support for spark interpreter in zeppelin-0.8. I've built it from source from *branch-0.8 (As of Nov-15) *and am facing the following issues intermittently in some of th

Re: Runtime Exception while trying to connect to remote spark interpreters, (In yarn-cluster mode in Zeppelin-0.8.0)

2018-11-19 Thread Xun Liu
HI,Sarthak Sharma The log shows that the task submitted by spark-submmit has been waiting for execution in the queue of YARN. Is there no resource for the queue of YARN? You can specify a queue with resources in the spark interpreter via the spark.yarn.queue parameter. > 在 2018年11月19日,下午7:41,S