Could you check the yarn app log ?


Иван Шаповалов <shapovalov.iva...@gmail.com>于2017年6月26日周一 下午6:40写道:

> Hi all,
> I am trying to connect and run note via livy
>
> *created interpreter setting:*
> livy.spark.driver.cores 1
> livy.spark.driver.memory 1g
> livy.spark.dynamicAllocation.cachedExecutorIdleTimeout 600
> livy.spark.dynamicAllocation.enabled true
> livy.spark.dynamicAllocation.initialExecutors 1
> livy.spark.dynamicAllocation.maxExecutors 2
> livy.spark.dynamicAllocation.minExecutors 1
> livy.spark.executor.cores 1
> livy.spark.executor.instances 3
> livy.spark.executor.memory 1g
> livy.spark.jars.packages
> zeppelin.livy.concurrentSQL false
> zeppelin.livy.displayAppInfo false
> zeppelin.livy.keytab
> zeppelin.livy.principal zeppelin
> zeppelin.livy.pull_status.interval.millis 1000
> zeppelin.livy.session.create_timeout 600
> zeppelin.livy.spark.sql.maxResult 1000
> zeppelin.livy.url http://correct-path:correct-port
>
> *and have following livy server config:*
> livy.impersonation.enabled = false
> livy.repl.enableHiveContext = true
> ivy.server.csrf_protection.enabled = true
> livy.spark.master = yarn.cluster
>
> *Trying to run paragraph drives me to:*
>
> INFO [2017-06-26 11:39:22,036] ({pool-2-thread-2} 
> BaseLivyInterprereter.java[createSession]:204) - Session 3 is in state 
> shutting_down, appId application_1498447942743_0011
>  INFO [2017-06-26 11:39:23,184] ({pool-2-thread-2} 
> BaseLivyInterprereter.java[createSession]:204) - Session 3 is in state dead, 
> appId application_1498447942743_0011
> ERROR [2017-06-26 11:39:23,185] ({pool-2-thread-2} 
> BaseLivyInterprereter.java[createSession]:214) - Error when creating livy 
> session for user anonymous
> org.apache.zeppelin.livy.LivyException: Session 3 is finished, appId: 
> application_1498447942743_0011, log: [YARN Diagnostics:, AM container is 
> launched, waiting for AM container to Register with RM]
>    at 
> org.apache.zeppelin.livy.BaseLivyInterprereter.createSession(BaseLivyInterprereter.java:209)
>    at 
> org.apache.zeppelin.livy.BaseLivyInterprereter.initLivySession(BaseLivyInterprereter.java:98)
>    at 
> org.apache.zeppelin.livy.BaseLivyInterprereter.open(BaseLivyInterprereter.java:80)
>    at 
> org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:70)
>    at 
> org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:483)
>    at org.apache.zeppelin.scheduler.Job.run(Job.java:175)
>    at 
> org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:139)
>    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>    at 
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
>    at 
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
>    at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>    at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>    at java.lang.Thread.run(Thread.java:745)
>
> Could anyone please help to understand what am I doing wrong ?
> Thanks
> --
> Ivan Shapovalov
> Kharkov, Ukraine
>
>

Reply via email to