Hi all,
I am trying to connect and run note via livy
*created interpreter setting:*
livy.spark.driver.cores 1
livy.spark.driver.memory 1g
livy.spark.dynamicAllocation.cachedExecutorIdleTimeout 600
livy.spark.dynamicAllocation.enabled true
livy.spark.dynamicAllocation.initialExecutors 1
livy.spark.dynamicAllocation.maxExecutors 2
livy.spark.dynamicAllocation.minExecutors 1
livy.spark.executor.cores 1
livy.spark.executor.instances 3
livy.spark.executor.memory 1g
livy.spark.jars.packages
zeppelin.livy.concurrentSQL false
zeppelin.livy.displayAppInfo false
zeppelin.livy.keytab
zeppelin.livy.principal zeppelin
zeppelin.livy.pull_status.interval.millis 1000
zeppelin.livy.session.create_timeout 600
zeppelin.livy.spark.sql.maxResult 1000
zeppelin.livy.url http://correct-path:correct-port
*and have following livy server config:*
livy.impersonation.enabled = false
livy.repl.enableHiveContext = true
ivy.server.csrf_protection.enabled = true
livy.spark.master = yarn.cluster
*Trying to run paragraph drives me to:*
INFO [2017-06-26 11:39:22,036] ({pool-2-thread-2}
BaseLivyInterprereter.java[createSession]:204) - Session 3 is in state
shutting_down, appId application_1498447942743_0011
INFO [2017-06-26 11:39:23,184] ({pool-2-thread-2}
BaseLivyInterprereter.java[createSession]:204) - Session 3 is in state
dead, appId application_1498447942743_0011
ERROR [2017-06-26 11:39:23,185] ({pool-2-thread-2}
BaseLivyInterprereter.java[createSession]:214) - Error when creating
livy session for user anonymous
org.apache.zeppelin.livy.LivyException: Session 3 is finished, appId:
application_1498447942743_0011, log: [YARN Diagnostics:, AM container
is launched, waiting for AM container to Register with RM]
at
org.apache.zeppelin.livy.BaseLivyInterprereter.createSession(BaseLivyInterprereter.java:209)
at
org.apache.zeppelin.livy.BaseLivyInterprereter.initLivySession(BaseLivyInterprereter.java:98)
at
org.apache.zeppelin.livy.BaseLivyInterprereter.open(BaseLivyInterprereter.java:80)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:70)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:483)
at org.apache.zeppelin.scheduler.Job.run(Job.java:175)
at org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:139)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Could anyone please help to understand what am I doing wrong ?
Thanks
--
Ivan Shapovalov
Kharkov, Ukraine
