Tony Liu created ZEPPELIN-2391:
----------------------------------
Summary: Cannot initialize SparkContext on CDH5.7
Key: ZEPPELIN-2391
URL: https://issues.apache.org/jira/browse/ZEPPELIN-2391
Project: Zeppelin
Issue Type: Bug
Components: Interpreters
Affects Versions: 0.7.1
Environment: OS: CentOS 6.8
Kernel: 2.6.32-642.el6.x86_64
CDH: CDH-5.10.0 (Hadoop version: 2.6.0-cdh5.10.0)
Reporter: Tony Liu
I built Zeppelin 0.7.1 from source with the following command:
mvn clean package -Pspark-1.6 -Dspark.version=1.6.0 -Phadoop-2.6
-Dhadoop.version=2.6.0-cdh5.10.0 -Pvendor-repo -DskipTests -Pbuild-distr
But when I create a new note with Spark interpreter and run sc.version, it
gives this error:
java.lang.NoSuchMethodError:
org.apache.hadoop.io.retry.RetryPolicies.retryOtherThanRemoteException(Lorg/apache/hadoop/io/retry/RetryPolicy;Ljava/util/Map;)Lorg/apache/hadoop/io/retry/RetryPolicy;
at
org.apache.hadoop.yarn.client.RMProxy.createRetryPolicy(RMProxy.java:291)
at
org.apache.hadoop.yarn.client.RMProxy.createRetryPolicy(RMProxy.java:207)
at org.apache.hadoop.yarn.client.RMProxy.createRMProxy(RMProxy.java:91)
at
org.apache.hadoop.yarn.client.ClientRMProxy.createRMProxy(ClientRMProxy.java:72)
at
org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.serviceStart(YarnClientImpl.java:174)
at
org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at
org.apache.spark.deploy.yarn.Client.submitApplication(Client.scala:127)
at
org.apache.spark.scheduler.cluster.YarnClientSchedulerBackend.start(YarnClientSchedulerBackend.scala:57)
at
org.apache.spark.scheduler.TaskSchedulerImpl.start(TaskSchedulerImpl.scala:158)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:538)
at
org.apache.zeppelin.spark.SparkInterpreter.createSparkContext_1(SparkInterpreter.java:484)
at
org.apache.zeppelin.spark.SparkInterpreter.createSparkContext(SparkInterpreter.java:382)
at
org.apache.zeppelin.spark.SparkInterpreter.getSparkContext(SparkInterpreter.java:146)
at
org.apache.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:828)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:70)
at
org.apache.zeppelin.spark.PySparkInterpreter.getSparkInterpreter(PySparkInterpreter.java:564)
at
org.apache.zeppelin.spark.PySparkInterpreter.createGatewayServerAndStartScript(PySparkInterpreter.java:208)
at
org.apache.zeppelin.spark.PySparkInterpreter.open(PySparkInterpreter.java:162)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:70)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:483)
at org.apache.zeppelin.scheduler.Job.run(Job.java:175)
at
org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:139)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
