Hi,
Please find below full stack trace.
ERROR [2016-09-15 16:49:15,117] ({pool-1-thread-2}
RemoteInterpreter.java[init]:182) - Failed to create interpreter:
org.apache.zeppelin.spark.SparkInterpreter
ERROR [2016-09-15 16:49:15,118] ({pool-1-thread-2} Job.java[run]:189) - Job
failed
org.apache.zeppelin.interpreter.InterpreterException:
org.apache.thrift.transport.TTransportException
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreter.init(RemoteInterpreter.java:183)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getFormType(RemoteInterpreter.java:328)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.getFormType(LazyOpenInterpreter.java:105)
at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:260)
at org.apache.zeppelin.scheduler.Job.run(Job.java:176)
at
org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:328)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.thrift.transport.TTransportException
at
org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at
org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429)
at
org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318)
at
org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:69)
at
org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.recv_createInterpreter(RemoteInterpreterService.java:184)
at
org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.createInterpreter(RemoteInterpreterService.java:168)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreter.init(RemoteInterpreter.java:172)
... 12 more
ERROR [2016-09-15 16:49:15,118] ({Thread-18}
RemoteInterpreterEventPoller.java[run]:88) - Can't get RemoteInterpreterEvent
Thanks,
Arpan.
________________________________________
From: DuyHai Doan [[email protected]]
Sent: Thursday, September 15, 2016 4:29 AM
To: [email protected]
Subject: Re: Issue with Zeppelin setup on Datastax-Spark
Can you provide the complete stack trace ?
Also, worth reading my blog post about integrating Spark/Zeppelin/C* or DSE :
http://www.doanduyhai.com/blog/?p=2325
On Thu, Sep 15, 2016 at 5:17 AM, Arpan Saha
<[email protected]<mailto:[email protected]>> wrote:
Hi Team,
I am trying to integrate Zeppelin 0.6.0 with DataStax 4.8.8 (which has Spark
1.4.2). After I configured following properties in zeppelin-env.sh when I start
zeppelin daemon it started and in the browser I can see zeppelin is running but
when I am trying to execute spark query in the notebook it is throwing below
Error. Could you please help me to solve this issue.
export JAVA_HOME=<JAVA Home Path>
export SPARK_HOME=/etc/dse/spark
export HADOOP_CONF_DIR=/etc/dse/hadoop
export MASTER=spark://<masterhost>:7077
Also, added/updated below properties in the Spark Interpreter screen of
Zeppelin UI.
Master
spark.app.name<http://spark.app.name>
spark.cassandra.auth.password
spark.cassandra.auth.username
spark.cassandra.connection.host
spark.cores.max
spark.executor.memory
zeppelin.interpreter.host
zeppelin.interpreter.port
Trying to execute below statement in the notebook:
%spark
sc.version
Below Error is getting:
java.net.SocketException: Connection reset at
java.net.SocketInputStream.read(SocketInputStream.java:209) at
java.net.SocketInputStream.read(SocketInputStream.java:141) at
java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at
java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at
java.io.BufferedInputStream.read(BufferedInputStream.java:345) at
org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86) at
org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429) at
org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318) at
org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:69) at
org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.recv_createInterpreter(RemoteInterpreterService.java:184)
at
org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.createInterpreter(RemoteInterpreterService.java:168)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreter.init(RemoteInterpreter.java:172)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getFormType(RemoteInterpreter.java:328)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.getFormType(LazyOpenInterpreter.java:105)
[email protected]<mailto:[email protected]>
Thanks,
Arpan.
________________________________
Notice: This e-mail message has been sent by an employee or contractor of
American Express Global Business Travel (“GBT”), a joint venture that is not
wholly-owned by American Express Company or any of its subsidiaries (“American
Express”). E-mail from GBT employees and contractors may continue to utilize an
American Express domain for some period; however American Express is not
responsible for the content of this email, which is controlled by GBT.
“American Express Global Business Travel”, “American Express” and the American
Express Logo are trademarks of American Express and are used by GBT under
limited license.
________________________________
Important : Cet email a été envoyé par un employé ou un sous-traitant
d’American Express Global Business Travel (« GBT »), une joint-venture qui
n’est pas intégralement détenue par American Express Company ou l’une de ses
filiales (« American Express »). Les emails des employés et sous-traitants de
GBT peuvent continuer de comporter un nom de domaine d’American Express pour
une certaine période ; toutefois, American Express n’est pas responsable du
contenu de cet email, qui est contrôlé par GBT. « American Express Global
Business Travel », « American Express » et le logo American Express sont des
marques d’American Express et sont utilisées par GBT aux termes d’une licence
limitée.
________________________________
http://www.mindtree.com/email/disclaimer.html
