Re: Pyspark interpreter configuration for Zeppelin

I think you need to build Zeppelin from source to run against CDH On Wed, Sep 14, 2016 at 12:58 PM -0700, "Abhi Basu" <9000r...@gmail.com> wrote: I feel there is a scala compatibility issue and I will try compiling with the right switches. On Wed, Sep 14, 2016 at

Re: Pyspark interpreter configuration for Zeppelin

I feel there is a scala compatibility issue and I will try compiling with the right switches. On Wed, Sep 14, 2016 at 1:54 PM, Abhi Basu <9000r...@gmail.com> wrote: > Yes that fixed some of the problems. > > I am using Zeppelin 0.6.1 binaries against CDH 5.8 (Spark 1.6.0). Would > there be a comp

Re: Pyspark interpreter configuration for Zeppelin

Yes that fixed some of the problems. I am using Zeppelin 0.6.1 binaries against CDH 5.8 (Spark 1.6.0). Would there be a compatibility issue? Thanks Abhi On Wed, Sep 14, 2016 at 12:55 PM, moon soo Lee wrote: > Could you try to set full path of python command on zeppelin.python > property? not

Re: Pyspark interpreter configuration for Zeppelin

Could you try to set full path of python command on zeppelin.python property? not the bin directory. On Wed, Sep 14, 2016 at 10:19 AM Abhi Basu <9000r...@gmail.com> wrote: > Tried pyspark command on same machine which uses Anaconda python and > sc.version returned value. > > Zeppelin: > zeppelin.

Re: Pyspark interpreter configuration for Zeppelin

Tried pyspark command on same machine which uses Anaconda python and sc.version returned value. Zeppelin: zeppelin.python /home/cloudera/anaconda2/bin In zeppelin, nothing is returned. On Wed, Sep 14, 2016 at 11:53 AM, moon soo Lee wrote: > Did you export SPARK_HOME in conf/zeppelin-env.sh? >

Re: Pyspark interpreter configuration for Zeppelin

Did you export SPARK_HOME in conf/zeppelin-env.sh? Could you verify the some code works with ${SPARK_HOME}/bin/pyspark, on the same machine that zeppelin runs? Thanks, moon On Wed, Sep 14, 2016 at 8:07 AM Abhi Basu <9000r...@gmail.com> wrote: > Oops sorry. the above code generated this error: >

Re: Pyspark interpreter configuration for Zeppelin

Oops sorry. the above code generated this error: RROR [2016-09-14 10:04:27,121] ({qtp2003293121-11} NotebookServer.java[onMessage]:221) - Can't handle message org.apache.zeppelin.interpreter.InterpreterException: org.apache.thrift.transport.TTransportException at org.apache.zeppelin.interpreter.re

Pyspark interpreter configuration for Zeppelin

%pyspark input_file = "hdfs:tmp/filenname.gz" raw_rdd = sc.textFile(input_file)