Re: Zeppelin Installation Help

2016-08-04 Thread Jongyoul Lee
If you have spark binary in your local, you can enforce the version by setting SPARK_HOME in your zeppelin-env.sh On Fri, Aug 5, 2016 at 9:48 AM, Mohit Jaggi wrote: > I defer to the experts but that is what i do and it works. Weird rpc > errors on spark are often due to version mismatch. I wish

Re: question on livy session in zeppelin

2016-08-04 Thread Chen Song
Thanks Vinay. Following up on this, in a multi-user environment, Livy will create a session (and a separate Spark job) for each user. If one user restarts the Livy interpreter, will that cause other users' sessions along with their Spark job to be killed? If so, can I work around this by setting

deprecation warnings

2016-08-04 Thread Randy Gelhausen
Hi, After upgrading to Spark 2.0, I'm seeing some "warning: there was one deprecation warning; re-run with -deprecation for details" warnings in Spark output. How can I configure Zeppelin to tell me what deprecated API I'm using? Thanks, -Randy

Re: Zeppelin Installation Help

2016-08-04 Thread Mohit Jaggi
I defer to the experts but that is what i do and it works. Weird rpc errors on spark are often due to version mismatch. I wish there was a simple version check but afaik there isnt Sent from my iPhone > On Aug 4, 2016, at 11:51 AM, Brian Liao wrote: > > So you are saying that I need to insta

Re: question on livy session in zeppelin

2016-08-04 Thread Vinay Shukla
Hi Chen, I agree this is not very user friendly & there should be no need to restart LivyInterpreter. One short term fix may be to increase the livy session timeout by changing livy.server.session.timeout (takes time in millisecond) Filed https://issues.apache.org/jira/browse/ZEPPELIN-1293 to tra

question on livy session in zeppelin

2016-08-04 Thread Chen Song
Hi When using Zeppelin over Livy, it appears that Livy will delete the session (and terminate the Spark job) after one hour of inactivity. After that, the SparkContext is closed and the user will see an error like 404 Not Found in Zeppelin notebook. >From this point, is the only way to proceed is

Re: Zeppelin Installation Help

2016-08-04 Thread Brian Liao
So you are saying that I need to install spark locally in order to get this to work? > On Aug 4, 2016, at 11:12 AM, Mohit Jaggi wrote: > > One of the Z config variables points to your local spark installation. Make > sure it is the same version as the one on the cluster. > >> On Aug 4, 2016,

Re: Zeppelin Installation Help

2016-08-04 Thread Mohit Jaggi
One of the Z config variables points to your local spark installation. Make sure it is the same version as the one on the cluster. > On Aug 4, 2016, at 10:49 AM, Brian Liao wrote: > > Hi, > > Thank you. > > I used the prebuilt binary package version 0.6.0 from Zeppelin and my spark > cluster

Re: Zeppelin Installation Help

2016-08-04 Thread Brian Liao
Hi, Thank you. I used the prebuilt binary package version 0.6.0 from Zeppelin and my spark cluster is 1.5. Is there a way to force the prebuilt zeppelin to use 1.5? or the only way to do this is to compile from source? Also I don’t need to install Spark locally on where I host Zeppelin? > O

Re: spark.jars option for Zeppelin over Livy

2016-08-04 Thread Chen Song
I tried setting livy.spark.jars and it works but only with HDFS. I cannot get it configured to pull jars from local. On Tue, Aug 2, 2016 at 6:15 PM Felix Cheung wrote: > Probably livy.spark.jars then as Spark Packages is a different list? > > > http://spark.apache.org/docs/latest/submitting-appl

Re: Zeppelin Installation Help

2016-08-04 Thread Mohit Jaggi
mismatched spark version? > On Aug 4, 2016, at 8:11 AM, Brian Liao wrote: > > Hi > > I am following this guide (http://zeppelin.apache.org/download.html > ) to install Zeppelin, but wasn't > able to configure it and get it to work. I used the binary

Zeppelin Installation Help

2016-08-04 Thread Brian Liao
Hi I am following this guide (http://zeppelin.apache.org/download.html ) to install Zeppelin, but wasn't able to configure it and get it to work. I used the binary package (the one that I don't need to compile anymore). I would like to have Zeppelin s