RE: Zeppelin Stops Loading Notes

2017-10-13 Thread Belousov Maksim Eduardovich
Paul, Ben, Fabian, please share your workload at time when notes are not loading. How much interpreters were started at that moment? You can find all started interpreters in linux command line with: ps -ef | grep ZeppelinServer | grep -v grep | awk "NR==1" | awk -F' ' '{print $2}' | xargs ps -f

Re: Zepplin 0.7.3 DEBUG console output, how do I switch it off!!! Spark 2.2.0-bin-hadoop2.7

2017-10-13 Thread Amer Sheikh
Hi there Please see the console output On Thu, Oct 12, 2017 at 1:25 PM, Jeff Zhang wrote: > > What kind of DEBUG log you see ? Can you paste it ? > > > amersh...@gmail.com 于2017年10月12日周四 下午5:44写道: > >> >> >> On 2017-10-12 10:41, "amersh...@gmail.com" wrote: >> > Hello there >> > >> > I have i

Re: question about how to update zeppelin interpreters.

2017-10-13 Thread moon soo Lee
Hi, I think id value of interpreter is just randomly generated ID [1]. You can find ID generation routine here [2]. Thanks, moon [1] https://github.com/apache/zeppelin/blob/v0.7.3/zeppelin-zengine/src/main/java/org/apache/zeppelin/interpreter/InterpreterSetting.java#L106 [2] https://github.com/a

Re: sql paragraph doesn't see my 3rd party jars

2017-10-13 Thread moon soo Lee
Could you share little more about how did you add 3rd party jars? ie. through %spark.dep, Interpreter setting menu on GUI, environment variable, and so on. Thanks, moon On Sat, Oct 7, 2017 at 3:47 AM Serega Sheypak wrote: > Hi, I'm trying to use spark and sql paragraphs with 3rd party jars add

Re: Users in a DynamoDb for Zeppelin

2017-10-13 Thread moon soo Lee
Because of Zeppelin uses shiro for authentication, i think Apache Shiro community might give better answers. Not sure there's existing implementation but found a related thread in shiro user mailing list. http://shiro-user.582556.n2.nabble.com/Configuring-with-NoSQL-DynamoDB-td7523917.html Thanks

Re: Newbie question... switching between local and external spark engines within the notebook?

2017-10-13 Thread moon soo Lee
Hi Mike, You can always create multiple interpreter settings, in Interpreter menu. For example 'spark-local' and 'spark-cluster'. You can bind multiple interpreter settings in interpreter binding menu of each notebook. Then you can write a paragraph '%spark-local' and then next paragraph with '%

Error when trying to build from source?

2017-10-13 Thread Michael Segel
I’ve been trying to build zeppelin from the source. Ran in to the following error: [INFO] Compiling 6 source files to /opt/zeppelin-0.7.3/zeppelin-display/target/classes at 1507925417280 [ERROR] /opt/zeppelin-0.7.3/zeppelin-display/src/main/scala/org/apache/zeppelin/display/angular/AbstractAngul

run zeppelin notebook from outside Zeppelin UI or programmatically

2017-10-13 Thread Richard Xin
Hi, is there a recommended way to run zeppelin notebook from outside Zeppelin UI or command-line or programmatically?  I found one post, but looks pretty hacky to me.  How to run zeppelin notebook from command line (automatically) | | | | | | | | | | | How to run zeppelin notebook fro

Re: run zeppelin notebook from outside Zeppelin UI or programmatically

2017-10-13 Thread Jeff Zhang
Check notebook rest api https://zeppelin.apache.org/docs/0.8.0-SNAPSHOT/usage/rest_api/notebook.html Richard Xin 于2017年10月14日周六 上午8:08写道: > Hi, > is there a recommended way to run zeppelin notebook from outside Zeppelin > UI or command-line or programmatically? > > I found one post, but looks p

Re: Zepplin 0.7.3 DEBUG console output, how do I switch it off!!! Spark 2.2.0-bin-hadoop2.7

2017-10-13 Thread Jianfeng (Jeff) Zhang
These are zeppelin server log which is controlled by log4.properties under ZEPPELIN_CONF_DIR. And I don’t understand why would you say these log would affect the performance. Could you explain more ? Best Regard, Jeff Zhang From: Amer Sheikh mailto:amersh...@gmail.com>> Reply-To: "users@z

Re: Zepplin 0.7.3 DEBUG console output, how do I switch it off!!! Spark 2.2.0-bin-hadoop2.7

2017-10-13 Thread Amer Sheikh
Hi Jeff Thanks for your reply. The zeppelin console output is continuous when my scala code (spark sql) is running. The same code runs very from a separate spark-shell, so im suspecting that Zeppelin is executing the code in DEBUG mode. When I installed Zeppelin, I did not change any settings. M

Re: Zepplin 0.7.3 DEBUG console output, how do I switch it off!!! Spark 2.2.0-bin-hadoop2.7

2017-10-13 Thread Jeff Zhang
I just suspect it is due to different spark configuration in zeppelin spark interpreter and spark-shell. Please make sure they are using the same configuration. Amer Sheikh 于2017年10月14日周六 下午1:44写道: > Hi Jeff > > Thanks for your reply. The zeppelin console output is continuous when my > scala cod