option to zeppelin notebook run if one of the paragraph fails

2017-11-06 Thread Richard Xin
Let's say I have multiple paragraphs in a note,  it seems that those paragraphs run sequentially one after another, and the subsequent paragraph continues to run if any previous one fails,  is there any way to configure the notebook to stop further runs if any paragraph fails? Thanks,Richard

Re: RE: Zeppelin 0.7.2 integration with Presto 0.184

2017-11-01 Thread Richard Xin
b#diff-fc7374097aa800bd529f476b35716019 Any unrecognized co... | | | On Wednesday, November 1, 2017, 9:15:20 AM PDT, Richard Xin wrote: the problem looks like the strict check introduced a few month ago by presto throws exception when unrecognized properties are added, and default.

Re: RE: Zeppelin 0.7.2 integration with Presto 0.184

2017-11-01 Thread Richard Xin
a to the url?   Error message suggests problem is with the “default.url” in the interpreter settings.   On another note, AWS has released Athena (managed version of presto) so when it's available in my region I will look at using that.   Dave   From: Richard Xin Sent: Wed

Zeppelin 0.7.2 integration with Presto 0.184

2017-10-31 Thread Richard Xin
I am not sure Zeppelin 0.7.2 is compatible with Presto 0.184here are the steps: 1. create new presto interpreter  2. %presto show tables java.sql.SQLException: Unrecognized connection property 'url' at com.facebook.presto.jdbc.PrestoDriverUri.validateConnectionProperties(PrestoDriverUri.java:292)

run zeppelin notebook from outside Zeppelin UI or programmatically

2017-10-13 Thread Richard Xin
Hi, is there a recommended way to run zeppelin notebook from outside Zeppelin UI or command-line or programmatically?  I found one post, but looks pretty hacky to me.  How to run zeppelin notebook from command line (automatically) | | | | | | | | | | | How to run zeppelin notebook fro

Re: Zeppelin postgres interpreter throws NPE

2017-08-03 Thread Richard Xin
, you can create a ticket for better exception message. And the error is better to be displayed in frontend Best Regard,Jeff Zhang From: Richard Xin Reply-To: "users@zeppelin.apache.org" Date: Friday, August 4, 2017 at 4:40 AM To: "users@zeppelin.apache.org" Subject: R

Re: Zeppelin postgres interpreter throws NPE

2017-08-03 Thread Richard Xin
PM PDT, Richard Xin wrote: on AWS EMR1. Tested remote postgres connection using psql, works OK2. added postges interpreter via Interpreter UI3. create new note:%postgresql   (or %psql) select * from test.batch_report;  got NPE 4. here are what's in the log: WARN [2017-08-03 20:22:4

Zeppelin postgres interpreter throws NPE

2017-08-03 Thread Richard Xin
on AWS EMR1. Tested remote postgres connection using psql, works OK2. added postges interpreter via Interpreter UI3. create new note:%postgresql   (or %psql) select * from test.batch_report;  got NPE 4. here are what's in the log: WARN [2017-08-03 20:22:46,859] ({qtp459296537-18} LoginRestApi.ja

Re: configure Zeppelin to use existing external hive metastore

2017-08-03 Thread Richard Xin
It works, Thanks Jeff! On Wednesday, August 2, 2017, 6:24:34 PM PDT, Jeff Zhang wrote: I suppose the %sql means %spark.sql, in that case you need to modify the hive-site.xml under SPARK_CONF_DIR Richard Xin 于2017年8月3日周四 上午9:21写道: on AWS EMRI am trying to bind zeppelin to an existing hive

configure Zeppelin to use existing external hive metastore

2017-08-02 Thread Richard Xin
on AWS EMRI am trying to bind zeppelin to an existing hive metastore, I modified hive-site.xml under /etc/hive/conf to pointing to existing metastore, and I tested with commandline hive, it works as expected.but under zeppelin %sql is still connected to previous hive metastore, I added line expo

Re: Shiro AD auth - unable to use jceks

2017-07-26 Thread Richard Xin
we have Zeppelin instance on aws emr, we didn't experience any issues with jceks On Monday, July 24, 2017, 11:57:16 PM PDT, cs user wrote: Bump Has anyone managed to get this working?  On Thu, Jul 20, 2017 at 11:37 AM, cs user wrote: Hello,  Can someone explain how the shiro.ini config s

Re: activeDirectoryRealm.groupRolesMap

2017-07-26 Thread Richard Xin
, 11:13:39 AM PDT, Richard Xin wrote: I am facing some hurdle with activeDirectoryRealm.groupRolesMapthe following is the content of my shiro.ini...activeDirectoryRealm.groupRolesMap = "CN=Zeppelin-Admin,OU=Zeppelin,OU=Applications,OU=Groups,DC=directory,DC=[domain_here],DC=com":&

activeDirectoryRealm.groupRolesMap

2017-07-26 Thread Richard Xin
;body":{"principal":"richard.xin","ticket":"b681cbbb-8a10-40c8-9ba8-c46ee59efd42","roles":"[]"}} please note roles node is empty, I was expecting "admin" in the role list, does anyone have similar issue? is my config activeDirectoryRealm.groupRolesMap  correct? Thanks,Richard Xin

Interpreter menu stop working when Active Directory integration enabled

2017-07-25 Thread Richard Xin
It looks like a bug to me. [ZEPPELIN-2810] Interpreter menu stop working when Active Directory integration enabled - ASF JIRA | | | | [ZEPPELIN-2810] Interpreter menu stop working when Active Directory inte... | | |

z.load() Must be used before SparkInterpreter (%spark) initialized?

2017-07-25 Thread Richard Xin
understand thee reason behind it. If every time I have to restart zeppelin before I could dynamically add an external jar, then this feature is useless to most people. Richard Xin

Re: Zeppelin's integration with Active Directory integration

2017-07-24 Thread Richard Xin
never mind, I figured out (principalSuffix) On Monday, July 24, 2017, 11:48:11 AM PDT, Richard Xin wrote: I just configured Zeppelin for AD integration, I am facing an issue that it only support full DN as user namefor example:It works when login as "CN=John Doe,OU=Employees,DC=directo

Zeppelin's integration with Active Directory integration

2017-07-24 Thread Richard Xin
at's the likely root cause for that? My Zeppelin (0.7.2) is hosted on AWS' EMR.  Thanks,Richard Xin

Re: Zeppelin directory structure for S3 notebook storage

2017-07-22 Thread Richard Xin
elin | | | I just filed a ticket ZEPPELIN-2805, please let me know whether its a valid ticket, thanks On Friday, July 21, 2017, 3:16:40 PM PDT, Richard Xin wrote: correction:I tried both "user" and  "username", and the S3 directory structure is actually like this:

Re: Zeppelin directory structure for S3 notebook storage

2017-07-21 Thread Richard Xin
correction:I tried both "user" and  "username", and the S3 directory structure is actually like this: {bucket}/username/notebook/{notebook-id}/note.json instead of advertised "{bucket}/{username}/{notebook-id}/note.json" Please advise.Thanks On Friday, July 21, 201

Re: Zeppelin directory structure for S3 notebook storage

2017-07-21 Thread Richard Xin
2:58:09 PM PDT, Richard Xin wrote: 1. enabled default security by renaming shiro.ini (default user admin, user1,2 ...)2. enabled S3 storage, and my config in    zeppelin.notebook.s3.user  username  user name for s3 folder structure

Zeppelin directory structure for S3 notebook storage

2017-07-21 Thread Richard Xin
1. enabled default security by renaming shiro.ini (default user admin, user1,2 ...)2. enabled S3 storage, and my config in    zeppelin.notebook.s3.user  username  user name for s3 folder structure

Re: Zeppelin notebook.repo.GitNotebookRepo

2017-07-20 Thread Richard Xin
ok, I don't think Zeppelin supports remote git repo, I have filed a Jira request to put to the wish list, hope it gets fixed soon ZEPPELIN-2802. Thanks,-Richard On Thursday, July 20, 2017, 11:28:41 AM PDT, Richard Xin wrote: Khalid, thanks for the reply.the problem I am facing is we

Re: Zeppelin notebook.repo.GitNotebookRepo

2017-07-20 Thread Richard Xin
wrote: Hi Richard, Actually that setting is only for local storage that allows git/revision related actions (e.g. commit, change revision). There's a separate setting for S3 though, you can find details in here. On Thu, Jul 20, 2017 at 9:47 AM, Richard Xin wrote: for newly installed Zeppe

Why anonymous login disabled for zeppelin (EMR)

2017-07-20 Thread Richard Xin
I started AWS EMR instance, initially anonymous login was enabled, i renamed zeppelin-site.xml.template to zeppelin-site.xml and restarted zeppelin, I noticed that anonymous login was disabled. shouldn't config in zeppelin-site.xml.template be all default values? and I checked the file, it does

Re: restarting zeppelin on EMR causing exceptions

2017-07-20 Thread Richard Xin
uot;users@zeppelin.apache.org" Date: Wednesday, July 19, 2017 at 5:39 PM To: "users@zeppelin.apache.org" Subject: Re: restarting zeppelin on EMR causing exceptions   Hi,   Can you try restart Zeppelin with 'zeppelin' user permission?   sudo -u zeppelin /usr/lib/zeppel

Zeppelin notebook.repo.GitNotebookRepo

2017-07-19 Thread Richard Xin
for newly installed Zeppelin (0.7.2), I renamed zeppelin-site.xml.template to zeppelin-site.xml, and restart zeppelin, zeppelin-site.xml already have the following enabled:   zeppelin.notebook.storage   org.apache.zeppelin.notebook.repo.GitNotebookRepo   versioned notebook persistence layer impl

Re: restarting zeppelin on EMR causing exceptions

2017-07-19 Thread Richard Xin
at 3:21 PM Richard Xin wrote: I was doing config changes on EMR (EMR Release label:emr-5.7.0) Zeppelin (Zeppelin 0.7.2) and struggled with Zeppelin server restart, finally I was able to narrow down to the steps to reproduce below (it's reproducible for any newly created EMR if following the

restarting zeppelin on EMR causing exceptions

2017-07-19 Thread Richard Xin
I was doing config changes on EMR (EMR Release label:emr-5.7.0) Zeppelin (Zeppelin 0.7.2) and struggled with Zeppelin server restart, finally I was able to narrow down to the steps to reproduce below (it's reproducible for any newly created EMR if following the steps below): 1) provision a EMR c

Re: can Zeppelin runParagraph from different notebooks?

2017-06-28 Thread Richard Xin
ok, thanks for clarification. On Monday, June 26, 2017, 6:13:16 PM PDT, Jianfeng (Jeff) Zhang wrote: z.run is a async call, It just send the message to ask zeppelin to run note instead of waiting until is finished.   Best Regard,Jeff Zhang From: Richard Xin Reply-To: "

Re: can Zeppelin runParagraph from different notebooks?

2017-06-26 Thread Richard Xin
tln("Note2: " + message) //:316: error: not found: value message// newly defined variables can not be used in the same paragraph of z.run? My question is, is the behavior I described expected? Or did I missing something obvious? Thanks,RichardX On Monday, June 26, 2017, 3:23:52 PM PDT, J

Re: can Zeppelin runParagraph from different notebooks?

2017-06-26 Thread Richard Xin
13, 2017, 8:48:54 PM PDT, Jianfeng (Jeff) Zhang wrote: Please use 0.7.x Best Regard,Jeff Zhang From: Richard Xin Reply-To: "users@zeppelin.apache.org" Date: Wednesday, June 14, 2017 at 8:48 AM To: "m...@apache.org" , "users@zeppelin.apache.org" Subject: Re

Re: NPE in SparkInterpreter.java

2017-06-26 Thread Richard Xin
7;m going to check this one stuff:https://stackoverflow.com/questions/43289067/getting-nullpointerexception-when-running-spark-code-in-zeppelin-0-7-1 2017-06-26 20:41 GMT+02:00 Richard Xin : Anyone? On Thursday, June 22, 2017, 3:00:01 PM PDT, Richard Xin wrote: apache/zeppelin | | |

Re: NPE in SparkInterpreter.java

2017-06-26 Thread Richard Xin
Anyone? On Thursday, June 22, 2017, 3:00:01 PM PDT, Richard Xin wrote: apache/zeppelin | | | | | | | | | | | apache/zeppelin zeppelin - Mirror of Apache Zeppelin | | | in the code I see // Some case, scala.tools.nsc.interpreter.IMain$ReadEvalPrint.call throws an NPE We

NPE in SparkInterpreter.java

2017-06-22 Thread Richard Xin
apache/zeppelin | | | | | | | | | | | apache/zeppelin zeppelin - Mirror of Apache Zeppelin | | | in the code I see // Some case, scala.tools.nsc.interpreter.IMain$ReadEvalPrint.call throws an NPE We had issues that Zeppelin note errored out immediately without any hint mess

Re: Zeppelin 0.6.0 (on EMR) stops responding after several runs (NPE error), and back online after restart zeppelin

2017-06-14 Thread Richard Xin
(LambdaLift.scala:30) at scala.reflect.internal.tpe.TypeMaps$TypeMap.mapOver(TypeMaps.scala:110) On Wednesday, June 14, 2017, 12:38:30 PM PDT, Richard Xin wrote: it happened several times already, worked again after restart Zeppelin I see consistently similar error when died ERROR [2017-06-14 17

Zeppelin 0.6.0 (on EMR) stops responding after several runs (NPE error), and back online after restart zeppelin

2017-06-14 Thread Richard Xin
it happened several times already, worked again after restart Zeppelin I see consistently similar error when died ERROR [2017-06-14 17:59:59,705] ({pool-2-thread-2} SparkInterpreter.java[putLatestVarInResourcePool]:1253) - java.lang.NullPointerException at scala.tools.nsc.interpreter.IMain$Rea

Re: can Zeppelin runParagraph from different notebooks?

2017-06-13 Thread Richard Xin
it doesn't work, which version you are using? On Tuesday, June 13, 2017, 5:41:06 PM PDT, moon soo Lee wrote: In spark interpreter, you can try  %sparkrun(NOTE_ID, PARAGRAPH_ID) Hope this helps. Thanks,moon On Mon, Jun 12, 2017 at 9:52 AM Richard Xin wrote: Angular (fronten

can Zeppelin runParagraph from different notebooks?

2017-06-12 Thread Richard Xin
Angular (frontend API) | | | | | | | | | | | Angular (frontend API) The Apache Software Foundation Angular (frontend API) | | | This method doesn't seem to support running paragraphs from different notebooks, did I miss anything?