RE: InvalidClassException using Zeppelin (master) and spark-2.1 on a standalone spark cluster

2017-06-26 Thread David Howell
Hi Jeff, The ticket says it is fixed from Zeppelin 0.7.0 I am running Zeppelin 0.7.1 , and yes it is fixed for reading from json, but it still throws an error for writing to json. See my repro example. -Original Message- From: Jianfeng (Jeff) Zhang [mailto:jzh...@hortonworks.com] Sen

Re: InvalidClassException using Zeppelin (master) and spark-2.1 on a standalone spark cluster

2017-06-26 Thread Jianfeng (Jeff) Zhang
It is fixed in https://issues.apache.org/jira/browse/ZEPPELIN-1977 Best Regard, Jeff Zhang On 6/27/17, 12:46 PM, "David Howell" wrote: >Hi, >I know this issue is resolved for reading from json, and tested for that >use >case, but I'm seeing the exact same error message when writing to js

Re: InvalidClassException using Zeppelin (master) and spark-2.1 on a standalone spark cluster

2017-06-26 Thread David Howell
Hi, I know this issue is resolved for reading from json, and tested for that use case, but I'm seeing the exact same error message when writing to json. java.io.InvalidClassException: org.apache.commons.lang3.time.FastDateParser; local class incompatible: stream classdesc serialVersionUID = 2, lo

Odp.: do we have IRC?

2017-06-26 Thread Ganko, Marek (Nokia - PH/Quezon City)
Can we use https://gitter.im/ as the communication tool? [https://avatars.gitter.im/default] Gitter ?? Where developers come to talk. gitter.im Where communities thrive. Gitter is a chat and networking platform that helps to manage, grow and connect commu

Re: can Zeppelin runParagraph from different notebooks?

2017-06-26 Thread Jianfeng (Jeff) Zhang
z.run is a async call, It just send the message to ask zeppelin to run note instead of waiting until is finished. Best Regard, Jeff Zhang From: Richard Xin mailto:richardxin...@yahoo.com>> Reply-To: "users@zeppelin.apache.org" mailto:users@zeppelin.apache.

Re: can Zeppelin runParagraph from different notebooks?

2017-06-26 Thread Richard Xin
Thanks Jeff,It worked in some cases, However it seems it has following issues:example:in Note A I have following paragraph:val message = "Hello Zeppelin" println("Note 1 = " + message) Test Case 1=== in Note B: Paragraph 1:%spark z.run("2CN3UDXMZ", "20170612-231131_191205958") // works but

Re: can Zeppelin runParagraph from different notebooks?

2017-06-26 Thread Jianfeng (Jeff) Zhang
z.run Best Regard, Jeff Zhang From: Richard Xin mailto:richardxin...@yahoo.com>> Reply-To: "users@zeppelin.apache.org" mailto:users@zeppelin.apache.org>> Date: Tuesday, June 27, 2017 at 6:04 AM To: "users@zeppelin.apache.org"

Re: can Zeppelin runParagraph from different notebooks?

2017-06-26 Thread Richard Xin
%spark run("2CN3UDXMZ", "20170609-233658_1498522009");  (which is spark script written in scala) :288: error: not found: value run run("2CN3UDXMZ", "20170609-233658_1498522009"); ^ Zeppelin Version 0.7.1  Did I miss anything?Thanks,  On Tuesday, June 13, 2017, 8:48:54 PM PDT, Jianfeng (Jeff)

Re: NPE in SparkInterpreter.java

2017-06-26 Thread Richard Xin
just try to understand the comment in the code:// Some case, scala.tools.nsc.interpreter.IMain$ReadEvalPrint.call throws an NPE what are the "Some case", it sounds like Zeppelin developers are not sure how it happened and how to prevent it? I am trying to make a strong case for my company to swi

Re: Hitting strange NPE

2017-06-26 Thread Serega Sheypak
pse.jetty.websocket.common.events.JettyListenerEvent >> Driver.onTextFrame(JettyListenerEventDriver.java:122) >> >> at org.eclipse.jetty.websocket.common.events.AbstractEventDrive >> r.incomingFrame(AbstractEventDriver.java:161) >> >> at org.eclipse.jetty.websocket.comm

Re: Hitting strange NPE

2017-06-26 Thread Serega Sheypak
ctWebSocketConnection. > readParse(AbstractWebSocketConnection.java:632) > > at org.eclipse.jetty.websocket.common.io.AbstractWebSocketConnection. > onFillable(AbstractWebSocketConnection.java:480) > > at org.eclipse.jetty.io.AbstractConnection$2.run( > AbstractConnection.java:544) &g

Hitting strange NPE

2017-06-26 Thread Serega Sheypak
started by scheduler org.apache.zeppelin.interpreter.remote.RemoteInterpretershared_session426301004 INFO [2017-06-26 08:47:54,925] ({pool-2-thread-10} Paragraph.java[jobRun]:363) - run paragraph 20170626-081737_1275486301 using null org.apache.zeppelin.interpreter.LazyOpenInterpreter@55b139c6 INFO [201

Re: NPE in SparkInterpreter.java

2017-06-26 Thread Serega Sheypak
Hi, I have more or less the same symptom if (Utils.isScala2_10()) { binder = (Map) getValue("_binder"); } else { binder = (Map) getLastObject(); } binder.put("sc", sc); // EXCEPTION HERE java.lang.NullPointerException at org.apache.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:

Re: NPE in SparkInterpreter.java

2017-06-26 Thread Richard Xin
Anyone? On Thursday, June 22, 2017, 3:00:01 PM PDT, Richard Xin wrote: apache/zeppelin | | | | | | | | | | | apache/zeppelin zeppelin - Mirror of Apache Zeppelin | | | in the code I see // Some case, scala.tools.nsc.interpreter.IMain$ReadEvalPrint.call throws an NPE We

Interpreter %sq not found Zeppelin swallows last "l" for some reason...?

2017-06-26 Thread Serega Sheypak
Hi, I get super weird exception: ERROR [2017-06-26 07:44:17,523] ({qtp2016336095-99} NotebookServer.java[persistAndExecuteSingleParagraph]:1749) - Exception from run org.apache.zeppelin.interpreter.InterpreterException: paragraph_1498480084440_1578830546's Interpreter %sq not found I have three

Caused by: java.lang.NoSuchMethodError: org.apache.zeppelin.interpreter.InterpreterGroup.keySet()Ljava/util/concurrent/ConcurrentHashMap$KeySetView;

2017-06-26 Thread Serega Sheypak
Hi, what is the right way to fix it? Found: https://issues.apache.org/jira/browse/ZEPPELIN-2405 But I do compile with java-7 and run on java-7...

Re: Livy failure

2017-06-26 Thread Иван Шаповалов
Got it, thank you. 2017-06-26 14:58 GMT+03:00 Jeff Zhang : > > The error message is clear, you didn't set the right configuration. You > enable the dynamic allocation, and set max executor as 2 but you set the > initial executor as 3 > > > > Caused by: java.lang.IllegalArgumentException: requirem

Re: Livy failure

2017-06-26 Thread Jeff Zhang
The error message is clear, you didn't set the right configuration. You enable the dynamic allocation, and set max executor as 2 but you set the initial executor as 3 Caused by: java.lang.IllegalArgumentException: requirement failed: initial executor number 3 must between min executor number 1 a

Re: Livy failure

2017-06-26 Thread Иван Шаповалов
Here is the failure from resource manager 17/06/26 05:55:43 ERROR ApplicationMaster: Uncaught exception: org.apache.spark.SparkException: Exception thrown in awaitResult: at org.apache.spark.util.ThreadUtils$.awaitResult(ThreadUtils.scala:194) at org.apache.spark.deploy.yarn.Appli

Re: Livy failure

2017-06-26 Thread Jeff Zhang
Could you check the yarn app log ? Иван Шаповалов 于2017年6月26日周一 下午6:40写道: > Hi all, > I am trying to connect and run note via livy > > *created interpreter setting:* > livy.spark.driver.cores 1 > livy.spark.driver.memory 1g > livy.spark.dynamicAllocation.cachedExecutorIdleTimeout 600 > livy.spa

Livy failure

2017-06-26 Thread Иван Шаповалов
Hi all, I am trying to connect and run note via livy *created interpreter setting:* livy.spark.driver.cores 1 livy.spark.driver.memory 1g livy.spark.dynamicAllocation.cachedExecutorIdleTimeout 600 livy.spark.dynamicAllocation.enabled true livy.spark.dynamicAllocation.initialExecutors 1 livy.spark.

Access right management & group roles in Zeppelin

2017-06-26 Thread Petr Knez
Hi, I have question regarding access right management in Zeppelin. Is it possible to manage access to notes or interpreters on group group level (defined in section roles in shiro.ini) or now has Zeppelin only capability to manage these right on user level? I tried it via users and it works fine