Re: Storing result of Cassandra select into variable

2018-02-09 Thread DuyHai Doan
There is no integration for the moment yet of the Cassandra interpreter with the common data sharing infrastructure On Fri, Feb 9, 2018 at 2:47 PM, André Schütz wrote: > Hi, > > I am trying to store the result of a SELECT query (1) to Cassandra into > a variable to use this within a second (2) q

Re: java.lang.NoClassDefFoundError: Could not initialize class org.apache.zeppelin.cassandra.DisplaySystem

2017-10-06 Thread DuyHai Doan
not switch to > > > call "%bin%\functions.cmd" ADDEACHJARINDIR"%ZEPPELIN_ > HOME%\zeppelin-interpreter\target\lib" > call "%bin%\functions.cmd" ADDEACHJARINDIR"%ZEPPELIN_ > HOME%\lib\interpreter" > call "%bin%\functions.cmd" AD

Re: java.lang.NoClassDefFoundError: Could not initialize class org.apache.zeppelin.cassandra.DisplaySystem

2017-10-05 Thread DuyHai Doan
.(ScalaCompiler.scala:59)" >13 = {StackTraceElement@5341} "org.fusesource.scalate. > support.ScalaCompiler$.create(ScalaCompiler.scala:42)" > 14 = {StackTraceElement@5342} "org.fusesource.scalate. > TemplateEngine.createCompiler(TemplateEngine.scala:231)" >15

Re: java.lang.NoClassDefFoundError: Could not initialize class org.apache.zeppelin.cassandra.DisplaySystem

2017-10-05 Thread DuyHai Doan
The problem is the NoClassDefFoundError exception. We need to know where it comes from, which class cannot be found. Can you please provide full exception stack trace ? On Wed, Oct 4, 2017 at 4:45 PM, Patrick Brunmayr < patrick.brunm...@kpibench.com> wrote: > Hello > > I am having troubles using

Re: Create cassandra interpreter for Zeppelin on AWS EMR spark cluster

2017-05-20 Thread DuyHai Doan
ialize class > org.apache.zeppelin.cassandra.DisplaySystem$NoResultDisplay$ > at org.apache.zeppelin.cassandra.EnhancedSession.( > EnhancedSession.scala:40) > > Please help. > > On Fri, May 19, 2017 at 3:45 PM, DuyHai Doan wrote: > >> Just download a binary of Zepp

Re: Create cassandra interpreter for Zeppelin on AWS EMR spark cluster

2017-05-19 Thread DuyHai Doan
ckage with all interpreters and works > fine. > > On AWS EMR, all the binaries may not be there, and thats where I need > help. > > Thanks > > On Fri, May 19, 2017 at 3:04 PM, DuyHai Doan wrote: > >> So just use the Cassandra interpreter, I don't see where

Re: Create cassandra interpreter for Zeppelin on AWS EMR spark cluster

2017-05-19 Thread DuyHai Doan
t; On Fri, May 19, 2017 at 2:39 PM, DuyHai Doan wrote: > >> If you're running on AWS EMR Spark Cluster, why do you need a Cassandra >> interpreter Is Cassandra installed on your AWS cluster ? >> >> On Fri, May 19, 2017 at 11:23 PM, shyla deshpande < >

Re: Create cassandra interpreter for Zeppelin on AWS EMR spark cluster

2017-05-19 Thread DuyHai Doan
If you're running on AWS EMR Spark Cluster, why do you need a Cassandra interpreter Is Cassandra installed on your AWS cluster ? On Fri, May 19, 2017 at 11:23 PM, shyla deshpande wrote: > Hello all, > > I need help in creating cassandra interpreter for Zeppelin on AWS EMR > spark cluster. P

Re: How to create a real time dashboards from spark using web socket?

2017-04-25 Thread DuyHai Doan
Yes, the scheduler applies to the entire note, not just paragraph Le 25 avr. 2017 02:39, "kant kodali" a écrit : > Also it doesn't look like we can run a scheduler on one paragraph? we have > to run the scheduler for the entire notebook always? > > On Mon, Apr 24, 2017 at 1:06 PM, kant kodali wr

Re: Visualize streaming data

2017-02-07 Thread DuyHai Doan
What you want is an auto-refresh of the visualization right ? Why not use the cron-scheduling feature ? On Tue, Feb 7, 2017 at 9:19 AM, Jeff Zhang wrote: > Zeppelin's built-in visualization capability is helpful for batch data > analysis, I am wondering whether zeppelin support to visualize stre

Re: [ANNOUNCE] Apache Zeppelin 0.7.0 released

2017-02-06 Thread DuyHai Doan
Congratulations for the team, great release! On Mon, Feb 6, 2017 at 1:34 PM, Vinay Shukla wrote: > Congratulations Zeppelin users, contributors and committers. > > This is a great milestone. > > Before the dust settles on 0.7.0, let's put together our heads together to > define features for the

Re: [VOTE] Release Apache Zeppelin 0.7.0 (RC4)

2017-02-02 Thread DuyHai Doan
+1 On Thu, Feb 2, 2017 at 9:56 AM, Mina Lee wrote: > I propose the following RC to be released for the Apache Zeppelin 0.7.0 > release. > > The commit id is df007f2284a09caa7c8b35f8b59d5f1993fe8b64 which is > corresponds to the tag v0.7.0-rc4: > *https://git-wip-us.apache.org/repos/asf?p=zeppeli

Re: [VOTE] Release Apache Zeppelin 0.7.0 (RC2)

2017-01-22 Thread DuyHai Doan
+1 On Sun, Jan 22, 2017 at 8:59 AM, Mina Lee wrote: > I propose the following RC to be released for the Apache Zeppelin 0.7.0 > release. > > The commit id is d0ddf8fdff75b4229543f7ebfd5eb001f685382d which is > corresponds to the tag v0.7.0-rc2: > *https://git-wip-us.apache.org/repos/asf?p=zeppel

Re: programmatically call parameterised notebook paragraph

2016-12-29 Thread DuyHai Doan
Use REST Api with a simple REST client http://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/rest-api/rest-notebook.html#run-a-paragraph-synchronously You can inject the Angular param values as POST data to the target paragraph On Thu, Dec 29, 2016 at 5:54 PM, Tushar Kapila wrote: > I have a notebook

Re: Dynamic Forms

2016-12-12 Thread DuyHai Doan
Here you are: http://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/displaysystem/front-end-angular.html On Mon, Dec 12, 2016 at 9:11 AM, Igor Drozdov wrote: > Hello! > > > > I’m writing a notebook sample in Zeppelin. It downloads apache mail > archives and computes some statistics. > > Here it is http

Re: Adding Angular API to non-Spark interpreters

2016-12-10 Thread DuyHai Doan
All interpreters can leverage the AngularObjectRegistry. The Cassandra interpreter does this here: https://github.com/apache/zeppelin/blob/master/cassandra/src/main/scala/org/apache/zeppelin/cassandra/InterpreterLogic.scala#L316-L356 On Fri, Dec 9, 2016 at 10:45 PM, Goodman, Alexander (398K) < al

Re: Zeppelin or Jupiter

2016-11-28 Thread DuyHai Doan
"Granted, these two features are currently only fully supported by the spark interpreter group but work is currently underway to make the API extensible to other interpreters" --> Incorrect, the display system has also an API for front-end: https://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/displaysys

Re: Is it possible to run Java code on Zeppelin Notebook?

2016-11-20 Thread DuyHai Doan
Or wait for Java9, there will be a REPL for Java On Sun, Nov 20, 2016 at 11:40 AM, Felix Cheung wrote: > I think you will need to convert Java code into Scala syntax? But Scala > can call into Java libraries and so on. > > I don't think we have an interpreter for Java since it does not come with

Re: FW: Issue with Zeppelin setup on Datastax-Spark

2016-11-16 Thread DuyHai Doan
I recommend downloading my pre-built Zeppelin for Datastax. Shared folder link: https://drive.google.com/folderview?id=0B6wR2aj4Cb6wQ01aR3ItR0xUNms On Wed, Nov 16, 2016 at 11:13 AM, DuyHai Doan wrote: > Ok I understand why you have issue. > > You are using Spark 2.0.2 and latest Datas

Re: FW: Issue with Zeppelin setup on Datastax-Spark

2016-11-16 Thread DuyHai Doan
and `zeppelin.interpreter.port` >> values on Interpreter setting UI should be removed because Interpreter >> will automatically be launched when you run a paragraph. >> >> 2016-09-16 3:56 GMT+09:00 Arpan Saha : >> >>> Yes. It is a zeppelin log. Not spark inter

Re: Share variable across notebooks

2016-11-14 Thread DuyHai Doan
You can share variables using ResourcePool: Put a variable - https://github.com/apache/zeppelin/blob/master/spark/src/main/java/org/apache/zeppelin/spark/ZeppelinContext.java#L809-L812 Get a variable - https://github.com/apache/zeppelin/blob/master/spark/src/main/java/org/apache/zeppelin/spark/Ze

Re: [DISCUSS] Zeppelin 0.7 Roadmap

2016-10-09 Thread DuyHai Doan
I'd also add in the Enterprise section a topic about monitoring (e.g. at least exposing JMX metrics as a 1st step). I guess we cannot pretend to be enterprise ready without at least some means to monitor the Zeppelin server state. Hopefully the monitoring topic will be covered by the big refactori

Re: Some problem of using Zeppelin with Spark

2016-10-07 Thread DuyHai Doan
Try adding -U before -DskipTests On Fri, Oct 7, 2016 at 10:06 PM, mingda li wrote: > Dear all, > > Hi, we are using Zeppelin with Spark and AsterixDB now. The Spark will get > data from AsterixDB and Zeppelin can let users operate the data in Spark. > Now, we can run an example well in Spark

Re: How Apache Zeppelin runs a paragraph

2016-10-04 Thread DuyHai Doan
Hello Jongyoul Excellent write up to demystify the execution life-cycle of a paragraph. There is a small typo in the blog: "At last, it has two words separated by comma, *getInterpreter* handles it as “%{group_name}.{interpreter_name}”" Instead of comma, shouldn't it be DOT (.) ? There is also

Re: Paragraph text editor is very slow when number of notes is large (> 1000)

2016-10-01 Thread DuyHai Doan
The digest function is an Angular stuff and is a well known perf issue related to the way how Angular detects changes in UI components. This perf issue should be fixed with Angular2, which is using native functions for change detection: http://blog.thoughtram.io/angular/2016/02/22/angular-2-change

Re: Spark with Kudu

2016-09-27 Thread DuyHai Doan
Did you add the jar dependency to the Spark interpreter too ? On Tue, Sep 27, 2016 at 2:34 PM, Joaquín Silva < joaquin.silva.vigen...@gmail.com> wrote: > Hello, > > I'm running Spark with Kudu like this: > https://kudu.apache.org/docs/developing.html#_kudu_integration_with_spark > > The spark-she

Re: Regarding some doubts on usage of zeppelin

2016-09-21 Thread DuyHai Doan
Hello 1) Try to look at the angular js front end API http://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/displaysystem/front-end-angular.html 2) Manually format your html output with angular ngif directive. 3) use tag On Wed, Sep 21, 2016 at 6:33 PM, Dipesh Vora wrote: > Hi, > > I have some doubt

Re: FW: Issue with Zeppelin setup on Datastax-Spark

2016-09-15 Thread DuyHai Doan
terService.java:168) > at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.init( > RemoteInterpreter.java:172) > ... 12 more > ERROR [2016-09-15 16:49:15,118] ({Thread-18} > RemoteInterpreterEventPoller.java[run]:88) > - Can't get Rem

Re: zeppelin architecture with multiple users

2016-09-15 Thread DuyHai Doan
Right now, you have some options to isolate the notes. Look at the doc about interpreter binding mode here : http://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/manual/interpreters.html#interpreter-binding-mode On Thu, Sep 15, 2016 at 7:15 AM, York Huang wrote: > Hi, > > I want to set up a environ

Re: Issue with Zeppelin setup on Datastax-Spark

2016-09-15 Thread DuyHai Doan
Can you provide the complete stack trace ? Also, worth reading my blog post about integrating Spark/Zeppelin/C* or DSE : http://www.doanduyhai.com/blog/?p=2325 On Thu, Sep 15, 2016 at 5:17 AM, Arpan Saha wrote: > Hi Team, > > I am trying to integrate Zeppelin 0.6.0 with DataStax 4.8.8 (which ha

Re: is there way to update(push latest data to) Zeppelin dashboard ?

2016-08-24 Thread DuyHai Doan
eiver component from the display component and make them pluggable. On Wed, Aug 24, 2016 at 5:51 PM, Vinay Shukla wrote: > Is there a way to make it easier for our Zeppelin users? Perhaps some > built in visualization widget that can poll a backend for updates? > > > On Wednesday

Re: is there way to update(push latest data to) Zeppelin dashboard ?

2016-08-24 Thread DuyHai Doan
"I want the updates to be pushed to the dashboard I dont want keep running the query over and over again or do some sort of polling." In this case the only solution for you is: 1) use %angular interpreter 2) import a JS library in a paragraph and do some JS coding to open a web-socket channel to

Re: [ANNOUNCE] Apache Zeppelin 0.6.1 released

2016-08-16 Thread DuyHai Doan
Congratulations to the whole team for the great job On Tue, Aug 16, 2016 at 6:59 PM, Mohit Jaggi wrote: > awesome! > > Mohit Jaggi > Founder, > Data Orchard LLC > www.dataorchardllc.com > > > > > On Aug 16, 2016, at 6:56 AM, Ahyoung Ryu wrote: > > Congratulations, the Apache Zeppelin team & all

Spark/Cassandra/Zeppelin integration: How to

2016-08-08 Thread DuyHai Doan
Hello all For those who are struggling to integrate those 3 stacks (and I know there are quite a few, given the number of questions I got on this topic), I have written a blog post to explain the steps to make it work: http://www.doanduyhai.com/blog/?p=2325 Optionally I have pre-built some Zeppe

Re: Use embedded Spark for some notebook but use system provided Spark for others

2016-08-08 Thread DuyHai Doan
Easier solution: creates different instances of Spark interpreter for each use case: 1) For embedded Spark, just let the master property to local[*] 2) For system provided Spark, edit the Spark interpreter settings and change the master to some spark://:7077 On Mon, Aug 8, 2016 at 9:52 AM, Patric

Re: Scratching my head around Zeppelin/Spark & Docker

2016-08-06 Thread DuyHai Doan
My host IP is 192.168.1.16 The VM IP is 10.0.2.15 (using Docker4Mac) Indeed I tried many things: 1) using the host network (--net=host) but then I cannot access Zeppelin (localhost:8080 or 127.0.0.1:8080). Zeppelin listens to the address 0.0.0.0 by default (config in zeppelin-site.xml). Changing

Re: Scratching my head around Zeppelin/Spark & Docker

2016-08-05 Thread DuyHai Doan
e the Docker container to communicate with the external Spark cluster On Fri, Aug 5, 2016 at 9:00 PM, George Webster wrote: > can you share your docker file? also, are you using docker-compose or just > docker-machine > > On Fri, Aug 5, 2016 at 8:46 PM, DuyHai Doan wrote: > >

Scratching my head around Zeppelin/Spark & Docker

2016-08-05 Thread DuyHai Doan
Hello guys Has anyone attempted to run Zeppelin inside Docker that connect to a real Spark cluster running on the host machine ? I've spend a day trying to make it work but unsuccessfully, the job never completed because the driver program (Zeppelin Spark shell) is listening on an Internal IP add

Re: Import jars from spark spackages

2016-08-01 Thread DuyHai Doan
ard zeppelin configuration: > zeppelin.dep.additionalRemoteRepository=spark-packages, > http://dl.bintray.com/spark-packages/maven,false; > > > [1] https://gist.github.com/conker84/d2ad350850f39022e594825b6fda980e > > Il giorno sab 30 lug 2016 alle ore 15:14 DuyHai Doan > ha scritto: > >

Re: Import jars from spark spackages

2016-07-30 Thread DuyHai Doan
What is exactly the error message you have in the logs ? On Sat, Jul 30, 2016 at 2:58 PM, Andrea Santurbano wrote: > Hi all, > i want to import this library: > https://github.com/databricks/spark-corenlp > which is under spark packages: > https://spark-packages.org/package/databricks/spark-coren

Re: Question: How to call/run one zeppelin notebook from another?

2016-07-27 Thread DuyHai Doan
:46 PM, Hanan Shteingart wrote: > Hi DuyHai, > > 1. How do you call a paragraph from another? > 2. How is one expected to reuse function/class definitions across > notebooks? > > Best, > Hanan > > *HS* > > On Wed, Jul 27, 2016 at 6:47 PM, DuyHai Doan wrote:

Re: Question: How to call/run one zeppelin notebook from another?

2016-07-27 Thread DuyHai Doan
It is possible to call/run one paragraph from another, not possible if you can run a notebook from another. On Wed, Jul 27, 2016 at 5:19 PM, Hanan Shteingart wrote: > anyone? > > *HS* > > On Wed, Jul 27, 2016 at 10:24 AM, Hanan Shteingart > wrote: > >> Hi, >> Question: How to call/run one zeppe

Re: Paragraph opened as IFrame in multiple browsers

2016-07-27 Thread DuyHai Doan
"Can this behavior be customized? Does some of you have found a workaround?" --> Work around is to create 2 distinct paragraphs with the same content and export them as Iframe separately On Wed, Jul 27, 2016 at 9:53 AM, Patrick Duflot < patrick.duf...@iba-group.com> wrote: > Hello Zeppelin, >

Re: Spark/Zeppelin/Cassandra talk

2016-07-21 Thread DuyHai Doan
soo Lee wrote: > Thanks for sharing great event. > > > On Wed, Jul 6, 2016 at 7:20 AM DuyHai Doan wrote: > >> Hello Zeppelin fans >> >> If you're living in the London area, I'll be giving a talk about using >> Spark/Cassandra and Zeppelin to st

Spark/Zeppelin/Cassandra talk

2016-07-06 Thread DuyHai Doan
Hello Zeppelin fans If you're living in the London area, I'll be giving a talk about using Spark/Cassandra and Zeppelin to store, aggregate and visualize particle accelerator metrics: http://www.meetup.com/fr-FR/Spark-London/events/232355493/ Also if you know any event related to Zeppelin, plea

Re: Ask opinion regarding 0.6.0 release package

2016-06-20 Thread DuyHai Doan
+1 for zeppelin-bin-min release package What I would suggest is that for a specific package of Zeppelin with XXX interpreter(s) built-in is that the maintainers/contributors of each interpreter(s) can help releasing those "custom" builds for the community. Any thought on this idea ? On Mon, Jun 2

Re: Input Controls and Visualizations in Zeppelin

2016-05-28 Thread DuyHai Doan
You can design your own input form using plain Bootstrap/Angular and then use the new AngularJS front-end API to interact with paragraphs: http://zeppelin.incubator.apache.org/docs/0.6.0-incubating-SNAPSHOT/displaysystem/front-end-angular.html On Sat, May 28, 2016 at 11:13 AM, ashish rawat wrote:

Re: The Apache Software Foundation Announces Apache(R) Zeppelin™ as a Top-Level Project

2016-05-25 Thread DuyHai Doan
Great! Finally I can remove the (incubator) from my Zeppelin slides. Congrats all the team. Awesome work during the last months! On Wed, May 25, 2016 at 4:12 PM, Hyung Sung Shim wrote: > Great jobs. > Congratulations! > > > 2016-05-25 23:02 GMT+09:00 Jungtaek Lim : > >> Congrats! Well deserved!