Re: Zeppelin Integration with Livy Server

2016-06-16 Thread Jeff Zhang
What do you mean "create a job artifact" ? I don't think zeppelin provide such function for you. You can not reuse the code in interactive session for batch session. On Thu, Jun 16, 2016 at 11:48 AM, kishore wrote: > What I meant by reusing the code is to extract the function created with in >

Re: Rest API

2016-06-16 Thread kevin giroux
Thank again for you reply. Do you know if it is a possible improvement for the Web Side and Rest API ? I think it will could be usefull to allowed user to create Notebook and paragraph with this system. Sincerely, Le jeu. 16 juin 2016 à 07:07, moon soo Lee a écrit : > Websocket server in the

Zeppelin multi-user dashboards

2016-06-16 Thread ashish rawat
Hi All, I believe there has been some work done on multitenancy in Zeppelin through z-manager, but that does not look aligned with a typical dashboard use case, where once a Dashboard/Notebook gets created, multiple users login and use the dashboard by changing various filters. In case of a Zeppe

RE: Zeppelin multi-user dashboards

2016-06-16 Thread Darren Govoni
I guess the workaround is to copy the notebook for each user. Simplest solution. Sent from my Verizon Wireless 4G LTE smartphone Original message From: ashish rawat Date: 06/16/2016 6:54 AM (GMT-05:00) To: us...@zeppelin.incubator.apache.org Subject: Zeppelin multi-

RE: Zeppelin multi-user dashboards

2016-06-16 Thread ashish rawat
Yeah, I thought the same, but this is quite unmanageable for a changing dashboard and changing user list. Perhaps, a clean solution could be to introduce a read mode, where the notebook is maintained per user session and changes are only kept in memory and not persisted. If there are no solutions

Re: Zeppelin multi-user dashboards

2016-06-16 Thread Corneau Damien
Using Authentication in Zeppelin, you can set Read/Write rules to Notebooks On Thu, Jun 16, 2016 at 10:29 PM, ashish rawat wrote: > Yeah, I thought the same, but this is quite unmanageable for a changing > dashboard and changing user list. > > Perhaps, a clean solution could be to introduce a re

Re: Rest API

2016-06-16 Thread moon soo Lee
Yes, it's reasonable to have RestAPI for change 'config'. Please feel free to file a issue. Code contribution would be more than welcome. Thanks, moon On Thu, Jun 16, 2016 at 12:31 AM kevin giroux wrote: > Thank again for you reply. > > Do you know if it is a possible improvement for the Web Si

zeppelin PostgreSQL interpreter data sharing

2016-06-16 Thread Cameron McBride
Greetings, I'm brand new to zeppelin, and this notebook technology looks great. I'm evaluating using it for our data science team, but got it up and running quickly using some PostgreSQL data and some spark tests. The distributed nature of each paragraph, and naturally varying interpreters within

Re: zeppelin PostgreSQL interpreter data sharing

2016-06-16 Thread Mohit Jaggi
I believe z.context() is the only way to share data between interpreters. Within an interpreter data is usually available across paragraphs…perhaps even across notebooks as I guess zeppelin will create a single interpreter in the backend unless you somehow make it use separate ones. > On Jun 16

Re: zeppelin PostgreSQL interpreter data sharing

2016-06-16 Thread moon soo Lee
ResourcePool [1] is a data store that all the different types of interpreter can access. It allows exchange data between paragraphs/notebooks/interpreters. However, not all interpreter uses ResourcePool, at the moment. For example Spark interpreter family provides API to use it (spark, pyspark, sp

Re: zeppelin PostgreSQL interpreter data sharing

2016-06-16 Thread Cameron McBride
Appreciate the quick responses! The patch (#pr836) does sound like a good solution, as it will generically address this issue (and makes use of the existing ResourcePool framework). The example of this working with the shell is also nice. Obviously my vote is to include it in 0.6.0. :) Are there

Re: zeppelin PostgreSQL interpreter data sharing

2016-06-16 Thread Mohit Jaggi
Moon: Are z. Context and resource pool different or the same? Sent from my iPhone > On Jun 16, 2016, at 10:23 PM, Cameron McBride > wrote: > > Appreciate the quick responses! > > The patch (#pr836) does sound like a good solution, as it will generically > address this issue (and makes use of

Re: zeppelin PostgreSQL interpreter data sharing

2016-06-16 Thread moon soo Lee
There is really basic usage[1] in Spark interpreter docs. [2] is corresponding source code. And this diagram [3] from Helium proposal [4] might help little bit more. Currently, DistributedResourcePool [5] implements ResourcePool api. DistributedResourcePool keeps the data in the individual interpr

Re: Zeppelin multi-user dashboards

2016-06-16 Thread ashish rawat
Hi Damien, Does the read mode work as I described above i.e. multiple users can work with selectors and input boxes of the same notebook and view different outputs? My assumption is that read will only allow users to just view the notebook in report mode and not interact with it, perhaps an intera

Re: Zeppelin multi-user dashboards

2016-06-16 Thread Corneau Damien
It is simple Read/Write Some people can edit, some people can see. By essence, if the view is different from each user, then it is not the same notebook anymore. Being able to have a different results for each user saved somewhere so that they can read it, seems like a big overhead. On Fri, Jun 1

Re: Zeppelin Integration with Livy Server

2016-06-16 Thread kishore
Our thought is to use the Zeppelin to create the algorithms leveraging the interactive data analysis and eventually deploy the algorithm in the production environment In that process after the algorithm is created and published. we can eventually create job artifact and post the artifact to the re

Re: Zeppelin Integration with Livy Server

2016-06-16 Thread Jeff Zhang
Yeah, I don't think zeppelin has the capability to create artifact for you. But if zepplein has such feature, you can of course reuse the code in interactive session and submit it as batch session to livy. On Fri, Jun 17, 2016 at 12:33 PM, kishore wrote: > Our thought is to use the Zeppelin to c

Re: Zeppelin multi-user dashboards

2016-06-16 Thread vincent gromakowski
Isnt it acheivable via git repository ? A kind of git clone to get an indépendant copy of the notebook? Le 17 juin 2016 4:18 AM, "Corneau Damien" a écrit : > It is simple Read/Write > Some people can edit, some people can see. > > By essence, if the view is different from each user, then it is no