Re: How to use web sockets with Zeppellin

@spacewalkman Just an FYI I don't have anything to do with Spark at the moment. I just have a node.js server which is capable of websocket connections and ready to push data needed for charts. This protocol looks interesting but how do I construct messages such that I can see different visualizati

RE: Config for spark interpreter

Hi, We found a way how to solve this issue. It's hacky but probably give you some ideas how to fix it. Steps: 1. Unpack zeppelin-spark-0.6.0.jar inside zeppelin instance 2. Overwrite interpreter-setting.json 3. Repack jar 4. Restart Zeppelin Regards, Polina

Re: Making bookmarks for zeppelin notes work after authentication

Thanks Damien! I created ZEPPELIN-1418 - Making bookmarks for zeppelin notes work after authentication. BTW, would it be possible to do websocket connection authentication with shiro using jsessionid cookies so we don't need tickets

Re: Authenticate 1 user per notebook

Regarding the latter message on invalid token. That stacktrace possible when someone logs out from Zeppelin but keeps the window open in browser. Then it keeps sending websocket ping messages with invalid ticket which errors in Zeppelin. On Thu, Sep 8, 2016 at 11:06 AM, Polina Marasanova < polina.

RE: Hbase configuration storage without data

Hi moon, Yes that was the way that I was using. But is there any plan for future releases to removing the data from note and storing only configuration? Because storing the configuration with data when there is no max result limit will create a big note.json file. Thanks & Regards, Vikash Kumar

Re: How to use web sockets with Zeppellin

maybe a custom SparkStreamingInterpreter can handle this. zeppelin WS protocol is defined in: https://github.com/apache/zeppelin/blob/master/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/socket/Message.java

RE: Config for spark interpreter

Hi Mina, Thank you for your response. I double checked approach 1 and 3, still no luck. Probably the point is that I'm not using default Zeppelin binary zeppelin-0.6.0-bin-netinst.tgz because it doesn't fit our cluster architecture (we use MapR 5.1). I built it from source code for version 0.6.0

Re: How to use web sockets with Zeppellin

ok here is a concrete example. I am still trying to connect the dots..If I were to split Zeppelin as both front end and backend then I wouldn't choose to use Zeppelin in the first place. The main motivation for me to explore Zeppelin is that I don't have to spend time developing different visualizt

Re: Install external jar for zeppelin

Could you check the spark interpreter log to see whether avro jar is loaded ? It is located in /var/log/zeppelin/zeppelin-interpreter-spark*.log On Thu, Sep 8, 2016 at 10:31 AM, York Huang wrote: > Hi, > > I am using HDP 2.4 sandbox. I download spark-avro jar file and add the > following to > /e

Install external jar for zeppelin

Hi, I am using HDP 2.4 sandbox. I download spark-avro jar file and add the following to /etc/spark/2.4.0.0-169/0/spark-defaults.conf and /usr/hdp/2.4.0.0-169/etc/spark/conf/spark-defaults.conf. spark.driver.extraClassPath /opt/spark-jars/spark-avro_2.10-2.0.1.jar spark.executor.extraClassPath /op

Re: How to use web sockets with Zeppellin

i thought it was a separating zeppelin backend and frontend problem, but what @corneadoug say is a high-level WS description, maybe i misinterpretation @kant kodali’s issue > 在 2016年9月8日，09:48，Corneau Damien 写道： > > This change wouldn't solve your issue, it is the address where the front-end

RE: ActiveDirectoryGroupRealm.java allows user outside of searchBase to login

Related to this issue: One more thing. In Zeppelin logs there are many messages like this 16/09/08 02:03:46 DEBUG NotebookServer: RECEIVE << PING 16/09/08 02:03:46 DEBUG NotebookServer: RECEIVE PRINCIPAL << 16/09/08 02:03:46 DEBUG NotebookServer: RECEIVE TICKET << 16/09/08 02:03:46 DEBUG Notebo

RE: Authenticate 1 user per notebook

One more thing. In Zeppelin logs there are many messages like this: 16/09/08 02:03:46 DEBUG NotebookServer: RECEIVE << PING 16/09/08 02:03:46 DEBUG NotebookServer: RECEIVE PRINCIPAL << 16/09/08 02:03:46 DEBUG NotebookServer: RECEIVE TICKET << 16/09/08 02:03:46 DEBUG NotebookServer: RECEIVE ROLES

Re: How to use web sockets with Zeppellin

This change wouldn't solve your issue, it is the address where the front-end send his API requests and listen to WS (zeppelin server) I guess your requirements are different. The way Zeppelin works is usually pretty simple: 1) You type your code in the front-end 2) That code is sent to Zeppelin s

Re: How to use web sockets with Zeppellin

@kan kodali, i’m not a front guy either.i’v got the same requirement as you recently, i have to separate zeppelin backend and frontend to different servers, i did as what the previous mail says,i works. for you questions: 1. AFAK，is not configurable. if you are familiar with Grunt ，maybe a cust

RE: ActiveDirectoryGroupRealm.java allows user outside of searchBase to login

Hi everyone, I'm experiencing exactly same problem with Zeppelin 0.6.0 It shiro plugin lets everyone in and it cannot be limited by searchbase. Here is an example of my config. In fact it lets everyone in from OU=Users. [main] ### A sample for configuring Active Directory Realm activeDirectoryRea

Re: Can't download zeppelin 0.6.1 binary

HI guys, Can the binary work for mapr directly? Do I need to download the source and build for mapr? Thanks York Sent from my iPhone > On 7 Sep 2016, at 5:51 PM, Alexander Bezzubov wrote: > > Hi, > > hotfix for the website has just went live - download page should work again! > > Thank y

java.lang.ClassNotFoundException: org.apache.spark.repl.SparkCommandLine

I have Zeppelin 0.6.0 running on a linux server, this server is also an edge node to my Hadoop cluster. I have a Hadoop cluster with spark 1.5 running on it. By pointing the spark master to yarn-client, I can run spark in zeppelin without a problem. I also have spark 2.0 unpacked in my home d

Re: How to use web sockets with Zeppellin

Hi! Thanks for this but I still see the big picture. I have not used Angular before nor I am a frontend guy. so I have the following questions. 1. Why do we need to change the source code? isn't this configurable or isn't there a way to pass url as a parameter? If you think it is the easiest w

Re: Hbase configuration storage without data

Hi, For now, code and result data are mixed in note.json, which is represented by 'class Note' [1]. And every Notebook storage layer need to implement 'NotebookRepo.get()' [2] to read note.json from underlying storage and convert it into 'class Note'. As you see the related API and class definiti

Re: Spark DataFrame Plotting

You will need to generate extra column which can be used as a X-axis for column A and B. On Wed, Sep 7, 2016 at 2:34 AM Abhisar Mohapatra < abhisar.mohapa...@inmobi.com> wrote: > I am not sure ,But can you try once by grouby function in zeppelin.If uou > can group by columns then i guess that wou

Re: Zeppelin and Docker Images

In a lot of ways I want to setup the interpreters with a base level of includes, but then be able to specify a per user "second" directory for interpreters, so users can add more as they please, without having to include every interpreter for every user... On Tue, Sep 6, 2016 at 2:14 PM, Mohit Jag

Re: How to use web sockets with Zeppellin

@kant kodali change zeppelin-web\ src\components\baseUrl\baseUrl.service.js like this: this.getWebsocketUrl = function() { var wsProtocol = location.protocol === 'https:' ? 'wss:' : 'ws:'; return wsProtocol + ‘//your_ip_address:' + this.getPort() + skipTrailingSlash(location.pathname)

Hbase configuration storage without data

Hi all, We are storing the note.json configuration into hbase as it is stored into File system. As default behavior in note.json the query data is stored along with configuration. But we want to store the configurations only and when user loading its note then query should get ex

Re: Spark DataFrame Plotting

I am not sure ,But can you try once by grouby function in zeppelin.If uou can group by columns then i guess that would do the trick or pass the data to another HTML block and use d3 comparison chart to plot it On Wed, Sep 7, 2016 at 2:56 PM, patcharee wrote: > Normal select * gives me one column

Re: Spark DataFrame Plotting

Normal select * gives me one column on X-axis and another on Y-axis. I cannot make both A:Double, B:Double displayed on Y-axis. How to do that? Patcharee On 07. sep. 2016 11:05, Abhisar Mohapatra wrote: You can do a normal select * on the dataframe and it would be automatically interpreted.

Re: Spark DataFrame Plotting

You can do a normal select * on the dataframe and it would be automatically interpreted. On Wed, Sep 7, 2016 at 2:29 PM, patcharee wrote: > Hi, > > I have a dataframe with this schema A:Double, B:Double. How can I plot > this dataframe as two lines (comparing A and B at each step)? > > Best, > >

Spark DataFrame Plotting

Hi, I have a dataframe with this schema A:Double, B:Double. How can I plot this dataframe as two lines (comparing A and B at each step)? Best, Patcharee

Re: Can't download zeppelin 0.6.1 binary

Hi, hotfix for the website has just went live - download page should work again! Thank you York for a notice and Damien for prompt responce and fixing the issue. -- Alex On Wed, Sep 7, 2016 at 2:04 PM, Corneau Damien wrote: > Hi York, > > Thanks for reporting it, seems we had a small problem

How to use web sockets with Zeppellin

HI Guys, I have a server which can handle websocket connections. Now I would like to see if there is a way to tell apache zeppellin to create to websocket connect to my server and display the whatever it received? Thanks, Kant