Re: Replacing the JSP web UIs to HTML 5 applications

2013-11-01 Thread Haohui Mai
hui > >> > >> > >> > >> On Tue, Oct 29, 2013 at 5:22 AM, Zheng, Kai > wrote: > >> > >> > > having /JMX for monitoring integration and a /JSON end point for > the UI > >> > IMHO, this makes sense, especially for the long

Re: Replacing the JSP web UIs to HTML 5 applications

2013-11-01 Thread Colin McCabe
, WebUI serves as end user >> > interface. Both might share same functionality codes, but that does not >> > validate we couple them together. >> > >> > Thanks & regards, >> > Kai >> > >> > -Original Message- >> > Fro

Re: Replacing the JSP web UIs to HTML 5 applications

2013-10-30 Thread Haohui Mai
es sense, especially for the long term. JMX interface > > > serves > > > > as management console in admin perspective, WebUI serves as end user > > > > interface. Both might share same functionality codes, but that does > not > > > > validate we couple them to

Re: Replacing the JSP web UIs to HTML 5 applications

2013-10-30 Thread Andrew Wang
and a /JSON end point for the > UI > > > IMHO, this makes sense, especially for the long term. JMX interface > > serves > > > as management console in admin perspective, WebUI serves as end user > > > interface. Both might share same functionality codes, but that does not

Re: Replacing the JSP web UIs to HTML 5 applications

2013-10-30 Thread Luke Lu
ut that does not > > validate we couple them together. > > > > Thanks & regards, > > Kai > > > > -Original Message----- > > From: Alejandro Abdelnur [mailto:t...@cloudera.com] > > Sent: Tuesday, October 29, 2013 8:14 AM > > To: hdfs-dev@hadoop

Re: Replacing the JSP web UIs to HTML 5 applications

2013-10-29 Thread Haohui Mai
validate we couple them together. > > Thanks & regards, > Kai > > -Original Message- > From: Alejandro Abdelnur [mailto:t...@cloudera.com] > Sent: Tuesday, October 29, 2013 8:14 AM > To: hdfs-dev@hadoop.apache.org > Subject: Re: Replacing the JSP web UIs to HTML

RE: Replacing the JSP web UIs to HTML 5 applications

2013-10-29 Thread Zheng, Kai
not validate we couple them together. Thanks & regards, Kai -Original Message- From: Alejandro Abdelnur [mailto:t...@cloudera.com] Sent: Tuesday, October 29, 2013 8:14 AM To: hdfs-dev@hadoop.apache.org Subject: Re: Replacing the JSP web UIs to HTML 5 applications Isn't using JMX to

Re: Replacing the JSP web UIs to HTML 5 applications

2013-10-28 Thread Larry McCay
So, if I understand correctly, we are using an HTTP based API to access JMX data. The API isn't strictly designed to REST principals but does reflect the management API and query parameters of JMX. While unfortunate that we don't have a better REST based design for it, it may not add enough value

Re: Replacing the JSP web UIs to HTML 5 applications

2013-10-28 Thread Haohui Mai
Just to provide some data point to make the discussion concrete. Here is a part of the dump of the JMX information: curl " http://localhost:50070/jmx?qry=Hadoop:service=NameNode,name=NameNodeInfo"; { "beans" : [ { "name" : "Hadoop:service=NameNode,name=NameNodeInfo", "modelerType" : "o

Re: Replacing the JSP web UIs to HTML 5 applications

2013-10-28 Thread Larry McCay
I think it is important that we make provisions for all Ajax calls to be able to go through gateway deployments like Knox with the cluster firewalled off. As I have commented on the Jira, any calls that are currently on the serverside but are moving to the browser will need to either require punchi

Re: Replacing the JSP web UIs to HTML 5 applications

2013-10-28 Thread Haohui Mai
Neither of them will go through JMX. The new Web UI implements hdfs browsing through WebHDFS. The logs are available through the static servlets, which is exactly the same as what we have today. Thanks, Haohui On Mon, Oct 28, 2013 at 6:01 PM, Alejandro Abdelnur wrote: > are you planning to ex

Re: Replacing the JSP web UIs to HTML 5 applications

2013-10-28 Thread Alejandro Abdelnur
are you planning to expose things like hdfs browsing and nn/dn logs over jmx? thx Alejandro (phone typing) On Oct 28, 2013, at 17:48, Haohui Mai wrote: > It seems more appealing to me that the UI should JMX directly, because: > > * We're support the JMX in the long term for other management s

Re: Replacing the JSP web UIs to HTML 5 applications

2013-10-28 Thread Haohui Mai
It seems more appealing to me that the UI should JMX directly, because: * We're support the JMX in the long term for other management software. * The information provided by the JMX API will be mostly identical of the JSON API. Today the Web UI covers most of the information provided by JMX. The W

Re: Replacing the JSP web UIs to HTML 5 applications

2013-10-28 Thread Alejandro Abdelnur
Isn't using JMX to expose JSON for the web UI misusing JMX? I would think a more appropriate approach would be having /JMX for monitoring integration and a /JSON end point for the UI data. Thanks. On Mon, Oct 28, 2013 at 4:58 PM, Haohui Mai wrote: > Alejandro, > > If I understand correctly, t

Re: Replacing the JSP web UIs to HTML 5 applications

2013-10-28 Thread Haohui Mai
Alejandro, If I understand correctly, that is the exact approach that the new web UI is taking. The new web UI takes the output from JMX and renders them as HTML at the client side. ~Haohui On Mon, Oct 28, 2013 at 4:18 PM, Alejandro Abdelnur wrote: > Haohui, > > If you have NN and DNs producin

Re: Replacing the JSP web UIs to HTML 5 applications

2013-10-28 Thread Alejandro Abdelnur
Haohui, If you have NN and DNs producing JSON instead HTML, then you can build JS based web UIs. Take for example Oozie, Oozie produces JSON, it has a built in JS web ui that consumes JSON and Hue has built an external web UI that also consumes JSON. In the case of Hue UI, Oozie didn't have to cha

Re: Replacing the JSP web UIs to HTML 5 applications

2013-10-28 Thread Haohui Mai
Hi Alejandro, Can you please elaborate on producing JSON? All information presented in the new Web UIs directly comes from the JMX side. I'm okay with leaving the current JSP right now, since both the old and the new Web UI can happily coexist. When do you think it is a good time to switch the d

Re: Replacing the JSP web UIs to HTML 5 applications

2013-10-28 Thread Haohui Mai
Echo my comments on HDFS-5402: bq. If we're going to remove the old web UI, I think the new web UI has to have the same level of unit testing. We shouldn't go backwards in terms of unit testing. I take a look at TestNamenodeJspHelper / TestDatanodeJspHelper / TestClusterJspHelper. It seems to me

Re: Replacing the JSP web UIs to HTML 5 applications

2013-10-28 Thread Alejandro Abdelnur
Producing JSON would be great. Agree with Colin that we should leave for now the current JSP based web ui. thx On Mon, Oct 28, 2013 at 11:16 AM, Colin McCabe wrote: > This is a really interesting project, Haohui. I think it will make > our web UI much nicer. > > I have a few concerns about rem

Re: Replacing the JSP web UIs to HTML 5 applications

2013-10-28 Thread Colin McCabe
This is a really interesting project, Haohui. I think it will make our web UI much nicer. I have a few concerns about removing the old web UI, however: * If we're going to remove the old web UI, I think the new web UI has to have the same level of unit testing. We shouldn't go backwards in term

Re: Replacing the JSP web UIs to HTML 5 applications

2013-10-25 Thread Haohui Mai
Thanks for the reply, Luke. Here I just echo my response from the jira: bq. this client-side js only approach, which is less secure than a progressively enhanced hybrid approach used by YARN. The recent gmail XSS fiasco highlights the issue. I'm presenting an informal security analysis to compare

Re: Replacing the JSP web UIs to HTML 5 applications

2013-10-25 Thread Luke Lu
Echoing my comments on HDFS-3555: I have concerns with this client-side js only approach, which is less secure than a progressively enhanced hybrid approach used by YARN. The recent gmail XSS fiasco highlights the issue. I also have concerns that we commit these changes without matching unit tests

Replacing the JSP web UIs to HTML 5 applications

2013-10-22 Thread Haohui Mai
Hi all, Jing Zhao and I recently have reimplemented the JSP-based web UIs in HTML 5 applications (HDFS-5333). Based on our prelimanary testing results we believe thst the new web UIs of the namenodes and the datanode are ready for everyday uses. You're more than welcome to try it out on trunk by