WebHDFS metrics

2015-11-16 Thread Laxman Ch
Hi Devs, We recently enabled WebHDFS on Hadoop 2.6.0. I couldn't find any traces of metrics in code/documentation for WebHDFS. I feel we need to expose some metrics that may help in debugging/identifying some problems. *Thoughts on this please?* Here is a quick compilation of metrics to start wi

Re: ReadOnly WebHDFS

2015-11-06 Thread Laxman Ch
you want > to file an HDFS JIRA for further discussion of your proposal, there is no > harm in that. It might end up as a "Won't Fix", or perhaps others in the > community see it differently from me, and we'd want to proceed. > > Thanks for sharing the work you'

ReadOnly WebHDFS

2015-11-06 Thread Laxman Ch
Hi, We run a cluster with security set to simple. Also, to some users, we had provided http access to HDFS via HttpFS gateways. However, this is not scaling and we are suffering from HttpFs gateway choking problem. So, we wanted to enable WebHDFS directly on hadoop. But this brings in the problem