Re: ReadOnly WebHDFS

Thanks for your response Chris. >> I'm curious how this is a new problem after migration from HttpFs to WebHDFS With HttpFs, gateway admin users are allowed to proxy some limited set of users. They are not allowed to mock a root/dfsadmin user and do some fatal stuff ("rmr /"). With WebHDFS, thats

Hadoop-Hdfs-trunk - Build # 2518 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2518/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6416 lines...] main: [mkdir] Created dir: /home/jenk

Build failed in Jenkins: Hadoop-Hdfs-trunk #2518

See Changes: [arp] HDFS-6481. DatanodeManager#getDatanodeStorageInfos() should check the [yzhang] HDFS-9236. Missing sanity check for block size during block recovery. [kihwal] HDFS-9318. considerLoad factor can be improved. Contrib

[jira] [Created] (HDFS-9399) Ability to disable HDFS browsing via browseDirectory.jsp , make it configurable

Raghu C Doppalapudi created HDFS-9399: - Summary: Ability to disable HDFS browsing via browseDirectory.jsp , make it configurable Key: HDFS-9399 URL: https://issues.apache.org/jira/browse/HDFS-9399

[jira] [Created] (HDFS-9398) Make ByteArraryManager log message in one-line format

Mingliang Liu created HDFS-9398: --- Summary: Make ByteArraryManager log message in one-line format Key: HDFS-9398 URL: https://issues.apache.org/jira/browse/HDFS-9398 Project: Hadoop HDFS Issue T

[jira] [Created] (HDFS-9397) Fix typo for readChecksum() LOG.warn in BlockSender.java

Enrique Flores created HDFS-9397: Summary: Fix typo for readChecksum() LOG.warn in BlockSender.java Key: HDFS-9397 URL: https://issues.apache.org/jira/browse/HDFS-9397 Project: Hadoop HDFS Is

Build failed in Jenkins: Hadoop-Hdfs-trunk #2517

See Changes: [jlowe] Update CHANGES.txt for commit of HADOOP 12413 to 2.7.3 and 2.6.3 -- [...truncated 6192 lines...] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.072 sec

Hadoop-Hdfs-trunk - Build # 2517 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2517/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6385 lines...] [INFO] --- maven-antrun-plugin:1.7:run (cr

[jira] [Created] (HDFS-9396) Total files and directories on jmx and web UI on standby is uninitialized

Kihwal Lee created HDFS-9396: Summary: Total files and directories on jmx and web UI on standby is uninitialized Key: HDFS-9396 URL: https://issues.apache.org/jira/browse/HDFS-9396 Project: Hadoop HDFS

[jira] [Created] (HDFS-9395) getContentSummary is audit logged as success even if failed

Kihwal Lee created HDFS-9395: Summary: getContentSummary is audit logged as success even if failed Key: HDFS-9395 URL: https://issues.apache.org/jira/browse/HDFS-9395 Project: Hadoop HDFS Issue

Re: ReadOnly WebHDFS

Hello Laxman, I'm curious how this is a new problem after migration from HttpFs to WebHDFS. With the HttpFs deployment architecture, were you somehow proxying only the read-only operations? I would think this kind of thing could be achieved by writing a custom authentication filter, deploying th

Hadoop-Hdfs-trunk - Build # 2516 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2516/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7060 lines...] [INFO] Executing tasks main: [mkdir]

Build failed in Jenkins: Hadoop-Hdfs-trunk #2516

See Changes: [cnauroth] HDFS-9384. TestWebHdfsContentLength intermittently hangs and fails due -- [...truncated 6867 lines...] Running org.apache.hadoop.hdfs.server.mover.TestMover Tests run:

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #577

See Changes: [cnauroth] HDFS-9384. TestWebHdfsContentLength intermittently hangs and fails due -- [...truncated 6848 lines...] Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractR

Hadoop-Hdfs-trunk-Java8 - Build # 577 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/577/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7041 lines...] [INFO] Executing tasks main: [mk

ReadOnly WebHDFS

Hi, We run a cluster with security set to simple. Also, to some users, we had provided http access to HDFS via HttpFS gateways. However, this is not scaling and we are suffering from HttpFs gateway choking problem. So, we wanted to enable WebHDFS directly on hadoop. But this brings in the problem

Hadoop-Hdfs-trunk - Build # 2515 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2515/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6416 lines...] main: [mkdir] Created dir: /home/jenk

Build failed in Jenkins: Hadoop-Hdfs-trunk #2515

See Changes: [aw] MAPREDUCE-3914. Mismatched free() / delete / delete [] in HadoopPipes [aw] MAPREDUCE-1125. SerialUtils.cc: deserializeFloat is out of sync with [lei] HADOOP-11684. S3a to use thread pool that blocks clients. (Thoma