[jira] [Created] (HDFS-7793) Refactor DFSOutputStream seperating DataStreamer out

Kai Zheng created HDFS-7793: --- Summary: Refactor DFSOutputStream seperating DataStreamer out Key: HDFS-7793 URL: https://issues.apache.org/jira/browse/HDFS-7793 Project: Hadoop HDFS Issue Type: Impr

[jira] [Created] (HDFS-7792) Add links to FaultInjectFramework and SLGUserGuide to site index

Masatake Iwasaki created HDFS-7792: -- Summary: Add links to FaultInjectFramework and SLGUserGuide to site index Key: HDFS-7792 URL: https://issues.apache.org/jira/browse/HDFS-7792 Project: Hadoop HDFS

[jira] [Created] (HDFS-7791) dfs count -v should be added to quota documentation

Allen Wittenauer created HDFS-7791: -- Summary: dfs count -v should be added to quota documentation Key: HDFS-7791 URL: https://issues.apache.org/jira/browse/HDFS-7791 Project: Hadoop HDFS Iss

Re: max concurrent connection to HDFS name node

Colin, Thanks. 30~50K is smaller than I thought, through I understand that I shouldn't stress the traffic unnecessarily. If I can put my client(java/c) on a datanode and only read the local hdfs files, that is the files have their replicas on such datanode. Is there an API I can use to talk direc

[jira] [Resolved] (HDFS-7083) TestDecommission#testIncludeByRegistrationName sometimes fails

[ https://issues.apache.org/jira/browse/HDFS-7083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-7083. Resolution: Duplicate > TestDecommission#testIncludeByRegistrationName sometimes fail

[jira] [Reopened] (HDFS-7083) TestDecommission#testIncludeByRegistrationName sometimes fails

[ https://issues.apache.org/jira/browse/HDFS-7083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe reopened HDFS-7083: > TestDecommission#testIncludeByRegistrationName sometimes fails > --

Re: max concurrent connection to HDFS name node

The NN can do somewhere around 30,000 - 50,000 RPCs per second currently, depending on configuration. In general you do not want to have extremely high NN RPC traffic, because it will slow things down. You might consider re-architecting your application to do more DN traffic and less NN traffic, i

Re: Erratic Jenkins behavior

We could potentially use different .m2 directories for each executor. I think this has been brought up in the past as well. I'm not sure how maven handles concurrent access to the .m2 directory... if it's not using flock or fnctl then it's not really safe. This might explain some of our missing c

[jira] [Created] (HDFS-7790) Do not create optional fields in DFSInputStream unless they are needed

Colin Patrick McCabe created HDFS-7790: -- Summary: Do not create optional fields in DFSInputStream unless they are needed Key: HDFS-7790 URL: https://issues.apache.org/jira/browse/HDFS-7790 Projec

[jira] [Created] (HDFS-7789) DFsck should resolve the path to support cross-FS symlinks

Gera Shegalov created HDFS-7789: --- Summary: DFsck should resolve the path to support cross-FS symlinks Key: HDFS-7789 URL: https://issues.apache.org/jira/browse/HDFS-7789 Project: Hadoop HDFS Is

[jira] [Created] (HDFS-7788) Post 2.6 namenode may not start up with an image containing inodes created with an old release.

Kihwal Lee created HDFS-7788: Summary: Post 2.6 namenode may not start up with an image containing inodes created with an old release. Key: HDFS-7788 URL: https://issues.apache.org/jira/browse/HDFS-7788 P

Hadoop-Hdfs-trunk - Build # 2034 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2034/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6480 lines...] [INFO] --- maven-checkstyle-plugin:2.12.1:

Build failed in Jenkins: Hadoop-Hdfs-trunk #2034

See Changes: [stevel] YARN-2616 [YARN-913] Add CLI client to the registry to list, view and manipulate entries. (Akshay Radia via stevel) [stevel] YARN-2683. [YARN-913] registry config options: document and move to core-default. (s

[jira] [Created] (HDFS-7787) Wrong priorty of replication

Frode Halvorsen created HDFS-7787: - Summary: Wrong priorty of replication Key: HDFS-7787 URL: https://issues.apache.org/jira/browse/HDFS-7787 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-7786) Handle failures and slow writers for DFSOutputStream when there're multiple data streamers

Li Bo created HDFS-7786: --- Summary: Handle failures and slow writers for DFSOutputStream when there're multiple data streamers Key: HDFS-7786 URL: https://issues.apache.org/jira/browse/HDFS-7786 Project: Hadoop