[Federation setup] Adding a new name node to federated cluster

Hi all, Use case : I am trying to add a new name node to already running federated cluster https://hadoop.apache.org/docs/r2.6.0/hadoop-project-dist/hadoop-hdfs/Federation.html#Adding_a_new_Namenode_to_an_existing_HDFS_cluster When I execute the refreshNamenodes($HADOOP_PREFIX/bin/hdfs dfsadmin

[jira] [Created] (HDFS-8038) Fix TestOfflineImageViewer#testPBDelimitedWriter on Windows

Xiaoyu Yao created HDFS-8038: Summary: Fix TestOfflineImageViewer#testPBDelimitedWriter on Windows Key: HDFS-8038 URL: https://issues.apache.org/jira/browse/HDFS-8038 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-8037) WebHDFS: CheckAccess silently accepts certain malformed FsActions

Jake Low created HDFS-8037: -- Summary: WebHDFS: CheckAccess silently accepts certain malformed FsActions Key: HDFS-8037 URL: https://issues.apache.org/jira/browse/HDFS-8037 Project: Hadoop HDFS Issu

[jira] [Created] (HDFS-8036) Use snapshot path as source when using snapshot diff report in DistCp

Jing Zhao created HDFS-8036: --- Summary: Use snapshot path as source when using snapshot diff report in DistCp Key: HDFS-8036 URL: https://issues.apache.org/jira/browse/HDFS-8036 Project: Hadoop HDFS

[jira] [Created] (HDFS-8035) Move checking replication and get client DN to BM and DM respectively

Haohui Mai created HDFS-8035: Summary: Move checking replication and get client DN to BM and DM respectively Key: HDFS-8035 URL: https://issues.apache.org/jira/browse/HDFS-8035 Project: Hadoop HDFS

[jira] [Created] (HDFS-8034) Fix TestDFSClientRetries#testDFSClientConfigurationLocateFollowingBlockInitialDelay for Windows

Xiaoyu Yao created HDFS-8034: Summary: Fix TestDFSClientRetries#testDFSClientConfigurationLocateFollowingBlockInitialDelay for Windows Key: HDFS-8034 URL: https://issues.apache.org/jira/browse/HDFS-8034

[jira] [Created] (HDFS-8033) Erasure coding: stateful (non-positional) read from files in striped layout

Zhe Zhang created HDFS-8033: --- Summary: Erasure coding: stateful (non-positional) read from files in striped layout Key: HDFS-8033 URL: https://issues.apache.org/jira/browse/HDFS-8033 Project: Hadoop HDFS

[jira] [Created] (HDFS-8032) Erasure coding: use sentinels in BlockInfoStriped and shrink size of indices

Zhe Zhang created HDFS-8032: --- Summary: Erasure coding: use sentinels in BlockInfoStriped and shrink size of indices Key: HDFS-8032 URL: https://issues.apache.org/jira/browse/HDFS-8032 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-7981) getStoragePolicy() regards HOT policy as EC policy

[ https://issues.apache.org/jira/browse/HDFS-7981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-7981. - Resolution: Won't Fix HDFS-7839 is close to finish. > getStoragePolicy() regards HOT policy as EC policy >

[jira] [Resolved] (HDFS-7729) Add logic to DFSOutputStream to support writing a file in striping layout

[ https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-7729. - Resolution: Duplicate > Add logic to DFSOutputStream to support writing a file in striping layout > --

[jira] [Resolved] (HDFS-7783) Support appending to a striping layout file

[ https://issues.apache.org/jira/browse/HDFS-7783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-7783. - Resolution: Duplicate > Support appending to a striping layout file > -

[jira] [Resolved] (HDFS-7689) Add periodic checker to find the corrupted EC blocks/files

[ https://issues.apache.org/jira/browse/HDFS-7689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-7689. - Resolution: Duplicate > Add periodic checker to find the corrupted EC blocks/files > --

[jira] [Resolved] (HDFS-7617) Add unit tests for editlog transactions for EC

[ https://issues.apache.org/jira/browse/HDFS-7617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-7617. - Resolution: Fixed Fix Version/s: HDFS-7285 > Add unit tests for editlog transactions for EC > --

[jira] [Created] (HDFS-8031) Follow-on work for erasure coding phase I (striping layout)

Zhe Zhang created HDFS-8031: --- Summary: Follow-on work for erasure coding phase I (striping layout) Key: HDFS-8031 URL: https://issues.apache.org/jira/browse/HDFS-8031 Project: Hadoop HDFS Issue Ty

[jira] [Created] (HDFS-8030) HDFS Erasure Coding Phase II -- EC with contiguous layout

Zhe Zhang created HDFS-8030: --- Summary: HDFS Erasure Coding Phase II -- EC with contiguous layout Key: HDFS-8030 URL: https://issues.apache.org/jira/browse/HDFS-8030 Project: Hadoop HDFS Issue Type:

Re: Uncertainty of pre-commit builds

Ravi just pointed me to HADOOP-11746. Thanks a bunch for working on improving our test-patch scripts, Allen. On Tue, Mar 31, 2015 at 9:37 AM, Allen Wittenauer wrote: > > Very likely. One of the things I noticed during HADOOP-11746 is > that there is a HUGE, catastrophic race if Jenkins

Re: Uncertainty of pre-commit builds

Very likely. One of the things I noticed during HADOOP-11746 is that there is a HUGE, catastrophic race if Jenkins doesn’t setup the environment correctly or leaks variables between runs. shellcheck prints out so many messages on the current code I’m surprised it doesn’t crash. On Ma

Uncertainty of pre-commit builds

Hi devs, I am sure people must have noticed, but thought I would bring this up. I have noticed that our pre-commit builds could end up running the "wrong" set of unit tests for patches. For instance, YARN-3412 changes only YARN files, but the test

Hadoop-Hdfs-trunk-Java8 - Build # 140 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/140/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7840 lines...] [INFO] [INFO] --- maven-source-plugi

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #140

See Changes: [kihwal] HDFS-7742. Favoring decommissioning node for replication can cause a block to stay [aajisaka] HDFS-8002. Website refers to /trash directory. Contributd by Brahma Reddy Battula. [vinodkv] YARN-3304. Clean

Build failed in Jenkins: Hadoop-Hdfs-trunk #2081

See Changes: [kihwal] HDFS-7742. Favoring decommissioning node for replication can cause a block to stay [aajisaka] HDFS-8002. Website refers to /trash directory. Contributd by Brahma Reddy Battula. [vinodkv] YARN-3304. Cleaning u

Hadoop-Hdfs-trunk - Build # 2081 - Failure

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2081/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6518 lines...] [INFO] [INFO] --- maven-source-plugin:2.3

[jira] [Created] (HDFS-8029) NPE during disk usage calculation on snapshot directory, after a sub folder is deleted

kanaka kumar avvaru created HDFS-8029: - Summary: NPE during disk usage calculation on snapshot directory, after a sub folder is deleted Key: HDFS-8029 URL: https://issues.apache.org/jira/browse/HDFS-8029

[jira] [Created] (HDFS-8028) TestNNHandlesBlockReportPerStorage/TestNNHandlesCombinedBlockReport Failed after patched HDFS-7704

hongyu bi created HDFS-8028: --- Summary: TestNNHandlesBlockReportPerStorage/TestNNHandlesCombinedBlockReport Failed after patched HDFS-7704 Key: HDFS-8028 URL: https://issues.apache.org/jira/browse/HDFS-8028

Re: Why DFSClient in HA-cluster tries to resolve HA cluster name?

Thats a good find Dmitry Simonov. Even in DFSAdmin, everywhere its used just to print to console. You can raise a jira and post a patch to refactor this. -Vinay On Tue, Mar 31, 2015 at 12:34 PM, Dmitry Simonov wrote: > Hello! > > Why DFSClient in HA-cluster tries to resolve HA cluster name? >

[jira] [Resolved] (HDFS-8027) Erasure Coding: Update CHANGES-HDFS-7285.txt with branch commits

[ https://issues.apache.org/jira/browse/HDFS-8027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B resolved HDFS-8027. - Resolution: Fixed Fix Version/s: HDFS-7285 Committed to HDFS-7285 branch, Committed directly

[jira] [Created] (HDFS-8027) Update CHANGES-HDFS-7285.txt with branch commits

Vinayakumar B created HDFS-8027: --- Summary: Update CHANGES-HDFS-7285.txt with branch commits Key: HDFS-8027 URL: https://issues.apache.org/jira/browse/HDFS-8027 Project: Hadoop HDFS Issue Type:

Why DFSClient in HA-cluster tries to resolve HA cluster name?

Hello! Why DFSClient in HA-cluster tries to resolve HA cluster name? I have just been investigating a problem - FileSystem.get() method sometimes takes too long time to complete, about 2-3 seconds, and found that: 1. DFSClient makes call to NameNodeProxies.createProxy() 2. createProxy() method,