Re: [VOTE] Release Apache Hadoop 2.6.2

+1 (binding) Download the tarball and run some HDFS tests and MR examples in a pseudo-distributed cluster. Thanks, -Jing On Mon, Oct 26, 2015 at 2:06 PM, Vinod Vavilapalli wrote: > I was helping Sangjin offline with the release. > > We briefly discussed the KEYS problem before, but it missed m

Re: Erasure coding in branch-2 [Was Re: [VOTE] Merge HDFS-7285 (erasure coding) branch to trunk]

ange it to binding.) > > >>>>>>>> > > >>>>>>>> +1 > > >>>>>>>> I have been involved in the development and code review on the > > >>>>>> feature > > >>>>>>>

Re: Erasure coding in branch-2 [Was Re: [VOTE] Merge HDFS-7285 (erasure coding) branch to trunk]

trunk. I'll update on this thread when the merge is > > >>> done. > > >>>>>>>> > > >>>>>>>> --- > > >>>>>>>> Zhe Zhang > > >>>>>>>> > > >>>>>>>> O

Re: [Important] Lots of 2.8.0 commits are in branch-2 only

Thanks for reporting the issue, Wangda. Recreating a new branch-2.8 based on the current branch-2 makes sense to me. Thanks, -Jing On Wed, Dec 16, 2015 at 5:38 PM, Wangda Tan wrote: > Hi folks, > > I found there're lots of commits are in branch-2 only. > Ran "git log branch-2.8..branch-2". > >

Re: Regarding hsync

Hi Hemant, HDFS-4213 (https://issues.apache.org/jira/browse/HDFS-4213) may be the one you're looking for. In general, an hsync which can update the file size on NN is enabled. You may call "hsync(EnumSet.of(SyncFlag.UPDATE_LENGTH))" to do that. Thanks, -Jing On Thu, Jul 11, 2013 at 1:38 AM,

Re: File not found exception

Hi Sugato, Do you want to read the data from hdfs? From the log it seems like you're reading data from a "RawLocalFileSystem". Maybe you need to check if you have set your default file system in the configuration correctly ( fs.default.name or fs.defaultFS, depending on your hadoop version)?

Re: Deprecate hftp / hsftp

+1 So I've reviewed most of Haohui's patch for developing swebhdfs, fixing https setup for hsftp, and supporting HA in webhdfs. For both webhdfs and swebhdfs we have run system tests on both secured and insecure cluster, including running distcp to transfer data between 1.x and 2.x. I believe curr

Re: Deprecate BackupNode

+1. BackupNode also brings extra work for the recent https/http policy work, since we need to make sure the checkpoint works for all the policy/security combinations. We should deprecate it if no one is using it. On Wed, Dec 4, 2013 at 3:06 PM, Suresh Srinivas wrote: > It is almost an year a jira

Re: [VOTE] Merge HDFS-5698 Use protobuf to serialize / deserialize FSImage to trunk

inue to test and > fix any bugs that may be found on trunk. > > The bulk of the design and implementation was done by Jing Zhao, > Suresh Srinivas and me. Thanks Kihwal Lee, Todd Lipcon, Colin > Patrick McCabe, Chris Nauroth, and Daryn Sharp for providing feedback on > the jiras an

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

+1 (binding) downloaded the source tar ball, built it, and ran some examples and distcp job. Thanks, -Jing On Tue, Apr 14, 2015 at 11:06 AM, Robert Kanter wrote: > +1 (non-binding) > > + verified checksum > + Deployed binary tarball, ran some examples, clicked around in the Web UIs > > thanks

Re: [VOTE] Merge HDFS-7285 (erasure coding) branch to trunk

S, snapshot, append, truncate, hflush, hsync, > >and so forth. > > > >Development of this feature has been a collaboration across many > >companies and institutions. I'd like to thank J. Andreina, Takanobu > >Asanuma, Vinayakumar B, Li Bo, Takuya Fukudome, Uma Maheswar

Re: Query : Reg Uploading branch 1.2 patch to JIRA

Hi Vivek, For branch-1.x patches, we usually run test-patch.sh and all the unit tests in our local machine and post the results in the jira. Thanks, -Jing On Thu, Feb 6, 2014 at 10:36 PM, Vivek Ganesan wrote: > I have uploaded a patch for branch-1.2 in > HDFS-4901

Re: [VOTE] Merge HDFS-4685 HDFS ACLs to trunk

cess, integration with the existing >> permissions model, persistence of ACLs to fsimage and edits, and more. We >> have documented our further system testing plans in a test plan document >> attached to issue HDFS-4685. >> >> I want to thank the numerous contrib

Re: [VOTE] Merge HDFS-5535 Rolling Upgrade Improvement

gned to > > Vinay) > > > HDFS-6016: Update datanode replacement policy to make writes more > robust > > (assigned to Kihwal) > > > > > > HDFS-6000 will be committed soon. All other issues are further > > improvements which can be done after merge.

Re: HDFS-6376

Hi Dave, The Jenkins only runs against trunk. Thus you need to upload a patch for trunk instead of 2.4. Thanks, -Jing On Wed, May 28, 2014 at 11:28 AM, wrote: > I’m trying to complete this issue, but I am unable to get it to build in > Jenkins. The patch applies for my locally. Is there a

Re: [VOTE] Merge HDFS-6581 to trunk - Writing to replicas in memory.

+1. This is a very useful feature and the performance number looks convincing. Thanks, -Jing On Tue, Sep 23, 2014 at 5:12 PM, Xiaoyu Yao wrote: > +1 non-binding. I’ve reviewed most of the changes in the branch and the > E2E perf numbers looks good. > > Thanks, > Xiaoyu > > On Sep 23, 2014, at 4

Re: Thinking ahead to hadoop-2.6

Just to give a quick update about the current status of HDFS-6584 (archival storage). So far after HDFS-7081 got committed this morning, the main functionalities have already been finished. As a summary two new DistributedFileSystem APIs are added: getStoragePolicies and setStoragePolicy. We have a

Re: [VOTE] Release Apache Hadoop 2.6.0

+1 (binding) Verified checksums and signatures. Successfully deploy a cluster with NameNode HA setup and run some hdfs commands. Thanks, -Jing On Fri, Nov 14, 2014 at 3:58 PM, Chris Nauroth wrote: > +1 (binding) > > - Verified checksums and signatures for source and binary tarballs. > - Starte

[jira] [Resolved] (HDFS-15842) HDFS mover to emit metrics

[ https://issues.apache.org/jira/browse/HDFS-15842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-15842. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed +1. Thank you for the

[jira] [Resolved] (HDFS-16224) testBalancerWithObserverWithFailedNode times out

[ https://issues.apache.org/jira/browse/HDFS-16224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-16224. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed I've committed th

[jira] [Resolved] (HDFS-10648) Expose Balancer metrics through Metrics2

[ https://issues.apache.org/jira/browse/HDFS-10648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-10648. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Resolved Thanks for the work

[jira] [Resolved] (HDFS-16268) Balancer stuck when moving striped blocks due to NPE

[ https://issues.apache.org/jira/browse/HDFS-16268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-16268. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Balancer stuck when mov

[jira] [Created] (HDFS-16874) Improve DataNode decommission for Erasure Coding

Jing Zhao created HDFS-16874: Summary: Improve DataNode decommission for Erasure Coding Key: HDFS-16874 URL: https://issues.apache.org/jira/browse/HDFS-16874 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-16875) Erasure Coding: data access proxy to allow old clients to read EC data

Jing Zhao created HDFS-16875: Summary: Erasure Coding: data access proxy to allow old clients to read EC data Key: HDFS-16875 URL: https://issues.apache.org/jira/browse/HDFS-16875 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-15548) Allow configuring DISK/ARCHIVE storage types on same device mount

[ https://issues.apache.org/jira/browse/HDFS-15548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-15548. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed I've committed the c

[jira] [Resolved] (HDFS-14904) Add Option to let Balancer prefer highly utilized nodes in each iteration

[ https://issues.apache.org/jira/browse/HDFS-14904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-14904. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Add Option to let Balan

[jira] [Resolved] (HDFS-15549) Use Hardlink to move replica between DISK and ARCHIVE storage if on same filesystem mount

[ https://issues.apache.org/jira/browse/HDFS-15549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-15549. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed +1. Thank you for the

[jira] [Resolved] (HDFS-15683) Allow configuring DISK/ARCHIVE capacity for individual volumes

[ https://issues.apache.org/jira/browse/HDFS-15683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-15683. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Allow configuring D

[jira] [Resolved] (HDFS-15781) Add metrics for how blocks are moved in replaceBlock

[ https://issues.apache.org/jira/browse/HDFS-15781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-15781. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed I've committed the

[jira] [Created] (HDFS-9145) Tracking methods that hold FSNamesytemLock for too long

Jing Zhao created HDFS-9145: --- Summary: Tracking methods that hold FSNamesytemLock for too long Key: HDFS-9145 URL: https://issues.apache.org/jira/browse/HDFS-9145 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-9180) Update excluded DataNodes in DFSStripedOutputStream based on failures in data streamers

Jing Zhao created HDFS-9180: --- Summary: Update excluded DataNodes in DFSStripedOutputStream based on failures in data streamers Key: HDFS-9180 URL: https://issues.apache.org/jira/browse/HDFS-9180 Project

[jira] [Created] (HDFS-9204) DatanodeDescriptor#PendingReplicationWithoutTargets is wrongly calculated

Jing Zhao created HDFS-9204: --- Summary: DatanodeDescriptor#PendingReplicationWithoutTargets is wrongly calculated Key: HDFS-9204 URL: https://issues.apache.org/jira/browse/HDFS-9204 Project: Hadoop HDFS

[jira] [Created] (HDFS-9223) Code cleanup for DatanodeDescriptor and HeartbeatManager

Jing Zhao created HDFS-9223: --- Summary: Code cleanup for DatanodeDescriptor and HeartbeatManager Key: HDFS-9223 URL: https://issues.apache.org/jira/browse/HDFS-9223 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-9319) Make DatanodeInfo thread safe

Jing Zhao created HDFS-9319: --- Summary: Make DatanodeInfo thread safe Key: HDFS-9319 URL: https://issues.apache.org/jira/browse/HDFS-9319 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-9371) Code cleanup for DatanodeManager

Jing Zhao created HDFS-9371: --- Summary: Code cleanup for DatanodeManager Key: HDFS-9371 URL: https://issues.apache.org/jira/browse/HDFS-9371 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-9535) Fix TestReplication#testNoExtraReplicationWhenBlockReceivedIsLate

Jing Zhao created HDFS-9535: --- Summary: Fix TestReplication#testNoExtraReplicationWhenBlockReceivedIsLate Key: HDFS-9535 URL: https://issues.apache.org/jira/browse/HDFS-9535 Project: Hadoop HDFS

[jira] [Created] (HDFS-9542) Move BlockIdManager from FSNamesystem to BlockManager

Jing Zhao created HDFS-9542: --- Summary: Move BlockIdManager from FSNamesystem to BlockManager Key: HDFS-9542 URL: https://issues.apache.org/jira/browse/HDFS-9542 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-9575) Use byte array for internal block indices in a striped block

Jing Zhao created HDFS-9575: --- Summary: Use byte array for internal block indices in a striped block Key: HDFS-9575 URL: https://issues.apache.org/jira/browse/HDFS-9575 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-9621) {{getListing}} wrongly associates Erasure Coding policy to pre-existing replicated files under an EC directory

Jing Zhao created HDFS-9621: --- Summary: {{getListing}} wrongly associates Erasure Coding policy to pre-existing replicated files under an EC directory Key: HDFS-9621 URL: https://issues.apache.org/jira/browse/HDFS

[jira] [Created] (HDFS-9646) ErasureCodingWorker may fail when recovering data blocks with length less than the first internal block

Jing Zhao created HDFS-9646: --- Summary: ErasureCodingWorker may fail when recovering data blocks with length less than the first internal block Key: HDFS-9646 URL: https://issues.apache.org/jira/browse/HDFS-9646

[jira] [Created] (HDFS-4429) Add unit tests for taking snapshots while file appending

Jing Zhao created HDFS-4429: --- Summary: Add unit tests for taking snapshots while file appending Key: HDFS-4429 URL: https://issues.apache.org/jira/browse/HDFS-4429 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-4431) Support snapshot in OfflineImageViewer

Jing Zhao created HDFS-4431: --- Summary: Support snapshot in OfflineImageViewer Key: HDFS-4431 URL: https://issues.apache.org/jira/browse/HDFS-4431 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-4432) Support INodeFileUnderConstructionWithSnapshot in FSImage saving/loading

Jing Zhao created HDFS-4432: --- Summary: Support INodeFileUnderConstructionWithSnapshot in FSImage saving/loading Key: HDFS-4432 URL: https://issues.apache.org/jira/browse/HDFS-4432 Project: Hadoop HDFS

[jira] [Created] (HDFS-4479) In branch-1, logSync() may be called with the FSNamesystem lock held in commitBlockSynchronization

Jing Zhao created HDFS-4479: --- Summary: In branch-1, logSync() may be called with the FSNamesystem lock held in commitBlockSynchronization Key: HDFS-4479 URL: https://issues.apache.org/jira/browse/HDFS-4479

[jira] [Created] (HDFS-4499) Fix file/directory/snapshot deletion for file diff

Jing Zhao created HDFS-4499: --- Summary: Fix file/directory/snapshot deletion for file diff Key: HDFS-4499 URL: https://issues.apache.org/jira/browse/HDFS-4499 Project: Hadoop HDFS Issue Type: Sub

[jira] [Created] (HDFS-4514) Add CLI support for snapshot rename, diff report, and snapshottable directory listing

Jing Zhao created HDFS-4514: --- Summary: Add CLI support for snapshot rename, diff report, and snapshottable directory listing Key: HDFS-4514 URL: https://issues.apache.org/jira/browse/HDFS-4514 Project

[jira] [Created] (HDFS-4520) Support listing snapshots under a snapshottable directory using "ls"

Jing Zhao created HDFS-4520: --- Summary: Support listing snapshots under a snapshottable directory using "ls" Key: HDFS-4520 URL: https://issues.apache.org/jira/browse/HDFS-4520 Project: H

[jira] [Created] (HDFS-4524) Update SnapshotManager#snapshottables when loading fsimage

Jing Zhao created HDFS-4524: --- Summary: Update SnapshotManager#snapshottables when loading fsimage Key: HDFS-4524 URL: https://issues.apache.org/jira/browse/HDFS-4524 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-4550) Refactor INodesInPath and add extra check for path ending with "/.snapshot"

Jing Zhao created HDFS-4550: --- Summary: Refactor INodesInPath and add extra check for path ending with "/.snapshot" Key: HDFS-4550 URL: https://issues.apache.org/jira/browse/HDFS-4550 Project: H

[jira] [Created] (HDFS-4557) Fix FSDirectory#delete when INode#cleanSubtree returns 0

Jing Zhao created HDFS-4557: --- Summary: Fix FSDirectory#delete when INode#cleanSubtree returns 0 Key: HDFS-4557 URL: https://issues.apache.org/jira/browse/HDFS-4557 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-4563) Update namespace/diskspace after deleting snapshots

Jing Zhao created HDFS-4563: --- Summary: Update namespace/diskspace after deleting snapshots Key: HDFS-4563 URL: https://issues.apache.org/jira/browse/HDFS-4563 Project: Hadoop HDFS Issue Type: Sub

[jira] [Created] (HDFS-4616) Update the FilesDeleted metric while deleting file/dir in the current tree

Jing Zhao created HDFS-4616: --- Summary: Update the FilesDeleted metric while deleting file/dir in the current tree Key: HDFS-4616 URL: https://issues.apache.org/jira/browse/HDFS-4616 Project: Hadoop HDFS

[jira] [Created] (HDFS-4622) Remove redundant synchronized from FSNamesystem#rollEditLog in branch-1

Jing Zhao created HDFS-4622: --- Summary: Remove redundant synchronized from FSNamesystem#rollEditLog in branch-1 Key: HDFS-4622 URL: https://issues.apache.org/jira/browse/HDFS-4622 Project: Hadoop HDFS

[jira] [Created] (HDFS-4627) Fix FSImageFormat#Loader#loadFilesUnderConstruction

Jing Zhao created HDFS-4627: --- Summary: Fix FSImageFormat#Loader#loadFilesUnderConstruction Key: HDFS-4627 URL: https://issues.apache.org/jira/browse/HDFS-4627 Project: Hadoop HDFS Issue Type: Sub

[jira] [Created] (HDFS-4636) Update quota usage when deleting a file/dir that is not included in the latest snapshot

Jing Zhao created HDFS-4636: --- Summary: Update quota usage when deleting a file/dir that is not included in the latest snapshot Key: HDFS-4636 URL: https://issues.apache.org/jira/browse/HDFS-4636 Project

[jira] [Created] (HDFS-4637) INodeDirectory#replaceSelf4Quota may convert a newly created directory (which is not included in the latest snapshot) to an INodeDirectoryWithSnapshot

Jing Zhao created HDFS-4637: --- Summary: INodeDirectory#replaceSelf4Quota may convert a newly created directory (which is not included in the latest snapshot) to an INodeDirectoryWithSnapshot Key: HDFS-4637 URL: https

[jira] [Created] (HDFS-4648) For snapshot deletion, when merging the diff from to-delete snapshot to the prior snapshot, make sure files/directories created after the prior snapshot get deleted

Jing Zhao created HDFS-4648: --- Summary: For snapshot deletion, when merging the diff from to-delete snapshot to the prior snapshot, make sure files/directories created after the prior snapshot get deleted Key: HDFS-4648

[jira] [Created] (HDFS-4650) Add unit tests for rename with snapshots

Jing Zhao created HDFS-4650: --- Summary: Add unit tests for rename with snapshots Key: HDFS-4650 URL: https://issues.apache.org/jira/browse/HDFS-4650 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-4666) Disallow users to create file/dir named ".snapshot"

Jing Zhao created HDFS-4666: --- Summary: Disallow users to create file/dir named ".snapshot" Key: HDFS-4666 URL: https://issues.apache.org/jira/browse/HDFS-4666 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-4667) Capture renamed files/directories in snapshot diff report

Jing Zhao created HDFS-4667: --- Summary: Capture renamed files/directories in snapshot diff report Key: HDFS-4667 URL: https://issues.apache.org/jira/browse/HDFS-4667 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-4675) Fix rename across snapshottable directories

Jing Zhao created HDFS-4675: --- Summary: Fix rename across snapshottable directories Key: HDFS-4675 URL: https://issues.apache.org/jira/browse/HDFS-4675 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-4686) Fix quota computation for rename with snapshots

Jing Zhao created HDFS-4686: --- Summary: Fix quota computation for rename with snapshots Key: HDFS-4686 URL: https://issues.apache.org/jira/browse/HDFS-4686 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-4694) The SecondaryNameNode may change the inode id of root while doing checkpoint

Jing Zhao created HDFS-4694: --- Summary: The SecondaryNameNode may change the inode id of root while doing checkpoint Key: HDFS-4694 URL: https://issues.apache.org/jira/browse/HDFS-4694 Project: Hadoop HDFS

[jira] [Created] (HDFS-4700) Fix the undo section of rename

Jing Zhao created HDFS-4700: --- Summary: Fix the undo section of rename Key: HDFS-4700 URL: https://issues.apache.org/jira/browse/HDFS-4700 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-4726) Fix test failures after merging the mapping from INodeId to INode

Jing Zhao created HDFS-4726: --- Summary: Fix test failures after merging the mapping from INodeId to INode Key: HDFS-4726 URL: https://issues.apache.org/jira/browse/HDFS-4726 Project: Hadoop HDFS

[jira] [Created] (HDFS-4727) Update inodeMap after deleting files/directories/snapshots

Jing Zhao created HDFS-4727: --- Summary: Update inodeMap after deleting files/directories/snapshots Key: HDFS-4727 URL: https://issues.apache.org/jira/browse/HDFS-4727 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-4729) Update OfflineImageViewer and fix TestOfflineImageViewer

Jing Zhao created HDFS-4729: --- Summary: Update OfflineImageViewer and fix TestOfflineImageViewer Key: HDFS-4729 URL: https://issues.apache.org/jira/browse/HDFS-4729 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-4742) Fix appending a renamed file

Jing Zhao created HDFS-4742: --- Summary: Fix appending a renamed file Key: HDFS-4742 URL: https://issues.apache.org/jira/browse/HDFS-4742 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-4749) Use INodeId to identify the corresponding directory node for FSImage saving/loading

Jing Zhao created HDFS-4749: --- Summary: Use INodeId to identify the corresponding directory node for FSImage saving/loading Key: HDFS-4749 URL: https://issues.apache.org/jira/browse/HDFS-4749 Project

[jira] [Created] (HDFS-4757) Update FSDirectory#inodeMap when replacing an INodeDirectory while setting quota

Jing Zhao created HDFS-4757: --- Summary: Update FSDirectory#inodeMap when replacing an INodeDirectory while setting quota Key: HDFS-4757 URL: https://issues.apache.org/jira/browse/HDFS-4757 Project: Hadoop

[jira] [Created] (HDFS-4760) Update inodeMap after node replacement

Jing Zhao created HDFS-4760: --- Summary: Update inodeMap after node replacement Key: HDFS-4760 URL: https://issues.apache.org/jira/browse/HDFS-4760 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-4761) Refresh INodeMap in FSDirectory#reset()

Jing Zhao created HDFS-4761: --- Summary: Refresh INodeMap in FSDirectory#reset() Key: HDFS-4761 URL: https://issues.apache.org/jira/browse/HDFS-4761 Project: Hadoop HDFS Issue Type: Bug Affects

[jira] [Created] (HDFS-4773) Fix bugs in quota usage updating/computation

Jing Zhao created HDFS-4773: --- Summary: Fix bugs in quota usage updating/computation Key: HDFS-4773 URL: https://issues.apache.org/jira/browse/HDFS-4773 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-4791) Update and fix deletion of reference inode

Jing Zhao created HDFS-4791: --- Summary: Update and fix deletion of reference inode Key: HDFS-4791 URL: https://issues.apache.org/jira/browse/HDFS-4791 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-4800) Fix INodeDirectoryWithSnapshot#cleanDeletedINode

Jing Zhao created HDFS-4800: --- Summary: Fix INodeDirectoryWithSnapshot#cleanDeletedINode Key: HDFS-4800 URL: https://issues.apache.org/jira/browse/HDFS-4800 Project: Hadoop HDFS Issue Type: Sub

[jira] [Created] (HDFS-4806) For an INodeDirectoryWithSnapshot, use INode#isInLatestSnapshot() to check if the added/removed child should be recorded in snapshot diff

Jing Zhao created HDFS-4806: --- Summary: For an INodeDirectoryWithSnapshot, use INode#isInLatestSnapshot() to check if the added/removed child should be recorded in snapshot diff Key: HDFS-4806 URL: https

[jira] [Created] (HDFS-4809) Add more unit tests for the undo section of rename

Jing Zhao created HDFS-4809: --- Summary: Add more unit tests for the undo section of rename Key: HDFS-4809 URL: https://issues.apache.org/jira/browse/HDFS-4809 Project: Hadoop HDFS Issue Type: Sub

[jira] [Created] (HDFS-4842) Snapshot: identify the correct prior snapshot when deleting a snapshot under a renamed subtree

Jing Zhao created HDFS-4842: --- Summary: Snapshot: identify the correct prior snapshot when deleting a snapshot under a renamed subtree Key: HDFS-4842 URL: https://issues.apache.org/jira/browse/HDFS-4842

[jira] [Created] (HDFS-4857) Snapshot.Root and AbstractINodeDiff#snapshotINode should not be put into INodeMap when loading FSImage

Jing Zhao created HDFS-4857: --- Summary: Snapshot.Root and AbstractINodeDiff#snapshotINode should not be put into INodeMap when loading FSImage Key: HDFS-4857 URL: https://issues.apache.org/jira/browse/HDFS-4857

[jira] [Resolved] (HDFS-4847) hdfs dfs -count of a .snapshot directory fails claiming file does not exist

[ https://issues.apache.org/jira/browse/HDFS-4847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-4847. - Resolution: Invalid ".snapshot" is not a directory thus commands such as "count" and

[jira] [Created] (HDFS-4863) The root directory should be added to the snapshottable directory list while loading fsimage

Jing Zhao created HDFS-4863: --- Summary: The root directory should be added to the snapshottable directory list while loading fsimage Key: HDFS-4863 URL: https://issues.apache.org/jira/browse/HDFS-4863

[jira] [Created] (HDFS-4877) Snapshot: fix the scenario where a directory is renamed under its prior descendant

Jing Zhao created HDFS-4877: --- Summary: Snapshot: fix the scenario where a directory is renamed under its prior descendant Key: HDFS-4877 URL: https://issues.apache.org/jira/browse/HDFS-4877 Project: Hadoop

[jira] [Created] (HDFS-4971) Move IO operations out of locking in OpenFileCtx

Jing Zhao created HDFS-4971: --- Summary: Move IO operations out of locking in OpenFileCtx Key: HDFS-4971 URL: https://issues.apache.org/jira/browse/HDFS-4971 Project: Hadoop HDFS Issue Type: Sub

[jira] [Created] (HDFS-4978) Make disallowSnapshot idempotent

Jing Zhao created HDFS-4978: --- Summary: Make disallowSnapshot idempotent Key: HDFS-4978 URL: https://issues.apache.org/jira/browse/HDFS-4978 Project: Hadoop HDFS Issue Type: Improvement Affects

[jira] [Created] (HDFS-5005) Move SnapshotException and SnapshotAccessControlException to o.a.h.hdfs.protocol

Jing Zhao created HDFS-5005: --- Summary: Move SnapshotException and SnapshotAccessControlException to o.a.h.hdfs.protocol Key: HDFS-5005 URL: https://issues.apache.org/jira/browse/HDFS-5005 Project: Hadoop

[jira] [Created] (HDFS-5013) Improve HDFS HA document

Jing Zhao created HDFS-5013: --- Summary: Improve HDFS HA document Key: HDFS-5013 URL: https://issues.apache.org/jira/browse/HDFS-5013 Project: Hadoop HDFS Issue Type: Improvement Affects

[jira] [Created] (HDFS-5020) Make DatanodeProtocol#blockReceivedAndDeleted idempotent

Jing Zhao created HDFS-5020: --- Summary: Make DatanodeProtocol#blockReceivedAndDeleted idempotent Key: HDFS-5020 URL: https://issues.apache.org/jira/browse/HDFS-5020 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-5025) Record ClientId and CalldId in EditLog to enable rebuilding retry cache in case of HA failover

Jing Zhao created HDFS-5025: --- Summary: Record ClientId and CalldId in EditLog to enable rebuilding retry cache in case of HA failover Key: HDFS-5025 URL: https://issues.apache.org/jira/browse/HDFS-5025

[jira] [Created] (HDFS-5038) Backport several branch-2 APIs to branch-1

Jing Zhao created HDFS-5038: --- Summary: Backport several branch-2 APIs to branch-1 Key: HDFS-5038 URL: https://issues.apache.org/jira/browse/HDFS-5038 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-5045) Add more unit tests for retry cache to cover all AtMostOnce methods

Jing Zhao created HDFS-5045: --- Summary: Add more unit tests for retry cache to cover all AtMostOnce methods Key: HDFS-5045 URL: https://issues.apache.org/jira/browse/HDFS-5045 Project: Hadoop HDFS

[jira] [Created] (HDFS-5076) Create http servlets to enable querying NN's last applied transaction ID and most recent checkpoint's transaction ID

Jing Zhao created HDFS-5076: --- Summary: Create http servlets to enable querying NN's last applied transaction ID and most recent checkpoint's transaction ID Key: HDFS-5076 URL: https://issues.apache.org/jira/b

[jira] [Resolved] (HDFS-4926) namenode webserver's page has a tooltip that is inconsistent with the datanode HTML link

[ https://issues.apache.org/jira/browse/HDFS-4926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-4926. - Resolution: Fixed Fix Version/s: 2.1.1-beta Hadoop Flags: Reviewed I've committed th

[jira] [Created] (HDFS-5080) BootstrapStandby not working with QJM when the existing NN is active

Jing Zhao created HDFS-5080: --- Summary: BootstrapStandby not working with QJM when the existing NN is active Key: HDFS-5080 URL: https://issues.apache.org/jira/browse/HDFS-5080 Project: Hadoop HDFS

[jira] [Created] (HDFS-5091) Support for spnego keytab separate from the JournalNode keytab for secure HA

Jing Zhao created HDFS-5091: --- Summary: Support for spnego keytab separate from the JournalNode keytab for secure HA Key: HDFS-5091 URL: https://issues.apache.org/jira/browse/HDFS-5091 Project: Hadoop HDFS

[jira] [Created] (HDFS-5111) Correctly handling incorrect input for snapshot commands

Jing Zhao created HDFS-5111: --- Summary: Correctly handling incorrect input for snapshot commands Key: HDFS-5111 URL: https://issues.apache.org/jira/browse/HDFS-5111 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-5118) Extend LoadGenerator for testing NameNode retry cache

Jing Zhao created HDFS-5118: --- Summary: Extend LoadGenerator for testing NameNode retry cache Key: HDFS-5118 URL: https://issues.apache.org/jira/browse/HDFS-5118 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-5137) Improve WriteManager for processing stable write requests and commit requests

Jing Zhao created HDFS-5137: --- Summary: Improve WriteManager for processing stable write requests and commit requests Key: HDFS-5137 URL: https://issues.apache.org/jira/browse/HDFS-5137 Project: Hadoop HDFS

[jira] [Created] (HDFS-5145) Revisit the needEnter() check in SafeModeInfo#canLeave()

Jing Zhao created HDFS-5145: --- Summary: Revisit the needEnter() check in SafeModeInfo#canLeave() Key: HDFS-5145 URL: https://issues.apache.org/jira/browse/HDFS-5145 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-5167) Add metrics about the NameNode retry cache

Jing Zhao created HDFS-5167: --- Summary: Add metrics about the NameNode retry cache Key: HDFS-5167 URL: https://issues.apache.org/jira/browse/HDFS-5167 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Resolved] (HDFS-5038) Backport several branch-2 APIs to branch-1

[ https://issues.apache.org/jira/browse/HDFS-5038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-5038. - Resolution: Fixed Fix Version/s: 1.3.0 Hadoop Flags: Reviewed Thanks for the review Suresh

  1   2   3   4   5   >