[jira] [Reopened] (HDFS-13732) ECAdmin should print the policy name when an EC policy is set

[ https://issues.apache.org/jira/browse/HDFS-13732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen reopened HDFS-13732: -- > ECAdmin should print the policy name when an EC policy is

[jira] [Created] (HDFS-14039) ec -listPolicies doesn't show correct state for the default policy when the default is not RS(6,3)

Xiao Chen created HDFS-14039: Summary: ec -listPolicies doesn't show correct state for the default policy when the default is not RS(6,3) Key: HDFS-14039 URL: https://issues.apache.org/jira/browse/HDFS-

[jira] [Created] (HDFS-14038) Expose HdfsDataOutputStreamBuilder to include Spark in LimitedPrivate

Xiao Chen created HDFS-14038: Summary: Expose HdfsDataOutputStreamBuilder to include Spark in LimitedPrivate Key: HDFS-14038 URL: https://issues.apache.org/jira/browse/HDFS-14038 Project: Hadoop HDFS

[jira] [Created] (HDFS-14027) DFSStripedOutputStream should implement both hsync methods

Xiao Chen created HDFS-14027: Summary: DFSStripedOutputStream should implement both hsync methods Key: HDFS-14027 URL: https://issues.apache.org/jira/browse/HDFS-14027 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-14021) TestReconstructStripedBlocksWithRackAwareness#testReconstructForNotEnoughRacks fails intermittently

Xiao Chen created HDFS-14021: Summary: TestReconstructStripedBlocksWithRackAwareness#testReconstructForNotEnoughRacks fails intermittently Key: HDFS-14021 URL: https://issues.apache.org/jira/browse/HDFS-14021

[jira] [Created] (HDFS-13998) ECAdmin NPE with -setPolicy -replicate

Xiao Chen created HDFS-13998: Summary: ECAdmin NPE with -setPolicy -replicate Key: HDFS-13998 URL: https://issues.apache.org/jira/browse/HDFS-13998 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-13926) ThreadLocal aggregations for FileSystem.Statistics are incorrect with striped reads

Xiao Chen created HDFS-13926: Summary: ThreadLocal aggregations for FileSystem.Statistics are incorrect with striped reads Key: HDFS-13926 URL: https://issues.apache.org/jira/browse/HDFS-13926 Project

[jira] [Created] (HDFS-13847) Clean up ErasureCodingPolicyManager

Xiao Chen created HDFS-13847: Summary: Clean up ErasureCodingPolicyManager Key: HDFS-13847 URL: https://issues.apache.org/jira/browse/HDFS-13847 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-13788) Update EC documentation about rack fault tolerance

Xiao Chen created HDFS-13788: Summary: Update EC documentation about rack fault tolerance Key: HDFS-13788 URL: https://issues.apache.org/jira/browse/HDFS-13788 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-13741) Cosmetic code improvement in XAttrFormat

Xiao Chen created HDFS-13741: Summary: Cosmetic code improvement in XAttrFormat Key: HDFS-13741 URL: https://issues.apache.org/jira/browse/HDFS-13741 Project: Hadoop HDFS Issue Type: Bug

[jira] [Resolved] (HDFS-13690) Improve error message when creating encryption zone while KMS is unreachable

[ https://issues.apache.org/jira/browse/HDFS-13690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen resolved HDFS-13690. -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0 Committed to trunk. Thanks

[jira] [Created] (HDFS-13731) Investigate TestReencryption timeouts

Xiao Chen created HDFS-13731: Summary: Investigate TestReencryption timeouts Key: HDFS-13731 URL: https://issues.apache.org/jira/browse/HDFS-13731 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-13721) NPE in DataNode due to uninitialized DiskBalancer

Xiao Chen created HDFS-13721: Summary: NPE in DataNode due to uninitialized DiskBalancer Key: HDFS-13721 URL: https://issues.apache.org/jira/browse/HDFS-13721 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-13682) Cannot create encryption zone after KMS auth token expires

Xiao Chen created HDFS-13682: Summary: Cannot create encryption zone after KMS auth token expires Key: HDFS-13682 URL: https://issues.apache.org/jira/browse/HDFS-13682 Project: Hadoop HDFS Issue

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

Thanks for the effort on this Yongjun. +1 (binding) - Built from src - Deployed a pseudo distributed HDFS with KMS - Ran basic hdfs commands with encryption - Sanity checked webui and logs -Xiao On Fri, Jun 8, 2018 at 10:34 AM, Brahma Reddy Battula < brahmareddy.batt...@hotmail.com

[jira] [Created] (HDFS-13655) Adding missing ClientProtocol methods to RBF

Xiao Chen created HDFS-13655: Summary: Adding missing ClientProtocol methods to RBF Key: HDFS-13655 URL: https://issues.apache.org/jira/browse/HDFS-13655 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-13642) Creating a file with block size smaller than EC policy's cell size should throw

Xiao Chen created HDFS-13642: Summary: Creating a file with block size smaller than EC policy's cell size should throw Key: HDFS-13642 URL: https://issues.apache.org/jira/browse/HDFS-13642 Pr

[jira] [Created] (HDFS-13540) DFSStripedInputStream should not allocate new buffers during close / unbuffer

Xiao Chen created HDFS-13540: Summary: DFSStripedInputStream should not allocate new buffers during close / unbuffer Key: HDFS-13540 URL: https://issues.apache.org/jira/browse/HDFS-13540 Project: Hadoop

[jira] [Created] (HDFS-13539) DFSInputStream NPE when reportCheckSumFailure

Xiao Chen created HDFS-13539: Summary: DFSInputStream NPE when reportCheckSumFailure Key: HDFS-13539 URL: https://issues.apache.org/jira/browse/HDFS-13539 Project: Hadoop HDFS Issue Type: Bug

[jira] [Reopened] (HDFS-13430) Fix TestEncryptionZonesWithKMS failure due to HADOOP-14445

[ https://issues.apache.org/jira/browse/HDFS-13430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen reopened HDFS-13430: -- > Fix TestEncryptionZonesWithKMS failure due to HADOOP-14

[jira] [Resolved] (HDFS-13430) Fix TestEncryptionZonesWithKMS failure due to HADOOP-14445

[ https://issues.apache.org/jira/browse/HDFS-13430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen resolved HDFS-13430. -- Resolution: Invalid Fix Version/s: (was: 3.0.3) (was: 3.1.1

Re: [VOTE] Release Apache Hadoop 3.0.2 (RC1)

Thanks Eddy for the effort! +1 (binding) - Downloaded src tarball and verified checksums - Built from src - Started a pseudo distributed hdfs cluster - Verified basic hdfs operations work - Sanity checked webui and logs Best, -Xiao -Xiao On Fri, Apr 20, 2018 at 1:44 AM, 俊平堵 wr

[jira] [Created] (HDFS-13430) Fix TestEncryptionZonesWithKMS failure due to HADOOP-14445

Xiao Chen created HDFS-13430: Summary: Fix TestEncryptionZonesWithKMS failure due to HADOOP-14445 Key: HDFS-13430 URL: https://issues.apache.org/jira/browse/HDFS-13430 Project: Hadoop HDFS Issue

Re: [VOTE] Release Apache Hadoop 3.0.2 (RC0)

Thanks Eddy for the effort! +1 (binding) - Downloaded src tarball and verified checksums - Built from src - Started a pseudo distributed hdfs cluster - Verified basic hdfs operations work - Sanity checked logs / webui Best, -Xiao On Mon, Apr 9, 2018 at 11:28 AM, Eric Payne wrot

Re: Hdfs build on branch-2 are failing.

Similar to Haibo's link I found https://stackoverflow.com/a/22526046/1338884 to be working. Thrown a patch at HADOOP-15375 to unblock branch-2. I'm also not sure why this is passing for trunk. -Xiao On Thu, Apr 5, 2018 at 3:41 PM, Haibo Chen

Re: [VOTE] Adopt HDSL as a new Hadoop subproject

+1 Thanks, -Xiao On Sun, Mar 25, 2018 at 9:07 PM, Akira Ajisaka wrote: > +1 > > Thanks, > Akira > > > On 2018/03/24 15:18, Lokesh Jain wrote: > >> +1 (non-binding) >> >> Thanks >> Lokesh >> >> >> - >> To unsubscribe, e-mail: hd

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

Thanks Eddy for the effort! +1 (binding) - Downloaded src tarball and verified checksums - Built from src - Started a pseudo distributed hdfs cluster - Verified basic hdfs operations work - Verified hdfs encryption basic operations work - Sanity checked logs / webui -Xiao On

[jira] [Reopened] (HDFS-13164) File not closed if streamer fail with DSQuotaExceededException

[ https://issues.apache.org/jira/browse/HDFS-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen reopened HDFS-13164: -- > File not closed if streamer fail with DSQuotaExceededExcept

[jira] [Created] (HDFS-13177) Investigate and fix DFSStripedOutputStream handling of DSQuotaExceededException

Xiao Chen created HDFS-13177: Summary: Investigate and fix DFSStripedOutputStream handling of DSQuotaExceededException Key: HDFS-13177 URL: https://issues.apache.org/jira/browse/HDFS-13177 Project

[jira] [Created] (HDFS-13164) File not closed if append fail with DSQuotaExceededException

Xiao Chen created HDFS-13164: Summary: File not closed if append fail with DSQuotaExceededException Key: HDFS-13164 URL: https://issues.apache.org/jira/browse/HDFS-13164 Project: Hadoop HDFS

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC0)

Thanks Eddy for driving this! +1 (binding) - Downloaded src tarball and verified md5 - Built from src - Started a pseudo distributed cluster - Verified basic hdfs operations work - Verified hdfs encryption basic operations work - Sanity checked logs The wiki release page seems

[jira] [Created] (HDFS-13091) Remove tomcat from the Hadoop-auth test bundle

Xiao Chen created HDFS-13091: Summary: Remove tomcat from the Hadoop-auth test bundle Key: HDFS-13091 URL: https://issues.apache.org/jira/browse/HDFS-13091 Project: Hadoop HDFS Issue Type: Task

[jira] [Created] (HDFS-12990) Change default NameNode RPC port back to 8020

Xiao Chen created HDFS-12990: Summary: Change default NameNode RPC port back to 8020 Key: HDFS-12990 URL: https://issues.apache.org/jira/browse/HDFS-12990 Project: Hadoop HDFS Issue Type: Task

[jira] [Created] (HDFS-12946) Add a tool to check rack configuration against EC policies

Xiao Chen created HDFS-12946: Summary: Add a tool to check rack configuration against EC policies Key: HDFS-12946 URL: https://issues.apache.org/jira/browse/HDFS-12946 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-12933) Improve logging when DFSStripedOutputStream failed to read some blocks

Xiao Chen created HDFS-12933: Summary: Improve logging when DFSStripedOutputStream failed to read some blocks Key: HDFS-12933 URL: https://issues.apache.org/jira/browse/HDFS-12933 Project: Hadoop HDFS

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

+1 (binding) - downloaded src tarball, verified md5 - built from source with jdk1.8.0_112 - started a pseudo cluster with hdfs and kms - sanity checked encryption related operations working - sanity checked webui and logs. -Xiao On Mon, Dec 11, 2017 at 6:10 PM, Aaron T. Myers wrote: > +1 (bind

[jira] [Created] (HDFS-12872) EC Checksum broken when BlockAccessToken is enabled

Xiao Chen created HDFS-12872: Summary: EC Checksum broken when BlockAccessToken is enabled Key: HDFS-12872 URL: https://issues.apache.org/jira/browse/HDFS-12872 Project: Hadoop HDFS Issue Type

Re: [VOTE] Release Apache Hadoop 3.0.0 RC0

+1 (binding) Thanks Andrew! - Verified md5 and built from source - Started a pseudo distributed cluster with KMS, - Performed basic hdfs operations plus encryption related operations - Verified logs and webui - Confidence from CDH testings (will let Andrew answer officially, but

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC2)

;> similar to the other MIT dependencies. >> >> Cheers >> -Arun >> >> >> >> On Mon, Nov 13, 2017 at 2:53 PM, Xiao Chen wrote: >> >>> Thanks guys for pulling the RC and prompt reviews. >>> >>> From previous L&am

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC2)

Thanks guys for pulling the RC and prompt reviews. >From previous L&N discussions and http://www.apache.org/dev/licensing-howto.htm

[jira] [Created] (HDFS-12726) BlockPlacementPolicyDefault's debugLoggingBuilder is not logged

Xiao Chen created HDFS-12726: Summary: BlockPlacementPolicyDefault's debugLoggingBuilder is not logged Key: HDFS-12726 URL: https://issues.apache.org/jira/browse/HDFS-12726 Project: Hadoop

[jira] [Created] (HDFS-12725) BlockPlacementPolicyRackFaultTolerant still fails with racks with very few nodes

Xiao Chen created HDFS-12725: Summary: BlockPlacementPolicyRackFaultTolerant still fails with racks with very few nodes Key: HDFS-12725 URL: https://issues.apache.org/jira/browse/HDFS-12725 Project

[jira] [Resolved] (HDFS-12686) Erasure coding system policy state is not correctly saved and loaded during real cluster restart

[ https://issues.apache.org/jira/browse/HDFS-12686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen resolved HDFS-12686. -- Resolution: Duplicate Since HDFS-12682 should be able to handle this, and it's pretty hard to

[jira] [Created] (HDFS-12682) ECAdmin -listPolicies will always show policy state as DISABLED

Xiao Chen created HDFS-12682: Summary: ECAdmin -listPolicies will always show policy state as DISABLED Key: HDFS-12682 URL: https://issues.apache.org/jira/browse/HDFS-12682 Project: Hadoop HDFS

[jira] [Created] (HDFS-12668) MetricsSystemImpl should consistently check minicluster mode

Xiao Chen created HDFS-12668: Summary: MetricsSystemImpl should consistently check minicluster mode Key: HDFS-12668 URL: https://issues.apache.org/jira/browse/HDFS-12668 Project: Hadoop HDFS

[jira] [Created] (HDFS-12642) Log block and datanode details in BlockRecoveryWorker

Xiao Chen created HDFS-12642: Summary: Log block and datanode details in BlockRecoveryWorker Key: HDFS-12642 URL: https://issues.apache.org/jira/browse/HDFS-12642 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-12596) Add TestFsck#testFsckCorruptWhenOneReplicaIsCorrupt back to branch-2.7

Xiao Chen created HDFS-12596: Summary: Add TestFsck#testFsckCorruptWhenOneReplicaIsCorrupt back to branch-2.7 Key: HDFS-12596 URL: https://issues.apache.org/jira/browse/HDFS-12596 Project: Hadoop HDFS

[jira] [Created] (HDFS-12578) TestDeadDatanode#testNonDFSUsedONDeadNodeReReg failing in branch-2.7

Xiao Chen created HDFS-12578: Summary: TestDeadDatanode#testNonDFSUsedONDeadNodeReReg failing in branch-2.7 Key: HDFS-12578 URL: https://issues.apache.org/jira/browse/HDFS-12578 Project: Hadoop HDFS

Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0

Thanks Andrew! +1 (binding) - Verified md5 matches - Built from src tarball - Started pseudo-distributed hdfs cluster with kms, ran basic operations - Sanity checked logs and NN webui P.S. Obviously Andrew meant to say Oct. 3rd, not November. :) -Xiao On Thu, Sep 28, 2017 at 5:04 P

[jira] [Reopened] (HDFS-8865) Improve quota initialization performance

[ https://issues.apache.org/jira/browse/HDFS-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen reopened HDFS-8865: - Sorry to reopen. Trying to backport this to branch-2.7 and branch-2.6, attaching patches... > Improve qu

[jira] [Created] (HDFS-12518) Re-encryption should handle task cancellation and progress better

Xiao Chen created HDFS-12518: Summary: Re-encryption should handle task cancellation and progress better Key: HDFS-12518 URL: https://issues.apache.org/jira/browse/HDFS-12518 Project: Hadoop HDFS

[jira] [Created] (HDFS-12400) Provide a way for NN to drain the local key cache before re-encryption

Xiao Chen created HDFS-12400: Summary: Provide a way for NN to drain the local key cache before re-encryption Key: HDFS-12400 URL: https://issues.apache.org/jira/browse/HDFS-12400 Project: Hadoop HDFS

[jira] [Created] (HDFS-12383) Re-encryption updater should handle canceled tasks

Xiao Chen created HDFS-12383: Summary: Re-encryption updater should handle canceled tasks Key: HDFS-12383 URL: https://issues.apache.org/jira/browse/HDFS-12383 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-12378) TestClientProtocolForPipelineRecovery#testZeroByteBlockRecovery fails on trunk

Xiao Chen created HDFS-12378: Summary: TestClientProtocolForPipelineRecovery#testZeroByteBlockRecovery fails on trunk Key: HDFS-12378 URL: https://issues.apache.org/jira/browse/HDFS-12378 Project: Hadoop

[jira] [Created] (HDFS-12369) Edit log corruption due to hard lease recovery of not-closed file

Xiao Chen created HDFS-12369: Summary: Edit log corruption due to hard lease recovery of not-closed file Key: HDFS-12369 URL: https://issues.apache.org/jira/browse/HDFS-12369 Project: Hadoop HDFS

[jira] [Created] (HDFS-12363) Possible NPE in BlockManager$StorageInfoDefragmenter#scanAndCompactStorages

Xiao Chen created HDFS-12363: Summary: Possible NPE in BlockManager$StorageInfoDefragmenter#scanAndCompactStorages Key: HDFS-12363 URL: https://issues.apache.org/jira/browse/HDFS-12363 Project: Hadoop

[jira] [Created] (HDFS-12359) Re-encryption should operate with minimum KMS ACL requirements.

Xiao Chen created HDFS-12359: Summary: Re-encryption should operate with minimum KMS ACL requirements. Key: HDFS-12359 URL: https://issues.apache.org/jira/browse/HDFS-12359 Project: Hadoop HDFS

[jira] [Created] (HDFS-12347) TestBalancerRPCDelay#testBalancerRPCDelay fails consistently

Xiao Chen created HDFS-12347: Summary: TestBalancerRPCDelay#testBalancerRPCDelay fails consistently Key: HDFS-12347 URL: https://issues.apache.org/jira/browse/HDFS-12347 Project: Hadoop HDFS

Re: Why aren't delegation token operations audit logged?

f the audit log by omitting > common operations, it does not seem harmful to add these token ops. > > Erik > > On 8/14/17, 5:44 PM, "Allen Wittenauer" wrote: > > [You don't often get email from a...@apache.org. Learn why this is > important at http://aka

Re: Why aren't delegation token operations audit logged?

es not > contain anything like the identifier/password. My first thought was > logging overhead but I checked our clusters and the rate of logging would > be insignificant. > > Daryn > > On Mon, Aug 14, 2017 at 1:52 PM, Xiao Chen wrote: > >> Hello, >> >> Wh

[jira] [Created] (HDFS-12300) Audit-log delegation token related operations

Xiao Chen created HDFS-12300: Summary: Audit-log delegation token related operations Key: HDFS-12300 URL: https://issues.apache.org/jira/browse/HDFS-12300 Project: Hadoop HDFS Issue Type

Why aren't delegation token operations audit logged?

Hello, When inspecting the code, I found that the following methods in FSNamesystem are not audit logged: - getDelegationToken - renewDelegationToken - cancelDelegationToken The audit log itself does have a logTokenTrackingId

[jira] [Created] (HDFS-12261) Improve HdfsAdmin's javadoc regarding superusers.

Xiao Chen created HDFS-12261: Summary: Improve HdfsAdmin's javadoc regarding superusers. Key: HDFS-12261 URL: https://issues.apache.org/jira/browse/HDFS-12261 Project: Hadoop HDFS Issue

[jira] [Resolved] (HDFS-9590) NPE in Storage$StorageDirectory#unlock()

[ https://issues.apache.org/jira/browse/HDFS-9590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen resolved HDFS-9590. - Resolution: Cannot Reproduce Haven't seen this since, closing... > NPE in Storage$StorageDirector

[jira] [Created] (HDFS-12116) BlockReportTestBase#blockReport_08 and #blockReport_08 intermittently fail

Xiao Chen created HDFS-12116: Summary: BlockReportTestBase#blockReport_08 and #blockReport_08 intermittently fail Key: HDFS-12116 URL: https://issues.apache.org/jira/browse/HDFS-12116 Project: Hadoop

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0

Thanks Andrew! +1 (non-binding) - Verified md5's, checked tarball sizes are reasonable - Built source tarball and deployed a pseudo-distributed cluster with hdfs/kms - Tested basic hdfs/kms operations - Sanity checked webuis/logs -Xiao On Wed, Jul 5, 2017 at 10:33 PM, John Zhuge

[jira] [Resolved] (HDFS-12073) Add option to oiv to print out more information about snapshots.

[ https://issues.apache.org/jira/browse/HDFS-12073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen resolved HDFS-12073. -- Resolution: Duplicate It seems HDFS-10506 did this sorry didn't find it before filing > Ad

[jira] [Created] (HDFS-12073) Add option to oiv to print out more information about snapshots.

Xiao Chen created HDFS-12073: Summary: Add option to oiv to print out more information about snapshots. Key: HDFS-12073 URL: https://issues.apache.org/jira/browse/HDFS-12073 Project: Hadoop HDFS

Re: Jenkins failures

There was some maven-caused failures last night, and should be fixed by INFRA-14261 . Saw another error just now but not sure if that's just my run or something globally. Thanks, -Xiao On Thu, Jun 1, 2017 at 10:12 AM, Anu Engineer wrote: > Scr

[jira] [Created] (HDFS-11904) Reuse iip in unprotectedRemoveXAttrs calls

Xiao Chen created HDFS-11904: Summary: Reuse iip in unprotectedRemoveXAttrs calls Key: HDFS-11904 URL: https://issues.apache.org/jira/browse/HDFS-11904 Project: Hadoop HDFS Issue Type

[jira] [Resolved] (HDFS-11421) Make WebHDFS' ACLs RegEx configurable

[ https://issues.apache.org/jira/browse/HDFS-11421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen resolved HDFS-11421. -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Committed to branch-2, thanks

[jira] [Created] (HDFS-11876) Make WebHDFS' ACLs RegEx configurable Testing

Xiao Chen created HDFS-11876: Summary: Make WebHDFS' ACLs RegEx configurable Testing Key: HDFS-11876 URL: https://issues.apache.org/jira/browse/HDFS-11876 Project: Hadoop HDFS Issue Type:

[jira] [Reopened] (HDFS-11421) Make WebHDFS' ACLs RegEx configurable

[ https://issues.apache.org/jira/browse/HDFS-11421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen reopened HDFS-11421: -- Thanks for chiming in, folks. I have returned from paternity leave today, sorry for the delay in the past

[jira] [Reopened] (HDFS-11379) DFSInputStream may infinite loop requesting block locations

[ https://issues.apache.org/jira/browse/HDFS-11379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen reopened HDFS-11379: -- Sorry for reopening this. Attaching a branch-2.7 patch. 2.6 seems will be EOL'ed soon so maybe we can

[jira] [Created] (HDFS-11410) Use the cache when edit logging XAttrOps

Xiao Chen created HDFS-11410: Summary: Use the cache when edit logging XAttrOps Key: HDFS-11410 URL: https://issues.apache.org/jira/browse/HDFS-11410 Project: Hadoop HDFS Issue Type: Bug

Git Infra problem?

Hello, Saw some weird error when committing a jira this morning. Don't think I broke it... Filed https://issues.apache.org/jira/browse/INFRA-13412 Best, -Xiao

[jira] [Resolved] (HDFS-11372) Increase test timeouts that are too aggressive.

[ https://issues.apache.org/jira/browse/HDFS-11372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen resolved HDFS-11372. -- Resolution: Duplicate > Increase test timeouts that are too aggress

[jira] [Resolved] (HDFS-8377) Support HTTP/2 in datanode

[ https://issues.apache.org/jira/browse/HDFS-8377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen resolved HDFS-8377. - Resolution: Fixed Fix Version/s: (was: 3.0.0-alpha1) Committed the revert to trunk and branch-2

[jira] [Created] (HDFS-11372) Increase test timeouts that are too aggressive.

Xiao Chen created HDFS-11372: Summary: Increase test timeouts that are too aggressive. Key: HDFS-11372 URL: https://issues.apache.org/jira/browse/HDFS-11372 Project: Hadoop HDFS Issue Type

[jira] [Reopened] (HDFS-8377) Support HTTP/2 in datanode

[ https://issues.apache.org/jira/browse/HDFS-8377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen reopened HDFS-8377: - Reopening to run pre-commit. > Support HTTP/2 in datan

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

Thanks Andrew and the community to work out the alpha2 RC! +1 (non-binding) - Built the source tarball - Tested on a pseudo-distributed cluster, basic HDFS operations/sample pi job over HDFS encryption zone work. - Sanity checked NN and KMS webui - Sanity checked NN/DN/KMS logs.

[jira] [Resolved] (HDFS-11366) Clean up old .ckpt files after saveNamespace

[ https://issues.apache.org/jira/browse/HDFS-11366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen resolved HDFS-11366. -- Resolution: Duplicate Looks like we already have HDFS-3716 in place to take care of this problem

[jira] [Created] (HDFS-11366) Clean up old .ckpt files after saveNamespace

Xiao Chen created HDFS-11366: Summary: Clean up old .ckpt files after saveNamespace Key: HDFS-11366 URL: https://issues.apache.org/jira/browse/HDFS-11366 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-11275) Check groupEntryIndex and throw a helpful exception on failures when removing ACL.

Xiao Chen created HDFS-11275: Summary: Check groupEntryIndex and throw a helpful exception on failures when removing ACL. Key: HDFS-11275 URL: https://issues.apache.org/jira/browse/HDFS-11275 Project

[jira] [Created] (HDFS-11210) Enhance key rolling to be atomic

Xiao Chen created HDFS-11210: Summary: Enhance key rolling to be atomic Key: HDFS-11210 URL: https://issues.apache.org/jira/browse/HDFS-11210 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-11203) Rename handling during re-encrypt EDEK

Xiao Chen created HDFS-11203: Summary: Rename handling during re-encrypt EDEK Key: HDFS-11203 URL: https://issues.apache.org/jira/browse/HDFS-11203 Project: Hadoop HDFS Issue Type: Task

[jira] [Created] (HDFS-11159) Add reencryptEDEK interface for KMS

Xiao Chen created HDFS-11159: Summary: Add reencryptEDEK interface for KMS Key: HDFS-11159 URL: https://issues.apache.org/jira/browse/HDFS-11159 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-11120) TestEncryptionZones should waitActive

Xiao Chen created HDFS-11120: Summary: TestEncryptionZones should waitActive Key: HDFS-11120 URL: https://issues.apache.org/jira/browse/HDFS-11120 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-11093) TestEncryptionZones#testStartFileRetry intermittently fails with timeout

Xiao Chen created HDFS-11093: Summary: TestEncryptionZones#testStartFileRetry intermittently fails with timeout Key: HDFS-11093 URL: https://issues.apache.org/jira/browse/HDFS-11093 Project: Hadoop HDFS

[jira] [Created] (HDFS-11091) Implement a getTrashRoot that does not fall-back

Xiao Chen created HDFS-11091: Summary: Implement a getTrashRoot that does not fall-back Key: HDFS-11091 URL: https://issues.apache.org/jira/browse/HDFS-11091 Project: Hadoop HDFS Issue Type

[jira] [Reopened] (HDFS-10423) Increase default value of httpfs maxHttpHeaderSize

[ https://issues.apache.org/jira/browse/HDFS-10423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen reopened HDFS-10423: -- > Increase default value of httpfs maxHttpHeaderS

Re: Listing large directories via WebHDFS

Hi Zhe, Per my understanding, the runner in webhdfs goes to NamenodeWebHdfsMethods , w

[jira] [Created] (HDFS-11009) Add a tool to reconstruct block meta file from CLI

Xiao Chen created HDFS-11009: Summary: Add a tool to reconstruct block meta file from CLI Key: HDFS-11009 URL: https://issues.apache.org/jira/browse/HDFS-11009 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-10963) Reduce log level when network topology cannot find enough datanodes.

Xiao Chen created HDFS-10963: Summary: Reduce log level when network topology cannot find enough datanodes. Key: HDFS-10963 URL: https://issues.apache.org/jira/browse/HDFS-10963 Project: Hadoop HDFS

[jira] [Created] (HDFS-10918) Add a tool to get FileEncryptionInfo from CLI

Xiao Chen created HDFS-10918: Summary: Add a tool to get FileEncryptionInfo from CLI Key: HDFS-10918 URL: https://issues.apache.org/jira/browse/HDFS-10918 Project: Hadoop HDFS Issue Type: New

[jira] [Created] (HDFS-10899) Add functionality to re-encrypt EDEKs.

Xiao Chen created HDFS-10899: Summary: Add functionality to re-encrypt EDEKs. Key: HDFS-10899 URL: https://issues.apache.org/jira/browse/HDFS-10899 Project: Hadoop HDFS Issue Type: New Feature

[jira] [Created] (HDFS-10879) TestEncryptionZonesWithKMS#testReadWrite fails intermitently

Xiao Chen created HDFS-10879: Summary: TestEncryptionZonesWithKMS#testReadWrite fails intermitently Key: HDFS-10879 URL: https://issues.apache.org/jira/browse/HDFS-10879 Project: Hadoop HDFS

[jira] [Created] (HDFS-10875) Optimize du -x to cache intermediate result

Xiao Chen created HDFS-10875: Summary: Optimize du -x to cache intermediate result Key: HDFS-10875 URL: https://issues.apache.org/jira/browse/HDFS-10875 Project: Hadoop HDFS Issue Type

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

+1 (non-binding) Thanks Andrew for putting this up! Super excited to see a Hadoop 3 RC. Verifications done on OS X: - Verified md5 on all files - Spot checked release notes and changes - Built from source - Verified LICENSE and NOTICE are correctly contained in the jars built - Started pseudo-dis

[jira] [Resolved] (HDFS-10757) KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used

[ https://issues.apache.org/jira/browse/HDFS-10757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen resolved HDFS-10757. -- Resolution: Duplicate Agree with Arun. Closing this as a dup of HADOOP-13381. Feel free to reopen

  1   2   >