Re: [VOTE] Hadoop 3.2.x EOL

+1 On Tue, Dec 5, 2023 at 8:09 PM Xiaoqiao He wrote: > Dear Hadoop devs, > > Given the feedback from the discussion thread [1], I'd like to start > an official thread for the community to vote on release line 3.2 EOL. > > It will include, > a. An official announcement informs no further regular

Re: [ANNOUNCE] New Hadoop Committer - Simbarashe Dzinamarira

Congratulations! On Tue, Oct 3, 2023 at 8:55 AM Ayush Saxena wrote: > Congratulations!!! > > -Ayush > > > On 03-Oct-2023, at 5:42 AM, Erik Krogen wrote: > > > > Congratulations Simba! Thanks for the great work you've done on making > HDFS > > more scalable! > > > >> On Mon, Oct 2, 2023 at 4:31

Re: [DISCUSS] JIRA Public Signup Disabled

Thanks Ayush for taking care of this. I think option 1 sounds good. > On Nov 22, 2022, at 2:51 PM, Ayush Saxena wrote: > > Hi Folks, > Just driving the attention towards the recent change from Infra, which > disables new people from creating a Jira account, in order to prevent spams > around JIR

[jira] [Resolved] (HDFS-15938) Fix java doc in FSEditLog

[ https://issues.apache.org/jira/browse/HDFS-15938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HDFS-15938. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Fix java doc

[jira] [Resolved] (HDFS-15624) Fix the SetQuotaByStorageTypeOp problem after updating hadoop

[ https://issues.apache.org/jira/browse/HDFS-15624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HDFS-15624. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk

[ANNOUNCE] Mukund Thakur is a new Apache Hadoop Committer

is a great addition to the Hadoop project. His reviews are comprehensive with high standards to "approve a pull request". The granting of committership to him will enable better productivity. Please join me in congratulating him. Welcome aboard, Mukund! Mingliang Liu (on behalf of th

Re: [VOTE] Moving Ozone to a separated Apache project

+1 On Tue, Sep 29, 2020 at 3:44 PM Wangda Tan wrote: > +1, > > Thanks, > Wangda Tan > > On Tue, Sep 29, 2020 at 10:10 AM Aravindan Vijayan > wrote: > > > +1, thank you Marton. > > > > On Tue, Sep 29, 2020 at 9:17 AM Bharat Viswanadham > > wrote: > > > > > +1 > > > Thank You @Elek, Marton for

[jira] [Created] (HDFS-15595) stSnapshotCommands.testMaxSnapshotLimit fails in trunk

Mingliang Liu created HDFS-15595: Summary: stSnapshotCommands.testMaxSnapshotLimit fails in trunk Key: HDFS-15595 URL: https://issues.apache.org/jira/browse/HDFS-15595 Project: Hadoop HDFS

Re: [VOTE] Release Apache Hadoop 2.10.1 (RC0)

+1 (binding) 1. Download binary and check signature / checksum successfully 2. Create a 3 node cluster in Docker containers and start the HDFS/YARN services 3. Verify the running version 4. Run simple HDFS/YARN client/admin commands and verify the output 5. Run example programs wordcount and grep

Re: Unstable Unit Tests in Trunk

Thanks Eric. I also see some intermittent test failures in recent builds. Maybe we can mark those failing tests as @Flaky, and/or add the RetryRule() to them. Thoughts? On Tue, Sep 1, 2020 at 10:48 AM Eric Badger wrote: > While putting up patches for HADOOP-17169 >

Re: How to manually trigger a PreCommit build for a github PR?

can see an option 'replay' on the left, Clicking on it will rerun the > build. > > Secondly, If the last build isn't available, then I think creating an empty > commit is the only way as Dinesh also suggested. > > -Ayush > > On Wed, 9 Sep 2020 at 03:43, Minglia

Re: How to manually trigger a PreCommit build for a github PR?

. > > git commit --allow-empty -m 'trigger new CI check' && git push > > > Thanks, > Dinesh > > > > On Tue, Sep 8, 2020 at 5:39 PM Mingliang Liu wrote: > >> Hi, >> >> To trigger a PreCommit build without code change, I can make t

How to manually trigger a PreCommit build for a github PR?

Hi, To trigger a PreCommit build without code change, I can make the JIRA status "Patch Available" and provide the JIRA number to "Build With Parameters" link . Not sure how to do that for a PR without a real c

Re: [DISCUSS] Hadoop 2.10.1 release

I can see how I can help, but I can not take the RM role this time. Thanks, On Mon, Aug 31, 2020 at 12:15 PM Wei-Chiu Chuang wrote: > Hello, > > I see that Masatake graciously agreed to volunteer with the Hadoop 2.10.1 > release work in the 2.9 branch EOL discussion thread > https://s.apache.or

Re: [VOTE] End of Life Hadoop 2.9

+1 (binding) p.s. We should still maintain 2.10 for Hadoop 2 users and encourage them to upgrade to Hadoop 3. On Mon, Aug 31, 2020 at 12:10 PM Wei-Chiu Chuang wrote: > Dear fellow Hadoop developers, > > Given the overwhelming feedback from the discussion thread > https://s.apache.org/hadoop2.9e

[jira] [Resolved] (HDFS-15546) Remove duplicate initializeGenericKeys method when creating DFSZKFailoverController

[ https://issues.apache.org/jira/browse/HDFS-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HDFS-15546. -- Resolution: Not A Problem Thanks for good discussion [~jianghuazhu] and [~chaosun] Since this

[jira] [Reopened] (HDFS-15546) Remove duplicate initializeGenericKeys method when creating DFSZKFailoverController

[ https://issues.apache.org/jira/browse/HDFS-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reopened HDFS-15546: -- > Remove duplicate initializeGenericKeys method when creating > DFSZKFailoverCont

Re: [DISCUSS] fate of branch-2.9

> are there any Hadoop branch-2 releases planned, ever? If so I'll need to backport my s3a directory compatibility patch to whatever is still live. The branch-2 is gone. I think you mean branch-2.10, Steve. Many HBase users are still using Hadoop 2, so I hope Hadoop 2.10.x should still be release

Re: [DISCUSS] fate of branch-2.9

+1 for putting 2.9 lines to EOL. Let's focus on 2.10 releases for Hadoop 2. Also is there any plan for 2.10.1? It has been 11 months since 2.10 first release. Thanks, On Wed, Aug 26, 2020 at 10:57 PM Wei-Chiu Chuang wrote: > Bump up this thread after 6 months. > > Is anyone still interested in

[jira] [Created] (HDFS-15499) Exclude aws-java-sdk-bundle from httpfs

Mingliang Liu created HDFS-15499: Summary: Exclude aws-java-sdk-bundle from httpfs Key: HDFS-15499 URL: https://issues.apache.org/jira/browse/HDFS-15499 Project: Hadoop HDFS Issue Type: Bug

Re: [DISCUSS] making Ozone a separate Apache project

+1 On Mon, May 18, 2020 at 12:37 AM Elek, Marton wrote: > > > > One question, for the committers who contributed to Ozone before and got > > the committer-role in the past (like me), will they carry the > > committer-role to the new repo? > > > In short: yes. > > > In more details: > > This disc

[jira] [Created] (HDFS-15327) TestDataNodeErasureCodingMetrics.testReconstructionBytesPartialGroup3 fails intermittently

Mingliang Liu created HDFS-15327: Summary: TestDataNodeErasureCodingMetrics.testReconstructionBytesPartialGroup3 fails intermittently Key: HDFS-15327 URL: https://issues.apache.org/jira/browse/HDFS-15327

[jira] [Resolved] (HDFS-15324) TestRefreshCallQueue::testRefresh fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-15324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HDFS-15324. -- Resolution: Duplicate > TestRefreshCallQueue::testRefresh fails intermitten

[jira] [Created] (HDFS-15326) TestDataNodeErasureCodingMetrics::testFullBlock fails intermittently

Mingliang Liu created HDFS-15326: Summary: TestDataNodeErasureCodingMetrics::testFullBlock fails intermittently Key: HDFS-15326 URL: https://issues.apache.org/jira/browse/HDFS-15326 Project: Hadoop

[jira] [Created] (HDFS-15324) TestRefreshCallQueue::testRefresh fails intermittently

Mingliang Liu created HDFS-15324: Summary: TestRefreshCallQueue::testRefresh fails intermittently Key: HDFS-15324 URL: https://issues.apache.org/jira/browse/HDFS-15324 Project: Hadoop HDFS

Re: [Hadoop-3.3 Release update]- branch-3.3 has created

Brahma, What about https://issues.apache.org/jira/browse/HADOOP-17007? Thanks, On Fri, Apr 24, 2020 at 11:07 AM Brahma Reddy Battula wrote: > Ok. Done. Branch created. > > Following blockers are pending, will closely track this. > > https://issues.apache.org/jira/browse/HDFS-15287 ( Open: Unde

[jira] [Created] (HDFS-15297) TestNNHandlesBlockReportPerStorage::blockReport_02 fails intermittently in trunk

Mingliang Liu created HDFS-15297: Summary: TestNNHandlesBlockReportPerStorage::blockReport_02 fails intermittently in trunk Key: HDFS-15297 URL: https://issues.apache.org/jira/browse/HDFS-15297

[jira] [Created] (HDFS-15296) TestBPOfferService::testMissBlocksWhenReregister is flaky

Mingliang Liu created HDFS-15296: Summary: TestBPOfferService::testMissBlocksWhenReregister is flaky Key: HDFS-15296 URL: https://issues.apache.org/jira/browse/HDFS-15296 Project: Hadoop HDFS

[jira] [Created] (HDFS-14786) A new block placement policy tolerating availability zone failure

Mingliang Liu created HDFS-14786: Summary: A new block placement policy tolerating availability zone failure Key: HDFS-14786 URL: https://issues.apache.org/jira/browse/HDFS-14786 Project: Hadoop HDFS

Re: HADOOP-14163 proposal for new hadoop.apache.org

e best for documentation and hugo is best for > >>> generating site. > >>> > >>> > >>> I would like to finish this effort/jira: I would like to start a > >>> discussion about using this proposed version and approach as a new > >>> site of Apache Hadoop. Please let me know what you think. > >>> > >>> > >>> Thanks a lot, > >>> Marton > >>> > >>> - > >>> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > >>> For additional commands, e-mail: common-dev-h...@hadoop.apache.org > >>> > >> > >> > >> - > >> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > >> For additional commands, e-mail: common-dev-h...@hadoop.apache.org > >> > > > > - > > To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org > > For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org > > - > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: common-dev-h...@hadoop.apache.org > > -- Mingliang Liu

Re: [VOTE] Release Apache Hadoop 2.8.4 (RC0)

available via repository.apache.org< > http://repository.apache.org> at: > https://repository.apache.org/content/repositories/orgapachehadoop-1118 > > Please try the release and vote; the vote will run for the usual 5 > working days, ending on 5/14/2018 PST time. > > Thanks, > > Junping > -- Mingliang Liu

Re: [VOTE] Adopt HDSL as a new Hadoop subproject

run the standard 7 days and requires a lazy 2/3 vote. PMC > votes are binding, but everyone is encouraged to vote. > > +1 (binding) > > .. Owen > -- Mingliang Liu

Re: [DISCUSS] official docker image(s) for hadoop

> It would be very helpful for testing the RC. For testing and voting, I have been using docker containers for a while, see code at: https://github.com/weiqingy/caochong > TL;DR: I propose to create official hadoop images and upload them to the > dockerhub

Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)

Thanks Junping for doing this! +1 (non-binding) - Download the hadoop-2.8.2-src.tar.gz file and checked the md5 value - Build package using maven (skipping tests) with Java 8 - Spin up a test cluster in Docker containers having 1 master node (NN/RM) and 3 slave nodes (DN/NM) - Operate the basic

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Thanks Konstantin! +1 (non-binding) I have tried several steps including: - Download source package and check the checksums - Build from source using Java 8 - Deploy a test cluster using docker containers w/ 5 DNs and 1 NN - Run basic HDFS client/admin operations (e.g. read/write files, dfsadmin)

Re: Corona is here -- And Ozone works !!!!

Still, it’s good news! Best, > On Jul 20, 2017, at 2:44 PM, Anu Engineer wrote: > > Sorry, it was meant for a wrong alias. My apologies. > > —Anu > > > > > > On 7/20/17, 2:40 PM, "Anu Engineer" wrote: > >> Hi All, >> >> I just deployed a test cluster with Nandakumar and we were able to

[jira] [Created] (HDFS-12064) Reuse object mapper in HDFS

Mingliang Liu created HDFS-12064: Summary: Reuse object mapper in HDFS Key: HDFS-12064 URL: https://issues.apache.org/jira/browse/HDFS-12064 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-11903) Cleaning up local storage when closing MiniOzoneCluster

Mingliang Liu created HDFS-11903: Summary: Cleaning up local storage when closing MiniOzoneCluster Key: HDFS-11903 URL: https://issues.apache.org/jira/browse/HDFS-11903 Project: Hadoop HDFS

[jira] [Created] (HDFS-11892) Azure: handle failure gracefully in case of missing account key

Mingliang Liu created HDFS-11892: Summary: Azure: handle failure gracefully in case of missing account key Key: HDFS-11892 URL: https://issues.apache.org/jira/browse/HDFS-11892 Project: Hadoop HDFS

[jira] [Created] (HDFS-11704) OzoneFileSystem: A Hadoop file system implementation for Ozone

Mingliang Liu created HDFS-11704: Summary: OzoneFileSystem: A Hadoop file system implementation for Ozone Key: HDFS-11704 URL: https://issues.apache.org/jira/browse/HDFS-11704 Project: Hadoop HDFS

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

Thanks Junping for doing this. +1 (non-binding) 0. Download the src tar.gz file; checked the MD5 checksum 1. Build Hadoop from source successfully 2. Deploy a single node cluster and start the cluster successfully 3. Operate the HDFS from command line: ls, put, distcp, dfsadmin etc 4. Run hadoop

[jira] [Resolved] (HDFS-10891) Über-jira: Test Improvement by adding missing test cases for existing code

[ https://issues.apache.org/jira/browse/HDFS-10891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HDFS-10891. -- Resolution: Fixed > Über-jira: Test Improvement by adding missing test cases for existing c

[jira] [Reopened] (HDFS-11105) TestRBWBlockInvalidation#testRWRInvalidation fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-11105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reopened HDFS-11105: -- > TestRBWBlockInvalidation#testRWRInvalidation fails intermitten

[jira] [Resolved] (HDFS-11105) TestRBWBlockInvalidation#testRWRInvalidation fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-11105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HDFS-11105. -- Resolution: Fixed > TestRBWBlockInvalidation#testRWRInvalidation fails intermitten

[jira] [Resolved] (HDFS-10666) Über-jira: Unit tests should not use fixed sleep interval to wait for conditions

[ https://issues.apache.org/jira/browse/HDFS-10666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HDFS-10666. -- Resolution: Fixed Target Version/s: 2.8.0 (was: 3.0.0-alpha2) > Über-jira: U

[jira] [Resolved] (HDFS-11089) Accelerate TestDiskBalancerCommand using static shared MiniDFSCluster

[ https://issues.apache.org/jira/browse/HDFS-11089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HDFS-11089. -- Resolution: Not A Problem Thanks [~arpitagarwal] for your suggestion. Closing this JIRA as &quo

[jira] [Created] (HDFS-11095) BlockManagerSafeMode should respect extension period default config value (30s)

Mingliang Liu created HDFS-11095: Summary: BlockManagerSafeMode should respect extension period default config value (30s) Key: HDFS-11095 URL: https://issues.apache.org/jira/browse/HDFS-11095

[jira] [Created] (HDFS-11085) Add unit tests for NameNode failing to startup when name dir can not be written

Mingliang Liu created HDFS-11085: Summary: Add unit tests for NameNode failing to startup when name dir can not be written Key: HDFS-11085 URL: https://issues.apache.org/jira/browse/HDFS-11085

[jira] [Created] (HDFS-11083) Add unit test for DFSAdmin -report command

Mingliang Liu created HDFS-11083: Summary: Add unit test for DFSAdmin -report command Key: HDFS-11083 URL: https://issues.apache.org/jira/browse/HDFS-11083 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

Mingliang Liu created HDFS-11031: Summary: Add additional unit test for DataNode startup behavior when volumes fail Key: HDFS-11031 URL: https://issues.apache.org/jira/browse/HDFS-11031 Project

[jira] [Created] (HDFS-11030) TestDataNodeVolumeFailure#testVolumeFailure is flaky (though passing)

Mingliang Liu created HDFS-11030: Summary: TestDataNodeVolumeFailure#testVolumeFailure is flaky (though passing) Key: HDFS-11030 URL: https://issues.apache.org/jira/browse/HDFS-11030 Project: Hadoop

[jira] [Created] (HDFS-11008) Add unit test for parsing "-source" parameter in Balancer tool

Mingliang Liu created HDFS-11008: Summary: Add unit test for parsing "-source" parameter in Balancer tool Key: HDFS-11008 URL: https://issues.apache.org/jira/browse/HDFS-11008 Project: H

[jira] [Created] (HDFS-11007) AliyunOSSInputStream#read() should update read bytes stat correctly

Mingliang Liu created HDFS-11007: Summary: AliyunOSSInputStream#read() should update read bytes stat correctly Key: HDFS-11007 URL: https://issues.apache.org/jira/browse/HDFS-11007 Project: Hadoop

[jira] [Created] (HDFS-11002) Fix broken attr(5) link in ExtendedAttributes.md

Mingliang Liu created HDFS-11002: Summary: Fix broken attr(5) link in ExtendedAttributes.md Key: HDFS-11002 URL: https://issues.apache.org/jira/browse/HDFS-11002 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-10986) DFSAdmin should show detailed error message if any

Mingliang Liu created HDFS-10986: Summary: DFSAdmin should show detailed error message if any Key: HDFS-10986 URL: https://issues.apache.org/jira/browse/HDFS-10986 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-10985) o.a.h.ha.TestZKFailoverController#testGracefulFailoverMultipleZKfcs fails intermittently

Mingliang Liu created HDFS-10985: Summary: o.a.h.ha.TestZKFailoverController#testGracefulFailoverMultipleZKfcs fails intermittently Key: HDFS-10985 URL: https://issues.apache.org/jira/browse/HDFS-10985

[jira] [Created] (HDFS-10893) Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test

Mingliang Liu created HDFS-10893: Summary: Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test Key: HDFS-10893 URL: https://issues.apache.org/jira/browse/HDFS-10893 Project

[jira] [Created] (HDFS-10892) Add unit tests for HDFS command 'dfs -tail'

Mingliang Liu created HDFS-10892: Summary: Add unit tests for HDFS command 'dfs -tail' Key: HDFS-10892 URL: https://issues.apache.org/jira/browse/HDFS-10892 Project: Hadoop HDFS

[jira] [Created] (HDFS-10891) Über-jira: Test Improvement by adding missing test cases for existing code

Mingliang Liu created HDFS-10891: Summary: Über-jira: Test Improvement by adding missing test cases for existing code Key: HDFS-10891 URL: https://issues.apache.org/jira/browse/HDFS-10891 Project

[jira] [Created] (HDFS-10807) Doc about upgrading to a version of HDFS with snapshots may be confusing

Mingliang Liu created HDFS-10807: Summary: Doc about upgrading to a version of HDFS with snapshots may be confusing Key: HDFS-10807 URL: https://issues.apache.org/jira/browse/HDFS-10807 Project

[jira] [Resolved] (HDFS-10677) Über-jira: Enhancements to NNThroughputBenchmark tool

[ https://issues.apache.org/jira/browse/HDFS-10677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HDFS-10677. -- Resolution: Fixed Fix Version/s: 2.8.0 > Über-jira: Enhancements

[jira] [Created] (HDFS-10747) o.a.h.hdfs.tools.DebugAdmin usage message is misleading

Mingliang Liu created HDFS-10747: Summary: o.a.h.hdfs.tools.DebugAdmin usage message is misleading Key: HDFS-10747 URL: https://issues.apache.org/jira/browse/HDFS-10747 Project: Hadoop HDFS

[jira] [Created] (HDFS-10726) org.apache.hadoop.http.TestHttpServerLifecycle times out

Mingliang Liu created HDFS-10726: Summary: org.apache.hadoop.http.TestHttpServerLifecycle times out Key: HDFS-10726 URL: https://issues.apache.org/jira/browse/HDFS-10726 Project: Hadoop HDFS

[jira] [Created] (HDFS-10725) Caller context should always be constructed by a builder

Mingliang Liu created HDFS-10725: Summary: Caller context should always be constructed by a builder Key: HDFS-10725 URL: https://issues.apache.org/jira/browse/HDFS-10725 Project: Hadoop HDFS

[jira] [Created] (HDFS-10724) Document the caller context config keys

Mingliang Liu created HDFS-10724: Summary: Document the caller context config keys Key: HDFS-10724 URL: https://issues.apache.org/jira/browse/HDFS-10724 Project: Hadoop HDFS Issue Type: Sub

Re: [VOTE] Release Apache Hadoop 2.7.3 RC0

Thanks Vinod. +1 (non-binding) * Downloaded and built from source (with Java 8) * Checked LICENSE and NOTICE files * Verified MD5 signatures * Installed pseudo-distributed instance (Mac OS X 10.11) * Ran through HDFS and mapreduce tests * Operate HDFS from command line * Run tools like distcp/NNT

[jira] [Created] (HDFS-10678) Documenting NNThroughputBenchmark tool

Mingliang Liu created HDFS-10678: Summary: Documenting NNThroughputBenchmark tool Key: HDFS-10678 URL: https://issues.apache.org/jira/browse/HDFS-10678 Project: Hadoop HDFS Issue Type: Sub

[jira] [Created] (HDFS-10677) Enhancements to NNThroughputBenchmark

Mingliang Liu created HDFS-10677: Summary: Enhancements to NNThroughputBenchmark Key: HDFS-10677 URL: https://issues.apache.org/jira/browse/HDFS-10677 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-10668) Fix intermittently failing UT TestDataNodeMXBean#testDataNodeMXBeanBlockCount

Mingliang Liu created HDFS-10668: Summary: Fix intermittently failing UT TestDataNodeMXBean#testDataNodeMXBeanBlockCount Key: HDFS-10668 URL: https://issues.apache.org/jira/browse/HDFS-10668 Project

[jira] [Created] (HDFS-10666) Über-jira: Unit tests should not depend on nondeterministic behavior using fixed sleep interval

Mingliang Liu created HDFS-10666: Summary: Über-jira: Unit tests should not depend on nondeterministic behavior using fixed sleep interval Key: HDFS-10666 URL: https://issues.apache.org/jira/browse/HDFS-10666

[jira] [Created] (HDFS-10644) Fix intermittently failing TestDFSUpgradeWithHA#testRollbackWithJournalNodes

Mingliang Liu created HDFS-10644: Summary: Fix intermittently failing TestDFSUpgradeWithHA#testRollbackWithJournalNodes Key: HDFS-10644 URL: https://issues.apache.org/jira/browse/HDFS-10644 Project

[jira] [Created] (HDFS-10642) Fix intermittently failing UT TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas

Mingliang Liu created HDFS-10642: Summary: Fix intermittently failing UT TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas Key: HDFS-10642 URL: https://issues.apache.org/jira/browse/HDFS-10642

[jira] [Created] (HDFS-10641) Fix intermittently failing TestBlockManager#testBlockReportQueueing

Mingliang Liu created HDFS-10641: Summary: Fix intermittently failing TestBlockManager#testBlockReportQueueing Key: HDFS-10641 URL: https://issues.apache.org/jira/browse/HDFS-10641 Project: Hadoop

[jira] [Reopened] (HDFS-9277) IOException "Unable to load OAuth2 connection factory." in TestWebHDFSOAuth2.listStatusReturnsAsExpected

[ https://issues.apache.org/jira/browse/HDFS-9277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reopened HDFS-9277: - Thanks [~jojochuang] for reporting this. In our internal nightly test, this UT still fails

[jira] [Created] (HDFS-10622) o.a.h.security.TestGroupsCaching.testBackgroundRefreshCounters seems flaky

Mingliang Liu created HDFS-10622: Summary: o.a.h.security.TestGroupsCaching.testBackgroundRefreshCounters seems flaky Key: HDFS-10622 URL: https://issues.apache.org/jira/browse/HDFS-10622 Project

[jira] [Created] (HDFS-10556) DistCpOptions should be validated automatically

Mingliang Liu created HDFS-10556: Summary: DistCpOptions should be validated automatically Key: HDFS-10556 URL: https://issues.apache.org/jira/browse/HDFS-10556 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-10533) Make DistCpOptions class immutable

Mingliang Liu created HDFS-10533: Summary: Make DistCpOptions class immutable Key: HDFS-10533 URL: https://issues.apache.org/jira/browse/HDFS-10533 Project: Hadoop HDFS Issue Type

Re: cp and mv

Kun, I think you need to be ware of the difference between client and server side logic. Perhaps you’re more interested in the client side in this case. The commands are generally running in the shell, and org.apache.hadoop.fs.shell package is a good place to start. Specially, have a look at C

[jira] [Created] (HDFS-10397) Distcp should ignore -delete option if -diff option is provided instead of exiting

Mingliang Liu created HDFS-10397: Summary: Distcp should ignore -delete option if -diff option is provided instead of exiting Key: HDFS-10397 URL: https://issues.apache.org/jira/browse/HDFS-10397

[jira] [Created] (HDFS-10395) GlobalStorageStatistics should check null FileSystem scheme to avoid NPE

Mingliang Liu created HDFS-10395: Summary: GlobalStorageStatistics should check null FileSystem scheme to avoid NPE Key: HDFS-10395 URL: https://issues.apache.org/jira/browse/HDFS-10395 Project

[jira] [Resolved] (HDFS-10386) DataTransferProtocol#writeBlock missing some javadocs

[ https://issues.apache.org/jira/browse/HDFS-10386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HDFS-10386. -- Resolution: Duplicate This is a duplicate of [HDFS-10387]. Re-open if I'm wrong. T

[jira] [Created] (HDFS-10383) Safely close resources in DFSTestUtil

Mingliang Liu created HDFS-10383: Summary: Safely close resources in DFSTestUtil Key: HDFS-10383 URL: https://issues.apache.org/jira/browse/HDFS-10383 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-10335) Mover$Processor#chooseTarget() always chooses the first matching target datanode

Mingliang Liu created HDFS-10335: Summary: Mover$Processor#chooseTarget() always chooses the first matching target datanode Key: HDFS-10335 URL: https://issues.apache.org/jira/browse/HDFS-10335

[jira] [Created] (HDFS-10306) SafeModeMonitor should not leave safe mode if name system is starting active service

Mingliang Liu created HDFS-10306: Summary: SafeModeMonitor should not leave safe mode if name system is starting active service Key: HDFS-10306 URL: https://issues.apache.org/jira/browse/HDFS-10306

[jira] [Created] (HDFS-10293) StripedFileTestUtil#readAll flaky

Mingliang Liu created HDFS-10293: Summary: StripedFileTestUtil#readAll flaky Key: HDFS-10293 URL: https://issues.apache.org/jira/browse/HDFS-10293 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-10284) o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittently

Mingliang Liu created HDFS-10284: Summary: o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittently Key: HDFS-10284 URL: https://issues.apache.org/jira/browse/HDFS-10284

[jira] [Created] (HDFS-10283) o.a.h.hdfs.server.namenode.TestFSImageWithSnapshot#testSaveLoadImageWithAppending fails intermittently

Mingliang Liu created HDFS-10283: Summary: o.a.h.hdfs.server.namenode.TestFSImageWithSnapshot#testSaveLoadImageWithAppending fails intermittently Key: HDFS-10283 URL: https://issues.apache.org/jira/browse/HDFS

[jira] [Created] (HDFS-10281) o.a.h.hdfs.server.namenode.ha.TestPendingCorruptDnMessages fails intermittently

Mingliang Liu created HDFS-10281: Summary: o.a.h.hdfs.server.namenode.ha.TestPendingCorruptDnMessages fails intermittently Key: HDFS-10281 URL: https://issues.apache.org/jira/browse/HDFS-10281

[jira] [Created] (HDFS-10201) Implement undo log in parity datanode for hflush operations

Mingliang Liu created HDFS-10201: Summary: Implement undo log in parity datanode for hflush operations Key: HDFS-10201 URL: https://issues.apache.org/jira/browse/HDFS-10201 Project: Hadoop HDFS

[jira] [Created] (HDFS-9867) Missing block exception should carry locatedBlocks information

Mingliang Liu created HDFS-9867: --- Summary: Missing block exception should carry locatedBlocks information Key: HDFS-9867 URL: https://issues.apache.org/jira/browse/HDFS-9867 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-9846) Make DelegationTokenFetcher a Tool

[ https://issues.apache.org/jira/browse/HDFS-9846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HDFS-9846. - Resolution: Won't Fix > Make DelegationTokenFetche

[jira] [Created] (HDFS-9846) Make DelegationTokenFetcher a Tool

Mingliang Liu created HDFS-9846: --- Summary: Make DelegationTokenFetcher a Tool Key: HDFS-9846 URL: https://issues.apache.org/jira/browse/HDFS-9846 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-9767) TestFileAppend# fails intermittently

Mingliang Liu created HDFS-9767: --- Summary: TestFileAppend# fails intermittently Key: HDFS-9767 URL: https://issues.apache.org/jira/browse/HDFS-9767 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-9766) TestDataNodeMetrics#testDataNodeTimeSpend fails intermittently

Mingliang Liu created HDFS-9766: --- Summary: TestDataNodeMetrics#testDataNodeTimeSpend fails intermittently Key: HDFS-9766 URL: https://issues.apache.org/jira/browse/HDFS-9766 Project: Hadoop HDFS

[jira] [Created] (HDFS-9765) TestBlockScanner#testVolumeIteratorWithCaching fails intermittently

Mingliang Liu created HDFS-9765: --- Summary: TestBlockScanner#testVolumeIteratorWithCaching fails intermittently Key: HDFS-9765 URL: https://issues.apache.org/jira/browse/HDFS-9765 Project: Hadoop HDFS

[jira] [Created] (HDFS-9716) o.a.h.hdfs.TestRecoverStripedFile fails intermittently in trunk

Mingliang Liu created HDFS-9716: --- Summary: o.a.h.hdfs.TestRecoverStripedFile fails intermittently in trunk Key: HDFS-9716 URL: https://issues.apache.org/jira/browse/HDFS-9716 Project: Hadoop HDFS

[jira] [Created] (HDFS-9691) o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittently

Mingliang Liu created HDFS-9691: --- Summary: o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittently Key: HDFS-9691 URL: https://issues.apache.org/jira/browse/HDFS-9691

[jira] [Created] (HDFS-9689) Test o.a.h.hdfs.TestRenameWhileOpen fails intermittently

Mingliang Liu created HDFS-9689: --- Summary: Test o.a.h.hdfs.TestRenameWhileOpen fails intermittently Key: HDFS-9689 URL: https://issues.apache.org/jira/browse/HDFS-9689 Project: Hadoop HDFS

[jira] [Created] (HDFS-9672) o.a.h.hdfs.TestLeaseRecovery2 fails intermittently

Mingliang Liu created HDFS-9672: --- Summary: o.a.h.hdfs.TestLeaseRecovery2 fails intermittently Key: HDFS-9672 URL: https://issues.apache.org/jira/browse/HDFS-9672 Project: Hadoop HDFS Issue

Re: [VOTE] Release Apache Hadoop 2.7.2 RC1

+1 (non-binding) 1. Download the src tar file and validate the integrity 2. Build and configure the local cluster 3. Operate the HDFS from command line interface 4. Run several example MR jobs 5. Check logs Thanks. L > On Dec 16, 2015, at 6:49 PM, Vinod Kumar Vavilapalli > wrote: > > Hi all,

  1   2   >