[jira] [Created] (HDFS-13128) HDFS balancer in single node cluster fails with "Another Balancer is running.."

Zbigniew Kostrzewa created HDFS-13128: - Summary: HDFS balancer in single node cluster fails with "Another Balancer is running.." Key: HDFS-13128 URL: https://issues.apache.org/jira/browse/HDFS-13128

[jira] [Created] (HDFS-13127) Fix TestContainerStateManager and TestOzoneConfigurationFields

Mukul Kumar Singh created HDFS-13127: Summary: Fix TestContainerStateManager and TestOzoneConfigurationFields Key: HDFS-13127 URL: https://issues.apache.org/jira/browse/HDFS-13127 Project: Hadoop

回复：[DISCUSS] Meetup for HDFS tests and build infra

Thanks Chris for driving on this. >>I'm looking at you, TestDFSStripedOutputStreamWithFailure ...AFAIK and IMO, >>it's pretty hard to get all the test cases stably running given the >>limitation of MiniDFSCluster, and if we'd agree on that, we could remove >>these cases as unit tests and cover t

[jira] [Resolved] (HDFS-13122) Tailing edits should not update quota counts on ObserverNode

[ https://issues.apache.org/jira/browse/HDFS-13122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-13122. Resolution: Duplicate > Tailing edits should not update quota counts on ObserverNode > -

[jira] [Reopened] (HDFS-13120) Snapshot diff could be corrupted after concat

[ https://issues.apache.org/jira/browse/HDFS-13120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee reopened HDFS-13120: --- This breaks 2.8 compilation. Reverting... > Snapshot diff could be corrupted after concat > -

Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/130/ [Feb 7, 2018 4:58:28 PM] (billie) Revert "YARN-6078. Containers stuck in Localizing state. Contributed by [Feb 7, 2018 11:35:41 PM] (yzhang) HDFS-13115. In getNumUnderConstructionBlocks(), ignore the ino

[jira] [Created] (HDFS-13126) Re-enable HTTP Request Logging for WebHDFS

Erik Krogen created HDFS-13126: -- Summary: Re-enable HTTP Request Logging for WebHDFS Key: HDFS-13126 URL: https://issues.apache.org/jira/browse/HDFS-13126 Project: Hadoop HDFS Issue Type: Improv

Re: Apache Hadoop 3.0.1 Release plan

Hi, Brahma Thanks for reminder. YARN-5742 does not look like a blocker to me. I will create a RC right after HADOOP-14060. On Thu, Feb 8, 2018 at 7:35 AM, Kihwal Lee wrote: > HADOOP-14060 is a blocker. Daryn will add more detail to the jira or to > this thread. > > On Thu, Feb 8, 2018 at 7:01 A

[jira] [Created] (HDFS-13125) Improve efficiency of JN -> Standby Pipeline Under Frequent Edit Tailing

Erik Krogen created HDFS-13125: -- Summary: Improve efficiency of JN -> Standby Pipeline Under Frequent Edit Tailing Key: HDFS-13125 URL: https://issues.apache.org/jira/browse/HDFS-13125 Project: Hadoop HD

[CFP] Dataworks Summit San Jose Call for Presentations closes Friday 9 Feb

All, Dataworks Summit San Jose 2018 is June 17-21. The call for abstracts is open through February 9th. One of the tracks is Big Compute And Storage, which is great for talks about Hadoop. You can submit an abstract at https://dataworkssummit.com/san-jose-2018/ Thanks, Owen

Announcing Dynamometer Open Sourcing for HDFS Scale Testing

Hey folks, We at LinkedIn have been working for a while on a scale testing and performance evaluation tool for HDFS and particularly the NameNode, which we call Dynamometer. It is now open source: you can view it on our GitHub page [1], and read about our motivations and design in our blog post

Re: Apache Hadoop 3.0.1 Release plan

HADOOP-14060 is a blocker. Daryn will add more detail to the jira or to this thread. On Thu, Feb 8, 2018 at 7:01 AM, Brahma Reddy Battula wrote: > Hi Eddy, > > HDFS-12990 got committed to 3.0.1,can we have RC for 3.0.1 (only YARN-5742 > blocker is open ) ? > > > On Sat, Feb 3, 2018 at 12:40 A

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/685/ [Feb 7, 2018 6:54:53 AM] (xiao) HDFS-12933. Improve logging when DFSStripedOutputStream failed to write [Feb 7, 2018 3:09:45 PM] (billie) YARN-7516. Add security check for trusted docker images. Contribute

Re: Apache Hadoop 3.0.1 Release plan

Hi Eddy, HDFS-12990 got committed to 3.0.1,can we have RC for 3.0.1 (only YARN-5742 blocker is open ) ? On Sat, Feb 3, 2018 at 12:40 AM, Chris Douglas wrote: > On Fri, Feb 2, 2018 at 10:22 AM, Arpit Agarwal > wrote: > > Do you plan to roll an RC with an uncommitted fix? That isn't the right

[jira] [Created] (HDFS-13124) hadoop-daemon.sh exits with 1 when running HDFS balancer on balanced cluster

Zbigniew Kostrzewa created HDFS-13124: - Summary: hadoop-daemon.sh exits with 1 when running HDFS balancer on balanced cluster Key: HDFS-13124 URL: https://issues.apache.org/jira/browse/HDFS-13124

[jira] [Resolved] (HDFS-11360) HDFS balancer need a config to appoint to a decided nameservice

[ https://issues.apache.org/jira/browse/HDFS-11360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lantao Jin resolved HDFS-11360. --- Resolution: Duplicate Assignee: Lantao Jin > HDFS balancer need a config to appoint to a decided

Why always allocate shm slot when local read even if no zero copy needed?

Hello, It seems that we always allocate shm slot when local read, even if we only do the SC read without zero copy. Can we save this if no zero copy needed? According to my understanding, the shm slot is not used if we don't do the zero copy when local read, is that right? public ShortCircuitRep