[jira] [Resolved] (HDFS-15654) TestBPOfferService#testMissBlocksWhenReregister fails intermittently

2020-10-28 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri resolved HDFS-15654. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > TestBPOfferService#test

Re: This week's Hadoop Storage online meetup : IOStatistics API

2020-10-28 Thread Wei-Chiu Chuang
Thanks Steve for today's discussion. For those who were able to join, here's the recording: https://cloudera.zoom.us/rec/share/TBbCfsg44BEgyBpFwZCe_uDX_uh-qPh8Wa2oP4IVR6lu7KGSviZfdR-YVdFbEoNN.JX2mPnDm913SDCt_ Passcode: u^a0&Aw^ On Wed, Oct 28, 2020 at 9:50 AM Wei-Chiu Chuang wrote: > Hi gent

Apache Hadoop qbt Report: trunk+JDK11 on Linux/x86_64

2020-10-28 Thread Apache Jenkins Server
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java11-linux-x86_64/41/ [Oct 27, 2020 7:56:30 AM] (noreply) HDFS-15461. TestDFSClientRetries testGetFileChecksum fails (#2404) [Oct 27, 2020 10:18:08 AM] (noreply) HDFS-15580. [JDK 12] DFSTestUtil#addDataNodeLayoutVersion f

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64

2020-10-28 Thread Apache Jenkins Server
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/308/ [Oct 27, 2020 2:41:10 AM] (Yiqun Lin) HDFS-15640. Add diff threshold to FedBalance. Contributed by Jinglun. [Oct 27, 2020 7:56:30 AM] (noreply) HDFS-15461. TestDFSClientRetries testGetFileChecksum fa

Re: This week's Hadoop Storage online meetup : IOStatistics API

2020-10-28 Thread Wei-Chiu Chuang
Hi gentle reminder: this is happening in 10 minutes. See you later! On Tue, Oct 27, 2020 at 11:20 AM Wei-Chiu Chuang wrote: > Hi! > > Here's the reminder for this week's call tomorrow. Steve will discuss the > new IOStatistics API (HADOOP-16830). Useful for developing Hadoop > applications. > >

Re: For review: HADOOP-17313. FileSystem.get to support slow-to-instantiate FS clients

2020-10-28 Thread Wei-Chiu Chuang
I just reconfirmed with Steven. It's going to happen at 10am pacific time (10 minutes later) On Wed, Oct 28, 2020 at 9:10 AM Clay Baenziger (BLOOMBERG/ 919 3RD A) < cbaenzi...@bloomberg.net> wrote: > Oh I think I see the issue. Steve, you mean 11am PDT today (or 11am in the > Pacific Timezone)? O

Re:For review: HADOOP-17313. FileSystem.get to support slow-to-instantiate FS clients

2020-10-28 Thread Clay Baenziger (BLOOMBERG/ 919 3RD A)
Oh I think I see the issue. Steve, you mean 11am PDT today (or 11am in the Pacific Timezone)? Our current US daylight savings time is daylight time; standard time resuming on Nov. 3rd at 2am. -Clay From: At: 10/28/20 12:03:02To: hdfs-dev@hadoop.apache.org Subject: Re:For review: HADOOP-17313.

Re:For review: HADOOP-17313. FileSystem.get to support slow-to-instantiate FS clients

2020-10-28 Thread Clay Baenziger (BLOOMBERG/ 919 3RD A)
Any way someone can update https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+Storage+Online+Meetup to match the 11am PST time? I had put this in my calendar for 10am PST as per the webpage and sadly will have to miss it unless I can shuffle things around now. Best, Clay From: ste...@c

Apache Hadoop qbt Report: branch-2.10+JDK7 on Linux/x86_64

2020-10-28 Thread Apache Jenkins Server
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/99/ No changes -1 overall The following subsystems voted -1: asflicense hadolint jshint pathlen unit xml The following subsystems voted -1 but were configured to be filtered/ignored: c

For review: HADOOP-17313. FileSystem.get to support slow-to-instantiate FS clients

2020-10-28 Thread Steve Loughran
Broad review of this would be good as FileSystem.get() and Path.getFileSystem are so common https://github.com/apache/hadoop/pull/2396 -Steve PS: I'm talking about the IOStatistics API at 11:00 PST today (Oct 28) https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+Storage+Online+Meetup

Re: Wire compatibility between Hadoop 3.x client and 2.x server

2020-10-28 Thread Vinayakumar B
Thanks Jianliang, I saw jira assigned to you. Are you planning to provide a fix as well for this? If not, would you mind assigning to me? -Vinay On Wed, 28 Oct 2020 at 3:46 PM, Wu,Jianliang(vip.com) < jianliang...@vipshop.com> wrote: > Hi VinayaKumar and Wei-Chiu > > I filed jira https://iss

Re: Wire compatibility between Hadoop 3.x client and 2.x server

2020-10-28 Thread Wu,Jianliang(vip.com)
Hi VinayaKumar and Wei-Chiu I filed jira https://issues.apache.org/jira/browse/HDFS-15660 for details 2020年10月28日 17:08，Vinayakumar B mailto:vinayakum...@apache.org>> 写道： Hi Wu,Jianliang, Have you created the Jira for the issue you mentioned due to getContentSummary? I might have a fix for th

[jira] [Resolved] (HDFS-15657) RBF: TestRouter#testNamenodeHeartBeatEnableDefault fails by BindException

2020-10-28 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-15657. - Fix Version/s: 3.4.0 3.3.1 Resolution: Fixed Merged to trunk an

[jira] [Created] (HDFS-15660) StorageTypeProto is not compatiable between 3.x and 2.6

2020-10-28 Thread Ryan Wu (Jira)
Ryan Wu created HDFS-15660: -- Summary: StorageTypeProto is not compatiable between 3.x and 2.6 Key: HDFS-15660 URL: https://issues.apache.org/jira/browse/HDFS-15660 Project: Hadoop HDFS Issue Type: I

Re: Wire compatibility between Hadoop 3.x client and 2.x server

2020-10-28 Thread Vinayakumar B
Hi Wu,Jianliang, Have you created the Jira for the issue you mentioned due to getContentSummary? I might have a fix for this. Of-course it needs to be applied both client and server side. Let me know. -Vinay On Wed, Oct 14, 2020 at 12:26 PM Wu,Jianliang(vip.com) < jianliang...@vipshop.com> wro

[jira] [Created] (HDFS-15659) Set dfs.namenode.redundancy.considerLoad to false in MiniDFSCluster

2020-10-28 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HDFS-15659: Summary: Set dfs.namenode.redundancy.considerLoad to false in MiniDFSCluster Key: HDFS-15659 URL: https://issues.apache.org/jira/browse/HDFS-15659 Project: Hadoop HDF