[ANNOUNCE] Apache Hadoop 3.1.4 release

2020-08-29 Thread Gabor Bota
://hadoop.apache.org/docs/r3.1.4/hadoop-project-dist/hadoop-common/release/3.1.4/RELEASENOTES.3.1.4.html [4] https://hadoop.apache.org/releases.html Regards, Gabor Bota

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)

2020-08-08 Thread Gabor Bota
, 2020 at 11:08 AM Gabor Bota wrote: > > Hi All, > > With 6 binding and 1 non-binding +1s and no -1s the vote for Apache > hadoop-3.1.4 Release passes. > > Thank you everybody for contributing to the release, testing, and voting. > > Binding +1s: > - Masatake Iwasak

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)

2020-08-03 Thread Gabor Bota
ted teragen with automatic tests [1] > * checked "hadoop version" and compared with git revision > * checked if the staging repository contains src packages > > > Thanks the work (and the toughness) Gabor Bota. > > Marton > > > [1]: https://github.com/ele

[VOTE] Release Apache Hadoop 3.1.4 (RC4)

2020-07-21 Thread Gabor Bota
Hi folks, I have put together a release candidate (RC4) for Hadoop 3.1.4. * The RC includes in addition to the previous ones: * fix for HDFS-15313. Ensure inodes in active filesystem are not deleted during snapshot delete * fix for YARN-10347. Fix double locking in CapacityScheduler#reinitial

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC3)

2020-07-21 Thread Gabor Bota
Thank you all for the suggestions and testing. As there's a data loss issue in the release, I've created a new RC with the patch included. I'll send the update soon. Regards, Gabor Bota On Thu, Jul 16, 2020 at 1:29 PM Stephen O'Donnell wrote: > > Hi Gabor, > > We

[VOTE] Release Apache Hadoop 3.1.4 (RC3)

2020-07-13 Thread Gabor Bota
Hi folks, I have put together a release candidate (RC3) for Hadoop 3.1.4. * The RC includes in addition to the previous ones: * fix of YARN-10347. Fix double locking in CapacityScheduler#reinitialize in branch-3.1 (https://issues.apache.org/jira/browse/YARN-10347) * the revert of HDFS-14941,

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC2)

2020-07-10 Thread Gabor Bota
Yes, sure. I'll do another RC for next week. Thank you all for working on this! On Thu, Jul 9, 2020 at 8:20 AM Masatake Iwasaki wrote: > > Hi Gabor Bota, > > I committed the fix of YARN-10347 to branch-3.1. > I think this should be blocker for 3.1.4. > Could you cherry-

[VOTE] Release Apache Hadoop 3.1.4 (RC2)

2020-06-26 Thread Gabor Bota
Hi folks, I have put together a release candidate (RC2) for Hadoop 3.1.4. The RC is available at: http://people.apache.org/~gabota/hadoop-3.1.4-RC2/ The RC tag in git is here: https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC2 The maven artifacts are staged at https://repository.apac

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC1)

2020-06-24 Thread Gabor Bota
lease include : HDFS-15323 as well if possible. > > https://issues.apache.org/jira/browse/HDFS-15323 > > Remember tagging you there but at that time RC0 was up, try if that could > make into the release as well. > > Thanx!!! > -Ayush > > On Wed, 24 Jun 2020 at 16:16, Ga

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC1)

2020-06-24 Thread Gabor Bota
Thank you for your work! > > > > Kihwal reported IBR leak in standby NameNode: > > https://issues.apache.org/jira/browse/HDFS-15421. > > I think this is a blocker and this affects 3.1.4-RC1. Would you check this? > > > > Best regards, > > Akira > > >

[VOTE] Release Apache Hadoop 3.1.4 (RC1)

2020-06-22 Thread Gabor Bota
Hi folks, I have put together a release candidate (RC1) for Hadoop 3.1.4. The RC is available at: http://people.apache.org/~gabota/hadoop-3.1.4-RC1/ The RC tag in git is here: https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC1 The maven artifacts are staged at https://repository.apac

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC0)

2020-05-19 Thread Gabor Bota
uth-keys only. And abfs tests work fine in the current > trunk branch with my same azure-auth-keys.xml file. > Fyi: I am running mvn -T 1C -Dparallel-tests=abfs clean verify > *One thing I noticed here is , in this branch there are no ABFS related > classes.* > > @Gabor Bota

[VOTE] Release Apache Hadoop 3.1.4 (RC0)

2020-05-04 Thread Gabor Bota
Hi folks, I have put together a release candidate (RC0) for Hadoop 3.1.4. The RC is available at: http://people.apache.org/~gabota/hadoop-3.1.4-RC0/ The RC tag in git is here: https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC0 The maven artifacts are staged at https://repository.apac

Hadoop 3.1.4 Release Code Freeze

2020-04-22 Thread Gabor Bota
Hi All, The code freeze for Hadoop 3.1.4 release is planned for today. There some issues still open for that version. These are the open issues with 3.1.4 target/fix version: * https://issues.apache.org/jira/browse/YARN-8234 * https://issues.apache.org/jira/browse/HDFS-15205 * https://issues.apac

Hadoop 3.1.4 Release Plan Proposal

2020-01-20 Thread Gabor Bota
ne for the release is the following: * Feature Freeze Date: Wednesday, 11 March 2020 * Code Freeze Date: Wednesday, 22 April 2020 * Release Date: Wednesday, 29 April 2020 Please let me know if you have any suggestions. Regards, Gabor Bota References: [1] project in (HADOOP, MAPREDUCE, HDFS,

Re: [DISCUSS] Hadoop 2019 Release Planning

2020-01-08 Thread Gabor Bota
t on 3.2.x, Gabor if you > > have > > > bandwidth to help releases, I think we can do 3.2.2 first then 3.1.4. > > > > > > Thoughts? > > > - Wangda > > > > > > On Mon, Jan 6, 2020 at 5:50 AM Brahma Reddy Battula > > > > wrote: >

Re: [DISCUSS] Hadoop 2019 Release Planning

2020-01-06 Thread Gabor Bota
I'm interested in doing a release of hadoop. The version we need an RM is 3.1.3 right? What's the target date for that? Thanks, Gabor On Mon, Jan 6, 2020 at 8:31 AM Akira Ajisaka wrote: > Thank you Wangda. > > Now it's 2020. Let's release Hadoop 3.3.0. > I created a wiki page for tracking block

[jira] [Created] (HDFS-14874) Fix TestHDFSCLI and TestDFSShell test break because of logging change in mkdir

2019-09-25 Thread Gabor Bota (Jira)
Gabor Bota created HDFS-14874: - Summary: Fix TestHDFSCLI and TestDFSShell test break because of logging change in mkdir Key: HDFS-14874 URL: https://issues.apache.org/jira/browse/HDFS-14874 Project

Re: [DISCUSS] Prefer Github PR Integration over patch in JIRA

2019-07-23 Thread Gabor Bota
Although we will use github with PRs, I'd still prefer adding a +1 as a jira comment stating which PR was the last and approved one among the many. On Tue, Jul 23, 2019 at 11:22 AM Steve Loughran wrote: > On Mon, Jul 22, 2019 at 7:29 PM Eric Badger > wrote: > > > Where would JIRA fit into the P

Re: [VOTE] Force "squash and merge" option for PR merge on github UI

2019-07-17 Thread Gabor Bota
+1 Good idea. On Wed, Jul 17, 2019 at 9:37 AM Ayush Saxena wrote: > Thanks Marton, Makes Sense +1 > > > On 17-Jul-2019, at 11:37 AM, Elek, Marton wrote: > > > > Hi, > > > > Github UI (ui!) helps to merge Pull Requests to the proposed branch. > > There are three different ways to do it [1]: > >

Update guava to 27.0-jre in hadoop-project

2019-04-01 Thread Gabor Bota
Hi devs, I'm working on the guava version from 11.0.2 to 27.0-jre in hadoop-project. We need to do the upgrade because of CVE-2018-10237 . I've created an issue (HADOOP-15960 ) to track progress a

Re: [VOTE] Release Apache Hadoop 3.1.2 - RC1

2019-02-05 Thread Gabor Bota
deployed on a 3 node cluster verified pi job, teragen, terasort and teravalidate Regards, Gabor Bota On Tue, Feb 5, 2019 at 6:03 AM Suma Shivaprasad < sumasai.shivapra...@gmail.com> wrote: > +1 > > - Built from source > - Deployed a single node cluster > - Ran few MR

Re: [VOTE] Release Apache Hadoop 3.2.0 - RC1

2019-01-11 Thread Gabor Bota
n a 3 node cluster verified pi job, teragen, terasort and teravalidate Regards, Gabor Bota On Fri, Jan 11, 2019 at 1:11 PM Zoltan Haindrich wrote: > Hello, > > I would like to note that it seems like 3.2.0-RC1 release misses some > source attachments (as all releases lately

Re: [VOTE] Release Apache Hadoop 3.2.0 - RC0

2018-11-27 Thread Gabor Bota
uster - verified example pi job - ran teragen, terasort and teravalidate without any error Regards, Gabor Bota On Tue, Nov 27, 2018 at 5:56 PM Eric Badger wrote: > +1 (non-binding) > > - Verified all hashes and checksums > - Built from source on macOS 10.14.1, Java 1.8.0u65 >

Re: [VOTE] Release Apache Hadoop 2.8.5 (RC0)

2018-09-11 Thread Gabor Bota
Thanks for the work Junping! +1 (non-binding) - checked out git tag release-2.8.5-RC0 - built from source on Mac OS X 10.13.6, java version 8.0.181-oracle - deployed on a 3 node cluster - verified pi job (yarn), teragen, terasort and teravalidate Regards, Gabor Bota On Tue, Sep 11

[jira] [Created] (HDFS-13865) Improve fuse-dfs testing and dev docs

2018-08-24 Thread Gabor Bota (JIRA)
Gabor Bota created HDFS-13865: - Summary: Improve fuse-dfs testing and dev docs Key: HDFS-13865 URL: https://issues.apache.org/jira/browse/HDFS-13865 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-13864) Service for FSNamesystem#clearCorruptLazyPersistFiles to iterate with writeLock

2018-08-24 Thread Gabor Bota (JIRA)
Gabor Bota created HDFS-13864: - Summary: Service for FSNamesystem#clearCorruptLazyPersistFiles to iterate with writeLock Key: HDFS-13864 URL: https://issues.apache.org/jira/browse/HDFS-13864 Project

Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0

2018-08-07 Thread Gabor Bota
, terasort and teravalidate Regards, Gabor Bota On Thu, Aug 2, 2018 at 8:44 PM Wangda Tan wrote: > Hi folks, > > I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here: > > http://people.apache.org/~wangda/hadoop-3.1.1-RC0/ > > The RC tag in git is

[jira] [Resolved] (HDFS-13683) HDFS StoragePolicy commands should work with Federation

2018-06-19 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HDFS-13683. --- Resolution: Duplicate > HDFS StoragePolicy commands should work with Federat

[jira] [Created] (HDFS-13683) HDFS StoragePolicy commands should work with Federation

2018-06-15 Thread Gabor Bota (JIRA)
Gabor Bota created HDFS-13683: - Summary: HDFS StoragePolicy commands should work with Federation Key: HDFS-13683 URL: https://issues.apache.org/jira/browse/HDFS-13683 Project: Hadoop HDFS Issue

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-06-05 Thread Gabor Bota
X 10.13.4, java version 8.0.171-oracle - deployed on a 3 node cluster (HDFS HA, Non-HA YARN) - verified pi job (yarn), teragen, terasort and teravalidate Regards, Gabor Bota On Mon, Jun 4, 2018 at 7:38 PM Nandakumar Vadivelu < nvadiv...@hortonworks.com> wrote: > Thanks Yongjun fo

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-06-01 Thread Gabor Bota
Hi Yongjun, Thank you for working on this release. Is there a git tag in the upstream repo which can be checked out? I'd like to build the release from source. Regards, Gabor On Fri, Jun 1, 2018 at 7:57 AM Shashikant Banerjee < sbaner...@hortonworks.com> wrote: > Looks like the link with the fi

Re: [VOTE] Release Apache Hadoop 2.8.4 (RC0)

2018-05-09 Thread Gabor Bota
), teragen, terasort and teravalidate Regards, Gabor Bota On Wed, May 9, 2018 at 12:14 AM Ajay Kumar wrote: > Thanks for work on this, Junping!! > > +1 (non-binding) > - verified binary checksum > - built from source and setup 4 node cluster > - run basic hdfs c

Re: [VOTE] Release Apache Hadoop 2.9.1 (RC0)

2018-04-26 Thread Gabor Bota
- verified pi job, teragen, terasort and teravalidate Regards, Gabor Bota On Wed, Apr 25, 2018 at 7:12 AM, Chen, Sammi wrote: > > Paste the links here, > > The artifacts are available here: https://dist.apache.org/repos/ > dist/dev/hadoop/2.9.1-RC0/ > > The RC

[jira] [Created] (HDFS-13494) TestKeyProviderFactory test errors on JDK 8u171 (java.security.UnrecoverableKeyException)

2018-04-24 Thread Gabor Bota (JIRA)
Gabor Bota created HDFS-13494: - Summary: TestKeyProviderFactory test errors on JDK 8u171 (java.security.UnrecoverableKeyException) Key: HDFS-13494 URL: https://issues.apache.org/jira/browse/HDFS-13494

[jira] [Created] (HDFS-13481) TestRollingFileSystemSinkWithHdfs#testFlushThread: test failed intermittently

2018-04-19 Thread Gabor Bota (JIRA)
Gabor Bota created HDFS-13481: - Summary: TestRollingFileSystemSinkWithHdfs#testFlushThread: test failed intermittently Key: HDFS-13481 URL: https://issues.apache.org/jira/browse/HDFS-13481 Project

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

2018-03-20 Thread Gabor Bota
ragen, terasort and teravalidate without errors Regards, Gabor Bota On Tue, Mar 20, 2018 at 2:07 PM, Yufei Gu wrote: > Thanks Eddy! > > +1 (non-binding) > >- Downloaded the hadoop-3.0.1.tar.gz from > http://home.apache.org/~lei/hadoop-3.0.1-RC1/ >- Started a pseudo

[jira] [Created] (HDFS-13179) TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas fails intermittently

2018-02-22 Thread Gabor Bota (JIRA)
Gabor Bota created HDFS-13179: - Summary: TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas fails intermittently Key: HDFS-13179 URL: https://issues.apache.org/jira/browse/HDFS-13179 Project

[jira] [Reopened] (HDFS-11187) Optimize disk access for last partial chunk checksum of Finalized replica

2018-02-20 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reopened HDFS-11187: --- Reopened to provide patch for branch-2.7 > Optimize disk access for last partial chunk checksum

[jira] [Reopened] (HDFS-11187) Optimize disk access for last partial chunk checksum of Finalized replica

2018-02-07 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reopened HDFS-11187: --- Assignee: Gabor Bota (was: Wei-Chiu Chuang) Reopening this to add the change to branch-2

[jira] [Created] (HDFS-13065) TestErasureCodingMultipleRacks#testSkewedRack3 is failing

2018-01-25 Thread Gabor Bota (JIRA)
Gabor Bota created HDFS-13065: - Summary: TestErasureCodingMultipleRacks#testSkewedRack3 is failing Key: HDFS-13065 URL: https://issues.apache.org/jira/browse/HDFS-13065 Project: Hadoop HDFS