[jira] [Created] (HADOOP-17758) NPE and excessive warnings after HADOOP-17728

2021-06-10 Thread Jim Brennan (Jira)
Jim Brennan created HADOOP-17758: Summary: NPE and excessive warnings after HADOOP-17728 Key: HADOOP-17758 URL: https://issues.apache.org/jira/browse/HADOOP-17758 Project: Hadoop Common

Re: [E] [VOTE] Hadoop 3.1.x EOL

2021-06-03 Thread Jim Brennan
+1 On Thu, Jun 3, 2021 at 1:14 AM Akira Ajisaka wrote: > Dear Hadoop developers, > > Given the feedback from the discussion thread [1], I'd like to start > an official vote > thread for the community to vote and start the 3.1 EOL process. > > What this entails: > > (1) an official announcement

Re: [E] Re: Java 8 Lambdas

2021-04-29 Thread Jim Brennan
I just think that we should be cognizant of changes (particularly bug fixes), that will need to be ported to branch-2.10. Since it is still on Java7, anytime you use a lambda in code on trunk, we need to change it for branch-2.10. While not difficult, this is extra work and it increases the diff

Re: [E] Re: Problems with precommit builds

2021-03-04 Thread Jim Brennan
LyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=kETVCOG_yC4KNpizU-KmR0vv3uPVwXlst5M_wqzF6bI&s=V6ccL_RObB69kGSBR6Tem7ug2tjoz8vg_lZQyqsGzTA&e= > > Click on Build with Parameters, and then just the jira Id. That works for > most cases :-) > > -Ayush >

Re: Problems with precommit builds

2021-03-04 Thread Jim Brennan
The PR where we were having problems was: https://github.com/apache/hadoop/pull/2722 On Thu, Mar 4, 2021 at 1:04 PM Jim Brennan wrote: > Pre-commit builds in trunk seem to be very unreliable lately. I know > Ahmed Hussein ran into an issue last week with one of his PRs. When he > re

Problems with precommit builds

2021-03-04 Thread Jim Brennan
Pre-commit builds in trunk seem to be very unreliable lately. I know Ahmed Hussein ran into an issue last week with one of his PRs. When he rebased and updated it, the precommit builds failed to run, We ended up having to close and submit a new PR. And just this week I have been having similar p

[jira] [Created] (HADOOP-17486) Provide fallbacks for callqueue ipc namespace properties

2021-01-21 Thread Jim Brennan (Jira)
Jim Brennan created HADOOP-17486: Summary: Provide fallbacks for callqueue ipc namespace properties Key: HADOOP-17486 URL: https://issues.apache.org/jira/browse/HADOOP-17486 Project: Hadoop Common

[jira] [Resolved] (HADOOP-17408) Optimize NetworkTopology while sorting of block locations

2021-01-08 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan resolved HADOOP-17408. -- Fix Version/s: 3.4.0 3.3.1 Resolution: Fixed Thanks for the

Re: [E] Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

2020-12-21 Thread Jim Brennan
I put up a patch for https://issues.apache.org/jira/browse/YARN-10540. Thanks for bringing it to my attention. Jim On Mon, Dec 21, 2020 at 10:36 AM Sunil Govindan wrote: > I had some offline talks with a few folks. > This issue is happening only in Mac, hence ideally it does not cause much > of

[jira] [Resolved] (HADOOP-17417) Reduce UGI overhead in token ops

2020-12-11 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan resolved HADOOP-17417. -- Resolution: Later This needs to be done as part of a larger feature that we are not ready to

[jira] [Resolved] (HADOOP-17416) Reduce synchronization in the token secret manager

2020-12-11 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan resolved HADOOP-17416. -- Resolution: Later This change is part of a larger feature that we are not ready to put up

[jira] [Resolved] (HADOOP-17392) Remote exception messages should not include the exception class

2020-12-03 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan resolved HADOOP-17392. -- Fix Version/s: 3.2.3 3.1.5 3.4.0

Re: [E] Yetus is failing with Java unable to create threads

2020-12-02 Thread Jim Brennan
This is still happening. Latest build: https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/343/#showFailuresLink Looks like we are running out of threads in the containers where the unit tests run. Anyone know where this is setup? On Wed, Oct 21, 2020 at 5:51 PM Ahmed Hussein w

[jira] [Resolved] (HADOOP-17367) Add InetAddress api to ProxyUsers.authorize

2020-11-19 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan resolved HADOOP-17367. -- Fix Version/s: 3.2.3 3.1.5 3.4.0

[jira] [Resolved] (HADOOP-17362) Doing hadoop ls on Har file triggers too many RPC calls

2020-11-16 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan resolved HADOOP-17362. -- Fix Version/s: 3.2.3 3.1.5 3.4.0

[jira] [Reopened] (HADOOP-17306) RawLocalFileSystem's lastModifiedTime() looses milli seconds in JDK < 10.b09

2020-11-05 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan reopened HADOOP-17306: -- I have reverted this commit from trunk, branch-3.3, branch-3.2, and branch-3.2.2

[jira] [Created] (HADOOP-17342) Creating a token identifier should not do kerberos name resolution

2020-11-03 Thread Jim Brennan (Jira)
Jim Brennan created HADOOP-17342: Summary: Creating a token identifier should not do kerberos name resolution Key: HADOOP-17342 URL: https://issues.apache.org/jira/browse/HADOOP-17342 Project: Hadoop

Re: [E] [VOTE] Release Apache Hadoop 2.10.1 (RC0)

2020-09-16 Thread Jim Brennan
Thanks for your work on this Masatake! I am +1 (non-binding) on this 2.10.1 release. I built from source and ran hdfs, resourcemanager, and nodemanager unit tests. I set up a one-node-cluster and ran some example jobs (pi, sleep). I tested NM/RM recovery by killing NM/RM during jobs and verifying

Re: [E] Re: [DISCUSS] Hadoop 2.10.1 release

2020-09-02 Thread Jim Brennan
Thanks Masatake Iwasaki! I am willing to help out with Hadoop 2.10.1 release. Jim Brennan On Tue, Sep 1, 2020 at 2:13 AM Masatake Iwasaki wrote: > Thanks, Mingliang Liu. > > I volunteer to take the RM role then. > I will appreciate advice from who have the experience. > >

[jira] [Created] (HADOOP-17127) Use RpcMetrics.TIMEUNIT to initialize rpc queueTime and processingTime

2020-07-13 Thread Jim Brennan (Jira)
Jim Brennan created HADOOP-17127: Summary: Use RpcMetrics.TIMEUNIT to initialize rpc queueTime and processingTime Key: HADOOP-17127 URL: https://issues.apache.org/jira/browse/HADOOP-17127 Project

Branch 2.10 QBT builds

2020-05-21 Thread Jim Brennan
Does anyone know what's up with the qbt builds for branch-2.10? https://builds.apache.org/view/H-L/view/Hadoop/job/hadoop-qbt-branch-2.10-java7-linux-x86/692/console Last few have failed with: cd /testptch/hadoop /usr/bin/mvn --batch-mode -Dmaven.repo.local=/home/jenkins/jenkins-slave/workspace/h

[jira] [Created] (HADOOP-16789) In TestZKFailoverController, restore changes from HADOOP-11149 that were dropped by HDFS-6440

2020-01-03 Thread Jim Brennan (Jira)
Jim Brennan created HADOOP-16789: Summary: In TestZKFailoverController, restore changes from HADOOP-11149 that were dropped by HDFS-6440 Key: HADOOP-16789 URL: https://issues.apache.org/jira/browse/HADOOP-16789

Re: [DISCUSS] Making 2.10 the last minor 2.x release

2019-12-31 Thread Jim Brennan
It looks like QBT tests are still being run on branch-2 ( https://builds.apache.org/view/H-L/view/Hadoop/job/hadoop-qbt-branch2-java7-linux-x86/), and they are not very helpful at this point. Can we change the QBT tests to run against branch-2.10 instead? Jim On Mon, Dec 23, 2019 at 7:44 PM Akira

Re: [VOTE] Release Apache Hadoop 2.10.0 (RC1)

2019-10-25 Thread Jim Brennan
+1 (non-binding) on RC1 I built from source on Mac and RHEL7, ran hdfs, nodemanager, and resourcemanager unit tests, and set up a one-node cluster and ran some test jobs (pi and sleep). - Jim On Tue, Oct 22, 2019 at 4:55 PM Jonathan Hung wrote: > Hi folks, > > This is the second release candida

Re: [VOTE] Merge YARN-8200 to branch-2 and branch-3.0

2019-08-26 Thread Jim Brennan
+1 (non-binding). I have built branch-2 with the latest YARN-8200 patch (YARN-8200-branch-2.003.patch). I ran all of the NM/RM tests and ran a few test jobs on a one-node cluster with default settings. On Mon, Aug 26, 2019 at 3:51 PM Oliver Hu wrote: > +1 (non-binding) > > We have used this pa

[jira] [Created] (HADOOP-16361) TestSecureLogins#testValidKerberosName fails on branch-2

2019-06-11 Thread Jim Brennan (JIRA)
Jim Brennan created HADOOP-16361: Summary: TestSecureLogins#testValidKerberosName fails on branch-2 Key: HADOOP-16361 URL: https://issues.apache.org/jira/browse/HADOOP-16361 Project: Hadoop Common

Re: [DISCUSS] Docker build process

2019-03-19 Thread Jim Brennan
I agree with Steve and Marton. I am ok with having the docker build as an option, but I don't want it to be the default. Jim On Tue, Mar 19, 2019 at 12:19 PM Eric Yang wrote: > Hi Marton, > > Thank you for your input. I agree with most of what you said with a few > exceptions. Security fix

Re: [ANNOUNCE] Eric Badger is now a committer!

2019-03-05 Thread Jim Brennan
Congratulations Eric! On Tue, Mar 5, 2019 at 11:20 AM Eric Payne wrote: > It is my pleasure to announce that Eric Badger has accepted an invitation > to become a Hadoop Core committer. > > Congratulations, Eric! This is well-deserved! > > -Eric Payne >

[jira] [Created] (HADOOP-15548) Randomize local dirs

2018-06-20 Thread Jim Brennan (JIRA)
Jim Brennan created HADOOP-15548: Summary: Randomize local dirs Key: HADOOP-15548 URL: https://issues.apache.org/jira/browse/HADOOP-15548 Project: Hadoop Common Issue Type: Bug

[jira] [Created] (HADOOP-15357) Configuration.getPropsWithPrefix no longer does variable substitution

2018-04-02 Thread Jim Brennan (JIRA)
Jim Brennan created HADOOP-15357: Summary: Configuration.getPropsWithPrefix no longer does variable substitution Key: HADOOP-15357 URL: https://issues.apache.org/jira/browse/HADOOP-15357 Project

[jira] [Reopened] (HADOOP-15085) Output streams closed with IOUtils suppressing write errors

2017-12-15 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan reopened HADOOP-15085: -- Reopening so I can put up a patch for branch-2. > Output streams closed with IOUtils suppress