Re: [VOTE] Release Apache Hadoop Thirdparty 1.1.1 RC0

+1 - Verified checksums and signatures - Built from source with -Psrc profile - Checked the documents - Compiled Hadoop trunk and branch-3.3 with Hadoop third-party 1.1.1. -Akira On Wed, May 26, 2021 at 5:29 PM Wei-Chiu Chuang wrote: > > Hi folks, > > I have put together a release candidate (RC

Re: [DISCUSS] which release lines should we still consider actively maintained?

dea. > >> > >> > >> > >> For Hadoop 3.3 line: If no one beats me, I plan to make a 3.3.2 in 2-3 > >> months. And another one in another 2-3 months. > >> The Hadoop 3.3.1 has nearly 700 commits not in 3.3.0. It is very difficult > >> to mak

[VOTE] Hadoop 3.1.x EOL

Dear Hadoop developers, Given the feedback from the discussion thread [1], I'd like to start an official vote thread for the community to vote and start the 3.1 EOL process. What this entails: (1) an official announcement that no further regular Hadoop 3.1.x releases will be made after 3.1.4. (2

Re: [VOTE] Hadoop 3.1.x EOL

This vote has passed with 18 binding +1. I'll update the JIRA and the wiki. Thanks all for your participation. On Tue, Jun 8, 2021 at 3:03 AM Steve Loughran wrote: > > > > On Thu, 3 Jun 2021 at 07:14, Akira Ajisaka wrote: >> >> Dear Hadoop developers, >

Re: [DISCUSS] Tips for improving productivity, workflow in the Hadoop project?

Thank you Wei-Chiu for starting the discussion, > 3. JIRA security I'm +1 to use private JIRA issues to handle vulnerabilities. > 5. Doc update +1, I build the document daily and it helps me fixing documents: https://aajisaka.github.io/hadoop-document/ It's great if the latest document is built a

Re: [DISCUSS] Change project style guidelines to allow line length 100

Based on the positive feedback, filed https://issues.apache.org/jira/browse/HADOOP-17813 to update the checkstyle rule. I don't think it requires a vote thread. Thanks and regards, Akira On Sun, Jun 13, 2021 at 1:14 AM Steve Loughran wrote: > > +1 > > if you look closely the hadoop-azure module

[DISCUSS] Hadoop 3.2.3 release

Hi all, Hadoop 3.2.2 was released half a year ago, and now, we have accumulated more than 230 commits [1]. Therefore I want to start the release work for 3.2.3. There is one blocker for 3.2.3 [2]. - https://issues.apache.org/jira/browse/HDFS-12920 Is there anyone who would volunteer to be the 3.

Re: [DISCUSS] Hadoop 3.2.3 release

Hi Brahma, Thank you for volunteering! -Akira On Fri, Jul 23, 2021 at 5:57 PM Brahma Reddy Battula wrote: > > Hi Akira, > > Thanks for bringing this.. > > I want to drive this if nobody already plan to do this.. > > > On Thu, 22 Jul 2021 at 8:48 AM, Akira A

Re: [DISCUSS] Hadoop 3.2.3 release

t 2:05 PM Xiaoqiao He wrote: >> >> >> >>> Thanks Brahma for volunteering and driving this release plan. I just >> >>> created a dashboard for 3.2.3 release[1]. >> >>> I would like to support for this release line if need. (cc Brahma) >> >>

Re: Hadoop-3.2.3 Release Update

Thanks Brahma for cutting branch-3.2.3. In Apache Bigtop, there are some patches applied to Hadoop 3.2.2. https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop In these patches, how about backporting the following issues to branch-3.2 and branch-3.2.3? - HADOOP-14922 - HA

Re: [DISCUSS] Migrate to Yetus Interface classification annotations

Hi Masatake, The problem comes from the removal of com.sun.tools.doclets.* packages in Java 10. In Apache Hadoop, I removed the doclet support for filtering javadocs when the environment is Java 10 or upper. https://issues.apache.org/jira/browse/HADOOP-15304 Thanks, Akira On Tue, Sep 28, 2021 at

Re: Hadoop-3.2.3 Release Update

ahma Reddy Battula >>>> wrote: >>>> >>>>> Hi All, >>>>> >>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly this >>>>> can >>>>> be done by this week,then I will try to create the RC next if there

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC0

Thank you Chao Sun for preparing the RC. I've added your public key to the Hadoop KEYS file ( https://downloads.apache.org/hadoop/common/KEYS). Thanks, Akira On Fri, Dec 10, 2021 at 11:10 AM Chao Sun wrote: > Hi all, > > Sorry for the long delay. I've prepared RC0 for Hadoop 3.3.2 below: > > T

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC0

Hi Chao, > For this, I just need to update the hadoop-project/src/site/markdown/index.md.vm and incorporate notable changes made in 3.3.1/3.3.2, is that correct? > ARM binaries There was a discussion [1] and concluded that ARM binaries are optional. The release vote is only for source code, not b

Re: Possibility of using ci-hadoop.a.o for Nutch integration tests

(Adding builds@) Hi Lewis, Nutch is already using ci-builds.apache.org, so I think Nutch can continue using it. ci-hadoop.apache.org provides almost the same functionality as ci-builds.apache.org and there is no non-production Hadoop cluster running there. Therefore moving to ci-hadoop does not m

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3

Hi Masatake, I faced the same error in a clean environment and https://issues.apache.org/jira/browse/YARN-10561 should fix this issue. I'll rebase the patch shortly. By the way, I'm afraid there is no active maintainer in hadoop-yarn-applications-catalog module. The module is for a sample applica

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3

Thanks, Akira. >> >> I confirmed that the issue is fixed in current branch-3.3 containing >> YARN-10561. >> >> On 2022/01/28 14:25, Akira Ajisaka wrote: >> > Hi Masatake, >> > >> > I faced the same error in a clean environment and >> htt

Re: [DISCUSS] Hadoop 2.10.2 release

Thank you Masatake. +1 to release 2.10.2. On Fri, Mar 4, 2022 at 6:52 PM Masatake Iwasaki wrote: > Hi team, > > There are over 170 fixed issues in branch-2.10 after the release of > 2.10.1[1]. > Given that there is still a need for 2.10.x, I would like to release 2.10.2 > after HADOOP-18088[2]

Re: [VOTE] Release Apache Hadoop 3.2.3 - RC1

+1 (binding) - Verified the signatures and the checksums - Built from source using the "start-build-env.sh" from Ubuntu laptop. - Setup pseudo cluster and ran some mapreduce jobs. - Checked the Web UIs and the daemon logs. Thanks, Akira On Sun, Mar 20, 2022 at 2:33 PM Masatake Iwasaki < iwasak..

Re: [DISCUSS] Tips for improving productivity, workflow in the Hadoop project?

opers and the reviewers spending more time discussing in the > PR. > >> > - the relation between a single Jira and Github-PR is 1-to-M. In order > >> to > >> > find related discussions, the user may > >> >need to visit every PR (that may includ

[NOTICE] Attaching patches in JIRA issue no longer works

Dear Hadoop developers, I've disabled the Precommit-(HADOOP|HDFS|MAPREDUCE|YARN)-Build jobs. If you attach a patch to a JIRA issue, the Jenkins precommit job won't run. Please use GitHub PR for code review. Background: - https://issues.apache.org/jira/browse/HADOOP-17798 - https://lists.apache.or

Re: [E] [NOTICE] Attaching patches in JIRA issue no longer works

s on both is confusing and splitting information. I would >> rather use JIRA with patches or GitHub Issues with PRs. I think anything in >> between splits information and makes it hard to find. >> >> Eric >> >> On Sun, Mar 27, 2022 at 1:25 PM Akira Ajisaka >

Re: [VOTE] Release Apache Hadoop 3.3.3

Hi Chao, How about using https://repository.apache.org/content/repositories/orgapachehadoop-1348/ instead of https://repository.apache.org/content/repositories/staging/ ? Akira On Sat, May 7, 2022 at 10:52 AM Ayush Saxena wrote: > Hmm, I see the artifacts ideally should have got overwritten by

Re: [DISCUSS] Hadoop 3.2.4 release

Thank you Masatake for proceeding the release process. -Akira On Mon, Jul 11, 2022 at 10:12 AM Masatake Iwasaki wrote: > I'm going to cut branch-3.2.4 today. > If we need more time for 3.3.4 to fix the issue around HADOOP-18033, > 3.2.4 can be released first. > > Thanks, > Masatake Iwasaki > >

Re: [DISCUSS] Enable github security notifications to all Hadoop committers

Thanks Wei-Chiu for starting the discussion, +1 > I already have hundreds of incoming emails from various Hadoop alias each day so I don't mind adding a few more. Completely agreed. -Akira On Thu, Oct 24, 2019 at 3:48 PM Bharat Viswanadham wrote: > +1 (binding). I am interested in receiving

[DISCUSS] Remove Ozone and Submarine from Hadoop repo

Hi folks, Both Ozone and Apache Submarine have separate repositories. Can we remove these modules from hadoop-trunk? Regards, Akira

Re: [DISCUSS] Making 2.10 the last minor 2.x release

Thank you for your work, Jonathan. I found branch-2 has been unintentionally pushed again. Would you remove it? I think the branch should be protected if possible. -Akira On Tue, Dec 10, 2019 at 5:17 AM Jonathan Hung wrote: > It's done. The new commit chain is: trunk -> branch-3.2 -> branch-3.

Re: [DISCUSS] Making 2.10 the last minor 2.x release

ted, > we can’t delete it directly. > > Ref: https://issues.apache.org/jira/browse/INFRA-19581 > > -Ayush > > On 23-Dec-2019, at 5:03 PM, Akira Ajisaka wrote: > > Thank you for your work, Jonathan. > > I found branch-2 has been unintentionally pushed again. Would you r

Re: [DISCUSS] Hadoop 2019 Release Planning

Thank you Wangda. Now it's 2020. Let's release Hadoop 3.3.0. I created a wiki page for tracking blocker/critical issues for 3.3.0 and I'll check the issues in the list. https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.3+Release If you find blocker/critical issues in trunk, please set th

Re: [DISCUSS] Hadoop 2019 Release Planning

ell.. >> >> >> >> On Mon, 6 Jan 2020 at 6:08 PM, Gabor Bota >> wrote: >> >>> I'm interested in doing a release of hadoop. >>> The version we need an RM is 3.1.3 right? What's the target date for >>> that? >>> >>&g

Re: [DISCUSS] Removal of old hamlet package in 3.3+ or 3.4+

gating why the precommit job ignores new javadoc warnings/errors in https://issues.apache.org/jira/browse/HADOOP-16802. I'd like to remove the package to make the investigation easier. Regards, Akira On Thu, Feb 14, 2019 at 3:18 PM Akira Ajisaka wrote: > Thanks Masatake for your comments.

Re: [DISCUSS] Feature branch for HDFS-14978 In-place Erasure Coding Conversion

+1 for the feature branch. On Fri, Jan 24, 2020 at 6:34 AM Wei-Chiu Chuang wrote: > Hi we are working on a feature to improve Erasure Coding, and I would like > to seek your opinion on creating a feature branch for it. (HDFS-14978 > ) > > Reason

Re: Alternative Decommission Monitor Implementation

Yes, I'm interested in the new decommission monitor. We're planning to adopt this after upgrading to HDFS 3.3.0. Thanks, Akira On Wed, Feb 5, 2020 at 3:57 AM Wei-Chiu Chuang wrote: > @Akira Ajisaka you said you'd be interested, right? > Are you planning to adopt this fea

Re: [DISCUSS] EOL Hadoop branch-2.8

Thanks Wei-Chiu for starting the discussion, +1 for the EoL. -Akira On Tue, Feb 18, 2020 at 4:59 PM Ayush Saxena wrote: > Thanx Wei-Chiu for initiating this > +1 for marking 2.8 EOL > > -Ayush > > > On 17-Feb-2020, at 11:14 PM, Wei-Chiu Chuang wrote: > > > > The last Hadoop 2.8.x release, 2.

Re: [DISCUSS] hadoop-thirdparty 1.0.0 release

Thanks Vinayakumar for starting the discussion, +1 for the release plan. I think the release vote timeframe is now 5 days, not 7 days. -Akira On Fri, Feb 21, 2020 at 3:56 PM Vinayakumar B wrote: > Hi All, > > Since Hadoop-3.3.0 release is around the corner, its time to release > hadoop-thirdpa

Re: [VOTE] EOL Hadoop branch-2.8

gt; > >>> On Mon, Feb 24, 2020 at 11:47 PM Wei-Chiu Chuang > >>> wrote: > >>> > >>>> This thread has been running for 7 days and no -1. > >>>> > >>>> Don't think we've established a formal EOL process, but to publicize

Re: Hadoop & TLS 1.3

Hi Wei-Chiu, Now we are experimenting trunk with Java11 in our development cluster and the HttpFS supports TLS 1.3 without any specific configuration. We haven't done any performance tests. -Akira $ curl -I --tlsv1.3 --negotiate -u : "https:// :/webhdfs/v1/?op=liststatus" HTTP/1.1 401 Authentic

Re: This week's Hadoop storage community call

+cc: yarn-dev/mapreduce-dev since it contains the information for Hadoop 3.3.0 release Thank you all for the discussion and thanks Wei-Chiu for the summary. > I created a dashboard to track the Hadoop 3.3.0 release: > https://issues.apache.org/jira/secure/Dashboard.jspa?selectPageId=12335311 > It

Re: [DISCUSS] Hadoop 3.3.0 Release include ARM binary

Hi Brahma, I think we cannot do any of your proposed actions. http://www.apache.org/legal/release-policy.html#owned-controlled-hardware > Strictly speaking, releases must be verified on hardware owned and controlled by the committer. That means hardware the committer has physical possession and c

Re: [DISCUSS] Hadoop 3.3.0 Release include ARM binary

me other,please let me know. > > i) Single machine and share cred to future RM ( as we can delete keys once > release is over). > ii) Creating the jenkins project ( may be we need to discuss in the > board..) > iii) I can provide ARM release for future releases. > > > > &

Re: [VOTE] Release Apache Hadoop Thirdparty 1.0.0 - RC1

+1 - Verified signatures and checksums - Built jars and docs from source - Built hadoop trunk with hadoop-thirdparty 1.0.0 - Checked rat files and documents - Checked LICENSE and NOTICE files Thanks, Akira On Thu, Mar 12, 2020 at 5:26 AM Vinayakumar B wrote: > Hi folks, > > Thanks to everyone'

Re: JENKINS is not posting build results in jiras

Thanks Sunil for the report. The precommit jobs are failing to add comments to GitHub also. I'm looking into the cause, and any help is appreciated. Thanks, Akira On Mon, Mar 23, 2020 at 7:39 PM Sunil Govindan wrote: > Hello > > From last few days, jenkins results are not getting published in

Re: JENKINS is not posting build results in jiras

A few days ago I upgraded the build image and maybe it is the root cause. Created a pull request to revert the change to see if it is really the cause: https://github.com/apache/hadoop/pull/1911 Thanks, Akira On Tue, Mar 24, 2020 at 8:21 PM Akira Ajisaka wrote: > Thanks Sunil for the rep

Re: JENKINS is not posting build results in jiras

Sorry it was the root cause. Reverted. Now the precommit job can add comments to GitHub. https://github.com/apache/hadoop/pull/1820#issuecomment-603545202 Akira On Tue, Mar 24, 2020 at 8:53 PM Akira Ajisaka wrote: > A few days ago I upgraded the build image and maybe it is the root ca

Re: [DISCUSS] Shade guava into hadoop-thirdparty

+1 Thanks, Akira On Sun, Apr 5, 2020 at 4:13 AM Wei-Chiu Chuang wrote: > Hi Hadoop devs, > > I spent a good part of the past 7 months working with a dozen of colleagues > to update the guava version in Cloudera's software (that includes Hadoop, > HBase, Spark, Hive, Cloudera Manager ... more th

Re: [Hadoop-3.3 Release update]- branch-3.3 has created

Hi Brahma, How is this issue going? If there are some blockers, I can help you. -Akira On Mon, Mar 30, 2020 at 3:50 AM Brahma Reddy Battula wrote: > Hi All, > > branch-3.3 created[1] and trunk set to 3.4.0-SNAPSHOT. > > while committing jira's please set the proper fix version and if there is

Re: [DISCUSS] Making 2.10 the last minor 2.x release

86/), >> and they are not very helpful at this point. >> Can we change the QBT tests to run against branch-2.10 instead? >> >> Jim >> >> On Mon, Dec 23, 2019 at 7:44 PM Akira Ajisaka >> wrote: >> >>> Thank you, Ayush. >>> >>>

Moving to Yetus 0.12.0

Hi folks, I updated Jenkinsfile to use Yetus 0.12.0 in GitHub PR. https://issues.apache.org/jira/browse/HADOOP-16944 In addition, I'm updating the configs in the Jenkins jobs to use Yetus 0.12.0 in ASF JIRAs. I updated the settings of https://builds.apache.org/view/H-L/view/Hadoop/job/PreCommit-H

Re: Moving to Yetus 0.12.0

t) -Akira On Sun, Apr 19, 2020 at 3:41 AM Akira Ajisaka wrote: > Hi folks, > > I updated Jenkinsfile to use Yetus 0.12.0 in GitHub PR. > https://issues.apache.org/jira/browse/HADOOP-16944 > > In addition, I'm updating the configs in the Jenkins jobs to use Yetus >

Re: [Hadoop-3.3 Release update]- branch-3.3 has created

rg/jira/secure/ViewProfile.jspa?name=gandras >>> > >>> >>> Szilard >>> >>> Nemeth < >>> >>> https://issues.apache.org/jira/secure/ViewProfile.jspa?name=snemeth> >>> >>> [image: >>> >>> Minor] PATCH

Re: [Hadoop-3.3 Release update]- branch-3.3 has created

le branches might confuse or sombody might miss to commit.Shall I > wait till this weekend to create..? > > On Mon, Apr 20, 2020 at 11:57 AM Akira Ajisaka > wrote: > >> Hi Brahma, >> >> Thank you for preparing the release. >> Could you cut branch-3.3.0? I

Re: Moving to Yetus 0.12.0

n Sun, Apr 19, 2020 at 5:05 PM Akira Ajisaka wrote: > Updated Precommit-(HADOOP|HDFS|YARN|MAPREDUCE)-Build jobs. The daily qbt > jobs are kept as-is. Now I'm testing the new CI servers and testing the qbt > jobs with Yetus 0.12.0. > https://ci-hadoop.apache.org/job/hadoop-qbt-

Re: Changing the default Datanode Volume Choosing policy

+1 to change the default policy in Hadoop 3.4+. -Akira On Wed, Apr 29, 2020 at 1:28 AM Clay Baenziger (BLOOMBERG/ 919 3RD A) < cbaenzi...@bloomberg.net> wrote: > I can confirm that my group has run with Available Space for a number of > years on the 2.7.x line quite successfully. > > -Clay > > F

Re: [Hadoop-3.3 Release update]- branch-3.3 has created

287 ( Open: Under > > discussion > > > ) > > > https://issues.apache.org/jira/browse/YARN-10194 ( Patch Available) > > > https://issues.apache.org/jira/browse/HDFS-15286 ( Patch Available) > > > https://issues.apache.org/jira/browse/YARN-9898 ( Patch Available

Access to Hadoop QA account for migrating Precommit jobs in Hadoop

Hi Allen, I'm testing new Jenkins master and find that we have to set hadoopqa JIRA password to migrate the PreCommit-Admin and PreCommit-(HADOOP|HDFS|YARN|MAPREDUCE)-Build. Would you migrate the jobs or register the credential to the new Jenkins master ( https://ci-hadoop.apache.org/)? Best rega

Re: Client Caller Context Through Router(RBF)

Thanks Ayush for bringing this up. NameNode uses clientId and callId for retry cache. - clientId: I'm +1 for adding remoteAddr in IPCConectionContext and NN should use remoteAddr for clientId. This also resolves data locality issue. - callId: Can DFSRouters share the callId and the clientId of the

Re: [DISCUSS] making Ozone a separate Apache project

+1 -Akira On Wed, May 13, 2020 at 4:53 PM Elek, Marton wrote: > > > I would like to start a discussion to make a separate Apache project for > Ozone > > > > ### HISTORY [1] > > * Apache Hadoop Ozone development started on a feature branch of > Hadoop repository (HDFS-7240) > > * In the Octo

Re: [NOTICE] Removal of protobuf classes from Hadoop Token's public APIs' signature

> Please check https://issues.apache.org/jira/browse/HADOOP-17046 > This Jira proposes to keep existing ProtobuRpcEngine as-is (without shading and with protobuf-2.5.0 implementation) to support downstream implementations. Thank you, Vinay. I checked the PR and it mostly looks good. How do we proc

Re: Moving to Yetus 0.12.0

Updated Yetus version to 0.12.0 in branch-2.10 qbt job: https://builds.apache.org/view/H-L/view/Hadoop/job/hadoop-qbt-branch-2.10-java7-linux-x86/ -Akira On Tue, Apr 28, 2020 at 6:59 AM Akira Ajisaka wrote: > Hi folks, > > After upgrading the image from Ubuntu 16.04 to Ubuntu 18.04

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC1)

Hi Gabor, Thank you for your work! Kihwal reported IBR leak in standby NameNode: https://issues.apache.org/jira/browse/HDFS-15421. I think this is a blocker and this affects 3.1.4-RC1. Would you check this? Best regards, Akira On Mon, Jun 22, 2020 at 10:26 PM Gabor Bota wrote: > Hi folks, > >

Re: [VOTE] Release Apache Hadoop 3.3.0 - RC0

+1 (binding) - Verified checksums and signatures. - Built from the source with CentOS 7 and OpenJDK 8. - Successfully upgraded HDFS to 3.3.0-RC0 in our development cluster (with RBF, security, and OpenJDK 11) for end-users. No issues reported. - The document looks good. - Deployed pseudo cluster a

Re: [DISCUSS] fate of branch-2.9

+1 Thanks, Akira On Fri, Aug 28, 2020 at 5:51 PM lisheng.sun08 wrote: > +1 on EOL of branch-2.9. > > Thanks, > Lisheng Sun > > > > 发自我的小米手机 > 在 2020年8月27日 下午1:55，Wei-Chiu Chuang 写道： > > Bump up this thread after 6 months. > > Is anyone still interested in the 2.9 release line? Or are we good to

Re: [VOTE] End of Life Hadoop 2.9

+1 -Akira On Tue, Sep 1, 2020 at 4:09 AM Wei-Chiu Chuang wrote: > Dear fellow Hadoop developers, > > Given the overwhelming feedback from the discussion thread > https://s.apache.org/hadoop2.9eold, I'd like to start an official vote > thread for the community to vote and start the 2.9 EOL proce

Re: [VOTE] Moving Ozone to a separated Apache project

+1 Thanks, Akira On Fri, Sep 25, 2020 at 3:00 PM Elek, Marton wrote: > > Hi all, > > Thank you for all the feedback and requests, > > As we discussed in the previous thread(s) [1], Ozone is proposed to be a > separated Apache Top Level Project (TLP) > > The proposal with all the details, motivat

Re: Alternative Decommission Monitor Implementation

Hi Wei-Chiu and Stephen, We have upgraded to HDFS 3.3.0 and experimenting the new decommission monitor. I'd like to feedback to the community in the near future. Thanks, Akira On Thu, Feb 6, 2020 at 2:45 PM Akira Ajisaka wrote: > > Yes, I'm interested in the new decommission

Precommit job fails to write comments in the GitHub pull requests

Apache Hadoop developers, After YETUS-994, the jenkins job updates the commit status instead of writing a comment to the pull request. It requires an OAuth token with write access to "repo:status" but now there is no such token for Apache Hadoop. I asked the infra team to create a token: https://i

Re: Precommit job fails to write comments in the GitHub pull requests

I've got a GitHub App token from the infra team and set this to the hadoop-multibranch job. The commit statuses in GitHub pull requests will be updated by Jenkins and you'll need to check these statuses. -Akira On Tue, Sep 29, 2020 at 2:55 AM Akira Ajisaka wrote: > > Apache H

Re: Precommit job fails to write comments in the GitHub pull requests

of toolchain in order to > > avoid surprising the developers. > > We can upgrade Yetus when JDK11 Javadoc issue is fixed. > > > > Regards, > > Masatake Iwasaki > > > >> On 2020/09/29 2:55, Akira Ajisaka wrote: > >> Apache Hadoop developers, >

Re: Precommit job fails to write comments in the GitHub pull requests

> Can we point to a commit before Yetus-994 instead of master and get away with > this? I'm fine with that approach not to breaking more. Filed https://issues.apache.org/jira/browse/HADOOP-17297 Thanks, Akira On Mon, Oct 5, 2020 at 10:18 AM Akira Ajisaka wrote: > > Hi

Fixing flaky tests in Apache Hadoop

Hi Hadoop developers, Now there are a lot of failing unit tests and there is an issue to tackle this bad situation. https://issues.apache.org/jira/browse/HDFS-15646 Although this issue is in HDFS project, this issue is related to all the Hadoop developers. Please check the above URL, read the des

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC1

-1 - YARN resource localization is broken by HADOOP-17306 and it has been reverted. It should be reverted from 3.2.2 as well. (Thank you Jim Brennan for the report!) - Would you include HDFS-15643 in RC2? This fixes checksum error in EC with ISA-L. Thank you He Xiaoqiao for preparing the release

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC3

I found TestCombineFileInputFormat is failing in branch-3.2.2 and I've cherry-picked MAPREDUCE-7284 to fix the failure. Thanks, Akira On Fri, Dec 4, 2020 at 9:09 AM Chao Sun wrote: > > Thanks Xiaoqiao. I just committed the fix to branch-3.2 (and will port it > to other branches as well later). C

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC3

In addition, backported HDFS-13404 to fix TestRouterWebHDFSContractAppend failure. On Fri, Dec 4, 2020 at 10:43 AM Akira Ajisaka wrote: > > I found TestCombineFileInputFormat is failing in branch-3.2.2 and I've > cherry-picked MAPREDUCE-7284 to fix the failure. > > Thanks

[DISCUSS] Upgrading Jersey from 1.x

Hi folks, Recently I resumed the work for upgrading Jersey: - https://issues.apache.org/jira/browse/HADOOP-15984 - https://github.com/apache/hadoop/pull/763 This upgrade is important because we cannot compile and run Jersey 1.x with Java 11+. However, it is very complicated because: 1. We need t

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

o Sun > HADOOP-15775. [JDK9] Add missing javax.activation-api dependency. > Contributed by Akira Ajisaka. > HDFS-15240. Erasure Coding: dirty buffer causes reconstruction block error. > Contributed by HuangTao. > HDFS-15708. TestURLConnectionFactory fails by NoClassDefFoundError in &g

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC5

+1 (binding) - Verified the checksums and signatures - Verified the source is the same as the RC5 tag - Built from source with CentOS 7.9 and Java 1.8.0_275 - Setup pseudo cluster and ran some FsShell commands Thanks, Akira On Sun, Jan 3, 2021 at 11:40 PM Xiaoqiao He wrote: > > Hi folks, > > Th

Easy way to run all the unit tests (apache id required)

Hi folks, I've prepared a Jenkins on-demand qbt job: https://ci-hadoop.apache.org/job/hadoop-qbt-any-java8-linux-x86_64 If you are tired of touching the source code in the modules to run all the tests (and seeing some broken Jenkins job results), please use this job instead. How to use: - Login

Re: Seeing YETUS issue in jenkins runs

Probably this issue is due to https://issues.apache.org/jira/browse/HADOOP-16870. Reverted. -Akira On Fri, Feb 19, 2021 at 11:27 AM Sunil Govindan wrote: > > Hi All, > > We are getting the below error in recent runs. > > -1. yetus. 0m 8s. Unprocessed flag(s): --findbugs-strict-precheck > >

Re: Seeing YETUS issue in jenkins runs

t'll be maven, before long you'll be > > doing linux device drivers... > > > > > > > > On Fri, 19 Feb 2021 at 05:53, Akira Ajisaka wrote: > > > > > Probably this issue is due to > > > https://issues.apache.org/jira/browse/HADOOP-16870.

Re: [DISCUSS] NameNode layout version change in 3.3/3.4

Hi Wei-Chiu and Brahma, +1 for the proposal. Normally we expect the NameNode layout version is the same between bugfix releases. However, HDFS-15566 is a serious issue. Therefore I think we can bump the layout version even in the bugfix release if the new layout version is required to fix the iss

Re: [VOTE] hadoop-thirdparty 1.1.0-RC0

+1 - Verified checksums and signatures - Built from source with -Psrc profile - Checked the documents -Akira On Thu, May 13, 2021 at 8:55 PM Wei-Chiu Chuang wrote: > > Hello my fellow Hadoop developers, > > I am putting together the first release candidate (RC0) for > Hadoop-thirdparty 1.1.0. T

Re: [DISCUSS] Change project style guidelines to allow line length 100

I'm +1 to allow <= 100 chars. FYI: There were some discussions long before: - https://lists.apache.org/thread.html/7813c2f8a49b1d1e7655dad180f2d915a280b2f4d562cfe981e1dd4e%401406489966%40%3Ccommon-dev.hadoop.apache.org%3E - https://lists.apache.org/thread.html/3e1785cbbe14dcab9bb970fa0f534811cfe

Re: [DISCUSS] which release lines should we still consider actively maintained?

Hi Sean, Thank you for starting the discussion. I think branch-2.10, branch-3.1, branch-3.2, branch-3.3, and trunk (3.4.x) are actively maintained. The next releases will be: - 3.4.0 - 3.3.1 (Thanks, Wei-Chiu!) - 3.2.3 - 3.1.5 - 2.10.2 > Are there folks willing to go through being release manag

Re: Planning for Apache Hadoop 2.6.2

Thanks Vinod and Sangjin for releasing 2.6.1 and starting discussion for 2.6.2! +1. If there's anything I can help you with, please tell me. Thanks, Akira On 9/25/15 13:23, Vinayakumar B wrote: Thanks Vinod and Sangjin for making 2.6.1 release possible. Apologies for not getting time to veri

Re: [VOTE] Release Apache Hadoop 2.6.2

Thanks Sangjin for creating RC for 2.6.2. +1 (non-binding) - Verified signatures and checksums - Deployed a single node cluster - Built Tez 0.7.0 with Hadoop 2.6.2 pom - Built Hive 1.2.1 with Hadoop 2.6.2 pom - Ran some Hive on Tez queries successfully Regards, Akira On 10/23/15 06:14, Sangjin

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

Thanks Junping for starting release process. I noticed there are duplicated tags: * release-2.6.3-RC0 * release-2.6.3-RC0.1 * release-2.6.3-RC1 Could you remove RC0.1 and RC1? Regards, Akira On 12/16/15 10:17, yliu wrote: Thanks Junping, +1. Download the tarball and deploy a small HDFS/YARN c

Re: [RESULT] [VOTE] Release Apache Hadoop 2.6.3 RC0

My late +1 (binding) - Downloaded source tarball - Verified signatures and checksums - Compiled and built a single node cluster - Confirmed commons-collections is upgraded to 3.2.2 - Compiled Hive 1.2.1 and Tez 0.7.0 using Hadoop 2.6.3 pom successfully - Ran some Hive on Tez/MRv2 queries successf

Re: [VOTE] Release Apache Hadoop 2.7.2 RC1

+1 (binding) - Downloaded source tarball - Verified signatures and checksums - Compiled and built a single node cluster - Confirmed commons-collections is upgraded to 3.2.2 - Compiled Hive 1.2.1 and Tez 0.7.0/0.8.1-alpha using Hadoop 2.7.2 pom successfully - Ran some Hive on Tez/MRv2 queries su

Re: [VOTE] Release Apache Hadoop 2.7.2 RC1

Thanks Vinod for starting the discussion. I'm +1 for cherry-picking these issues to 2.7.2. As Andrew said, when users upgrade Hadoop from 2.6.3 to 2.7.2, they can hit the issues. I'm thinking we should reduce the regressions as possible. Regards, Akira On 12/25/15 01:56, Andrew Wang wrote: My

Re: [DISCUSSION] Release Plan for Apache Hadoop 2.6.4

+1 for releasing 2.6.4 after release 2.7.2. I'll work on the list [2]. Thanks, Akira On 1/7/16 08:59, Junping Du wrote: Hello folks, Hope everyone had a wonderful holiday and good rest in passed weeks. We just had a 2.6.3 release on Dec.17 and now it is a good time to look forward to

Re: [VOTE] Release Apache Hadoop 2.7.2 RC1

The general rule sounds good to me. > "any fix in 2.x.y to be there in all 2.b.c releases (while b>=x) that get out after 2.x.y release date" +1 > I would prefer this rule only applies on critical/blocker fixes, but not applies on minor/trivial issues. +1 Thanks, Akira On 12/29/15 23:50,

Re: [UPDATE] New ASF git policy on force-pushes / Tags / Stale branches

Thanks Vinod for the information. +1 for removing origin/bracnh-2.8 and origin/sjlee/hdfs-merge. In addition, I'm thinking we need to delete origin/master, which was pushed wrongly. I've already deleted origin/ajisakaa/common-merge before force-push protection starts. > — There is a general rec

Re: [VOTE] Release Apache Hadoop 2.7.2 RC2

Hi Xiao, > From a quick comparison between the releasenotes.html and the CHANGES.txt > files in source tarball, the number of total JIRAs is quite different. In CHANGES.txt, JIRAs fixed in 2.6.1/2.6.2 are not in 2.7.2. That is why the number of JIRAs are different. Regards, Akira On 1/16/16

Re: Managing docs with hadoop-1 & hadoop-2

# Have stable1/stable2 links: http://hadoop.apache.org/docs/stable1 -> hadoop-1.x http://hadoop.apache.org/docs/stable2 -> hadoop-2.x +1, would also make: current -> stable2(since v2 is the latest) stable -> stable1 (for compatibility) +1, Eli's proposal looks good to me. - T

Re: [VOTE] Merge HDFS-5698 Use protobuf to serialize / deserialize FSImage to trunk

+1 (non-binding). This feature is very good for the developers to reduce the tasks for supporting FSImage compatibility. Thanks, Akira (2014/01/31 7:37), Haohui Mai wrote: Hello all, I would like to call a vote to merge of the new protobuf-based FSImage into trunk. The changes introduce a pr

Re: Permissions to edit Confluence Wiki

You can get the privilege by sending an e-mail to the dev ML. I added it for you. Thanks, Akira On 2017/09/09 4:50, Arun Suresh wrote: Hi folks How do we get access to edit the confluence wiki; https://cwiki.apache.org/confluence/display/HADOOP ? We were hoping to update it with hadoop 2.9 re

Re: Do we still have nightly (or even weekly) unit test run for Hadoop projects?

Yes, qbt runs nightly and it sends e-mail to dev lists. https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/ Regards, Akira On 2017/10/19 7:54, Wangda Tan wrote: Hi, Do we still have nightly (or even weekly) unit test run for Hadoop projects? I couldn't find it on Jenkins dashboard

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

+1 * Downloaded source tarball and verified checksum and signature * Compiled the source with OpenJDK 1.8.0_151 and CentOS 7.4 * Deployed a pseudo cluster and ran some simple MR jobs I noticed ISA-L build options are documented in BUILDING.txt but the options do not exist in 2.x releases. Filed

Re: [VOTE] Release Apache Hadoop 3.0.0 RC0

Hi Andrew, Signatures are missing. Would you upload them? Thanks, Akira On 2017/11/15 6:34, Andrew Wang wrote: Hi folks, Thanks as always to the many, many contributors who helped with this release. I've created RC0 for Apache Hadoop 3.0.0. The artifacts are available here: http://people.apa

Re: [VOTE] Release Apache Hadoop 3.0.0 RC0

> - When did we stop putting CHANGES files into the source artifacts? CHANGES files were removed by https://issues.apache.org/jira/browse/HADOOP-11792 > - Even after "mvn install"ing once, shading is repeated again and again for every new 'mvn install' even though there are no source change

  1   2   3   4   5   6   >