Re: [DISCUSS] Optimize the invoke retry of async repsonder when some nameservices are slow

2025-04-23 Thread Xiaoqiao He
+ hdfs-dev. Thanks Haobo for your proposal. As you mentioned above, this may be related to RBF and ARR features, right? IMO, it is necessary to improve responder performance, but I am a little confused about nameservice will slow down the whole system, The first glance is client or package size sh

Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0

2025-03-25 Thread Xiaoqiao He
hub.com:apache/hadoop-thirdparty.git > [git] * [new tag] release-1.4.0-RC1 -> release-1.4.0-RC1 > > > > On Mon, 24 Mar 2025 at 03:32, Xiaoqiao He wrote: >> >> Thanks Steve for driving this release. >> >> +0 and will give my +1 while tag to be fixed. >

Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0

2025-03-23 Thread Xiaoqiao He
Thanks Steve for driving this release. +0 and will give my +1 while tag to be fixed. [Y] LICENSE files exist and NOTICE is included. [Y] Build the source code on Ubuntu and OpenJDK 11. [Y] Verified checksums and Signature. [Y] Skimmed over the contents of ReleaseNotes and ChangeLogs. [N] release

Re: [VOTE] Request to merge HADOOP-19236 into trunk.

2025-03-23 Thread Xiaoqiao He
+1. Best Regards, - He Xiaoqiao On Thu, Mar 20, 2025 at 11:06 AM jinglun wrote: > > Hi everyone, I would like to propose merging > HADOOP-19236(https://issues.apache.org/jira/browse/HADOOP-19236) into trunk. > > > How to merge > The original branch is > HADOOP-19236(https://github.com/apache/h

Re: [DISCUSS] Integration of Volcano Engine TOS in Hadoop.

2025-03-13 Thread Xiaoqiao He
gt; > > > contracts and extended test cases. To run it, we need a machine > > > > > > that can > > > > > > connect to TOS. Setting the 6 environment variables below. > > > > > > > ``` > > > > > > > export TOS_ACCESS_KEY_ID={YOUR_ACCESS_KEY}

Re: [DISCUSS] Hadoop 3.4.2 release

2025-02-26 Thread Xiaoqiao He
+1. Thanks Ahmar. On Thu, Feb 27, 2025 at 2:31 AM Chris Nauroth wrote: > +1 > > Thank you, Ahmar! > > Chris Nauroth > > > On Wed, Feb 26, 2025 at 8:31 AM Ahmar Suhail wrote: > > > Hey all, > > > > Would like to start a discussion for a Hadoop 3.4.2 release. > > > > For S3A, we would like to rel

[RESULT][VOTE] Request to merge branch HDFS-17531 into trunk.

2025-02-19 Thread Xiaoqiao He
Addendum vote result: 4(binding) +1: Hui Fei, Ayush Saxena, Xiaoqiao He, Shilun Fan 3(non-binding) +1: Zhanghaobo, HuaLong Zhang, Jian Zhang Change to the formal title. Merged to trunk. Thanks all for your works. Best Regards, - He Xiaoqiao On Thu, Feb 20, 2025 at 11:42 AM jian zhang wrote

[jira] [Resolved] (HADOOP-19459) Comply with ASF website policy

2025-02-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-19459. -- Fix Version/s: site Hadoop Flags: Reviewed Resolution: Fixed > Comply with

[jira] [Created] (HADOOP-19459) Comply with ASF website policy

2025-02-19 Thread Xiaoqiao He (Jira)
Xiaoqiao He created HADOOP-19459: Summary: Comply with ASF website policy Key: HADOOP-19459 URL: https://issues.apache.org/jira/browse/HADOOP-19459 Project: Hadoop Common Issue Type

[jira] [Resolved] (HADOOP-19453) Fix site CSP issue which to match Infra team requirement.

2025-02-18 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-19453. -- Fix Version/s: site Hadoop Flags: Reviewed Resolution: Fixed > Fix site

[jira] [Created] (HADOOP-19453) Fix site CSP issue which to match Infra team requirement.

2025-02-17 Thread Xiaoqiao He (Jira)
Xiaoqiao He created HADOOP-19453: Summary: Fix site CSP issue which to match Infra team requirement. Key: HADOOP-19453 URL: https://issues.apache.org/jira/browse/HADOOP-19453 Project: Hadoop Common

Re: [VOTE] Request to merge branch HDFS-17531 into trunk.

2025-02-14 Thread Xiaoqiao He
+1 Best Regards, - He Xiaoqiao On Fri, Feb 14, 2025 at 3:53 PM Ayush Saxena wrote: > +1 > > -Ayush > > > On 14 Feb 2025, at 1:20 PM, Hui Fei wrote: > > > > Did some test work referring to the documentation. > > > > - Compiled source codes, built a local cluster and the async feature > > w

Re: [DISCUSS] Request to merge branch HDFS-17531 into trunk.

2025-02-12 Thread Xiaoqiao He
slfan1989's PR: HADOOP-19415. [JDK17] Upgrade JUnit from 4 to 5 in > hadoop-common Part 1. (#7339). slfan1989 will fix it later. > > Best Regards, > - Jian Zhang > > Xiaoqiao He 于2025年2月11日周二 11:15写道: > > > Hi Jian Zhang, Thanks for your great work. Please fix

Re: [DISCUSS] Integration of Volcano Engine TOS in Hadoop.

2025-02-10 Thread Xiaoqiao He
Thanks Jinglun for your work. Basically +1 from me to involve it into the Hadoop codebase. a. After a quick review of JIRA and PR, I think it is solid including document and code style. b. Contributors involved here are diverse who are from different projects and companies, and active enough. c. Co

[jira] [Resolved] (HADOOP-19370) Fix error links of huaweicloud in site index.

2024-12-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-19370. -- Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > Fix error li

[jira] [Resolved] (HADOOP-19339) OutofBounds Exception due to assumption about buffer size in BlockCompressorStream

2024-12-08 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-19339. -- Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > OutofBou

[jira] [Resolved] (HADOOP-19337) Fix ZKFailoverController NPE issue due to integer overflow in parseInt when initHM.

2024-12-08 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-19337. -- Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed >

Re: [ANNOUNCE] Apache Hadoop 3.4.1 release

2024-11-03 Thread Xiaoqiao He
Hi Steve and Muhund, Any progress about 3.4.1 release documents on site? Thanks. Best Regards, - He Xiaoqiao On Fri, Oct 25, 2024 at 9:21 PM Steve Loughran wrote: > I thought we'd done that. > > Mukund is away this week; it'll be something we can fix next week. > > On Thu, 24 Oct 2024 at 07:06,

Re: [VOTE] Release Apache Hadoop 3.4.1 RC3

2024-10-16 Thread Xiaoqiao He
Update my vote to +1(binding). Addendum: Verified signature was correct for both src/binary/site tarball. On Mon, Oct 14, 2024 at 5:26 PM Xiaoqiao He wrote: > Thanks Mukund and Steve for driving this release. > > +0. Will +1 when signature check passed. > > [Y] LICENSE files e

Re: [VOTE] Release Apache Hadoop 3.4.1 RC3

2024-10-14 Thread Xiaoqiao He
Thanks Mukund and Steve for driving this release. +0. Will +1 when signature check passed. [Y] LICENSE files exist and NOTICE is included. [Y] Rat check is ok. mvn clean apache-rat:check [Y] Build the source code on Ubuntu and OpenJDK 11 by `mvn clean package -DskipTests -Pnative -Pdist -Dtar`. [

Re: [VOTE] Release Apache Hadoop Thirdparty 1.3.0

2024-08-22 Thread Xiaoqiao He
+1 (binding). Thanks Steve and Mukund for driving this release. Best Regards - He Xiaoqiao On Wed, Aug 21, 2024 at 11:51 PM Mukund Madhav Thakur wrote: > +1 ( binding) > > On Tue, Aug 20, 2024 at 9:16 AM Steve Loughran > > wrote: > > > Mukund and I have built a release candidate (RC1) for Had

Re: [DISCUSS] what needs to be done to switch to java17

2024-07-31 Thread Xiaoqiao He
Great discussion. Strong +1 to support JDK 17. Not verify carefully, just want to collect if it is clear when we want to upgrade to support JDK17. a. CI infra. b. JUnit 5? (Not confirmed?) c. Jersey. d. JPMS args. e. Some other dependencies (Not clear). f. Any other things... we are using Hadoop c

[jira] [Resolved] (HADOOP-19228) ShellCommandFencer#setConfAsEnvVars should also replace '-' with '_'.

2024-07-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-19228. -- Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed

[jira] [Resolved] (HADOOP-19218) Avoid DNS lookup while creating IPC Connection object

2024-07-16 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-19218. -- Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Target Version/s: (was: 3.3.9

Re: [Discuss] RBF: Aynchronous router RPC.

2024-06-05 Thread Xiaoqiao He
Hi @zhangjian <1361320...@qq.com> , the dev branch HDFS-17531 is ready now. FYI. Best Regards, - He Xiaoqiao On Tue, Jun 4, 2024 at 10:08 PM zhangjian <1361320...@qq.com> wrote: > Hi, Xiaoqiao He: > Can you help create a dev branch? I don't have the permission to cre

Re: [Discuss] RBF: Aynchronous router RPC.

2024-05-29 Thread Xiaoqiao He
> On Fri, May 24, 2024 at 1:57 AM zhangjian <1361320...@qq.com> wrote: > >>>>> Hello everyone, currently, I have tested the performance of async > and sync router for a downstream ns: > >>>>> 1. The throughput, CPU, and thread performance of the a

Re: [DISCUSS] pruning surplus branches/tags from the main hadoop repo

2024-05-29 Thread Xiaoqiao He
Strong +1. One concerns, how we define 'unnecessary branches', which mean how to distinguish the branches someone accidentally created, I try to traverse some of them but didn't get one obvious rule. Thanks. Best Regards, - He Xiaoqiao On Wed, May 29, 2024 at 10:11 PM Ayush Saxena wrote: > +1

[jira] [Resolved] (HADOOP-19156) ZooKeeper based state stores use different ZK address configs

2024-05-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-19156. -- Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > ZooKeeper ba

Re: [Discuss] RBF: Aynchronous router RPC.

2024-05-23 Thread Xiaoqiao He
gjin > > > > On Tue, May 21, 2024 at 5:13 AM zhangjian <1361320...@qq.com.invalid> > wrote: > > > >> Hi, xiaoqiao he, thank you for your reply. > >> > >> 1.Currently, the server and client protocols within router can be >

Re: [Discuss] RBF: Aynchronous router RPC.

2024-05-20 Thread Xiaoqiao He
Thanks for this great proposal! Some questions after reviewing the design doc (sorry didn't review PR carefully which is too large.) 1. This solution will involve RPC framework update, will it affect other modules and how to keep other modules off these changes. 2. Some RPC requests should be forw

[ANNOUNCE] New Hadoop Committer - Haiyang Hu

2024-04-21 Thread Xiaoqiao He
I am pleased to announce that Haiyang Hu has been elected as a committer on the Apache Hadoop project. We appreciate all of Haiyang's work, and look forward to her/his continued contributions. Congratulations and Welcome, Haiyang! Best Regards, - He Xiaoqiao (On behalf of the Apache Hadoop PMC)

[jira] [Resolved] (HADOOP-19060) Support hadoop client authentication through keytab configuration.

2024-03-26 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-19060. -- Resolution: Won't Fix > Support hadoop client authentication through keytab confi

[jira] [Resolved] (HADOOP-19111) ipc client print client info message duplicate

2024-03-24 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-19111. -- Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > ipc client pr

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

2024-03-13 Thread Xiaoqiao He
root root 2739952 Sep 19 13:09 >> /usr/lib/aarch64-linux-gnu/libcrypto.so.1.1 >> -rw-r--r-- 1 root root 4466856 Oct 27 13:40 >> /usr/lib/aarch64-linux-gnu/libcrypto.so.3 >> >> Anyone got any insights on how I should set up this (debian-based) OS >> here? >>

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

2024-03-11 Thread Xiaoqiao He
x27;ve > > verified they are good. > > > > Oh, and I've also got my raspberry p5 doing the download of the arm > > stuff for its checknative; not expecting problems. > > > > So: i've got some stuff still ongoing, but the core changes to packaging > &g

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

2024-03-11 Thread Xiaoqiao He
fixed in HADOOP-19057 > <https://issues.apache.org/jira/browse/HADOOP-19057>. > > -- > *From:* slfan1989 > *Sent:* Monday, March 4, 2024 10:07:05 PM > *To:* Hadoop Common; Hdfs-dev; yarn-dev; mapreduce-dev; < > priv...@hadoop.apache.org>

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

2024-03-06 Thread Xiaoqiao He
cc @Chao Sun @zhang...@apache.org @Ayush Saxena Would you mind helping to check the upstream systems(Spark, HBase, Hive) dependency with the new hadoop release version if necessary? Thanks. Best Regards, - He Xiaoqiao On Thu, Mar 7, 2024 at 10:23 AM Xiaoqiao He wrote: > Shilun, Thanks

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

2024-03-06 Thread Xiaoqiao He
Shilun, Thanks for your great work. I am checking but not finished yet. Will confirm once done. Best Regards, - He Xiaoqiao On Thu, Mar 7, 2024 at 7:23 AM slfan1989 wrote: > @Xiaoqiao He @Ayush Saxena > @Steve > Loughran @Mukund Madhav Thakur > @Takanobu > Asanuma @M

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC2)

2024-02-29 Thread Xiaoqiao He
files and run some test with it; this caught some >>> problems >>> > >> with exported slf4j and log4j2 artifacts getting into the >>> classpath. That >>> > >> is: hadoop-common pulling in log4j 1.2 and 2.x bindings. >>> > >> &g

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 (RC1)

2024-02-05 Thread Xiaoqiao He
cc @PJ Fanning @Ayush Saxena @Steve Loughran @Takanobu Asanuma @Shuyan Zhang @inigo...@apache.org On Mon, Feb 5, 2024 at 11:30 AM Xiaoqiao He wrote: > +1(binding). > > I checked the following items: > - [X] Download links are valid. > - [X] Checksums and PGP signatures ar

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 (RC1)

2024-02-04 Thread Xiaoqiao He
10:29 PM slfan1989 wrote: > Hi folks, > > Xiaoqiao He and I have put together a release candidate (RC1) for Hadoop > Thirdparty 1.2.0. > > The RC is available at: > https://dist.apache.org/repos/dist/dev/hadoop/hadoop-thirdparty-1.2.0-RC1 > > The RC tag is > ht

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 RC0

2024-02-01 Thread Xiaoqiao He
ds, > Shilun Fan. > > On Tue, Jan 30, 2024 at 6:20 PM Xiaoqiao He wrote: > > > Thanks Shilun for driving it and making it happen. > > > > +1(binding). > > > > [x] Checksums and PGP signatures are valid. > > [x] LICENSE files exist. > > [x] NOTICE

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 RC0

2024-01-31 Thread Xiaoqiao He
gt; > Best Regards, > > Shilun Fan. > > > > On Tue, Jan 30, 2024 at 6:20 PM Xiaoqiao He > wrote: > > > > > Thanks Shilun for driving it and making it happen. > > > > > > +1(binding). > > > > > > [x] Checksums and PGP sig

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 RC0

2024-01-30 Thread Xiaoqiao He
wrote: > Hi folks, > > Xiaoqiao He and I have put together a release candidate (RC0) for Hadoop > Thirdparty 1.2.0. > > The RC is available at: > https://dist.apache.org/repos/dist/dev/hadoop/hadoop-thirdparty-1.2.0-RC0 > > The RC tag is > https://github.com/apache/

Re: [INFO] Hadoop-3.4 Release Update

2024-01-24 Thread Xiaoqiao He
Mon, 22 Jan 2024 at 11:50 AM, slfan1989 wrote: > > > >> Thank you very much for specifying the frozen time for the > >> Branch-3.4.0. @Xiaoqiao > >> He > >> > >> If there is a need to backport any PRs to branch-3.4/branch-3.4.0, > please &

Re: [INFO] Hadoop-3.4 Release Update

2024-01-21 Thread Xiaoqiao He
gt; > Best > > On Mon, Jan 22, 2024 at 10:38 AM Xiaoqiao He > wrote: > >> Thanks all for your input. Connected to Shilun offline yesterday, and he >> will >> update or recover the fix version tag before 3.4.0-RC1. >> >> Best Regards, >> - He Xiao

Re: [INFO] Hadoop-3.4 Release Update

2024-01-21 Thread Xiaoqiao He
se versions have been released, > remove > > > the 3.4.0 entry from the fix version. > > > > > > 3. For JIRA issues with target version set to 3.4.0, fix version set to > > > 3.4.0, and status set to > > > RESOLVED, if Affects Ve

[INFO] Hadoop-3.4 Release Update

2024-01-18 Thread Xiaoqiao He
Hi All, Branch trunk has been set to 3.5.0-SNAPSHOT and branch-3.4 is created[1]. Please set the proper fix version while committing jira, 3.5.0 should be priority. If there is any blocker/critical please also backport to branch-3.4 or sync to me or RM Shilun Fan. Shilun will start 3.4.0 RC1 vot

Re: [VOTE] Release Apache Hadoop 3.4.0 RC0

2024-01-16 Thread Xiaoqiao He
Hi Shilun, Thanks for your great work! Compare branch-3.4 and branch-3.4.0, I found that commit [1] is only checked in branch-3.4.0 but not branch-3.4. Please double check if we need to backport branch-3.4. Moreover, before 3.4.0 release we should cherry-pick from trunk to branch-3.4 first if ne

[jira] [Resolved] (HADOOP-19031) Enhance access control for RunJar

2024-01-16 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-19031. -- Fix Version/s: 3.4.0 3.5.0 Hadoop Flags: Reviewed Resolution

[jira] [Resolved] (HADOOP-19034) Fix Download Maven Url Not Found

2024-01-14 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-19034. -- Fix Version/s: 3.4.0 3.5.0 Hadoop Flags: Reviewed Resolution

[jira] [Created] (HADOOP-19031) Enhance access control for RunJar

2024-01-09 Thread Xiaoqiao He (Jira)
Xiaoqiao He created HADOOP-19031: Summary: Enhance access control for RunJar Key: HADOOP-19031 URL: https://issues.apache.org/jira/browse/HADOOP-19031 Project: Hadoop Common Issue Type

Re: [DISCUSS] Release Hadoop 3.4.0

2024-01-03 Thread Xiaoqiao He
> > I think the release discussion can be in public ML? Good idea. cc common-dev/hdfs-dev/yarn-dev/mapreduce-dev ML. Best Regards, - He Xiaoqiao On Tue, Jan 2, 2024 at 6:18 AM Ayush Saxena wrote: > +1 from me as well. > > We should definitely attempt to upgrade the thirdparty version for > 3.

Re: [VOTE] Hadoop 3.2.x EOL

2023-12-21 Thread Xiaoqiao He
Hi All, JIRA/WIKI/Website has been updated. Release line 3.2 is EOL now. Thanks all. Best Regards, - He Xiaoqiao On Tue, Dec 19, 2023 at 11:58 AM Xiaoqiao He wrote: > This vote passed with 10 +1. I'll update the JIRA, WIKI and website for a > while. > > Thanks all for y

Re: [DISCUSS][HDFS] Add rust binding for libhdfs

2023-12-20 Thread Xiaoqiao He
Thanks Xuanwo for your work. I believe it is valuable to enlarge hadoop ecosystem. I am also concerned that it will involve more hard work to release and version match, especially for one who is not familiar with C or Rust. Moreover, I am not aware the difference between `accept hdfs-sys as part o

Re: [VOTE] Hadoop 3.2.x EOL

2023-12-18 Thread Xiaoqiao He
; >> On Wed, Dec 6, 2023 at 8:39 AM Akira Ajisaka wrote: >> > >> > +1 >> > >> > >> > >> > On Wed, Dec 6, 2023 at 1:10 PM Xiaoqiao He wrote: >> > >> > > Dear Hadoop devs, >> > > >> > > Given the

[jira] [Resolved] (HADOOP-18982) Fix doc about loading native libraries

2023-12-06 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-18982. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Fix doc ab

[VOTE] Hadoop 3.2.x EOL

2023-12-05 Thread Xiaoqiao He
Dear Hadoop devs, Given the feedback from the discussion thread [1], I'd like to start an official thread for the community to vote on release line 3.2 EOL. It will include, a. An official announcement informs no further regular Hadoop 3.2.x releases. b. Issues which target 3.2.5 will not be fixe

Re: [DISCUSS] Make some release lines EOL

2023-12-05 Thread Xiaoqiao He
ease, as there's a clear story: we have a > > new 3.4.x line stabilising, if you want something already stable move > onto > > 3.3.x if you hadn't already > > > > > > > > > > > > On Mon, 4 Dec 2023 at 12:39, Xiaoqiao He wrote: > > &g

Re: [DISCUSS] Make some release lines EOL

2023-12-04 Thread Xiaoqiao He
> > -Ayush > > On Mon, 4 Dec 2023 at 18:09, Xiaoqiao He wrote: > > > > Hi folks, > > > > There are many discussions about which release lines should we still > > consider actively > > maintained in history. I want to launch this topic again, and

[DISCUSS] Make some release lines EOL

2023-12-04 Thread Xiaoqiao He
Hi folks, There are many discussions about which release lines should we still consider actively maintained in history. I want to launch this topic again, and try to get a consensus. >From download page[1] and active branches page[2], we have the following release lines: Hadoop 3.3 Release (relea

Re: [DISCUSS] Hadoop 3.4.0 release

2023-12-03 Thread Xiaoqiao He
Thanks Ahmar for starting this thread. Strong +1 to have 3.4.0 from trunk rather than from 3.3.*. We should keep release line clear, and it's not standard operation to cut a branch from another line. Let's move the trunk to 3.5.0-SNAPSHOT when we come to an agreement at this thread. About this rel

[ANNOUNCE] New Hadoop PMC Member - Shilun Fan

2023-10-31 Thread Xiaoqiao He
On behalf of the Apache Hadoop PMC, I am pleased to announce that Shilun Fan(slfan1989) has accepted the PMC's invitation to become PMC member on the project. We appreciate all of Shilun's generous contributions thus far and look forward to his continued involvement. Congratulations and welcome, S

[jira] [Resolved] (HADOOP-18943) Fix trademark description issue of Apache on website

2023-10-18 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-18943. -- Hadoop Flags: Reviewed Resolution: Fixed > Fix trademark description issue of Apa

[jira] [Created] (HADOOP-18943) Fix trademark description issue of Apache on website

2023-10-18 Thread Xiaoqiao He (Jira)
Xiaoqiao He created HADOOP-18943: Summary: Fix trademark description issue of Apache on website Key: HADOOP-18943 URL: https://issues.apache.org/jira/browse/HADOOP-18943 Project: Hadoop Common

[ANNOUNCE] New Hadoop Committer - Shuyan Zhang

2023-09-26 Thread Xiaoqiao He
I am pleased to announce that Shuyan Zhang has been elected as a committer on the Apache Hadoop project. We appreciate all of Shuyan's work, and look forward to her/his continued contributions. Congratulations and Welcome, Shuyan! Best Regards, - He Xiaoqiao (On behalf of the Apache Hadoop PMC)

[jira] [Resolved] (HADOOP-18906) Increase default batch size of ZKDTSM token seqnum to reduce overflow speed of zonde dataVersion.

2023-09-18 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-18906. -- Fix Version/s: 3.4.0 3.3.9 Hadoop Flags: Reviewed Resolution

[jira] [Created] (HADOOP-18906) Increase default batch size of ZKDTSM token seqnum to reduce overflow speed of zonde dataVersion.

2023-09-17 Thread Xiaoqiao He (Jira)
Xiaoqiao He created HADOOP-18906: Summary: Increase default batch size of ZKDTSM token seqnum to reduce overflow speed of zonde dataVersion. Key: HADOOP-18906 URL: https://issues.apache.org/jira/browse/HADOOP

[jira] [Resolved] (HADOOP-18851) Performance improvement for DelegationTokenSecretManager.

2023-09-14 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-18851. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Performa

[jira] [Created] (HADOOP-18881) ZKDTSM could be stuck when meet znode version overflow

2023-09-03 Thread Xiaoqiao He (Jira)
Xiaoqiao He created HADOOP-18881: Summary: ZKDTSM could be stuck when meet znode version overflow Key: HADOOP-18881 URL: https://issues.apache.org/jira/browse/HADOOP-18881 Project: Hadoop Common

[jira] [Resolved] (HADOOP-18840) Add enQueue time to RpcMetrics

2023-08-09 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-18840. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Add enQueue t

[jira] [Resolved] (HADOOP-18801) Delete path directly when it can not be parsed in trash

2023-07-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-18801. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Delete p

[jira] [Resolved] (HADOOP-18789) Remove ozone from hadoop dev support

2023-07-02 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-18789. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Remove oz

[jira] [Created] (HADOOP-18789) Remove ozone from hadoop dev support

2023-06-30 Thread Xiaoqiao He (Jira)
Xiaoqiao He created HADOOP-18789: Summary: Remove ozone from hadoop dev support Key: HADOOP-18789 URL: https://issues.apache.org/jira/browse/HADOOP-18789 Project: Hadoop Common Issue Type

Re: [VOTE] Release Apache Hadoop 3.3.6 RC1

2023-06-23 Thread Xiaoqiao He
+1(binding) * Verified signature and checksum of all source tarballs. * Built source code on Ubuntu and OpenJDK 11 by `mvn clean package -DskipTests -Pnative -Pdist -Dtar`. * Setup pseudo cluster with HDFS and YARN. * Run simple FsShell - mkdir/put/get/mv/rm and check the result. * Run example mr

Re: [VOTE] Release Apache Hadoop 3.3.6 RC1

2023-06-21 Thread Xiaoqiao He
Addendum: A. Build the release from sources using: `mvn clean install package -DskipTests=true -Dmaven.javadoc.skip=true` B. It works well when using the same command to build from the source branch trunk. On Wed, Jun 21, 2023 at 8:44 PM Xiaoqiao He wrote: > Hi, > > I met a fatal e

Re: [VOTE] Release Apache Hadoop 3.3.6 RC1

2023-06-21 Thread Xiaoqiao He
Hi, I met a fatal error when building from source on local Mac OSX. It could reproduce stably. Not sure if it is related to my local environment. Try to dig it, but not any conclusion right now. Will feedback once find reasons. Appendix system environment, some more stack information refer to the

[jira] [Resolved] (HADOOP-18774) Add .vscode to gitignore

2023-06-17 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-18774. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Add .vscode

[jira] [Created] (HADOOP-18774) Add .vscode to gitignore

2023-06-17 Thread Xiaoqiao He (Jira)
Xiaoqiao He created HADOOP-18774: Summary: Add .vscode to gitignore Key: HADOOP-18774 URL: https://issues.apache.org/jira/browse/HADOOP-18774 Project: Hadoop Common Issue Type: Improvement

Re: [VOTE] Release Apache Hadoop 3.3.6 RC0

2023-06-17 Thread Xiaoqiao He
Thanks Wei-Chiu for driving this release. The next RC will be prepared, right? If true, I would like to try and vote on the next RC. Just notice that some JIRAs are not included and need to revert some PRs to pass HBase verification which are mentioned above. Best Regards, - He Xiaoqiao On Fri,

Re: [DISCUSS] Hadoop 3.3.6 release planning

2023-05-04 Thread Xiaoqiao He
Thanks Wei-Chiu for driving this release. Cherry-pick YARN-11482 to branch-3.3 and mark 3.3.6 as the fixed version. so far only 8 jiras were resolved in the branch-3.3 line. If we should consider both 3.3.6 and 3.3.9 (which is from release-3.3.5 discuss)[1] for this release line? I try to query

[jira] [Resolved] (HADOOP-18644) Add bswap support for LoongArch

2023-03-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-18644. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Add bs

Re: [VOTE] Release Apache Hadoop 3.3.5 (RC3)

2023-03-20 Thread Xiaoqiao He
+1 * Verified signature and checksum of the source tarball. * Built the source code on Ubuntu and OpenJDK 11 by `mvn clean package -DskipTests -Pnative -Pdist -Dtar`. * Setup pseudo cluster with HDFS and YARN. * Run simple FsShell - mkdir/put/get/mv/rm (include EC) and check the result. * Run exam

[jira] [Resolved] (HADOOP-18497) Upgrade commons-text version to fix CVE-2022-42889

2022-10-17 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-18497. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Assignee: PJ Fanning (was

[jira] [Resolved] (HADOOP-18492) upgrade commons-text to 1.10.0

2022-10-17 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-18492. -- Resolution: Duplicate > upgrade commons-text to 1.1

[jira] [Resolved] (HADOOP-18462) InstrumentedWriteLock should consider Reentrant case

2022-10-16 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-18462. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed

[jira] [Created] (HADOOP-18497) Upgrade commons-text version to fix CVE-2022-42889

2022-10-16 Thread Xiaoqiao He (Jira)
Xiaoqiao He created HADOOP-18497: Summary: Upgrade commons-text version to fix CVE-2022-42889 Key: HADOOP-18497 URL: https://issues.apache.org/jira/browse/HADOOP-18497 Project: Hadoop Common

[jira] [Resolved] (HADOOP-18426) Improve the accuracy of MutableStat mean

2022-09-06 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-18426. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Improve

[jira] [Resolved] (HADOOP-18364) All method metrics related to the RPC protocol should be initialized

2022-08-03 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-18364. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk

Hadoop community online meetup (Mandarin)

2022-06-20 Thread Xiaoqiao He
Hi Hadoop folks, We am happy to inform you that we will have Dongfa Huang from ByteDance who is going to talk about their experience of extending NameNode of HDFS at ByteDance. This will be a Mandarin talk. Time/Date: 2022/06/22 10PM (US West Coast PST) 2022/06/23 1PM (Beijing, China CST) Join

Re: [VOTE] Release Apache Hadoop 3.3.3 (RC1)

2022-05-15 Thread Xiaoqiao He
+1(binding) * Verified signature and checksum of the source tarball. * Built the source code on Ubuntu and OpenJDK 11 by `mvn clean package -DskipTests -Pnative -Pdist -Dtar`. * Setup pseudo cluster with HDFS and YARN. * Run simple FsShell - mkdir/put/get/mv/rm and check the result. * Run example

Re: [DISCUSS] Hadoop 2.10.2 release

2022-05-11 Thread Xiaoqiao He
Thanks Masatake and Akira for bringing this release up. +1 for 2.10.2 release. Sorry for the late response. Regards, - He Xiaoqiao On Mon, Mar 14, 2022 at 1:17 PM Akira Ajisaka wrote: > > Thank you Masatake. > > +1 to release 2.10.2. > > On Fri, Mar 4, 2022 at 6:52 PM Masatake Iwasaki > wrote:

Re: [VOTE] Release Apache Hadoop 3.2.3 - RC1

2022-03-20 Thread Xiaoqiao He
+1(binding) * Verified signature and checksum of the source tarball. * Built the source code on Ubuntu and OpenJDK 11 by `mvn clean package -DskipTests -Pnative -Pdist -Dtar`. * Setup pseudo cluster with HDFS and YARN. * Run simple FsShell - mkdir/put/get/mv/rm and check the result. * Run example

Re: Hadoop-3.2.3 Release Update

2022-03-11 Thread Xiaoqiao He
.2.3 just for reload4j migration if we > need. > https://issues.apache.org/jira/browse/HADOOP-18088 > > Thanks, > Masatake Iwasaki > > On 2022/03/10 12:23, Xiaoqiao He wrote: > > Thanks Masatake for reaching out. > > > > Not sure if Brahma has bandwidth

Re: Hadoop-3.2.3 Release Update

2022-03-09 Thread Xiaoqiao He
t; > >>> I am evaluating the CVE’s which needs to go for this release.. > >>> > >>> Will update soon!! > >>> > >>> > >>> On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka > >> wrote: > >>> > >>>> Hi Brahm

Re: [ANNOUNCE] New Hadoop PMC Sun Chao

2022-03-08 Thread Xiaoqiao He
Congratulations, Sun Chao! Best Regards, - He Xiaoqiao On Wed, Mar 9, 2022 at 1:06 PM tom lee wrote: > Congratulations, Sun!👍 > > Wei-Chiu Chuang 于2022年3月9日周三 11:47写道: > > > On behalf of the Apache Hadoop PMC, I am pleased to announce that Sun > > Chao(sunchao) has accepted the PMC's invitatio

Re: [ANNOUNCE] Apache Hadoop 3.3.2 release

2022-03-06 Thread Xiaoqiao He
nt and 3.3.2 showed up in the list under the > > "Documentation" tab. > > > > In https://hadoop.apache.org, under the "Documentation" tab, the > > "Latest" and "Stable" are already updated to 3.3.2, but somehow the > > announcement is

Re: [ANNOUNCE] Apache Hadoop 3.3.2 release

2022-03-05 Thread Xiaoqiao He
the release, and everyone in > the > > Apache Hadoop community! This release is a direct result of your great > > contributions. > > > > Many thanks to everyone who helped in this release process! > > > > Many thanks to Viraj Jasani, Michael Stack, Masatake Iwasaki, Xiaoqiao > He, > > Mukund Madhav Thakur, Wei-Chiu Chuang, Steve Loughran, Akira Ajisaka and > > other folks who helped for this release process. > > > > Best Regards, > > Chao > > >

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC5

2022-02-23 Thread Xiaoqiao He
+1(binding) * Built on CentOS 8 and OpenJDK 8 by `mvn clean package -DskipTests -Pnative -Pdist -Dtar` from source. * Verified signature and checksums. * Setup pseudo cluster with HDFS and YARN. * Run simple FsShell - mkdir/put/get/mv/rm. * Submit example mr applications and check the result - Pi

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4

2022-02-21 Thread Xiaoqiao He
Thanks Chao for your great work and thanks Viraj's careful checks here. After checking to build from source and setting up a pseudo cluster based on the RC4, it seems that it is almost ready for release-3.3.2 beside update changelog, right? Please feel free to share information if you meet any bloc

  1   2   >