Re: [ANNOUNCE] Apache Hadoop 3.4.1 release

2025-04-08 Thread Ayush Saxena
directly won't work as I think it will break > > again > > > during the next release as the new files will be generated. > > > > > > [1] https://hadoop.apache.org/release/3.3.4.html > > > [2] > > > > > https://github.com/apache/hadoop-site/c

[jira] [Resolved] (HADOOP-19225) Upgrade to 9.4.57.v20241219 due to CVE-2024-8184

2025-04-05 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-19225. --- Fix Version/s: 3.5.0 Resolution: Fixed > Upgrade to 9.4.57.v20241219 due to

Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0

2025-03-21 Thread Ayush Saxena
+1 (Binding) * Built from source * Verified checksums * Verified Signature * Verified no diff b/w branch-1.4 & src tar [1] * Skimmed over the contents of ReleaseNotes & ChangeLog * Checked the NOTICE & LICENSE files Thanx Steve for driving the release. Good Luck!!! -Ayush [1] I think releas

Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0

2025-03-20 Thread Ayush Saxena
I did try everything, no problem with the keys or so. -Ayush On Thu, 20 Mar 2025 at 23:21, Steve Loughran wrote: > thanks. will kick off a new build. > > Did anyone else see problems with the gpg versions? > > I destroyed the entire .gpgconf dir on the host i was building on; did > manual verif

Re: hadoop thirdparty 1.4.0

2025-03-15 Thread Ayush Saxena
I believe it should be 1.4.0. We only did a x.x.1 kind of release once, when we couldn't release 1.1.0 [1] in the Hadoop 3.3.1 RC1 due to some issues. Instead, we issued 1.1.1 [2], which was ultimately used in 3.3.1. However, I can't exactly recall what was the issue which led to 1.1.1, but I think

Fwd: Community Over Code Asia Travel Assistance Applications now open!

2025-03-04 Thread Ayush Saxena
forwarded as requested -Ayush -- Forwarded message - From: Gavin McDonald Date: Tue, 4 Mar 2025 at 16:35 Subject: Community Over Code Asia Travel Assistance Applications now open! To: Apache Travel Assistance Committee --- The Travel Assistance Committee (TAC) are pleased to ann

[jira] [Resolved] (HADOOP-19305) Fix ProcessEnvironment ClassCastException in Shell.java

2025-03-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-19305. --- Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed >

Re: [DISCUSS] Hadoop 3.4.2 release

2025-03-01 Thread Ayush Saxena
+1, thanx Ahmar for driving it. I plan to c-pick YARN-11738 to branch-3.4, if folks are ok with it, that is need by Tez, or atleast makes life easier there -Ayush On Sun, 2 Mar 2025 at 01:30, Chao Sun wrote: > +1, thanks Ahmar! > > On Fri, Feb 28, 2025 at 7:21 AM larry mccay wrote: > > > +1 >

Re: [VOTE] Request to merge branch HDFS-17531 into trunk.

2025-02-13 Thread Ayush Saxena
+1 -Ayush > On 14 Feb 2025, at 1:20 PM, Hui Fei wrote: > > Did some test work referring to the documentation. > > - Compiled source codes, built a local cluster and the async feature > worked fine. > - it is disabled by default > - can increase or decrease the thread number by changin

Re: Apache Hadoop 3.4.1 docs landing page

2025-01-27 Thread Ayush Saxena
Hi Chris, This page requires a manual update before the release. an update was made for the 3.4.1 release in this commit [1], Not sure why the older links weren't removed though. In case you want to explore more, you can check how it was handled for the 3.4.0 release in HADOOP-19039. The process i

Re: Error while running notifications feature from refs/heads/trunk:.asf.yaml in hadoop!

2025-01-27 Thread Ayush Saxena
Some indent issue in the yaml file. Haven't spent time on it, but maybe changing the indentation like in [1] may fix it Not sure what triggered it all of sudden [1] https://github.com/apache/commons-bsf/pull/206 -Ayush On Mon, 27 Jan 2025 at 17:32, Steve Loughran wrote: > Not sure why I g

[jira] [Resolved] (HADOOP-19397) Update LICENSE-binary with jersey 2 details

2025-01-25 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-19397. --- Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > Update LICE

[jira] [Resolved] (HADOOP-19380) Update the year to 2025

2025-01-01 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-19380. --- Fix Version/s: 2.10.3 3.3.9 3.5.0

[jira] [Created] (HADOOP-19380) Update the year to 2025

2024-12-31 Thread Ayush Saxena (Jira)
Ayush Saxena created HADOOP-19380: - Summary: Update the year to 2025 Key: HADOOP-19380 URL: https://issues.apache.org/jira/browse/HADOOP-19380 Project: Hadoop Common Issue Type: Task

[jira] [Resolved] (HADOOP-19335) Bump netty to 4.1.116 due to CVE-2024-47535

2024-12-25 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-19335. --- Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > Bump netty

Re: [ANNOUNCE] Apache Hadoop 3.4.1 release

2024-11-05 Thread Ayush Saxena
ow+to+generate+and+push+ASF+web+site > > On Tue, Nov 5, 2024 at 12:26 PM Ayush Saxena wrote: >> >> Hi Mukund, >> I think your commit broke the website, you have changed the references >> to hadoop.apache.org in the website to localhost [1], try clicking on >> Rel

Re: [ANNOUNCE] Apache Hadoop 3.4.1 release

2024-11-05 Thread Ayush Saxena
Hi Mukund, I think your commit broke the website, you have changed the references to hadoop.apache.org in the website to localhost [1], try clicking on Release 3.4.1 available here [2] or any other link & it will lead to resolve to some link with localhost. And Hadoop logo also went missing on the

Re: [VOTE] Release Apache Hadoop 3.4.1 RC3

2024-10-18 Thread Ayush Saxena
Steve during 3.4.0. Also the link to this is present in [1] . > There was a discussion around this during the RC2 testing. > > I will check with Steve on why we don't have the equivalent for aarch64. > > [1] https://cwiki.apache.org/confluence/display/HADOOP2/HowToRelease >

Re: [VOTE] Release Apache Hadoop 3.4.1 RC3

2024-10-17 Thread Ayush Saxena
What exactly is this "lean tar"? I couldn’t find any mention of it in [1], nor did I come across any thread establishing consensus on adding it, as we did for the aarch64 tar. It’s also not clear to me from the create-release script how it is getting generated. So, where is this coming from? Additi

[jira] [Resolved] (HADOOP-19290) Operating on / in ChecksumFileSystem throws NPE

2024-09-28 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-19290. --- Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > Operating

[jira] [Created] (HADOOP-19290) Operating on / in ChecksumFileSystem throws NPE

2024-09-27 Thread Ayush Saxena (Jira)
Ayush Saxena created HADOOP-19290: - Summary: Operating on / in ChecksumFileSystem throws NPE Key: HADOOP-19290 URL: https://issues.apache.org/jira/browse/HADOOP-19290 Project: Hadoop Common

[jira] [Resolved] (HADOOP-19165) Explore dropping protobuf 2.5.0 from the distro

2024-09-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-19165. --- Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Release Note: Any build against the

[jira] [Resolved] (HADOOP-19164) Hadoop CLI MiniCluster is broken

2024-09-21 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-19164. --- Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > Hadoop

[jira] [Resolved] (HADOOP-19262) [JDK17] Upgade wildfly-openssl:1.1.3.Final to 2.1.4.Final+

2024-09-13 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-19262. --- Fix Version/s: 3.5.0 3.4.2 Resolution: Fixed > [JDK17] Upg

Re: [VOTE] Release Apache Hadoop Thirdparty 1.3.0

2024-08-23 Thread Ayush Saxena
+1 (Binding) * Built from source * Verified Signature(Signed by Mukund) * Verified Checksums * No diff b/w the git tag & src tar * Verified the NOTICE & LICENSE files * Skimmed over the contents of the site jar * Built Hadoop trunk with 1.3.0 version * Checked the hadoop test results here [1], not

[jira] [Resolved] (HADOOP-18786) Hadoop build depends on archives.apache.org

2024-08-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18786. --- Resolution: Fixed > Hadoop build depends on archives.apache.

[jira] [Resolved] (HADOOP-17994) when exporting table from mysql to hive using Sqoop it gets stuck

2024-08-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-17994. --- Resolution: Not A Bug > when exporting table from mysql to hive using Sqoop it gets st

[jira] [Resolved] (HADOOP-19134) Use StringBuilder instead of StringBuffer

2024-08-18 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-19134. --- Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed >

[jira] [Resolved] (HADOOP-19237) upgrade dnsjava to 3.6.0 due to CVEs

2024-08-02 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-19237. --- Fix Version/s: 3.5.0 3.4.1 Hadoop Flags: Reviewed Assignee

Re: [DISCUSS] what needs to be done to switch to java17

2024-07-30 Thread Ayush Saxena
> One thing I know is that it is necessary to upgrade JUnit 4 to JUnit 5 Do you know any specific reason or docs mentioning that? Just curious as to why we need to migrate to JUnit 5 for JDK-17, Looking here [1], it seems like it supports JDK-21 as well and even [2] mentions like it does support

Re: [DISCUSS] what needs to be done to switch to java17

2024-07-29 Thread Ayush Saxena
Depends on what we mean by switching to JDK-17, Compile time support or Runtime support, We don't have compile time support for JDK-11 too, it is just runtime, We have a daily build as well for JDK-11, which has now some genuine failures now, need to check [1], as of now the version is hardcoded he

Re: Need help with gpg signing while creating 3.4.1 release using MacOS M3

2024-07-25 Thread Ayush Saxena
Hi Mukund, If I remember correctly, there were some issues with the create-release for Arm, but after some changes it worked on branch-3, but I think the changes were done only on branch-3, maybe because some changes were already present on trunk. You check this PR [1], if it has anything relevant

[jira] [Resolved] (HADOOP-19216) Upgrade Guice from 4.0 to 5.1.0 to support Java 17

2024-07-06 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-19216. --- Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > Upgrade Gu

[jira] [Resolved] (HADOOP-19215) Fix unit tests testSlowConnection and testBadSetup failed in TestRPC

2024-07-04 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-19215. --- Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > Fix unit te

Re: [DISCUSS] pruning surplus branches/tags from the main hadoop repo

2024-05-29 Thread Ayush Saxena
+1 for the proposal, the first thing might be to just drop the unnecessary branches which are either from dependabot or someone accidentally created a branch in the main repo rather than in their fork, there are many, I don't think we need them in the archived repo either Regarding (3) If you mean

Re: [Discuss] RBF: Aynchronous router RPC.

2024-05-28 Thread Ayush Saxena
turn standby exception to allow the client to retry other routers > (RouterRpcFairnessPolicyController mechanism). > > Thank you again! > zhangjian > >> 2024年5月29日 07:05,Ayush Saxena 写道: >> Thanx folks, I had a very quick pass on the PDF and it looks good. >> Ma

Re: [Discuss] RBF: Aynchronous router RPC.

2024-05-28 Thread Ayush Saxena
the synchronous router. >>> 2. Asynchronous router can apply pressure downstream to better utilize the >>> performance of downstream ns, and can almost fill the call queue of >>> downstream ns. >>> >>> Due to the large size of the test result

[jira] [Resolved] (HADOOP-13147) Constructors must not call overrideable methods in PureJavaCrc32C

2024-05-20 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-13147. --- Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > Construct

Re: Hadoop Windows Build

2024-05-14 Thread Ayush Saxena
Hi Gautham, I think this Windows build has some issues, first is for hadoop-common maven site is failing [1] & second it is very confusing for most of the folks, the results from Windows build looks same as the normal build, unless you check inside that it was a Windows run and it doesn't run tests

[jira] [Created] (HADOOP-19166) [DOC] Drop Migrating from Apache Hadoop 1.x to Apache Hadoop 2.x

2024-05-07 Thread Ayush Saxena (Jira)
Ayush Saxena created HADOOP-19166: - Summary: [DOC] Drop Migrating from Apache Hadoop 1.x to Apache Hadoop 2.x Key: HADOOP-19166 URL: https://issues.apache.org/jira/browse/HADOOP-19166 Project: Hadoop

[jira] [Created] (HADOOP-19165) Explore dropping protobuf 2.5.0 from the distro

2024-05-07 Thread Ayush Saxena (Jira)
Ayush Saxena created HADOOP-19165: - Summary: Explore dropping protobuf 2.5.0 from the distro Key: HADOOP-19165 URL: https://issues.apache.org/jira/browse/HADOOP-19165 Project: Hadoop Common

[jira] [Created] (HADOOP-19164) Hadoop CLI MiniCluster is broken

2024-05-03 Thread Ayush Saxena (Jira)
Ayush Saxena created HADOOP-19164: - Summary: Hadoop CLI MiniCluster is broken Key: HADOOP-19164 URL: https://issues.apache.org/jira/browse/HADOOP-19164 Project: Hadoop Common Issue Type: Bug

Re: whatever happened to python3 from our yetus runs?

2024-05-02 Thread Ayush Saxena
Hi Steve, I think you are talking about the maven site failing right? The logs here [1] (read the link, it has windows) Check the very first few lines & the answer is there :-) ``` [INFO] [INFO] Detecting the operating syste

Re: Hadoop Windows Build

2024-04-29 Thread Ayush Saxena
1 Gautham Banasandra wrote: > > Yeah, I just noticed that. May I know how I can abort all the jobs at > once? I only saw that I > > can cancel the jobs one-by-one. > > > > Thanks, > > --Gautham > > > > On 2024/04/28 15:19:13 Ayush Saxena wrote: > > &

Re: Hadoop Windows Build

2024-04-28 Thread Ayush Saxena
his caused a starvation of the Windows nodes for other projects. > > I had reached out to the infra team several months ago and requested them > to add more > Windows nodes, but it was turned down. I'm not sure if there's a way > around this, other than > getting more Wi

Re: Hadoop Windows Build

2024-04-27 Thread Ayush Saxena
Found this on dev@hadoop -> Moving to common-dev (the ML we use) I think there was some initiative to enable Windows Pre-Commit for every PR and that seems to have gone wild, either the number of PRs raised are way more than the capacity the nodes can handle or something got misconfigured in the j

[jira] [Resolved] (HADOOP-19107) Drop support for HBase v1

2024-04-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-19107. --- Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > Drop supp

Re: [ANNOUNCE] New Hadoop Committer - Haiyang Hu

2024-04-21 Thread Ayush Saxena
Congratulations Haiyang!!! -Ayush > On 22 Apr 2024, at 9:41 AM, Xiaoqiao He wrote: > > I am pleased to announce that Haiyang Hu has been elected as > a committer on the Apache Hadoop project. We appreciate all of > Haiyang's work, and look forward to her/his continued contributions. > > Congr

[jira] [Resolved] (HADOOP-19130) FTPFileSystem rename with full qualified path broken

2024-04-17 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-19130. --- Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > FTPFileSys

Re: Recommended way of using hadoop-minicluster für unit testing?

2024-04-12 Thread Ayush Saxena
pi instead of minicluster). > > Gruß & Thx > Richard > > [1] https://github.com/apache/storm/pull/3637 > [2] > https://github.com/apache/storm/blob/e44f72767370d10a682446f8f36b75242040f675/external/storm-hdfs/pom.xml#L120 > > On 2024/04/11 21:29:13 Ayush Saxena wrote: &

[jira] [Resolved] (HADOOP-19123) Update commons-configuration2 to 2.10.1 due to CVE

2024-04-02 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-19123. --- Fix Version/s: 3.5.0 3.4.1 Hadoop Flags: Reviewed Resolution

[jira] [Resolved] (HADOOP-19077) Remove use of javax.ws.rs.core.HttpHeaders

2024-04-01 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-19077. --- Fix Version/s: 3.4.1 Hadoop Flags: Reviewed Resolution: Fixed > Remove use

[jira] [Resolved] (HADOOP-19024) Use bouncycastle jdk18 1.77

2024-03-30 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-19024. --- Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed >

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

2024-03-13 Thread Ayush Saxena
> Counter should be with yourself vote, where the current summary is 5 +1 binding and 1 +1 non-binding. Let's re-count when deadline. Just on the process: The release manager needs to "explicitly" vote like any other before counting their own vote, there has been a lot of discussions around that

Re: HDFS test builds always fails

2024-03-12 Thread Ayush Saxena
We are sorted now: the daily build from yesterday [1] shows 0 test failures [1] https://ci-hadoop.apache.org/view/Hadoop/job/hadoop-qbt-trunk-java8-linux-x86_64/1525/ -Ayush On Tue, 5 Mar 2024 at 17:03, Ayush Saxena wrote: > Hi, > We have a PR [1] which is gonna fix those tests rela

Re: [DISCUSS] Support/Fate of HBase v1 in Hadoop

2024-03-12 Thread Ayush Saxena
because > 2.2.x > > is also very old and EOL. 2.5.x is the currently maintained release for > > hbase2, with 2.5.7 being the latest. We’re soon going to release 2.6.0 as > > well. > > > > On Tue, Mar 5, 2024 at 6:56 AM Ayush Saxena wrote: > > > > > Hi Folks,

[jira] [Created] (HADOOP-19107) Drop support for HBase v1

2024-03-12 Thread Ayush Saxena (Jira)
Ayush Saxena created HADOOP-19107: - Summary: Drop support for HBase v1 Key: HADOOP-19107 URL: https://issues.apache.org/jira/browse/HADOOP-19107 Project: Hadoop Common Issue Type: Task

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

2024-03-07 Thread Ayush Saxena
anytime soon I will abstain -Ayush On Thu, 7 Mar 2024 at 08:33, Xiaoqiao He wrote: > cc @Chao Sun @zhang...@apache.org > @Ayush Saxena > Would you mind helping to check the upstream systems(Spark, HBase, Hive) > dependency with > the new hadoop release version if necessary? T

[jira] [Resolved] (HADOOP-19090) Update Protocol Buffers installation to 3.23.4

2024-03-07 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-19090. --- Fix Version/s: 3.4.1 Hadoop Flags: Reviewed Resolution: Fixed > Upd

[DISCUSS] Support/Fate of HBase v1 in Hadoop

2024-03-05 Thread Ayush Saxena
Hi Folks, As of now we have two profiles for HBase: one for HBase v1(1.7.1) & other for v2(2.2.4). The versions are specified over here: [1], how to build is mentioned over here: [2] As of now we by default run our Jenkins "only" for HBase v1, so we have seen HBase v2 profile silently breaking a c

Re: HDFS test builds always fails

2024-03-05 Thread Ayush Saxena
Hi, We have a PR [1] which is gonna fix those tests related to those java ByteBuffer, I will follow up on that & get it merged. -Ayush [1] https://github.com/apache/hadoop/pull/6593 On Tue, 5 Mar 2024 at 12:59, 王磊 wrote: > Hi, I found some tests always fails in some pull requests such as > had

[jira] [Created] (HADOOP-19100) Fix Spotbugs warnings in the build

2024-03-03 Thread Ayush Saxena (Jira)
Ayush Saxena created HADOOP-19100: - Summary: Fix Spotbugs warnings in the build Key: HADOOP-19100 URL: https://issues.apache.org/jira/browse/HADOOP-19100 Project: Hadoop Common Issue Type

Re: build q: getting the full DAG or all maven dependencies

2024-02-13 Thread Ayush Saxena
Does hadoop-dist package help? It does the packaging stuff for hadoop, IIRC it defines all the projects so that the dist kicks post everything is built [1], it has scripts mentioned in the pom which does the packaging work. for the protobuf, I think in the yarn modules we don't have the scope defi

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 (RC1)

2024-02-06 Thread Ayush Saxena
h `mvn clean install > -DskipTests` using the thirdparty 1.2.0-RC1 > * There are not any diffs between tag and src > > Regards, > - Takanobu Asanuma > > 2024年2月6日(火) 11:03 Xiaoqiao He : > > > cc @PJ Fanning @Ayush Saxena > @Steve > > Loughran @Takanobu Asanuma

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 RC0

2024-02-01 Thread Ayush Saxena
* Built from source * Verified Checksums * Verified Signatures * Validated files have ASF header Not sure if having diff b/w the git tag & src tar is ok, this doesn't look like core code change though, can anybody check & confirm? -Ayush On Thu, 1 Feb 2024 at 13:39, Xiaoqiao He

Re: [VOTE] Release Apache Hadoop 3.4.0 RC0

2024-01-12 Thread Ayush Saxena
We should consider including https://issues.apache.org/jira/browse/HDFS-17129 Which looks like inducing some misorder between IBR & FBR which can potentially lead to strange issues, if that can’t be merged, should revert the one which causes that. I think we should check for any ticket which has

Re: Re: [DISCUSS] Release Hadoop 3.4.0

2024-01-05 Thread Ayush Saxena
think the release discussion can be in public ML? > > > > Good idea. cc common-dev/hdfs-dev/yarn-dev/mapreduce-dev ML. > > > > Best Regards, > > - He Xiaoqiao > > > > On Tue, Jan 2, 2024 at 6:18 AM Ayush Saxena wrote: > > > > > +1 from me a

[jira] [Resolved] (HADOOP-19020) Update the year to 2024

2023-12-31 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-19020. --- Fix Version/s: 3.4.0 2.10.3 3.3.7 Hadoop Flags

[jira] [Created] (HADOOP-19020) Update the year to 2024

2023-12-31 Thread Ayush Saxena (Jira)
Ayush Saxena created HADOOP-19020: - Summary: Update the year to 2024 Key: HADOOP-19020 URL: https://issues.apache.org/jira/browse/HADOOP-19020 Project: Hadoop Common Issue Type: Task

Re: [DISCUSS][HDFS] Add rust binding for libhdfs

2023-12-21 Thread Ayush Saxena
valuable to enlarge hadoop > > ecosystem. > > > > I am also concerned that it will involve more hard work to release and > > version match, > > especially for one who is not familiar with C or Rust. > > Moreover, I am not aware the difference between `accept hd

[jira] [Resolved] (HADOOP-18613) Upgrade ZooKeeper to version 3.8.3

2023-12-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18613. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Upgr

Re: haoop-thirdparty release question

2023-12-15 Thread Ayush Saxena
Hi Dan, We usually get a new thirdparty release before the main hadoop release, so the newer commits part of hadoop-thirdparty would most probably be released and would be part of the next 3.4.0 or 3.3.x release, supposedly to happen in early of next year. Regarding the guava stuff, we use the sha

Re: [VOTE] Hadoop 3.2.x EOL

2023-12-05 Thread Ayush Saxena
+1 -Ayush > On 06-Dec-2023, at 9:40 AM, Xiaoqiao He wrote: > > Dear Hadoop devs, > > Given the feedback from the discussion thread [1], I'd like to start > an official thread for the community to vote on release line 3.2 EOL. > > It will include, > a. An official announcement informs no furt

Re: [DISCUSS] Make some release lines EOL

2023-12-04 Thread Ayush Saxena
Thanx He Xiaoqiao for starting the thread. +1 to mark 3.2 EOL. I am not sure about branch-2 stuff, I think a bunch of folks are still using Hadoop 2.x, but we hardly push anything over there & I am not sure if anyone is interested in releasing that or not. > Hadoop 3.3 Release (release-3.3.5 at J

Re: [DISCUSS] Hadoop 3.4.0 release

2023-12-01 Thread Ayush Saxena
Hi Ahmar, Makes sense to have a 3.4.0 rather than a 3.3.x if there are major changes. Few things on the process: * trunk should now point to 3.5.0-SNAPSHOT * Fix Versions of all the tickets merged to trunk would be 3.4.0 as of now, you need to move it to 3.5.0, else while chasing the release, the

[jira] [Resolved] (HADOOP-18924) Upgrade grpc jars to v1.53.0 due to CVEs

2023-11-30 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18924. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Upgrade g

[jira] [Resolved] (HADOOP-18957) Use StandardCharsets.UTF_8 constant

2023-11-20 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18957. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed >

[jira] [Resolved] (HADOOP-18964) Update plugin for SBOM generation to 2.7.10 #6235

2023-11-15 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18964. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Update plu

[jira] [Created] (HADOOP-18974) Replace commons-lang imports with commons-lang3

2023-11-15 Thread Ayush Saxena (Jira)
Ayush Saxena created HADOOP-18974: - Summary: Replace commons-lang imports with commons-lang3 Key: HADOOP-18974 URL: https://issues.apache.org/jira/browse/HADOOP-18974 Project: Hadoop Common

[jira] [Resolved] (HADOOP-18963) Fix typos in .gitignore

2023-11-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18963. --- Fix Version/s: 3.4.0 (was: 3.3.6) Hadoop Flags: Reviewed

Re: [ANNOUNCE] New Hadoop PMC Member - Shilun Fan

2023-10-31 Thread Ayush Saxena
Congratulations!!! -Ayush > On 31-Oct-2023, at 6:15 PM, Samrat Deb wrote: > > Congratulations Shilun Fan > > Bests, > Samrat > >> On Tue, Oct 31, 2023 at 6:07 PM Tao Li wrote: >> >> Congratulations!!! >> >> Xiaoqiao He 于2023年10月31日周二 20:19写道: >> >>> On behalf of the Apache Hadoop PMC, I

[jira] [Resolved] (HADOOP-18905) Negative timeout in ZKFailovercontroller due to overflow

2023-10-29 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18905. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Negat

[jira] [Resolved] (HADOOP-18936) Upgrade to jetty 9.4.53

2023-10-29 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18936. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Upgrade

[jira] [Resolved] (HADOOP-18916) module-info classes from external dependencies appearing in uber jars

2023-10-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18916. --- Fix Version/s: 3.4.0 3.3.9 Hadoop Flags: Reviewed Resolution

[jira] [Created] (HADOOP-18934) Add documentation for building hadoop with docker

2023-10-12 Thread Ayush Saxena (Jira)
Ayush Saxena created HADOOP-18934: - Summary: Add documentation for building hadoop with docker Key: HADOOP-18934 URL: https://issues.apache.org/jira/browse/HADOOP-18934 Project: Hadoop Common

[jira] [Resolved] (HADOOP-18923) Switch to SPDX identifier for license name

2023-10-07 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18923. --- Hadoop Flags: Reviewed Resolution: Fixed > Switch to SPDX identifier for lice

[jira] [Resolved] (HADOOP-18917) upgrade to commons-io 2.14.0

2023-10-05 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18917. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > upgrade

Re: [ANNOUNCE] New Hadoop Committer - Simbarashe Dzinamarira

2023-10-03 Thread Ayush Saxena
Congratulations!!! -Ayush > On 03-Oct-2023, at 5:42 AM, Erik Krogen wrote: > > Congratulations Simba! Thanks for the great work you've done on making HDFS > more scalable! > >> On Mon, Oct 2, 2023 at 4:31 PM Iñigo Goiri wrote: >> >> I am pleased to announce that Simbarashe Dzinamarira has b

[jira] [Resolved] (HADOOP-18912) upgrade snappy-java to 1.1.10.4 due to CVE

2023-09-27 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18912. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > upgrade sna

Re: [ANNOUNCE] New Hadoop Committer - Shuyan Zhang

2023-09-26 Thread Ayush Saxena
Congratulations!!! Sent from my iPhone > On 27-Sep-2023, at 9:56 AM, Xiaoqiao He wrote: > > I am pleased to announce that Shuyan Zhang has been elected as > a committer on the Apache Hadoop project. We appreciate all of > Shuyan's work, and look forward to her/his continued contributions. > >

Re: HADOOP-18207 hadoop-logging module about to land

2023-07-28 Thread Ayush Saxena
tial num of incompatibilities that would arise with jersey 2 > migration. > > I am really grateful to all reviewers that have reviewed the tasks so far, > I am not expecting reviewers to be able to provide their reviews as quickly > as possible, this particular sub-task has been dev and test ready f

Re: HADOOP-18207 hadoop-logging module about to land

2023-07-27 Thread Ayush Saxena
Hi Wei-Chiu, I am glad this activity finally made it to the dev mailing list. Just sharing the context being the guy who actually reverted this last time it was in: It had a test failure on the PR itself and it went in, that had nothing to do with the nature of the PR, generic for all PR and all pr

Re: Signing releases using automated release infra

2023-07-25 Thread Ayush Saxena
ue, 18 Jul 2023 at 21:05, Ayush Saxena wrote: >> >> Something we can explore as well!! >> >> -Ayush >> >> Begin forwarded message: >> >> > From: Volkan Yazıcı >> > Date: 19 July 2023 at 1:24:49 AM IST >> > To: d...@communit

[jira] [Resolved] (HADOOP-18823) Add Labeler Github Action.

2023-07-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18823. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Add Labe

[jira] [Created] (HADOOP-18823) Add Labeler Github Action.

2023-07-22 Thread Ayush Saxena (Jira)
Ayush Saxena created HADOOP-18823: - Summary: Add Labeler Github Action. Key: HADOOP-18823 URL: https://issues.apache.org/jira/browse/HADOOP-18823 Project: Hadoop Common Issue Type: Bug

Fwd: Signing releases using automated release infra

2023-07-18 Thread Ayush Saxena
Something we can explore as well!! -Ayush Begin forwarded message: > From: Volkan Yazıcı > Date: 19 July 2023 at 1:24:49 AM IST > To: d...@community.apache.org > Subject: Signing releases using automated release infra > Reply-To: d...@community.apache.org > > Abstract: Signing release artifac

RE: [DISCUSS][HDFS] Add rust binding for libhdfs

2023-07-15 Thread Ayush Saxena
Forwarding from dev@hadoop to relevant ML Original mail: https://lists.apache.org/thread/r5rcmc7lwwvkysj0320myxltsyokp9kq -Ayush On 2023/07/15 09:18:42 Xuanwo wrote: > Hello, everyone. > > I'm the maintainer of [hdfs-sys]: A binding to HDFS Native C API for Rust. I > want to know is it a good i

[jira] [Resolved] (HADOOP-18794) ipc.server.handler.queue.size missing from core-default.xml

2023-07-11 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18794. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed

[jira] [Created] (HADOOP-18796) Compilation fails with triple-beam@1.4.0: The engine "node" is incompatible with this module. Expected version ">= 16.0.0". Got "12.22.1"

2023-07-10 Thread Ayush Saxena (Jira)
Ayush Saxena created HADOOP-18796: - Summary: Compilation fails with triple-beam@1.4.0: The engine "node" is incompatible with this module. Expected version ">= 16.0.0". Got "12.22.1" Key: HADOOP-

[jira] [Resolved] (HADOOP-18783) upgrade netty to 4.1.94 due to CVE

2023-07-02 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18783. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > upgrade ne

  1   2   3   4   >