+1
I can provide assistance with the ARM release, as I originally planned to
release Hadoop 3.5.0, which supports JDK17, and have been conducting
related tests.
My approach is a workaround, and I hope it helps.
Best Regards,
- Shilun Fan
On Thu, Feb 27, 2025 at 9:08 PM Bhavik Patel
wrote:
> H
0:15 AM jian zhang wrote:
>
>> Hi, He Xiaoqiao
>>
>> I have rebased HDFS-17531 again and resolved the conflicts. The current
>> pipeline failure is unrelated to the ARR feature and was introduced by
>> slfan1989's PR: HADOOP-19415. [JDK17] Upgrade JUnit from 4
+1
Best Regards,
- Shilun Fan
On Fri, Feb 14, 2025 at 3:22 PM jian zhang wrote:
> Hi, all, the development of the asynchronous router functionality has been
> completed. Thanks to all the contributors who participated in this feature.
> The development branch is HDFS-17531, and it is ready to b
>
>> Great. +1 from my side. Thanks.
>>
>> Best Regards,
>> - He Xiaoqiao
>>
>> On Thu, Feb 13, 2025 at 10:15 AM jian zhang
>> wrote:
>>
>>> Hi, He Xiaoqiao
>>>
>>> I have rebased HDFS-17531 again and resolved the co
p when and what the next Hadoop release will support it?
>
>
>
> Thanks,
>
> Jason
>
>
>
> *From: *slfan1989
> *Date: *Wednesday, February 7, 2024 at 12:22 AM
> *To: *Xiaoqiao He , Ayush Saxena <
> ayush...@gmail.com>, ste...@cloudera.com , Takanobu
>
+1 (binding)
* Successfully built from source with `mvn clean install`
* Verified signatures and checksums
Thanks Steve and Mukund for driving this release.
Hope the release goes smoothly.
Shilun Fan.
On Fri, Aug 23, 2024 at 11:41 PM Shilun Fan wrote:
+1 (Binding)
>
> * Built from source
> *
-22T22:54:38+08:00
[INFO]
On Thu, Aug 22, 2024 at 9:35 AM slfan1989 wrote:
>
> I encountered some issues while trying to compile with version
> hadoop-thirdparty-1.3.0-RC1.
>
> Using mvn package clean -Dski
I encountered some issues while trying to compile with version
hadoop-thirdparty-1.3.0-RC1.
Using mvn package clean -DskipTests succeeds in compiling, but using mvn
install package -DskipTests fails to compile.
mvn clean package -DskipTests
[INFO]
Thank you very much for initiating this discussion! I am also very much
looking forward to JDK 17. I have observed that using --add-opens= is quite
common in other Apache projects. One thing I know is that it is necessary
to upgrade JUnit 4 to JUnit 5. There are some JIRA issues currently being
wor
othly.
Many thanks to Ayush for the detailed explanation, and also thanks to
Xiaoqiao and Steve.
Best Regards,
Shilun Fan.
On Sat, Jun 8, 2024 at 2:33 PM slfan1989 wrote:
> For the issues introduced by #6664, first and foremost, I express my
> apologies and regrets. However, I don't
For the issues introduced by #6664, first and foremost, I express my
apologies and regrets. However, I don't quite understand why the
surefire-upgrade would lead to CI crashes and failure to display results.
This PR was updated on March 24th, and while we did observe some failures
in HDFS unit test
Thank you for your hard work! This is a very meaningful improvement, and
from the design document, we can see a significant increase in HDFS
read/write throughput.
I am happy to see the progress made on HDFS-17384.
However, I still have some concerns, which roughly involve the following
aspects:
On behalf of the Apache Hadoop Project Management Committee, We are
pleased to announce the release of Apache Hadoop 3.4.0.
This is a release of Apache Hadoop 3.4 line.
Key changes include
* S3A: Upgrade AWS SDK to V2
* HDFS DataNode Split one FsDatasetImpl lock to volume grain locks
* YARN Fede
-binding(+2)
Suhail, Ahmar
Dongjoon Hyun
Thank you very much for helping with the review and validation!
We have received 6 binding PMC affirmative votes. hadoop-3.4.0 will be
officially released in the next 1-2 days.
Best Regards,
Shilun Fan.
On Fri, Mar 15, 2024 at 8:32 AM slfan1989 wrote:
>
bcrypto*
>> >> -rw-r--r-- 1 root root 2739952 Sep 19 13:09
>> >> /usr/lib/aarch64-linux-gnu/libcrypto.so.1.1
>> >> -rw-r--r-- 1 root root 4466856 Oct 27 13:40
>> >> /usr/lib/aarch64-linux-gnu/libcrypto.so.3
>> >>
>> >> Anyone got any in
d of the arm
> stuff for its checknative; not expecting problems.
>
> So: i've got some stuff still ongoing, but the core changes to packaging
> are in and the rest I'm not worried about -they shouldn't block the release
> as I already validated them on RC2
>
>
>
@Xiaoqiao He @Ayush Saxena @Steve
Loughran @Mukund Madhav Thakur
@Takanobu
Asanuma @Masatake Iwasaki
Can you help review and vote for hadoop-3.4.0-RC3? Thank you very much!
Best Regards,
Shilun Fan.
On Tue, Mar 5, 2024 at 6:07 AM slfan1989 wrote:
> Hi folks,
>
> Xiaoqiao He a
+1 Option2
I also agree with the idea of upgrading hbase 2.2 to 2.5.
Shilun Fan.
> Hbase v1 is EOL for a while now, so option 2 probably makes sense. While
> you are at it you should probably update the hbase2 version, because 2.2.x
> is also very old and EOL. 2.5.x is the currently maintained r
Hi folks,
Xiaoqiao He and I have put together a release candidate (RC3) for Hadoop
3.4.0.
What we would like is for anyone who can to verify the tarballs, especially
anyone who can try the arm64 binaries as we want to include them too.
The RC is available at:
https://dist.apache.org/repos/dist/d
- He Xiaoqiao
>
> On Fri, Mar 1, 2024 at 12:19 PM slfan1989 wrote:
>
>> I expect to initiate a vote for hadoop-3.4.0-RC3 in preparation for the
>> hadoop-3.4.0 release. We have been working on this for 2 months and have
>> already released hadoop-thirdparty-1.2.0.
>>
ughts of other members.
Best Regards,
Shilun Fan.
On Fri, Mar 1, 2024 at 6:05 AM slfan1989 wrote:
> Thank you for the feedback on this issue!
>
> We have already released hadoop-thirdparty-1.2.0. I think we should not
> release hadoop-thirdparty-1.2.1 before the launch of hadoop-3
.
HADOOP-19084: Pruning hadoop-common transitive dependencies.
I will use hadoop-release-support to package the arm version.
I plan to release hadoop-3.4.0-RC3 next Monday.
Best Regards,
Shilun Fan.
On Sat, Feb 24, 2024 at 11:28 AM slfan1989 wrote:
> Thank you very much for Steve's detai
nks, Shilun for putting this together.
> >
> > Tried the below things and everything worked for me.
> >
> > validated checksum and gpg signature.
> > compiled from source.
> > Ran AWS integration tests.
> > untar the binaries and able to access objects in S3 via hadoo
@Ayush Saxena @Takanobu Asanuma
@Xiaoqiao
He @inigo...@apache.org @Masatake
Iwasaki @Akira Ajisaka
Could you please assist with the Hadoop-3.4.0-RC2 vote?
Best Regards,
Shilun Fan.
On Fri, Feb 16, 2024 at 7:27 AM slfan1989 wrote:
> Thank you for helping review hadoop-3.4.0-
commands.
> compiled gcs-connector successfully using the 3.4.0 version.
>
> qq: what is the difference between RC1 and RC2? apart from some extra
> patches.
>
>
>
> On Thu, Feb 15, 2024 at 10:58 AM slfan1989 wrote:
>
>> Thank you for explaining this part!
>>
>
Loughran wrote:
>
>
> On Mon, 12 Feb 2024 at 15:32, slfan1989 wrote:
>
>>
>>
>> Note, because the arm64 binaries are built separately on a different
>> platform and JVM, their jar files may not match those of the x86
>> release -and therefore the maven artifac
Hi folks,
Xiaoqiao He and I have put together a release candidate (RC2) for Hadoop
3.4.0.
What we would like is for anyone who can to verify the tarballs, especially
anyone who can try the arm64 binaries as we want to include them too.
The RC is available at:
https://dist.apache.org/repos/dist/d
d region stuff? that'd be wonderful! I've
> been assuming i'd have to push out a 3.4.1 release for that alone.
>
> On Sat, 10 Feb 2024 at 23:36, slfan1989 wrote:
>
>> We will end the voting for hadoop-3.4.0-RC1 and will open the voting for
>> hadoop-3.4.0-RC2 in
.
Best Regards,
Shilun Fan.
On Mon, Jan 29, 2024 at 10:33 PM slfan1989 wrote:
> Apache Hadoop 3.4.0
>
> Xiaoqiao He and I have put together a release candidate (RC1) for Hadoop
> 3.4.0.
>
> What we would like is for anyone who can to verify the tarballs, especially
> anyone
Thank you all for your interest in this topic!
In my opinion, upgrading is very beneficial. Based on the roadmap for Spark
4.0, we can see that JDK8/JDK11 is no longer the default version.
Therefore, I believe it is important for us to fully support
JDK11/JDK17/JDK21 in Hadoop.
>From the informat
We have completed the release of hadoop-thirdparty-1.2.0 according to the
release process of how to release.
We will start preparing for hadoop-3.4.0-RC2 voting.
Looking forward to everything going smoothly!
Best Regards,
Shilun Fan.
On Wed, Feb 7, 2024 at 10:24 AM slfan1989 wrote:
>
gt; - [X] LICENSE and NOTICE files are correct for the repository.
>> >> - [X] Source code artifacts have correct names matching the current
>> >> release.
>> >> - [X] All files have license headers if necessary.
>> >> - [X] Building is OK using `mvn
Hi folks,
Xiaoqiao He and I have put together a release candidate (RC1) for Hadoop
Thirdparty 1.2.0.
The RC is available at:
https://dist.apache.org/repos/dist/dev/hadoop/hadoop-thirdparty-1.2.0-RC1
The RC tag is
https://github.com/apache/hadoop-thirdparty/releases/tag/release-1.2.0-RC1
The mav
vote.
Best Regards,
Shilun Fan.
On Sun, Feb 4, 2024 at 4:18 PM Shuyan Zhang wrote:
> +1 (non-binding)
>
> - Verified hashes
> - LICENSE and NOTICE are included.
> - Rat check is ok. `mvn clean apache-rat:check`
> - `mvn clean install` works well
>
>
> slfan1989 于2024年
rom source with `mvn clean install`
> * Successfully compiled Hadoop trunk and branch-3.4 using the Hadoop
> thirdparty 1.2.0
>
> Anyway, since hadoop-thirdparty-1.1.1 has some high vulnerabilities,
> hadoop-thirdparty-1.2.0 would be required for Hadoop-3.4.0.
>
> Thanks,
> - T
tures
> * Validated files have ASF header
>
> Not sure if having diff b/w the git tag & src tar is ok, this doesn't look
> like core code change though, can anybody check & confirm?
>
> -Ayush
>
>
> On Thu, 1 Feb 2024 at 13:39, Xiaoqiao He wrote:
>
>>
path).
>
> BTW, hadoop-thirdparty-1.2.0 will be included in release-3.4.0, hope we
> could finish this vote before 2024/02/06(UTC) if there are no concerns.
> Thanks all.
>
> Best Regards,
> - He Xiaoqiao
>
>
>
> On Mon, Jan 29, 2024 at 10:42 PM slfan1989 wrote:
>
Hi folks,
Xiaoqiao He and I have put together a release candidate (RC0) for Hadoop
Thirdparty 1.2.0.
The RC is available at:
https://dist.apache.org/repos/dist/dev/hadoop/hadoop-thirdparty-1.2.0-RC0
The RC tag is
https://github.com/apache/hadoop-thirdparty/releases/tag/release-1.2.0-RC0
The mav
Apache Hadoop 3.4.0
Xiaoqiao He and I have put together a release candidate (RC1) for Hadoop
3.4.0.
What we would like is for anyone who can to verify the tarballs, especially
anyone who can try the arm64 binaries as we want to include them too.
The RC is available at:
https://dist.apache.org/re
Regards,
> - He Xiaoqiao
>
>
> On Tue, Jan 23, 2024 at 7:58 AM slfan1989 wrote:
>
>> branch-3.4/branch-3.4.0 was created from the trunk branch, including the
>> changes from branch-3.3.
>>
>> Best Regards,
>> Shilun Fan.
>>
>> On Tue, Jan
>
>
>
> On Mon, 22 Jan 2024 at 11:50 AM, slfan1989 wrote:
>
>> Thank you very much for specifying the frozen time for the
>> Branch-3.4.0. @Xiaoqiao
>> He
>>
>> If there is a need to backport any PRs to branch-3.4/branch-3.4.0, please
>> feel f
>
> Thanks all.
>
> Best Regards,
> - He Xiaoqiao
>
>
>
> On Mon, Jan 22, 2024 at 10:43 AM slfan1989 wrote:
>
>> Thank you for the feedback!
>>
>> I apologize for updating partial information in the Hadoop module.
>>
>> Today, I will comp
In JIRA issues where other release versions have been released,
> > remove
> > > > the 3.4.0 entry from the fix version.
> > >
> > > As I mentioned in my comment on HADOOP-18045, I think 3.4.0 should
> still
> > be
> > > included i
Hi All,
I am currently preparing to release hadoop-3.4.0-RC1 and need to perform
some operations on the JIRA issues related to HADOOP, HDFS, YARN, and
MAPREDUCE. Specifically, the tasks include:
1. For JIRA issues with target version set to 3.4.0 and marked as
non-blocker, update the target versi
# build.properties:
> hadoop.version=3.4.0
> rc=RC0
> amd.src.dir=https://home.apache.org/~slfan1989/hadoop-3.4.0-RC0-amd64/
> http.source=https://home.apache.org/~slfan1989/hadoop-3.4.0-RC0-amd64
> <https://home.apache.org/~slfan1989/hadoop-3.4.0-RC0-amd64/http.source=http
Dear Community Members,
While discussing release Hadoop 3.4.0, we have also decided to release
Hadoop Thirdparty version 1.2.0.
I'll be initiating some branch preparation work over the weekend.
Best Regards,
Shilun Fan.
-- Forwarded message -
发件人： slfan1989
Date: 2024/01/
can prove it won't cause
> any issues. There is a comment which says a block was reported missing post
> the patch that induced it: [1]
>
> [1] https://github.com/apache/hadoop/pull/6244#issuecomment-1793981740
>
> -Ayush
>
>
> On Fri, 12 Jan 2024 at 07:37, slfan1989 wro
iption about new features of previous release
should be removed from the index.md.vm.
[1]
https://github.com/apache/hadoop/blob/branch-3.4.0/hadoop-project/src/site/markdown/index.md.vm
Masatake Iwasaki
On 2024/01/11 14:15, slfan1989 wrote:
> Hello all,
>
> We plan to release hadoop 3.4.0
-correct?
> steve
> On Thu, 11 Jan 2024 at 05:15, slfan1989 wrote:
> Hello all,
>
> We plan to release hadoop 3.4.0 based on hadoop trunk, which is the first
> hadoop 3.4.0-RC version.
>
> The RC is available at:
> https://home.apache.org/~slfan1989/hadoop-3.4.0-RC
Hello all,
We plan to release hadoop 3.4.0 based on hadoop trunk, which is the first
hadoop 3.4.0-RC version.
The RC is available at:
https://home.apache.org/~slfan1989/hadoop-3.4.0-RC0-amd64/ (for amd64)
https://home.apache.org/~slfan1989/hadoop-3.4.0-RC0-arm64/ (for arm64)
Maven artifacts is
oop-thirdparty
>> [2] https://github.com/apache/hadoop-thirdparty/pull/19
>> [3] https://github.com/apache/hadoop/pull/6370
>>
>>
>>
>> On 2024/01/04 14:26:37 slfan1989 wrote:
>> > Hey all,
>> >
>> > We are planning to release Hadoop 3.4.0 bas
> >
> > > +1 from me
> > >
> > > ant and maven repo to build and validate things, including making arm
> > > binaries if you work from an arm macbook.
> > > https://github.com/steveloughran/validate-hadoop-client-artifacts
> > >
> > &g
+1
On Wed, Dec 6, 2023 at 9:03 AM Chao Sun wrote:
> +1
>
> On Wed, Dec 6, 2023 at 8:39 AM Akira Ajisaka wrote:
> >
> > +1
> >
> >
> >
> > On Wed, Dec 6, 2023 at 1:10 PM Xiaoqiao He wrote:
> >
> > > Dear Hadoop devs,
> > >
> > > Given the feedback from the discussion thread [1], I'd like to start
+1 on marking 3.2 EOL.
+1 just keeping cherry-picking critical our CVEs without release on
branch-2.10.
+1 The new version is released based on version 3.4.0.
I am willing to take on the work during the release of the new version and
look forward to a smooth release.
Best Regards,
Shilun Fan.
Hey all,
With Inigo's assistance, we collaborated to enhance the functionality of
YARN Federation.
Currently, YARN-5597 is ready, and I look forward to releasing a new
version that includes our modifications.
I agree to release a new version based on 3.4.0 and am willing to assist in
the tasks ass
55 matches
Mail list logo
