regarding parquet, the jira there is :
https://github.com/apache/parquet-java/issues/3237
and while the change in that lib is "release the buffers", it hits a
problem with coalesced reads as there the releasing doesn't work.
my fix will be: disable coalescing, keep the code (for now), and add a
p
Thanks everyone for testing out this RC.
For this RC, the current status is:
* Issue with buffers allocated by ParquetFileReader.readVectored() are not
being released. While this is not new, we should root cause and fix in case
it's a hadoop issue for 3.4.2.
* Need to figure out what
Hi Wei-Chiu Chuang,
I really wish we can make ARM64 binaries. Would like to find time to work
on the two jiras mentioned.
I submitted PRs for YARN-11712 and YARN-11713.
Could you check the patches?
Thanks,
Masatake Iwasaki
On 2025/06/05 1:14, Wei-Chiu Chuang wrote:
I really wish we can make
I really wish we can make ARM64 binaries. Would like to find time to work
on the two jiras mentioned.
On Wed, May 28, 2025 at 5:25 AM Ahmar Suhail wrote:
> Hey all,
>
> The first release candidate for Hadoop 3.4.2 is now available for voting.
>
> There are a couple of things to note:
>
> 1/ No A
and I've done the bytebuffer flip for read vectored
https://github.com/apache/hadoop/pull/7725
but .flip() is used in so many other places, it's not enough. Given that
the overloaded flip() method appears in a lot of the jdk8 releases.
So how about "this releases uses the overloaded ByteByffer.fl
parquet stuff is unrelated, filed
https://github.com/apache/parquet-java/issues/3237 . still my fault though.
overall, I'm going to give a quick -1 with the commitment to provide one of
the patches.
my comments in markdown format:
## relesse docs index.html
the summary in index.html are from 3
I'm sort of leaning towards a -1, though the regression is actually in
3.4.0, and surfacing as a failure to release buffers in localfs IO.
[ERROR] org.apache.parquet.hadoop.TestParquetReader.testRangeFiltering[2]
-- Time elapsed: 0.033 s <<< ERROR!
org.apache.parquet.bytes.TrackingByteBufferAlloc
Ahmar, no need for prs there, it's a "commit then review" repo, as in other
people can revoke if you break things.
will do the merge and test
On Mon, 2 Jun 2025 at 16:51, Suhail, Ahmar
wrote:
> Steve - I created a PR on hadoop-release-support with my properties file:
> https://github.com/apach
Steve - I created a PR on hadoop-release-support with my properties file:
https://github.com/apache/hadoop-release-support/pull/4
Masatake - Yes, sounds good, will update the documentation for the new RC if it
is created.
Mukund - I realised too late that I messed up the commit for that one.
can you put up the relevant changes to the hadoop-release-support module;
I'd like to use it as part of my validation and I'm assuming you have
that src/releases/release-info-3.4.2.properties file
On Wed, 28 May 2025 at 13:25, Ahmar Suhail wrote:
> Hey all,
>
> The first release candidate for Ha
* git_jira_fix_version_check.py reported some inconsistencies between commits
and JIRA.
I updated JIRA's "Fix Versions/s" and "Resolution" along with the commit status.
Since HADOOP-19580 was commited to branch-3.4.2 but not in the RC1,
it will be contained if RC2 is created.
"Fix Versions/s"
Thanks for driving the release, Ahmar.
I found some issues on documentations.
While it is not worth for sinking the RC1, it would be nice to fix if we cut
RC2.
* The top page of site documentation looks mentioning changes of 3.4.1.
https://github.com/apache/hadoop/blob/release-3.4.2-RC1/hado
Thanks for starting this! I tried accessing the S3 bucket using the RC by
dropping in the bundle jar and it works. Will test more!
On Wed, May 28, 2025 at 7:25 AM Ahmar Suhail wrote:
> Hey all,
>
> The first release candidate for Hadoop 3.4.2 is now available for voting.
>
> There are a couple o
Thanks Ahmar for your work. Will try to verify and give feedback here.
Best Regards,
- He Xiaoqiao
On Wed, May 28, 2025 at 8:56 PM Ahmar Suhail wrote:
>
> Hey all,
>
> The first release candidate for Hadoop 3.4.2 is now available for voting.
>
> There are a couple of things to note:
>
> 1/ No Ar
14 matches
Mail list logo
