Hello Sungwoo,
It looks like HDFS-14099 was fixed in Apache Hadoop releases 3.2.3, 3.3.2
and 3.4.0. Users of Apache Hive 3.1.3 and earlier would be impacted. (Hive
3.1.3 used Hadoop 3.1.0.) However, Hive 4.0.0 used Hadoop 3.3.6, so I think
we can consider this resolved by the latest Hive release.
Hello,
I did not create a new JIRA ticket, but instead added two comments in
HDFS-14099 (to notify those involved in the JIRA ticket), with sample code
for reproducing the problem. My test used Hadoop 3.3.6 library with zstd
1.5.5 native library.
It is easy to reproduce the problem (as shown in t
Thanks Sungwoo Park for sharing the details. I'm forwarding this to
hdfs-dev@. I haven't had the chance to review the details in the
ticket yet, but if you can reproduce the issue, I recommend creating
an HDFS ticket and marking it as a blocker with the target versions
set to the upcoming releases.