[
https://issues.apache.org/jira/browse/HIVE-27535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17747848#comment-17747848
]
Ayush Saxena commented on HIVE-27535:
-------------------------------------
Hive is currently on hadoop-3.3.1, so this shouldn't be a problem. Does any
unit test fails if we changes the hadoop version to 3.3.5, I was exploring an
upgrade to 3.3.5 couple of weeks back:
[https://github.com/apache/hive/pull/4290/files]
and I didn't find any similar test failure for my PR then, just abandoned that
PR in favour of hadoop-3.3.6
> Make hive3.1.3 support hadoop3.3.5+
> -----------------------------------
>
> Key: HIVE-27535
> URL: https://issues.apache.org/jira/browse/HIVE-27535
> Project: Hive
> Issue Type: Improvement
> Components: Hive
> Affects Versions: 3.1.3
> Reporter: caijialiang
> Priority: Major
> Attachments: image-2023-07-27-16-18-03-692.png,
> image-2023-07-27-16-18-30-200.png, image-2023-07-27-16-18-45-151.png,
> patch15-support-hadoop3.3.5.diff
>
>
> Hive version: 3.1.3
> Hadoop version: 3.3.5
> After upgrading to Hadoop 3.3.5, the Hive WebHCat server fails to start
> because of inconsistent versions of the Jersey JAR package. Hive HCat lacks
> the jersey-server-1.19 jar.
> !image-2023-07-27-16-18-03-692.png!
> The issue is as follows: The startup script of the Hive WebHCat server sets
> the Hadoop class path. It first loads from its own class path, and if not
> found, it looks for it in the Hadoop class path.
> /usr/lib/hive-hcatalog/sbin/webhcat_server.sh
> !image-2023-07-27-16-18-30-200.png!
>
> In Hadoop 3.3.4, the version of the Jersey-related JARs in Hadoop is 1.19,
> which matches that of Hive. Therefore, even though the Hive WebHCat server
> does not contain jersey-server-1.19.jar, it successfully loads
> jersey-server-{color:#ff0000}1.19{color}.jar from the Hadoop class path, and
> no error occurs.
> !image-2023-07-27-16-18-45-151.png!
> However, after upgrading to Hadoop 3.3.5, Hadoop updates jersey to version
> {color:#ff0000}1.19.4{color}, which is inconsistent with the jersey version
> in the Hive WebHCat server. As a result, the startup fails. To resolve this,
> manually download a package and place it in
> /usr/lib/hive-hcatalog/share/webhcat/svr/lib/
> Therefore, when packaging Hive, we need to specify the version of Jersey in
> the Hive POM file to match the version of Jersey in Hadoop to avoid version
> conflicts.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
