[ 
https://issues.apache.org/jira/browse/HIVE-26748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17680370#comment-17680370
 ] 

Chris Nauroth commented on HIVE-26748:
--------------------------------------

If we're going with Hadoop 3.3.4, then that's going to switch to a custom 
shaded dependency for protobuf, so I don't expect problems there.

https://github.com/apache/hadoop/blob/rel/release-3.3.4/hadoop-project/pom.xml#L264-L268

However, note that it would be leapfrogging the master branch, which is 
currently on Hadoop 3.3.1. (That version still has the shaded dependency.)

Regarding Tez, I suppose the upgrade ends up working fine on master because the 
Tez protobuf messages get serialized/deserialized end-to-end in the context of 
a single Hive/Tez session, so the encoding is consistent even if Hive declares 
a different version dependency than Tez. There is never a case of passing one 
of these messages externally where another client might expect the earlier 
protobuf version.

To build confidence, it would be great to hear from anyone who has tested a 
full distro with the new Hive 4 alphas, which I haven't tried yet. If so, were 
there any surprises on protobuf compatibility?

> Prepare for Hive 3.2.0 Release
> ------------------------------
>
>                 Key: HIVE-26748
>                 URL: https://issues.apache.org/jira/browse/HIVE-26748
>             Project: Hive
>          Issue Type: Task
>          Components: Hive
>    Affects Versions: 3.1.3
>            Reporter: Aman Raj
>            Assignee: Aman Raj
>            Priority: Major
>              Labels: hive-3.2.0-must
>
> This is the Umbrella Jira to track all the commits that would go on top of 
> current branch-3 in this new 3.2.0 Hive release. I will add all the JIRAs 
> that will be cherry picked as part of this commit by defining subtasks or 
> linking the JIRAs.
>  
> *Please note that this is an Open forum and I welcome all responses for the 
> same from the community with regards to any new bug fixes that should be 
> cherry picked.*



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to