rahil-c commented on code in PR #5786:
URL: https://github.com/apache/hudi/pull/5786#discussion_r917463189
##########
packaging/hudi-hadoop-mr-bundle/pom.xml:
##########
@@ -29,6 +29,8 @@
<properties>
<checkstyle.skip>true</checkstyle.skip>
<main.basedir>${project.parent.basedir}</main.basedir>
+ <!-- override parquet version to be same as Hive 3.1.2 -->
+ <parquet.version>1.10.1</parquet.version>
Review Comment:
@umehrot2 Will make the change
@yihua Nice catch and yes I believe we need too. In the hive 2.x the parquet
is 1.8.x https://github.com/apache/hive/blob/rel/release-2.3.9/pom.xml#L183
In the hive 3.x the parquet is 1.10.x
https://github.com/apache/hive/blob/rel/release-3.1.2/pom.xml#L191
Im thinking we can just set `hive.parquet.version` to be the correct parquet
version in the spark2 and spark3 profiles.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
