[
https://issues.apache.org/jira/browse/HUDI-2524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sagar Sumit updated HUDI-2524:
------------------------------
Description:
For instance, hive sync should work seamlessly not just with Apache Hive but
also EMR Hive.
EMR 6.x has Hive 3.1.2, and the later versions of EMR 5.x has Hive 2.3.x. While
the HiveSyncTool is known to work with Hive 2.3.x.
The scope of the ticket is to verify that the hive sync through Hudi works with
EMR Hive 3.1.x as well.
We can refer to
[https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-hudi-work-with-dataset.html]
for hive sync properties.
The purpose of this verification is that hudi-hive-sync has Hive 2.3.1 as
compile-time dependency, so we need to check if the hive APIs used by the sync
tool are compatible with Hive 3.1.x.
was:
For instance, hive sync should work seamlessly not just with Apache Hive but
also EMR Hive.
EMR 6.x has Hive 3.1.2, and the later versions of EMR 5.x has Hive 2.3.x. While
the HiveSyncTool is known to work with Hive 2.3.x.
The scope of the ticket is to verify that the hive sync through Hudi works with
EMR Hive 3.1.x as well.
We can refer to
[https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-hudi-work-with-dataset.html]
for hive sync properties.
The purpose of this verification is that hudi-hive-sync has Hive 2.3.1 as
compile-time dependency, so we need to check is hive APIs used by the sync tool
are compatible with Hive 3.1.x.
> Certify Hive sync on cloud platforms
> ------------------------------------
>
> Key: HUDI-2524
> URL: https://issues.apache.org/jira/browse/HUDI-2524
> Project: Apache Hudi
> Issue Type: Task
> Reporter: Sagar Sumit
> Assignee: Forward Xu
> Priority: Blocker
> Fix For: 0.11.0
>
>
> For instance, hive sync should work seamlessly not just with Apache Hive but
> also EMR Hive.
> EMR 6.x has Hive 3.1.2, and the later versions of EMR 5.x has Hive 2.3.x.
> While the HiveSyncTool is known to work with Hive 2.3.x.
> The scope of the ticket is to verify that the hive sync through Hudi works
> with EMR Hive 3.1.x as well.
> We can refer to
> [https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-hudi-work-with-dataset.html]
> for hive sync properties.
> The purpose of this verification is that hudi-hive-sync has Hive 2.3.1 as
> compile-time dependency, so we need to check if the hive APIs used by the
> sync tool are compatible with Hive 3.1.x.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
