[
https://issues.apache.org/jira/browse/HIVE-7837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mithun Radhakrishnan updated HIVE-7837:
---------------------------------------
Description:
HCatalog doesn't provide a way to add partitions in an idempotent fashion. It
currently only has:
{{public abstract int addPartitions(List<HCatAddPartitionDesc> partInfoList);}}
(Pending HIVE-7576, there'll also be:
{{public abstract int addPartitionSpec(HCatPartitionSpec partitionSpec)throws
HCatException;}}
)
Neither provides a way to "add-partitions-if-not-exist". There's value in
adding such an API, for systems that add partitions to Hive tables, to be able
to retry reliably (and avoid an AlreadyExistsException).
This can be implemented using {{HiveMetaStoreClient.add_partitions( partList,
ifNotExists, needREsults )}}, for HCatClientHMSImpl.
was:
HCatalog doesn't provide a way to add partitions in an idempotent fashion. It
currently only has:
{{public abstract int addPartitions(List<HCatAddPartitionDesc> partInfoList);}}
(Pending HIVE-7576, there'll also be:
{{public abstract int addPartitionSpec(HCatPartitionSpec partitionSpec)
throws HCatException;}})
Neither provides a way to "add-partitions-if-not-exist". There's value in
adding such an API, for systems that add partitions to Hive tables, to be able
to retry reliably (and avoid an AlreadyExistsException).
This can be implemented using {{HiveMetaStoreClient.add_partitions( partList,
ifNotExists, needREsults )}}, for HCatClientHMSImpl.
> HCatClient doesn't have an addPartitions( partList, ifNotExist );
> -----------------------------------------------------------------
>
> Key: HIVE-7837
> URL: https://issues.apache.org/jira/browse/HIVE-7837
> Project: Hive
> Issue Type: Bug
> Components: HCatalog
> Affects Versions: 0.13.1
> Reporter: Mithun Radhakrishnan
> Assignee: Mithun Radhakrishnan
>
> HCatalog doesn't provide a way to add partitions in an idempotent fashion. It
> currently only has:
> {{public abstract int addPartitions(List<HCatAddPartitionDesc>
> partInfoList);}}
> (Pending HIVE-7576, there'll also be:
> {{public abstract int addPartitionSpec(HCatPartitionSpec partitionSpec)throws
> HCatException;}}
> )
> Neither provides a way to "add-partitions-if-not-exist". There's value in
> adding such an API, for systems that add partitions to Hive tables, to be
> able to retry reliably (and avoid an AlreadyExistsException).
> This can be implemented using {{HiveMetaStoreClient.add_partitions( partList,
> ifNotExists, needREsults )}}, for HCatClientHMSImpl.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
