[
https://issues.apache.org/jira/browse/HIVE-2777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13201963#comment-13201963
]
Aniket Mokashi commented on HIVE-2777:
--------------------------------------
Yes, our goal is to merge multiple small files (partitions) into big ones. But,
we would like users to see the data as soon as it comes to warehouse. Also, one
limitation is we run from S3, that doesn't allow a move operation. So, with
that we have come up with an idea to transparently create a new location for
merged data and atomically drop and add partitions to point to it.
> ability to add and drop partitions atomically
> ---------------------------------------------
>
> Key: HIVE-2777
> URL: https://issues.apache.org/jira/browse/HIVE-2777
> Project: Hive
> Issue Type: New Feature
> Components: Metastore
> Reporter: Aniket Mokashi
> Fix For: 0.9.0
>
>
> Hive should have ability to atomically add and drop partitions. This way
> admins can change partitions atomically without breaking the running jobs. It
> allows admin to merge several partitions into one.
> Essentially, we would like to have an api- add_drop_partitions(String db,
> String tbl_name, List<Partition> addParts, List<List<String>> dropParts,
> boolean deleteData);
> This jira covers changes required for metastore and thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
