[
https://issues.apache.org/jira/browse/HIVE-1918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12992606#comment-12992606
]
Krishna Kumar commented on HIVE-1918:
-------------------------------------
Hmm. LoadSemanticAnalyzer (which knows the table) does not add it to the
outputs, but the MoveTask it schedules, does.
Similarly, CREATE-TABLE does not add the entity but the DDLTask it schedules,
does. This may be fine only because the entity does not exist at compile time?
ADD-PARTITION adds the table as an *input* at compile time and the partition
itself is added as an output at execution time. Should not the table be an
output (at compile time) as well - for authorization/concurrency purposes?
Anyway, where the import operates on existing tables/partitions, I will add
them at compile time. If the entity is being created as part of the task, then
the task will be adding them to inputs/outputs at runtime. Is this fine?
> Add export/import facilities to the hive system
> -----------------------------------------------
>
> Key: HIVE-1918
> URL: https://issues.apache.org/jira/browse/HIVE-1918
> Project: Hive
> Issue Type: New Feature
> Components: Query Processor
> Reporter: Krishna Kumar
> Assignee: Krishna Kumar
> Attachments: HIVE-1918.patch.1.txt, HIVE-1918.patch.2.txt,
> HIVE-1918.patch.3.txt, HIVE-1918.patch.txt, hive-metastore-er.pdf
>
>
> This is an enhancement request to add export/import features to hive.
> With this language extension, the user can export the data of the table -
> which may be located in different hdfs locations in case of a partitioned
> table - as well as the metadata of the table into a specified output
> location. This output location can then be moved over to another different
> hadoop/hive instance and imported there.
> This should work independent of the source and target metastore dbms used;
> for instance, between derby and mysql.
> For partitioned tables, the ability to export/import a subset of the
> partition must be supported.
> Howl will add more features on top of this: The ability to create/use the
> exported data even in the absence of hive, using MR or Pig. Please see
> http://wiki.apache.org/pig/Howl/HowlImportExport for these details.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
