[
https://issues.apache.org/jira/browse/HIVE-1980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12997976#comment-12997976
]
Ning Zhang commented on HIVE-1980:
----------------------------------
This is not a problem for non-dynamic partition inserts because the input and
output is a single directory/partition. So even if there is only 1 reducer the
output will be a correct merge of the input files. In the dynamic partition
case, we have to guarantee that a single reducer only takes input from 1
partition. Otherwise the result partition will be mixed with different input
partitions.
> Merging using mapreduce rather than map-only job failed in case of dynamic
> partition inserts
> --------------------------------------------------------------------------------------------
>
> Key: HIVE-1980
> URL: https://issues.apache.org/jira/browse/HIVE-1980
> Project: Hive
> Issue Type: Bug
> Reporter: Ning Zhang
> Assignee: Ning Zhang
> Attachments: HIVE-1980.patch
>
>
> In dynamic partition insert and if merge is set to true and
> hive.mergejob.maponly=false, the merge MapReduce job will fail.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira