[ 
https://issues.apache.org/jira/browse/HIVE-1980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12997976#comment-12997976
 ] 

Ning Zhang commented on HIVE-1980:
----------------------------------

This is not a problem for non-dynamic partition inserts because the input and 
output is a single directory/partition. So even if there is only 1 reducer the 
output will be a correct merge of the input files. In the dynamic partition 
case, we have to guarantee that a single reducer only takes input from 1 
partition. Otherwise the result partition will be mixed with different input 
partitions. 

> Merging using mapreduce rather than map-only job failed in case of dynamic 
> partition inserts
> --------------------------------------------------------------------------------------------
>
>                 Key: HIVE-1980
>                 URL: https://issues.apache.org/jira/browse/HIVE-1980
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Ning Zhang
>            Assignee: Ning Zhang
>         Attachments: HIVE-1980.patch
>
>
> In dynamic partition insert and if merge is set to true and 
> hive.mergejob.maponly=false, the merge MapReduce job will fail. 

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to