Harish JP created HIVE-25521:
--------------------------------

             Summary: Fix concatenate file handling when files of different 
compressions are in same table/partition.
                 Key: HIVE-25521
                 URL: https://issues.apache.org/jira/browse/HIVE-25521
             Project: Hive
          Issue Type: Bug
            Reporter: Harish JP
            Assignee: Harish JP


Currently if files of different compressions are in same directory then 
concatenate can fail and cause data corruption. This happens because file can 
be moved by one task as incompatible file and the other tasks will fail after 
this.

 

This issue is addressed in this Jira by only processing a file in one task 
where offset 0 is process and ignoring the the file in all other tasks.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to