Janarthanan created HIVE-11117:
----------------------------------

             Summary: Hive external table - skip header and trailer property 
issue
                 Key: HIVE-11117
                 URL: https://issues.apache.org/jira/browse/HIVE-11117
             Project: Hive
          Issue Type: Bug
            Reporter: Janarthanan


I am using an external hive table pointing to a HDFS location. The external 
table is partitioned on year/mm/dd folders. When there are more than one 
partition folder (ex: /2015/01/02/file.txt & /2015/01/03/file2.txt), the select 
on external table, skips the DATA RECORD instead of skipping the header/trailer 
record from one of the file). 

tblproperties ("skip.header.line.count"="1");

Resolution: On enabling hive.input format instead of text input format and 
execution using TEZ engine instead of MapReduce resovled the issue. 

How to resolve the problem without setting these parameters ? I don't want to 
run the hive query using TEZ.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to