[ 
https://issues.apache.org/jira/browse/HIVE-7220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Szehon Ho updated HIVE-7220:
----------------------------

    Attachment: HIVE-7220.2.patch

I took another look at this, it was missing some things.  The startOffset and 
length arrays on the split correspond to the invalid paths, and must be pruned 
as well if path is pruned.  Giving it another try.

> Empty dir in external table causes issue (root_dir_external_table.q failure)
> ----------------------------------------------------------------------------
>
>                 Key: HIVE-7220
>                 URL: https://issues.apache.org/jira/browse/HIVE-7220
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Szehon Ho
>            Assignee: Szehon Ho
>         Attachments: HIVE-7220.2.patch, HIVE-7220.patch
>
>
> While looking at root_dir_external_table.q failure, which is doing a query on 
> an external table located at root ('/'), I noticed that latest Hadoop2 
> CombineFileInputFormat returns split representing empty directories (like 
> '/Users'), which leads to failure in Hive's CombineFileRecordReader as it 
> tries to open the directory for processing.
> Tried with an external table in a normal HDFS directory, and it also returns 
> the same error.  Looks like a real bug.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to