[
https://issues.apache.org/jira/browse/HIVE-7220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14038296#comment-14038296
]
Szehon Ho commented on HIVE-7220:
---------------------------------
Thanks for looking at the patch. I added that as prune left some inputSplit
without any valid path, and that was causing an ArrayIndexOutOfBounds further
down the line as some code tried to call getPath(0) on the split.
IsValidSplit() only returns false when all the splits are directories, so I
think it should be correct unless I'm missing something.
It fixed that case, but led to bunch of other test failures, so I need some
time to investigate those and rework the patch.
> Empty dir in external table causes issue (root_dir_external_table.q failure)
> ----------------------------------------------------------------------------
>
> Key: HIVE-7220
> URL: https://issues.apache.org/jira/browse/HIVE-7220
> Project: Hive
> Issue Type: Bug
> Reporter: Szehon Ho
> Assignee: Szehon Ho
> Attachments: HIVE-7220.patch
>
>
> While looking at root_dir_external_table.q failure, which is doing a query on
> an external table located at root ('/'), I noticed that latest Hadoop2
> CombineFileInputFormat returns split representing empty directories (like
> '/Users'), which leads to failure in Hive's CombineFileRecordReader as it
> tries to open the directory for processing.
> Tried with an external table in a normal HDFS directory, and it also returns
> the same error. Looks like a real bug.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
