Kanwaljit Singh created HIVE-4906:
-------------------------------------
Summary: IO Exception for empty file not found if IP address used
in core site instead of hostname
Key: HIVE-4906
URL: https://issues.apache.org/jira/browse/HIVE-4906
Project: Hive
Issue Type: Bug
Components: HiveServer2
Affects Versions: 0.10.0
Reporter: Kanwaljit Singh
The hive server has core-site.xml with IP address for DFS namenode instead of
the hostname. But it also has host ip mapping. We are getting this error. I
think the host reverse mapping is not taking place while trying to access the
folder on the HDFS.
hive> select httpurl, ptime from edr where ptime='2013-07-07 10:35:00' limit 10;
Total MapReduce jobs = 1
Launching Job 1 out of 1
Number of reduce tasks is set to 0 since there's no reduce operator
java.io.IOException: cannot find dir =
hdfs://Namenode-VIP:9000/tmp/hive-admin/hive_2013-07-19_07-56-06_498_6777975312240173780/-mr-10002/1/emptyFile
in pathToPartitionInfo:
[hdfs://192.168.172.87:9000/tmp/hive-admin/hive_2013-07-19_07-56-06_498_6777975312240173780/-mr-10002/1]
at
org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getPartitionDescFromPathRecursively(HiveFileFormatUtils.java:298)
at
org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getPartitionDescFromPathRecursively(HiveFileFormatUtils.java:260)
at
org.apache.hadoop.hive.ql.io.CombineHiveInputFormat$CombineHiveInputSplit.<init>(CombineHiveInputFormat.java:104)
at
org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getSplits(CombineHiveInputFormat.java:407)
at org.apache.hadoop.mapred.JobClient.writeOldSplits(JobClient.java:929)
at org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:921)
at org.apache.hadoop.mapred.JobClient.access$500(JobClient.java:170)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:838)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:791)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Unknown Source)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:791)
at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:765)
at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:447)
at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:136)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
