[
https://issues.apache.org/jira/browse/HIVE-2629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13183312#comment-13183312
]
Amareshwari Sriramadasu commented on HIVE-2629:
-----------------------------------------------
Reverted the previous commit, as the patch broke CombineFileInputFormat changes
in 23 shims.
Jobs which use CombineFileInputFormat fail with following exception:
java.lang.ClassCastException: [Lorg.apache.hadoop.mapred.InputSplit; cannot be
cast to [Lorg.apache.hadoop.mapred.lib.CombineFileSplit;
at
org.apache.hadoop.hive.shims.HadoopShimsSecure$CombineFileInputFormatShim.getSplits(HadoopShimsSecure.java:387)
at
org.apache.hadoop.hive.shims.HadoopShimsSecure$CombineFileInputFormatShim.getSplits(HadoopShimsSecure.java:353)
at
org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getSplits(CombineHiveInputFormat.java:387)
at
org.apache.hadoop.mapreduce.JobSubmitter.writeOldSplits(JobSubmitter.java:472)
at
org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:464)
at
org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:360)
at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159)
at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156)
at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:571)
at
org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:432)
at org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:690)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:189)
Job Submission failed with exception
'java.lang.ClassCastException([Lorg.apache.hadoop.mapred.InputSplit; cannot be
cast
Looks like we need to have Hadoop20SShims.java and Hadoop23Shims.java files
with proper CombineFileInputFormat changes for each version.
> Make a single Hive binary work with both 0.20.x and 0.23.0
> ----------------------------------------------------------
>
> Key: HIVE-2629
> URL: https://issues.apache.org/jira/browse/HIVE-2629
> Project: Hive
> Issue Type: Bug
> Components: Shims
> Reporter: Carl Steinbach
> Assignee: Thomas Weise
> Fix For: 0.8.1, 0.9.0
>
> Attachments: HIVE-2629.3.patch, HIVE-2629.D711.1.patch,
> HIVE-2629.D711.2.patch, HIVE-2629.D711.3.patch, HIVE-2629.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
