On Mon, 14 Jun 2021 at 19:07, Mich Talebzadeh <mich.talebza...@gmail.com> wrote:
> > > Now I am trying to read it in Hive > > 0: jdbc:hive2://rhes75:10099/default> desc test.randomDataDelta; > +----------------+--------------+----------+ > | col_name | data_type | comment | > +----------------+--------------+----------+ > | id | int | | > | clustered | int | | > | scattered | int | | > | randomised | int | | > | random_string | varchar(50) | | > | small_vc | varchar(50) | | > | padding | varchar(40) | | > +----------------+--------------+----------+ > 7 rows selected (0.169 seconds) > 0: jdbc:hive2://rhes75:10099/default> > > *select count(1) from test.randomDataDelta;Error: Error while processing > statement: FAILED: Execution Error, return code 1 from > org.apache.hadoop.hive.ql.exec.mr.MapRedTask. ORC split generation failed > with exception: java.lang.NoSuchMethodError: > org.apache.hadoop.fs.FileStatus.compareTo(Lorg/apache/hadoop/fs/FileStatus;)I > (state=08S01,code=1)* > > I did a Google search and showed the error I raised three years ago > > > https://user.hive.apache.narkive.com/Td3He6Vj/failed-execution-error-return-code-1-from-org-apache-hadoop-hive-ql-exec-mr-mapredtask-orc-split > > So it has not been fixed yet! > Looking at the commit log for FileStatus shows HADOOP-14683 touching compareTo, which cross references https://issues.apache.org/jira/browse/HIVE-17133 , which fixes are regression in https://issues.apache.org/jira/browse/HADOOP-12209 which was committed by, er, one ste...@apache.org, whoever they are (*). Try to build hive with the patch, drop in the modified JAR and verify it works, then confirm this on the hive JIRA. That will reassure reviewers this patch is needed and correct. steve (*) hadn't seen that regression; we should maybe have fixed by reinstating the old compareTo(Object) as an overloaded call, but it may have been impossible Comparator has expectations.
