Dr Mich Talebzadeh
LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* http://talebzadehmich.wordpress.com *Disclaimer:* Use it at your own risk. Any and all responsibility for any loss, damage or destruction of data or any other property which may arise from relying on this email's technical content is explicitly disclaimed. The author will in no case be liable for any monetary damages arising from such loss, damage or destruction. With Hadoop 3.0.3 I had the following 0: jdbc:hive2://rhes75:10099/default> select count(1) from sales; Error: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask. ORC split generation failed with exception: java.lang.NoSuchMethodError: org.apache.hadoop.fs.FileStatus.compareTo(Lorg/apache/hadoop/fs/FileStatus;)I (state=08S01,code=1) I upgraded Hadoop from 3.0.3 to 3.1.0and the same operation on that ORC table works now 0: jdbc:hive2://rhes75:10099/default> select count(1) from sales; +---------+ | _c0 | +---------+ | 917359 | +---------+ On Mon, 25 Jun 2018 at 18:27, Mich Talebzadeh <mich.talebza...@gmail.com> wrote: > Thanks > > I assume two things > > Create these ORC tables from scratch and populate them. These are older > tables from 2.7 > > Do I need to upgrade to Hadoop 3.1 as suggested as well? Or I can keep the > current 3.0.3 of Hadoop and just redo these ORC tables again > > Sounds like I need to upgrade Hadoop to 3.1? > > > Dr Mich Talebzadeh > > > > LinkedIn * > https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw > <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* > > > > http://talebzadehmich.wordpress.com > > > *Disclaimer:* Use it at your own risk. Any and all responsibility for any > loss, damage or destruction of data or any other property which may arise > from relying on this email's technical content is explicitly disclaimed. > The author will in no case be liable for any monetary damages arising from > such loss, damage or destruction. > > > > > On Mon, 25 Jun 2018 at 18:18, Gopal Vijayaraghavan <gop...@apache.org> > wrote: > >> > This is Hadoop 3.0.3 >> > java.lang.NoSuchMethodError: >> org.apache.hadoop.fs.FileStatus.compareTo(Lorg/apache/hadoop/fs/FileStatus;)I >> (state=08S01,code=1) >> > Something is missing here! Is this specific to ORC tables? >> >> No, it is a Hadoop BUG. >> >> https://issues.apache.org/jira/browse/HADOOP-1468 >> >> Fixed in Hadoop-2.8.2+ & most likely this is happening because you have >> built something against Hadoop-2.7.3 (Parquet and ORC default to the 2.7.3, >> so you need to rebuild them over for Hadoop3). >> >> Cheers, >> Gopal >> >> >>
