Re:doris 1.2.3 查询hive外部表中orc格式表的问题

[Mingyu Chen]

Thanks for your debug.
We will fix it later. And you can add "hive.exec.orc.split.strategy" = "BI"
to your `create catalog` properties to avoid this issue 




--

Best Regards
Mingyu Chen

Email:
morning...@apache.org





在 2023-04-21 11:44:53，"宇宙蒙面侠X" <635734...@qq.com.INVALID> 写道：
>您好:
>&nbsp; &nbsp;从官网下载的doris 1.2.3, 查询 hive外表的时候出现
>
>
>Caused by: java.lang.NoSuchFieldError: types
>       at org.apache.hadoop.hive.ql.io.orc.ReaderImpl.(ReaderImpl.java:62) 
> ~[hive-exec-3.1.3-core.jar:3.1.3]
>       at 
> org.apache.hadoop.hive.ql.io.orc.OrcFile.createReader(OrcFile.java:96) 
> ~[hive-exec-3.1.3-core.jar:3.1.3]
>       at 
> org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$SplitGenerator.populateAndCacheStripeDetails(OrcInputFormat.java:1647)
>  ~[hive-exec-3.1.3-core.jar:3.1.3]
>       at 
> org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$SplitGenerator.callInternal(OrcInputFormat.java:1533)
>  ~[hive-exec-3.1.3-core.jar:3.1.3]
>       at 
> org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$SplitGenerator.access$2700(OrcInputFormat.java:1329)
>  ~[hive-exec-3.1.3-core.jar:3.1.3]
>       at 
> org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$SplitGenerator$1.run(OrcInputFormat.java:1513)
>  ~[hive-exec-3.1.3-core.jar:3.1.3]
>       at 
> org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$SplitGenerator$1.run(OrcInputFormat.java:1510)
>  ~[hive-exec-3.1.3-core.jar:3.1.3]
>       at java.security.AccessController.doPrivileged(Native Method) 
> ~[?:1.8.0-292]
>       at javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0-292]
>       at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1878)
>  ~[hadoop-common-3.3.3.jar:?]
>       at 
> org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$SplitGenerator.call(OrcInputFormat.java:1510)
>  ~[hive-exec-3.1.3-core.jar:3.1.3]
>       at 
> org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$SplitGenerator.call(OrcInputFormat.java:1329)
>  ~[hive-exec-3.1.3-core.jar:3.1.3]
>       at java.util.concurrent.FutureTask.run(FutureTask.java:266) 
> ~[?:1.8.0-292]
>       ... 3 more
>       
>查到 hive源码 发现&nbsp; org.apache.hadoop.hive.ql.io.orc.ReaderImpl 继承自 
>org.apache.orc.impl.ReaderImpl&nbsp;
>看安装包里orc相关的jar包
>
>
>[root@localhost lib]# ll | grep orc
>-rw-r--r--. 1 1103 1103&nbsp; 1565700 Mar 16 18:52 orc-core-1.5.5-nohive.jar
>-rw-r--r--. 1 1103 1103&nbsp; &nbsp;993835 Mar 16 18:52 orc-core-1.6.0.jar
>-rw-r--r--. 1 1103 1103&nbsp; &nbsp;812313 Mar 16 18:52 
>orc-mapreduce-1.5.5-nohive.jar
>-rw-r--r--. 1 1103 1103&nbsp; &nbsp; 27745 Mar 16 18:52 orc-shims-1.5.5.jar
>
>
>反编译发现&nbsp; orc-core-1.5.5-nohive.jar 中 org.apache.orc.impl.ReaderImpl 
>有types属性 ，orc-core-1.6.0.jar 的没有 。用 orc-core-1.5.5.jar 
>替换orc-core-1.6.0.jar&nbsp; 后重启fe ，查询正常