[
https://issues.apache.org/jira/browse/HIVE-23014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058019#comment-17058019
]
Panagiotis Garefalakis commented on HIVE-23014:
-----------------------------------------------
I believe this was addressed by HIVE-18738 and is now part of Hive 3.0 – not
sure if back-porting it to 2.3.6 would make sense (?)
> ORC reading performance
> -----------------------
>
> Key: HIVE-23014
> URL: https://issues.apache.org/jira/browse/HIVE-23014
> Project: Hive
> Issue Type: Bug
> Components: ORC
> Affects Versions: 2.3.6
> Reporter: Peter Toth
> Priority: Major
> Attachments: OrcReadBenchmark-results.txt.hive-1.2.1,
> OrcReadBenchmark-results.txt.hive-2.3.6
>
>
> Spark 3 adds support for using Hive 2.3.6 besides the old Hive 1.2.1 version.
> Some of the ORC reading benchmark shows that there is a huge performance
> difference in ORC reading between the 2 versions. I measured that
> {{org.apache.hadoop.hive.ql.io.orc.ReaderImpl}} in hive-exec-2.3.6-core.jar
> is ~3-5 times slower than in hive-exec-1.2.1.spark2.jar.
> I'm not sure if more recent Hive versions still suffer from this performance
> regression.
> Please see some details here: SPARK-30565
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
