Re: Announce: MR3 0.3, and performance comparison with Hive-LLAP, Presto, Spark, Hive on Tez

The article can be found at: https://mr3.postech.ac.kr/blog/2018/08/15/comparison-llap-presto-spark-mr3/ -- Sungwoo Park On Thu, Aug 16, 2018 at 10:53 PM, Sungwoo Park wrote: > Hello Hive users, > > I am pleased to announce the release of MR3 0.3. A new feature of MR3 0.3 > is its support for

Announce: MR3 0.3, and performance comparison with Hive-LLAP, Presto, Spark, Hive on Tez

Hello Hive users, I am pleased to announce the release of MR3 0.3. A new feature of MR3 0.3 is its support for Hive 3.0.0 on Hadoop 2.7/2.8/2.9. I have also published a blog article that uses the TPC-DS benchmark to compare the following six systems: 1) Hive-LLAP included in HDP 2.6.4 2) Presto 0

[Hive Metastore] Add a Configuration Item to Skip the HDFS Data Modification

As stated in HIVE-20398 When we are conducting the hive upgrading, we have following use case: We want to sync the operations between two metastore server (A and B) by thrift api, but both them are based on the same HDFS. So, for operations like drop_partitions, drop_table, insert_overwrite,

Re: External Table Creation is slow/hangs

Hi, I can't tell for sure where your problem is coming from, but from what you said, I guess that the Hive Metastore is performing some list or scan operation on the files and that operation is taking a very long time. maybe setting *hive.stats.autogather* to false might help. Also, beware that