Re: HIVE-28488/28489/28490 and the performance of Hive 4.0.1 on MR3 1.12 (vs Trino 453)

2024-11-28 Thread Sungwoo Park
Hello, We've merged all three pull requests. Thanks for your contributions. > The updated version of HIVE-28489 additionally reduces the total running time of 10TB TPC-DS by about 100 seconds. So, the total running time now decreases from around 5700s to 5200s. Considering the maturity of the Hiv

Re: HIVE-28488/28489/28490 and the performance of Hive 4.0.1 on MR3 1.12 (vs Trino 453)

2024-11-28 Thread Shohei Okumiya
Hi, We've merged all three pull requests. Thanks for your contributions. > 1. The query plan is identical, but Trino is much faster. This is due to the > architectural difference between Trino and Hive (on shuffle-intensive > queries): Trino is based on MPP and thus uses the push model, while H