Re: Hive 3 has big performance improvement from my test

2023-01-08 Thread Sungwoo Park
Our claim is based on TPC-DS results reported in https://www.datamonad.com/post/2022-04-01-spark-hive-performance-1.4/ for 1) and https://www.datamonad.com/post/2021-08-18-spark-mr3/ for 2). Not sure about what you mean by 'Hive ability on handling MR'. One may draw different conclusions from the s

Re: Hive 3 has big performance improvement from my test

2023-01-08 Thread Mich Talebzadeh
What bothers me is that you are making sweeping statements about Spark inability to handle quote " ... the key weakness of Spark is 1) its poor performance when executing concurrent queries and 2) its poor resource utilization when executing multiple Spark applications concurrently" and conversely