Re: hive standalone can't find MaterializationsCacheCleanerTask

2022-09-07 Thread second_comet.yahoo.com via user
Hello Stamatis,  Thank you for the reply. which class should i use to set property as a replacement of MaterializationsCacheCleanerTask for Hive 3.1 onward?    metastore.task.threads.always   org.apache.hadoop.hive.metastore.events.EventCleanerTask,org.apache.hadoop.hive.metasto

Re: HiveServer2 slowly increaseing background CPU usage until restated

2022-09-07 Thread gwenael le barzic
Hello! In addition to the CPU, did you see if the heap usage of the HS2 was increasing, please ? Le mer. 7 sept. 2022 à 11:48, Deepak Goel a écrit : > Can you please post the utilisation graph of r5.24xlarge too? > > > Deepak > "The greatness of a nation can be judged by the way its animals are

Re: hive standalone can't find MaterializationsCacheCleanerTask

2022-09-07 Thread Stamatis Zampetakis
The task was removed by the following commit. Check HIVE-20006 and related jiras for more details. commit 1b5903b035c3b3ac02efbddf36d5438cda97cc91 Author: Jesus Camacho Rodriguez Date: Tue Jun 26 11:37:27 2018 -0700 HIVE-20006: Make materializations invalidation cache work with multiple ac

Re: HiveServer2 slowly increaseing background CPU usage until restated

2022-09-07 Thread Deepak Goel
Can you please post the utilisation graph of r5.24xlarge too? Deepak "The greatness of a nation can be judged by the way its animals are treated - Mahatma Gandhi" +91 73500 12833 deic...@gmail.com Facebook: https://www.facebook.com/deicool LinkedIn: www.linkedin.com/in/deicool "Plant a Tree, G

Re: HiveServer2 slowly increaseing background CPU usage until restated

2022-09-07 Thread Stamatis Zampetakis
Hi Laurence, It's hard to say just by seeing the graphs. Moreover Hive 2.3.1 is a quite old version so there are many things that may go wrong. I would suggest checking the logs and taking jstacks overtime and/or use a profiler (such as async-profiler[1]) to see what HS2 is actually doing while C