Re: Slow Hive query with a lot of 'get_materialized_views_for_rewriting'

2023-11-15 Thread Butao Zhang
Hi, which version of hms are you using now? I have checked the master branch and beta-1 branch source code, but I can't find the place where this method get_materialized_views_for_rewriting is called by mistake. Thanks, Butao Zhang Replied Message | From | Eugene Miretsky | | Dat

Slow Hive query with a lot of 'get_materialized_views_for_rewriting'

2023-11-15 Thread Eugene Miretsky
Hey! We have a catalog with fairly a lot of databases and tables. Where we do a simple query (select * from table limit 5;) on an ideal cluster, it takes around 20seconds, sometimes longer (usually first run takes 40s+) Looking at the hive-metastore logs during most of the query time the logs sh

Question on Hive Metastore catalog support

2023-11-15 Thread Flavio Junqueira
Hello there, I'm interested in understanding the Hive Metastore catalog support. I see references in the metastore code to catalogs, for example: https://github.com/apache/hive/blob/17525f169b9a08cd715bfb42899e45b7c689c77a/standalone-metastore/metastore-common/src/main/protobuf/org/apache/h