I should have mentioned earlier, but we encountered our problem with
queries between Trino and Hive3 MetaStore.
The tests I reported were also querying Hive1/3 MetaStore using Trino. The
problem might only exist between Trino and Hive3 MetaStore.
- Takanobu
2024年3月1日(金) 14:53 Takanobu Asanuma :
Yes, for now, we believe that HIVE-14187 has caused performance degradation
in Hive3 MetaStore.
We also use HiveServer2, but our HiveServer2 directly accesses the backend
DB without going through the Hive MetaStore, because it enhances
performance to directly access the DB in a heavily loaded clus
Thank you for sharing the result. (Does your result imply that HIVE-14187
is introducing an intended bug?)
Another issue that could be of your interest is the connection leak problem
reported in HIVE-20600. Do you see the connection leak problem, or is it
not relevant to your environment (e.g., be
Hi Pau and Sungwoo,
Thanks for sharing the information.
We tested a set of simple queries which just referenced the Hive table and
didn't execute any Hive jobs. The result is below.
No. Version rawstore.impl connectionPoolingType HIVE-14187 QueryTime
-
We didn't make any other attempt to fix the problem and just decided not to
use CachedStore. However, I think our installation of Metastore based on
Hive 3.1.3 is running without any serious problems.
Could you share how long it takes to compile typical queries in your
environment (with Hive 1 and
Hi,
We also had to disable CachedStore as it was producing wrong results in our
queries.
I'm sorry I cannot provide more detailed info.
Cheers,
Pau.
Missatge de Takanobu Asanuma del dia dc., 28 de febr.
2024 a les 13:59:
> Thanks for your detailed answer!
>
> In the original email, you report
Thanks for your detailed answer!
In the original email, you reported "the query compilation takes long" in
Hive 3.0, but has this issue been resolved in your fork of Hive 3.1.3?
Thank you for sharing the issue with CachedStore and the JIRA tickets.
I will also try out metastore.stats.fetch.bitvect
Hello Takanobu,
We did not test with vanilla Hive 3.1.3 and Metastore databases can be
different, so I don't know why Metastore responses are very slow. I can
only share some results of testing CachedStore in Metastore. Please note
that we did not use vanilla Hive 3.1.3 and instead used our own fo
Hi Sungwoo Park,
I'm sorry for the late reply to this old email.
We are attempting to upgrade Hive MetaStore from Hive1 to Hive3, and
noticed that the response of the Hive3 MetaStore is very slow.
We suspect that HIVE-14187 might be causing this slowness.
Could you tell me if you have resolved thi
