I've noticed strange behaviour of hive. When you run query against
partitioned table like this: select * from mytable where log_date =
date_add('2023-09-10',1) limit 3 (mytable is partitioned by log_date
string column) hive is trying to evaluate date_add inside metastore and throws
except
t if you disable `hive.limit.optimize.enable`.
Regards, Okumin On Wed, Jul 5, 2023 at 9:40 PM Wojtek Meler <
wme...@wp.pl > wrote: Hi, after switching to Hive 4.0 and Tez on yarn
I've noticed that simple fetch queries run much longer. I have following
configuration: hive
Hi, after switching to Hive 4.0 and Tez on yarn I've noticed that simple
fetch queries run much longer. I have following configuration:
hive.fetch.task.conversion=more
hive.fetch.task.conversion.threshold=1073741824
hive.limit.optimize.enable=true hive.limit.optimize.fetch.max=5
hiv
Any other options with DbTxnManager to prevent the access from hive queries to
files on hdfs while performing maintenance of external tables ?
Would it force non-DummyTxtManager instances to not access external tables
during exclusive locks? Dnia 1 lutego 2023 15:55 Denys Kuzmenko
napisał(a): DbTxnManager comes with DbLockManager
implementation that doesn't support explicit lock/unlock functionality.
That's
We are using external tables on early stages of ETL. Next we switch to managed
tables as we don't need to worry about partition management. With
DummyTxnManager we had problems dealing with managed tables. Regards, Wojtek
Dnia 1 lutego 2023 10:31 Denys Kuzmenko
nap
with that
transaction manager. Any other options to exclusively lock partition? Dnia
30 stycznia 2023 23:29 Sai Hemanth Gantasala <saihema...@cloudera.com>
napisał(a): Hi Wojtek Meler, Have you tried setting the below config before
running the queries? set hive.txn.ext.locking.enable
I've enabled external tables locking with issues.apache.org [HIVE-26258]
Provide an option for enable locking of external tables - ASF JIRA (apache.org)
but still locking with HQL is not posible:
org.apache.hadoop.hive.ql.metadata.HiveException: Current transaction manager
does not support