hive running udf in metastore can't load configuration with xinclude

2023-09-21 Thread Wojtek Meler
I've noticed strange behaviour of hive. When you run query against partitioned table like this: select * from mytable  where log_date = date_add('2023-09-10',1) limit 3  (mytable is partitioned by log_date string column) hive is trying to evaluate date_add inside metastore and throws except

Odp: Re: Tez & fetch task conversion

2023-08-03 Thread Wojtek Meler
t if you disable `hive.limit.optimize.enable`. Regards, Okumin On Wed, Jul 5, 2023 at 9:40 PM Wojtek Meler < wme...@wp.pl > wrote: Hi, after switching to Hive 4.0 and Tez on yarn I've noticed that simple fetch queries run much longer. I have following configuration: hive

Tez & fetch task conversion

2023-07-05 Thread Wojtek Meler
Hi, after switching to Hive 4.0 and Tez on yarn I've noticed that simple fetch queries run much longer. I have following configuration: hive.fetch.task.conversion=more hive.fetch.task.conversion.threshold=1073741824 hive.limit.optimize.enable=true hive.limit.optimize.fetch.max=5 hiv

Re: Odp: Re: hive 4.0.0-alpha2 external table locks

2023-02-09 Thread Wojtek Meler
Any other options with DbTxnManager to prevent the access from hive queries to files on hdfs while performing maintenance of external tables ?

Re: Odp: Re: hive 4.0.0-alpha2 external table locks

2023-02-02 Thread Wojtek Meler
Would it force non-DummyTxtManager instances to not access external tables during exclusive locks? Dnia 1 lutego 2023 15:55 Denys Kuzmenko napisał(a): DbTxnManager comes with DbLockManager implementation that doesn't support explicit lock/unlock functionality. That's

Re: Odp: Re: hive 4.0.0-alpha2 external table locks

2023-02-01 Thread Wojtek Meler
We are using external tables on early stages of ETL. Next we switch to managed tables as we don't need to worry about partition management. With DummyTxnManager we had problems dealing with managed tables. Regards, Wojtek Dnia 1 lutego 2023 10:31 Denys Kuzmenko nap

Odp: Re: hive 4.0.0-alpha2 external table locks

2023-01-31 Thread Wojtek Meler
with that transaction manager. Any other options to exclusively lock partition? Dnia 30 stycznia 2023 23:29 Sai Hemanth Gantasala <saihema...@cloudera.com> napisał(a): Hi Wojtek Meler, Have you tried setting the below config before running the queries? set hive.txn.ext.locking.enable

hive 4.0.0-alpha2 external table locks

2023-01-27 Thread Wojtek Meler
I've enabled external tables locking with  issues.apache.org [HIVE-26258] Provide an option for enable locking of external tables - ASF JIRA (apache.org)  but still locking with HQL is not posible: org.apache.hadoop.hive.ql.metadata.HiveException: Current transaction manager does not support