Hive Metastore Authorization

2022-12-28 Thread Colin Williams
within the Metastore, and fetch it's Table Schema? If so would someone point out some examples on a configuration like this? If Hive Metastore doesn't allow for this Authorization, can someone suggest what alternatives exist? Kind Regards, Colin Williams

Re: adding parquet partitions to external table (msck repair table not working)

2019-01-15 Thread Colin Williams
nual alter table / add partition steps. Thanks, Colin Williams On Wed, Jan 2, 2019 at 10:17 AM Vihang Karajgaonkar wrote: > > What version of Hive are you using? You should look at the HS2 logs to see if > there were any errors from msck command which ignored such partitions. Also, >

adding parquet partitions to external table (msck repair table not working)

2018-12-30 Thread Colin Williams
Hello, I have a parquet datasource that I'm writing via spark. For some reason this particular source will not pick up added partitions with msck repair table. However if I alter table tablename / add partition (key=value) then it works. However this is more cumbersome than msck repair table. Is

Accessing hive column statistics via JDBC or scripts to publish externally

2018-09-12 Thread Colin Williams
Hello, I'm interested in accessing the hive column statistics, and publishing to another source. Currently the only way I'm aware to access these is via DESCRIBE FORMATTED tablename column_name . But the result seems like a custom format that would be difficult to parse and could break. On said p

iterating on table columns using show columns or similar

2018-07-30 Thread Colin Williams
Hello, I'd like to write some HQL to iterate on the columns of a table. When I show columns in the result shows rows returned and what looks like a column called field. Then it seems like I should be able to use a subquery to write a select statment for each of these result rows but I just haven'

Re: Hive beeline and ACID tables.

2018-02-15 Thread Colin Williams
gt; other relevant properties) hive-site.xml so that all sessions agree on > which lock manager/txn manager they are using. > > > > Eugene > > > > *From: *Colin Williams > *Reply-To: *"user@hive.apache.org" > *Date: *Thursday, February 15, 2018 at 8:54 AM

Re: Hive beeline and ACID tables.

2018-02-15 Thread Colin Williams
Looking back I may have omitted the --hiveconf setting. I will try creating the table again today and see if that was the issue. On Thu, Feb 15, 2018 at 8:51 AM, Colin Williams < colin.williams.seat...@gmail.com> wrote: > Hi Johannes. I did set the "transactional" pr

Re: Hive beeline and ACID tables.

2018-02-15 Thread Colin Williams
https://cwiki.apache.org/confluence/display/Hive/Hive+Transactions > > For your error, the SELECT, maybe it is simply a copy-n-paste issue in > your mail, but your hiveconf parameter is missing a - ... it is beeline > --hiveconf ..., not beeline -hiveconf > > Regards, > > Joh

Hive beeline and ACID tables.

2018-02-14 Thread Colin Williams
Hello, I'm new to hive and had been porting some Redshift SQL to Hive. Today I ran across a table that uses update. After a somewhat time consuming translation process I was able to load the create table definition. However the update part returned an error about update not supported on non-acid