Hcatalog api - kerberos and knox

2015-10-15 Thread Rachna Jotwani Bakhru
I have a java application which reads hive metadata using hcatalog apis. If I need to read metadata from a hive database on a cluster with Kerberos and knox, would the following configuration work? HiveConf hcatConf = new HiveConf(); hcatConf.setVar(HiveConf.ConfVars.METASTOREURIS, “thrift://serv

RE: Problem with Hive metastore

2015-10-15 Thread Gary Clark
I’m using Derby database. I blew away the metastore.db away and restarted everything from scratch. From: Mich Talebzadeh [mailto:m...@peridale.co.uk] Sent: Thursday, October 15, 2015 3:52 PM To: user@hive.apache.org Subject: RE: Problem with Hive metastore What type of metastore are you using?

Strict mode and joins

2015-10-15 Thread Edward Capriolo
channel_meta.section_name = article_meta.channel WHERE entry_hourly_v3.dt=2015101517 AND article_meta.dt=2015101517 AND channel_meta.hitdate=20151015 AND article_meta.publish_timestamp > ((unix_timestamp() * 1000) - (1000 * 60 * 60 * 24 * 2)) GROUP entry_hourly_v3, channel_meta and article_meta

Re: Problem with Hive metastore

2015-10-15 Thread Jerrick Hoang
set the port to a new port export METASTORE_PORT=10001 then run ./hive --service metastore --verbose in the same session. You should be able to see another metastore starting in the port 10001 On Thu, Oct 15, 2015 at 1:52 PM, Mich Talebzadeh wrote: > What type of metastore are you using? > > > >

RE: Problem with Hive metastore

2015-10-15 Thread Mich Talebzadeh
What type of metastore are you using? Mich Talebzadeh Sybase ASE 15 Gold Medal Award 2008 A Winning Strategy: Running the most Critical Financial Data on ASE 15 http://login.sybase.com/files/Product_Overviews/ASE-Winning-Strategy-091908.pdf Author of the books "A Practitioner’s Guide

Best way to deal with incompatible column type changes

2015-10-15 Thread Udit Mehta
Hi, I have a Hive external table with a lot of partitions where the underlying data is in JSON. I use this popular serde to read and write in JSON format. So I have a data stream where sometimes there are changes to the JSON structure. For eg, a key mi

RE: View definition information

2015-10-15 Thread Rachna Jotwani Bakhru
Thanks I have created the Jira request. From: Alan Gates [mailto:alanfga...@gmail.com] Sent: Thursday, October 15, 2015 7:21 AM To: user@hive.apache.org Subject: Re: View definition information It should certainly be possible. Can you file a JIRA adding this as a new feature, and if you'r

RE: Problem with Hive metastore

2015-10-15 Thread Gary Clark
Thanks yes I did that and the blighter was still failing. I am going to dig around if I see anything I will let you know. From: Mich Talebzadeh [mailto:m...@peridale.co.uk] Sent: Thursday, October 15, 2015 3:37 PM To: user@hive.apache.org Subject: RE: Problem with Hive metastore Hi Gary, Do th

RE: Problem with Hive metastore

2015-10-15 Thread Mich Talebzadeh
Hi Gary, Do the following at OS level /bin/netstat -alnp|egrep 'Local|9083' Do you see any connection. If so then it is already running like below: netstat -alnp|egrep 'Local|9083' Proto Recv-Q Send-Q Local Address Foreign Address State PID/P

Re: View definition information

2015-10-15 Thread Alan Gates
It should certainly be possible. Can you file a JIRA adding this as a new feature, and if you're so inclined feel free to contribute a patch to add this. Alan. Rachna Jotwani Bakhru October 14, 2015 at 16:47 We are currently using the HCatalog API to get the Hive Da

Problem with Hive metastore

2015-10-15 Thread Gary Clark
Hello, I hit a problem this morning: ./hive –service metastore Caused by: MetaException(message:Could not connect to meta store using any of the URIs provided. Most recent failure: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused I did not see an

Syntax for SHOW TABLE EXTENDED

2015-10-15 Thread Subroto Sanyal
Hi , I am using Hive 0.14 and try to execute a query: SHOW TABLE EXTENDED in sampledb LIKE 'custom_table' PARTITION (test_partition='0') This query ends up with exception: FAILED: SemanticException [Error 10001]: Table not found custom_table but, the query works when little change is made to