Re: Hive 0.12.0 mysql metastore exception

Hi, jov Thanks for your attention. we use hive like this: hive -e "use abc; insert overwrite ." Here, abc is a hive schema which already exists in hive metastore. But, from the log we can see, hive ddl switch database is failed. That is to say, it doesn't read the exist schema? 2014-01-23 06

Re: Hive 0.12.0 mysql metastore exception

2014/1/23 Jander g > Caused by: java.sql.BatchUpdateException: Duplicate entry 'default' for > key 2 what is the HQL you run? it look like hive try to insert 'default' to a meta table which violate the unique key. Jov blog: http:amutu.com/blog

Hive 0.12.0 mysql metastore exception

Hi, guys I upgrade hive 0.70 to hive 0.12.0 recently. We resolve some problems, but the one as follows puzzles me. We have thousands jobs every day and that will have about 40 this errors. I increase mysql max connections from 2000 to 4000 and I found the history max connection less than 2000. A

DESCRIBE EXTENDED show numRows=0

Hi, I have observed that DESCRIBE EXTENDED always shows number of rows to be zero despite the fact that the table has data. Is it a bug? Is it known ? Has anyone else also come across the same ? Thanks,

Re: Using Hive metastore as general purpose RDBMS

Hi Alan, thank you for your reply. The loose idea I had was to store one row in the RDBMS per Hive partition so I don't think the size will be an issue (expecting 3000 partitions or so). The end goal was to help to decide which partitions that are relevant for a query. Something like adding partit

HIVE SUB QUERY:: How to implement this case

Hello all, I have a case statement where I need to work like this logic. select as_of_dt as as_of_dt, max_feed_key as max_feed_key, min_feed_key as min_feed_key from table feed_key_temp where max_fed_key > ( select max(feed_key) from summ_table ) group by as_of_dt ; Here, max_feed_key and min_f

Re: Using Hive metastore as general purpose RDBMS

HCatalog is definitely not designed for this purpose. Could you explain your use case more fully? Is this indexing for better query planning or faster file access? If so, you might look at some of the work going on in ORC, which is storing indices of its data in the format itself for these pu

Re: Formatting hive queries

Thanks john. I shall check this out — Sent from Mailbox for iPhone On Wed, Jan 22, 2014 at 7:45 PM, John Meagher wrote: > I use vim and https://github.com/vim-scripts/SQLUtilities to do it. > It's not hive specific. Any SQL formatting tool will work. > On Tue, Jan 21, 2014 at 11:23 PM, pandees

Re: Formatting hive queries

I use vim and https://github.com/vim-scripts/SQLUtilities to do it. It's not hive specific. Any SQL formatting tool will work. On Tue, Jan 21, 2014 at 11:23 PM, pandees waran wrote: > Hi, > > I would like to come up with a code which automatically formats your hql > files. > Because, formatting

HiverServer2 Logging

Hey, We are considering to start using HiveServer2 and its seems that the logging capabilities are really limited as the server runs on a single port. I'll explain the problem more accurately : Today, we are using HiveServer where each user gets a specific port (or a set of ports) then, we start

Using Hive metastore as general purpose RDBMS

Hi, I have a case where I would like to extend Hive to use information from a regular RDBMS. To limit the complexity of the installation I thought I could piggyback on the already existing metatstore. As I understand it, HCatalog is not built for this purpose. Is there someone out there that has