Hive JDBC Client - username/password

2011-10-04 Thread Sriram Krishnan
Hi, I am following instructions here (https://cwiki.apache.org/Hive/hiveclient.html#HiveClient-JDBCClientSampleCode) to use JDBC to connect to Hive. And I am also able to run queries via JDBC, just fine. However, I notice that the JDBC connection is created as follows - using "" for both the

Re: How does COLLECTION ITEMS work in Hive?

2011-10-04 Thread Mark Kerzner
Thank you, I found very few examples, and this old Jira helped the best https://issues.apache.org/jira/browse/HIVE-15 On Tue, Oct 4, 2011 at 7:23 PM, Steven Wong wrote: > COLLECTION ITEMS refers to the ARRAY column type. For more info on arrays, > see: > > ** ** > > https://cwiki.apache.org

RE: How does COLLECTION ITEMS work in Hive?

2011-10-04 Thread Steven Wong
COLLECTION ITEMS refers to the ARRAY column type. For more info on arrays, see: https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL https://cwiki.apache.org/confluence/display/Hive/LanguageManual+UDF From: Mark Kerzner [mailto:mark.kerz...@shmsoft.com] Sent: Tuesday, October 04,

Re: Hive Dynamic Partions - How to avoid overwrite

2011-10-04 Thread Bejoy Ks
Great Maxime, Thanks a lot. So I'm going in for a hive upgrade. It is definitely the best option. Thanks and Regards From: Maxime Brugidou To: user@hive.apache.org; Bejoy Ks Sent: Tuesday, October 4, 2011 11:50 PM Subject: Re: Hive Dynamic Partions - How to a

Re: Hive Dynamic Partions - How to avoid overwrite

2011-10-04 Thread Bejoy Ks
Thanks Vaibhav for the great response. Definitely it is a great approach, even my thought went in the same direction. I'm doing a daily load into my hive partitioned table and I anticipate it to be a performance breaker with lesser data in each partitions. Basically my hive jobs/queries is gonna

Re: Hive Dynamic Partions - How to avoid overwrite

2011-10-04 Thread Maxime Brugidou
i suspect you can't do that unless you use 0.8 from the wiki: "INSERT INTO will append to the table or partition keeping the existing data in tact. (Note: INSERT INTO syntax is only available starting in version 0.8)" if you don't have 0.8 then I suggest that you partition simply by day in additi

Re: Hive Dynamic Partions - How to avoid overwrite

2011-10-04 Thread Bejoy Ks
Thanks Florin for your response. But in the suggested approach, I'd have a concern. my partitioned table in course of time would hols 100ds of Terabytes of data. So every time when I'm loading my data from staging table intothe production partitioned table and UNION over the same would be way to

RE: Hive Dynamic Partions - How to avoid overwrite

2011-10-04 Thread Aggarwal, Vaibhav
You can choose to partition by (country, date). In this case you move the data in a date partition within your country partition and avoid overwriting old data. If you choose to go this way one thing to check is that this should not result in too many partitions. Large number of partitions have

How does COLLECTION ITEMS work in Hive?

2011-10-04 Thread Mark Kerzner
Hi, expert, I see this clause in CREATE TABLE -- COLLECTION ITEMS TERMINATED BY How does it work? Does Hive create a new row for each collection item, repeating the other elements? If not, how does it treat collection items? Thank you, Mark