Re: Create table like with partitions

2013-06-11 Thread Lefty Leverenz
Dynamic partitions are described in the Hive design docs here: https://cwiki.apache.org/confluence/display/Hive/DynamicPartitions. For the configuration parameters, though, you need to look in the language manual here: https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties (sear

Re: Create table like with partitions

2013-06-11 Thread Richa Sharma
Thanks for sharing! I looked at these links .. Is there any documentation with more examples with both static and dynamic partitions covered together. Richa On Tue, Jun 11, 2013 at 12:33 PM, Lefty Leverenz wrote: > Dynamic partitions are described in the Hive design docs here: > https://cwiki.

Re: Create table like with partitions

2013-06-11 Thread Richa Sharma
Hi all, Found a very useful guide online. Link -> http://it-ebooks.info/book/941/ Richa On Tue, Jun 11, 2013 at 1:53 PM, Richa Sharma wrote: > Thanks for sharing! > > I looked at these links .. Is there any documentation with more examples > with both static and dynamic partitions covered toge

Re: Create table like with partitions

2013-06-11 Thread Edward Capriolo
For reference, any that puts the entire book online like this is likely pirated. On Tue, Jun 11, 2013 at 8:34 AM, Richa Sharma wrote: > Hi all, > > Found a very useful guide online. Link -> http://it-ebooks.info/book/941/ > > Richa > > > On Tue, Jun 11, 2013 at 1:53 PM, Richa Sharma > wrote:

Re: OrcFile writing failing with multiple threads

2013-06-11 Thread Owen O'Malley
Sorry for dropping this thread for so long. Are you using the orc.Writer interface directly or going through the OrcOutputFormat? I forgot that I had updated the Writer to synchronize things. It looks like all of the methods in Writer are synchronized. I haven't had a chance to investigate this fur

Re: OrcFile writing failing with multiple threads

2013-06-11 Thread Andrew Psaltis
Yes I am using the orc.writer interface directly. Unless I synchronize the call to addRow it still fails. In good health, Andrew Sent from my GPU powered iPhone On Jun 11, 2013, at 11:00, "Owen O'Malley" mailto:omal...@apache.org>> wrote: Sorry for dropping this thread for so long. Are you us

Re: Create table like with partitions

2013-06-11 Thread Dean Wampler
I confirmed it is a pirate site. Sent from my rotary phone. On Jun 11, 2013, at 10:33 AM, Edward Capriolo wrote: > For reference, any that puts the entire book online like this is likely > pirated. > > > > > On Tue, Jun 11, 2013 at 8:34 AM, Richa Sharma > wrote: >> Hi all, >> >> Found

Renaming partition columnname only (locations remain unchanged)

2013-06-11 Thread Sanjay Subramanian
Hi I have external tables where I want to change the name of the partition column, locations remaining constant Is there a way to do this…Else I will drop and create the table with new partition column names and run my scripts to ADD PARTITION, with LOCATION specified Thanks sanjay CONFIDENTIAL

Re: Create table like with partitions

2013-06-11 Thread Sanjay Subramanian
>From Russia with Love... Domain ID:D39022749-LRMS Domain Name:IT-EBOOKS.INFO Created On:27-Jul-2011 12:24:45 UTC Last Updated On:29-Apr-2013 11:00:03 UTC Expiration Date:27-Jul-2015 12:24:45 UTC Sponsoring Registrar:GoDaddy.com LLC (R171-LRMS) Status:CLIENT DELETE PROHIBITED Status:CLIENT RENEW

Re: Compression in Hive

2013-06-11 Thread Sanjay Subramanian
1. We use LZO compression in our MR jobs that create LZO files (these are NOT sequence files) that are the feeder files for Hive 2. Then we we use Hive data (LZO files) and run aggregation reports Hope this helps Good luck sanjay From: "Ravi Mummulla (BIG DATA)" mailto:rav...@microsoft.com>>

Re: Create table like with partitions

2013-06-11 Thread Lefty Leverenz
It's an excellent book, and not too expensive so I recommend buying your own copy from O'Reilly or Amazon. (Not only will you have a legal copy, but you'll encourage authors to write more books for the benefit of all.) I've got it in hardcover and digital format. – Lefty On Tue, Jun 11, 2013

Re: Create table like with partitions

2013-06-11 Thread Sanjay Subramanian
+1 Its one of the very very usable hands on book published in this technical domain. Same here I bought both versions :-) From: Lefty Leverenz mailto:le...@hortonworks.com>> Reply-To: "user@hive.apache.org" mailto:user@hive.apache.org>> Date: Tuesday, June 11, 2013 5

Re: Renaming partition columnname only (locations remain unchanged)

2013-06-11 Thread Nitin Pawar
currently hive partitions on hdfs stored as col1=val1/col2=val2 looking at this if you change the column name in the metadata, I am not sure you will be able to locate the data with old column name. other way would be alter table and and run hdfs move to reflect your new column name in the partiti

Re: Create table like with partitions

2013-06-11 Thread Richa Sharma
Yes ... wise advice ... thanks :-) On Wed, Jun 12, 2013 at 7:41 AM, Sanjay Subramanian < sanjay.subraman...@wizecommerce.com> wrote: > +1 Its one of the very very usable hands on book published in this > technical domain. Same here I bought both versions :-) > > From: Lefty Leverenz > Reply-