lto:user@hive.apache.org>>
Subject: Re: Parallely Load Data into Two partitions of a Hive Table
Only thing i was confused that mysql meta update may have lock and it might
cause any data loss.
Now i am clear on this. Thanks a lot Nitin.
On Fri, May 3, 2013 at 1:06 PM, Nitin Pawar
mailto:nit
Only thing i was confused that mysql meta update may have lock and it might
cause any data loss.
Now i am clear on this. Thanks a lot Nitin.
On Fri, May 3, 2013 at 1:06 PM, Nitin Pawar wrote:
> Why dont you load all of your data into a temporary table and then from
> there to your current tabl
Why dont you load all of your data into a temporary table and then from
there to your current tables.
Hive will take care of adding dynic partitions and that will remove the
ocerhead from you.
To answer your question, you can always load data in different partitions
parallely as long as you have
Hi All,
I need to load a month worth of processed data into a hive table. Table
have 10 partitions. Each day have many files to load and each file is
taking two seconds(constantly) and i have ~3000 files). So it will take
days to complete for 30 days worth of data.
I planned to load every day dat
