Re: Strategy for Loading Apache Logs

2011-05-11 Thread Ashish Thusoo
you could always have another sub partition under the daily partition. This sub partition could be the timestamp on when you did the load. So when you run the statement you would create a new sub partition within the date partition and in effect you end up doing an append to the Hive partition.

Re: Strategy for Loading Apache Logs

2011-05-10 Thread hadoopman
You're pretty much going to overwrite the partition every time you want to add data to it. I wish there was an append but there isn't. We're basically doing it the same way you are (looking at your insert statement). The challenge I'm running into (doing the same thing you are) is when I'm b