RE: Hive NoSuchMethodError

2011-10-03 Thread Juwon Lee
More information on this. There are 2 different kinds of data having the same schema. One of them is failing with the exception below while the other works fine. The only difference between the two data sets is volume but I guess it is not causing the issue. Thanks, Juwon From: Juwon Lee [mai

Re: Hive Dynamic Partions - How to avoid overwrite

2011-10-03 Thread Florin Diaconeasa
I would recommend doing the following SELECT: INSERT OVERWRITE INTO TABLE SELECT * FROM ( SELECT x,y,z FROM UNION ALL SELECT * FROM ) allTables; Obviously, there are rules coming with UNION ALL, such as you need to name(user alias eventually) all the columns of each select. More on this

Hive Dynamic Partions - How to avoid overwrite

2011-10-03 Thread Bejoy Ks
Hi Experts     I'm intending to use hive dynamic partition approach on my current business use case. What I have in mind for the design is as follows. -Load my incoming data into a non partitioned hive table (Table 1) -Load this data into partitioned hive table using Dynamic Partitions(Table 2) -