Re: Question of Hive Partitioning

2010-12-28 Thread Narendra
I guess it's the left outer that's making it do a full table scan...but why??? On Tue, Dec 28, 2010 at 2:34 PM, Narendra wrote: > Thanks for the response. > > The query is something like this - > > select > a.a_val1, > count(a.a_val2), > sum(b.b_val), > c.c_val, > d.d_val > from > table1 a > lef

Re: Question of Hive Partitioning

2010-12-28 Thread Narendra
Thanks for the response. The query is something like this - select a.a_val1, count(a.a_val2), sum(b.b_val), c.c_val, d.d_val from table1 a left outer join table2 b on (a.someval = b.someval), left outer join table3 c on (a.someval2 = c.someval2), left outer join table4 d on (a.someval3 = d.someva

Re: Question of Hive Partitioning

2010-12-27 Thread yongqiang he
Can you post your query? Is there " or " connecting the partitions' predicate with others? Thanks Yongqiang On Mon, Dec 27, 2010 at 11:09 PM, Narendra wrote: > Hi, > > Hive wiki says "Hive currently does input pruning only if the partition > predicates are specified in the WHERE clause closest to

Question of Hive Partitioning

2010-12-27 Thread Narendra
Hi, Hive wiki says "Hive currently does input pruning only if the partition predicates are specified in the WHERE clause closest to the table_reference in the FROM clause..." what does this mean? I have a query in which I am joining 4 tables two of which need to be pruned by partition. The partit