RE: Effecient partitions usage in join

2012-11-23 Thread Dima Datsenko
Thanks Guys, it’s just what I’ve looked for. From: Dean Wampler [mailto:dean.wamp...@thinkbiganalytics.com] Sent: יום ו 23 נובמבר 2012 15:41 To: user@hive.apache.org Cc: Dima Datsenko Subject: Re: Effecient partitions usage in join A quick suggestion. If the format never changes, you might as

RE: Effecient partitions usage in join

2012-11-22 Thread Dima Datsenko
@hive.apache.org Cc: Dima Datsenko Subject: RE: Effecient partitions usage in join Unfortunately at the moment partition pruning is a bit limited in hive. When hive creates the query plan it decides what partitions to use. So if you put hardcoded list of partition_id items in the where clause it will

Effecient partitions usage in join

2012-11-22 Thread Dima Datsenko
Hi Guys, I wonder if you could help me. I have a huge Hive table partitioned by some field. It has thousands of partitions. Now I have another small table containing tens of partitions id. I'd like to get the data only from those partitions. However when I run Select * from A join B on (A.part