Re: Help with Join involving Non-Equality condition

2012-08-17 Thread Edward Capriolo
You should check out the work being done on. non-equi map joins http://mail-archives.apache.org/mod_mbox/hive-dev/201206.mbox/%3C1948451998.13482.1339612423225.JavaMail.jiratomcat@issues-vm%3E https://issues.apache.org/jira/browse/HIVE-3133 On Fri, Aug 17, 2012 at 1:52 AM, Bertrand Dechoux wrote

Re: Help with Join involving Non-Equality condition

2012-08-16 Thread Bertrand Dechoux
What are the data volume? And what are the meaning of those data? >From what I can see, you have a 'pack' per day. If that's true, a map join could be used because you should not have that many pack creation (But I am not sure how to enforce that.) I so filtering could happen right after. You woul

Re: Help with Join involving Non-Equality condition

2012-08-16 Thread Navis류승우
If you don't specify join condition, hive performs cross join. What is added to hive 0.10.0 is just a clarifying grammar. 2012/8/17 Himanish Kushary > We are on Hive 0.8 , I think cross join is available only since 0.10.0 > > Do we have any other options ? > > On Thu, Aug 16, 2012 at 2:28 PM, A

Re: Help with Join involving Non-Equality condition

2012-08-16 Thread Himanish Kushary
We are on Hive 0.8 , I think cross join is available only since 0.10.0 Do we have any other options ? On Thu, Aug 16, 2012 at 2:28 PM, Ablimit Aji wrote: > You can do a CROSS JOIN, then filter with the original inequality join > condition. > This would generate a lot of redundant tuples and may

Re: Help with Join involving Non-Equality condition

2012-08-16 Thread Ablimit Aji
You can do a CROSS JOIN, then filter with the original inequality join condition. This would generate a lot of redundant tuples and may not work if you have large amounts of data. On Thu, Aug 16, 2012 at 2:07 PM, Himanish Kushary wrote: > Hi, > > We have two tables in the following structure : >