Re: Bug in map join optimization causing "OutOfMemory" error

2013-11-01 Thread Brock Noland
Hi, Thank you for the report! Can you open a JIRA for this issue? It sounds like a bug. Brock On Fri, Nov 1, 2013 at 2:23 AM, Mehant Baid wrote: > Hey Folks, > > Could you please take a look at the below problem. We are hitting > OutOfMemoryErrors while joining tables that are not managed by

Re: Bug in map join optimization causing "OutOfMemory" error

2013-11-01 Thread Mehant Baid
Hey Folks, Could you please take a look at the below problem. We are hitting OutOfMemoryErrors while joining tables that are not managed by Hive. Would appreciate any feedback. Thanks Mehant On 10/7/13 12:04 PM, Mehant Baid wrote: Hey Folks, We are using hive-0.11 and are hitting java.lang.

Bug in map join optimization causing "OutOfMemory" error

2013-10-07 Thread Mehant Baid
Hey Folks, We are using hive-0.11 and are hitting java.lang.OutOfMemoryError. The problem seems to be in CommonJoinResolver.java (processCurrentTask()), in this function we try and convert a map-reduce join to a map join if 'n-1' tables involved in a 'n' way join have a size below a certain t