52 rate: 0.734
>
> 2012-04-05 10:41:07 Processing rows:290 Hashtable size:
> 289 Memory usage: 1062065576 rate: 0.76****
>
> Exception in thread "Thread-1" java.lang.OutOfMemoryError: Java heap space
>
>
> ** **
>
>
h (Mr)
Cell phone: (+84)98.226.0622
From: Nitin Pawar [mailto:nitinpawar...@gmail.com]
Sent: Thursday, April 05, 2012 5:36 PM
To: user@hive.apache.org
Subject: Re: Why BucketJoinMap consume too much memory
can you try adding these settings
set hive.enforc
But it still created many hash tables then threw Java Heap space error
>
> ** **
>
> *Best regards*
>
> Nguyen Thanh Binh (Mr)
>
> Cell phone: (+84)98.226.0622****
>
> ** **
>
> *From:* Bejoy Ks [mailto:bejoy...@yahoo.com]
> *Sent:* Thursday, April 05
user@hive.apache.org
Subject: Re: Why BucketJoinMap consume too much memory
Hi Amit
Sorry for the delayed response, had a terrible schedule. AFAIK, there
is no flags that would help you to take the hash table creation, compression
and load into tmp files away from client node.
ze is too large, than the heap size
specified for your client, it'd throw an out of memory.
Regards
Bejoy KS
From: Amit Sharma
To: user@hive.apache.org; Bejoy Ks
Sent: Tuesday, April 3, 2012 11:06 PM
Subject: Re: Why BucketJoinMap consume too much memo
I am experiencing similar behavior in my queries. All the conditions for
bucketed map join are met, and the only difference in execution when i set
the hive.optimize.bucketmapjoin flag to true, is that instead of a single
hash table, multiple hash tables are created. All the Hash Tables are still
c
Hi
On a first look, it seems like map join is happening in your case other
than bucketed map join. The following conditions need to hold for bucketed map
join to work
1) Both the tables are bucketed on the join columns
2) The number of buckets in each table should be multiples of each other
3
