Re: Map-side join memory limit is too low

2014-02-03 Thread Lefty Leverenz
Searching the JIRA for HADOOP_HEAPSIZE turned up this new ticket (and related ones mentioned in the comments): HADOOP-10245 : The Hadoop command line scripts (hadoop.sh or hadoop.cmd) will call java > with "-Xmx" options twice. The impact is that

Re: Map-side join memory limit is too low

2014-02-02 Thread Navis류승우
try "set hive.mapred.local.mem=7000" or add it to hive-site.xml instead of modifying hive-env.sh HADOOP_HEAPSIZE is not in use. Should fix documentation of it. Thanks, Navis 2014-01-31 Avrilia Floratou : > Hi, > I'm running hive 0.12 on yarn and I'm trying to convert a common join into > a map

Map-side join memory limit is too low

2014-01-31 Thread Avrilia Floratou
Hi, I'm running hive 0.12 on yarn and I'm trying to convert a common join into a map join. My map join fails and from the logs I can see that the memory limit is very low: Starting to launch local task to process map join; maximum memory = 514523136 How can I increase the maximum memory? I'