Searching the JIRA for HADOOP_HEAPSIZE turned up this new ticket (and related ones mentioned in the comments): HADOOP-10245<https://issues.apache.org/jira/browse/HADOOP-10245> :
The Hadoop command line scripts (hadoop.sh or hadoop.cmd) will call java > with "-Xmx" options twice. The impact is that any user defined > HADOOP_HEAP_SIZE env variable will take no effect because it is overwritten > by the second "-Xmx" option. > -- Lefty On Sun, Feb 2, 2014 at 8:20 PM, Navis류승우 <navis....@nexr.com> wrote: > try "set hive.mapred.local.mem=7000" or add it to hive-site.xml instead of > modifying hive-env.sh > > HADOOP_HEAPSIZE is not in use. Should fix documentation of it. > > Thanks, > Navis > > > 2014-01-31 Avrilia Floratou <avrilia.flora...@gmail.com>: > > Hi, >> I'm running hive 0.12 on yarn and I'm trying to convert a common join >> into a map join. My map join fails >> and from the logs I can see that the memory limit is very low: >> >> Starting to launch local task to process map join; maximum memory = >> 514523136 >> >> How can I increase the maximum memory? >> I've set the HADOOP_HEAP_SIZE at 7GB in hadoop-env.sh and hive-env.sh but >> that didn't help. >> Also the nodemanager runs with 7GB heap size. >> >> Is there anything else I can do to increase this value? >> >> Thanks, >> Avrilia >> > >
