Thanks for the line, looks like a jre-issue.
2011/12/13 王锋 :
> I got the question of hive large memory.
>
> before the jvm args:
> export HADOOP_OPTS="$HADOOP_OPTS -XX:NewRatio=1 -Xms2000m
> -XX:MaxHeapFreeRatio=40 -XX:MinHeapFreeRatio=15 -XX:+UseParallelGC
> -XX:ParallelGCThreads=20 -XX:+UseParal
I got the question of hive large memory.
before the jvm args:
export HADOOP_OPTS="$HADOOP_OPTS -XX:NewRatio=1 -Xms2000m
-XX:MaxHeapFreeRatio=40 -XX:MinHeapFreeRatio=15 -XX:+UseParallelGC
-XX:ParallelGCThreads=20 -XX:+UseParallelOldGC -XX:-UseGCOverheadLimit
-XX:MaxTenuringThreshold=8 -XX:Perm
yes,we using jdk 1. 0.26
[hdfs@d048049 conf]$ java -version
java version "1.6.0_26"
Java(TM) SE Runtime Environment (build 1.6.0_26-b03)
Java HotSpot(TM) 64-Bit Server VM (build 20.1-b02, mixed mode)
I will see the document of the url,thanks very much!
在 2011-12-12 19:08:37，"alo alt" 写道：
Argh, increase! sry, to fast typing
2011/12/12 alo alt :
> Did you update your JDK in last time? A java-dev told me that could be
> a issue in JDK _26
> (https://forums.oracle.com/forums/thread.jspa?threadID=2309872), some
> devs report a memory decrease when they use GC - flags. I'm quite not
>
Did you update your JDK in last time? A java-dev told me that could be
a issue in JDK _26
(https://forums.oracle.com/forums/thread.jspa?threadID=2309872), some
devs report a memory decrease when they use GC - flags. I'm quite not
sure, sounds for me to far away.
The stacks have a lot waitings, bu
You can identify threads with "top -H", the catch one process (pid)
and use jstack:
jstack PID
Its quite not possible I think to filter for a task (If I wrong please
correct me). Here you need a long running task.
- Alex
2011/12/12 王锋 :
>
> how about watch one hive job's stacks .Can it be watche
When you start a high-load hive query can you watch the stack-traces?
Its possible over the webinterface:
http://jobtracker:50030/stacks
- Alex
2011/12/12 王锋
>
> hiveserver will throw oom after several hours .
>
>
> At 2011-12-12 17:39:21,"alo alt" wrote:
>
> what happen when you set xmx=2048m
