[jira] [Created] (ZEPPELIN-2358) zeppelin throw PermGen out of memory after a long time running

[poseidon (JIRA)]

poseidon created ZEPPELIN-2358:
----------------------------------

             Summary: zeppelin throw PermGen out of memory after a long time 
running
                 Key: ZEPPELIN-2358
                 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2358
             Project: Zeppelin
          Issue Type: Bug
          Components: Interpreters
    Affects Versions: 0.6.2
         Environment: HDP  zeppelin 0.6.2 
HDP spark 1.6.2 
HDP HADOOP 2.6 


``` zeppelin-evn

export MASTER=yarn-client
export SPARK_YARN_JAR={{spark_jar}}

export ZEPPELIN_LOG_DIR={{zeppelin_log_dir}}
export ZEPPELIN_PID_DIR={{zeppelin_pid_dir}}


export JAVA_HOME={{java64_home}}

export ZEPPELIN_JAVA_OPTS="-Dspark.executor.memory={{executor_mem}} 
-Dspark.executor.instances={{executor_instances}} 
-Dspark.yarn.queue={{spark_queue}}"

export ZEPPELIN_INTP_MEM="-XX:MaxPermSize=1024m"

export ZEPPELIN_INTP_JAVA_OPTS="-Dhdp.version=2.4.2.0-258 
-XX:+CMSClassUnloadingEnabled -XX:+UseConcMarkSweepGC 
-XX:+CMSPermGenSweepingEnabled  -XX:MaxPermSize=1024m"  

export SPARK_HOME=/usr/hdp/2.4.2.0-258/spark

export SPARK_SUBMIT_OPTIONS="--driver-memory 7G --executor-memory 16G 
--jars=/usr/hdp/2.4.2.0-258/zeppelin/interpreter/spark/hanlp-portable-1.3.1.jar"

HADOOP_CONF_DIR.
export HADOOP_CONF_DIR=/etc/hadoop/conf

export 
PYTHONPATH="${SPARK_HOME}/python:${SPARK_HOME}/python/lib/py4j-0.8.2.1-src.zip"
export SPARK_YARN_USER_ENV="PYTHONPATH=${PYTHONPATH}"

```


            Reporter: poseidon


1、setup zeppelin with ambari 
2、config interpreter with a greate mount of PermGen Memory
3、create a notebook in zeppelin 
4、run spark code 

for some reason I need to use one notebook again and again. 

after running like 1000 lines code in notebook.
zeppelin  throw like PermGen Space Out of Memory Exception.

and notebook won't return from running any more.





--
This message was sent by Atlassian JIRA
(v6.3.15#6346)