I have also seen similar issues even using zeppelin-ddeamon but didn't have much time to investigate the issue when it was happening to me.
On Thu, Dec 15, 2016 at 12:15 PM Ruslan Dautkhanov <dautkha...@gmail.com> wrote: > Moon, > > > ZeppelinServer try to terminate interpreter process when shutting down > [1]. > > Unfortunatally, this does not happen all the time. > I have seen zombie spark interpreter processes many times. > As a double conirmation - I see spark yarn application was still running. > > > Also bin/zeppelin-deamon.sh script clean up if some processes are left > [2]. > > We were not using that script. We were just running like zeppelin.sh > --config .. > Will try to switch to zeppelin-deamon.sh and see if it makes a difference. > > Thanks! > > > > > -- > Ruslan Dautkhanov > > > > On Thu, Dec 15, 2016 at 12:46 PM, moon <m...@zepl.com> wrote: > > Hi, > > > > > > ZeppelinServer try to terminate interpreter process when shutting down [1]. > > > Also bin/zeppelin-deamon.sh script clean up if some processes are left [2]. > > > > > > If some processes are remained after shutting down Zeppelin, that's not an > > > expected result. > > > > > > Thanks, > > > moon > > > > > > [1] > > > > https://github.com/apache/zeppelin/blob/master/zeppelin-server/src/main/java/org/apache/zeppelin/server/ZeppelinServer.java#L159 > > > [2] > > > https://github.com/apache/zeppelin/blob/master/bin/zeppelin-daemon.sh#L218 > > > > > > On Thu, Dec 15, 2016 at 11:25 AM Ruslan Dautkhanov <dautkha...@gmail.com> > > > wrote: > > > > > > > How to make Interpreter processes terminate if Zeppelin server exits? > > > > > > > > When we restart Zeppelin server (main process), in many cases, > Interpreter > > > > process keeps running, essential becoming a zombie processes. > > > > > > > > In case of Spark interpreter, it also holds SparkContext - consuming > > > > server-side > > > > resources too. > > > > > > > > How do we configure Zeppelin to kill all interpreters before its main > > > > process terminates? > > > > Or is this a bug? > > > > > > > > We're running ~2 weeks old snapshot of 0.7.0 Zeppelin. > > > > > > > > > > > > Thank you, > > > > Ruslan Dautkhanov > > > > > > > > -- Sent from my Mobile device
