Hi Tim,
Yes we are running Spark on Mesos in cluster mode with supervise flag.
Submit script looks like this:
spark-submit \
--conf "spark.executor.extraJavaOptions=-XX:+UseG1GC -XX:+UseCompressedOops
-XX:-UseGCOverheadLimit" \
--supervise \
--deploy-mode cluster \
--class \
--master mesos://:70
Hi Duc,
Are you running Spark on Mesos with cluster mode? And what's your cluster
mode submission, and version of Spark are you running?
Tim
On Sat, Jan 30, 2016 at 8:19 AM, PhuDuc Nguyen
wrote:
> I have a spark job running on Mesos in multi-master and supervise mode. If
> I kill it, it is res
I have a spark job running on Mesos in multi-master and supervise mode. If
I kill it, it is resilient as expected and respawns on another node.
However, I cannot kill it when I need to. I have tried 2 methods:
1) ./bin/spark-class org.apache.spark.deploy.Client kill
2) ./bin/spark-submit --mast
