Hi Jonathan,
Thank you for the information!
Yes, I am using maximizeResourceAllocation. I will try turn off this and
just use dynamicAllocation alone.
Regards,
Soonoh
On 4 October 2016 at 11:07, Jonathan Kelly wrote:
> On the most recent several releases of EMR, Spark dynamicAllocation is
> au
On the most recent several releases of EMR, Spark dynamicAllocation is
automatically enabled, as it allows longer running apps like Zeppelin's
Spark interpreter to continue running in the background without taking up
resources for any executors unless Spark jobs are actively running.
However, if y
Hi everyone,
I am using Zeppelin in AWS EMR (Zeppelin 0.6.1, spark 2.0 on Yarn RM)
Basically Zeppelin spark interpreter's spark job is not finishing after
executing a notebook.
It looks like the spark job still occupying memory a lot in my Yarn cluster.
Is there a way restart spark interpreter aut
