Hi all,

Just 2 questions:

  1. Is there a way to automatically re-spawn spark workers? We've
situations where executor OOM causes worker process to be DEAD and it does
not came back automatically.

  2. How to dynamically add (or remove) some worker machines to (from) the
cluster? We'd like to leverage the auto-scaling group in EC2 for example.

We're using spark-standalone.

Thanks a lot.

-- 
*JU Han*

Data Engineer @ Botify.com

+33 0619608888

Reply via email to