On Thu, Mar 24, 2016 at 9:54 AM, Koert Kuipers <ko...@tresata.com> wrote: > i guess what i am saying is that in a yarn world the only hard restrictions > left are the the containers you run in, which means the hadoop version, java > version and python version (if you use python).
It is theoretically possible to run containers with a different JDK than the NM (I've done it for testing), although I'm not sure about whether that's recommended from YARN's perspective. But I understand your concern is that you're not allowed to modify the machines where the NMs are hosted. You could hack things and distribute the JVM with your Spark application, but that would be incredibly ugly. -- Marcelo --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org For additional commands, e-mail: dev-h...@spark.apache.org
