Hi all, trying to change defaults of where stuff gets written. I've set "-Dspark.local.dir=/spark/tmp" and I can see that the setting is used when the executor is started.
I do indeed see directories like spark-local-20140815004454-bb3f in this desired location but I also see undesired stuff under /tmp usr@executor:~# ls /tmp/spark-93f4d44c-ff4d-477d-8930-5884b10b065f/ files jars usr@driver: ls /tmp/spark-7e456342-a58c-4439-ab69-ff8e6d6b56a5/ files jars Is there a way to move these directories off of /tmp? I am running 0.9.1 (SPARK_WORKER_DIR is also exported on all nodes though all that I see there are executor logs) Thanks
