Default value is infinite, so you need to enable it. Personally I’ve setup a
couple of cron jobs to clean up /tmp and /var/run/spark.
On 06.11.2014, at 08:15, Romi Kuntsman wrote:
> Hello,
>
> Spark has an internal cleanup mechanism
> (defined by spark.cleaner.ttl, see
> http://spark.apache.o
Hello,
Spark has an internal cleanup mechanism
(defined by spark.cleaner.ttl, see
http://spark.apache.org/docs/latest/configuration.html)
which cleans up tasks and stages.
However, in our installation, we noticed that Snappy temporary files and
never cleaned up.
Is it a misconfiguration? Missing
