Hello, Spark has an internal cleanup mechanism (defined by spark.cleaner.ttl, see http://spark.apache.org/docs/latest/configuration.html) which cleans up tasks and stages.
However, in our installation, we noticed that Snappy temporary files and never cleaned up. Is it a misconfiguration? Missing feature? How do you deal with build-up of temp files? Thanks, *Romi Kuntsman*, *Big Data Engineer* http://www.totango.com
