N/m, these are just profiling snapshots :) Sorry for the wide distribution.
On Tue, Nov 10, 2015 at 9:46 AM, Dmitry Goldenberg <dgoldenberg...@gmail.com > wrote: > We're seeing a bunch of .snapshot files being created under > /home/spark/Snapshots, such as the following for example: > > CoarseGrainedExecutorBackend-2015-08-27-shutdown.snapshot > CoarseGrainedExecutorBackend-2015-08-31-shutdown-1.snapshot > SparkSubmit-2015-08-31-shutdown-1.snapshot > Worker-2015-08-27-shutdown.snapshot > > These files are large and they blow out our disk space in some > environments. > > What are these, when are they created and for what purpose? Is there a > way to control how they're generated and most importantly where they're > stored? > > Thanks. >
