>From BlockManager code + ShuffleMapTask code, it writes under spark.local.dir or java.io.tmpdir.
val diskBlockManager = new DiskBlockManager(shuffleBlockManager, conf.get("spark.local.dir", System.getProperty("java.io.tmpdir"))) On Mon, Mar 3, 2014 at 10:45 PM, Usman Ghani <us...@platfora.com> wrote: > Where on the filesystem does spark write the shuffle files? > -- "...:::Aniket:::... Quetzalco@tl"