ks
>
> Saisai
>
>
>
> *From:* Michael Chang [mailto:m...@tellapart.com]
> *Sent:* Friday, June 13, 2014 10:15 AM
> *To:* user@spark.apache.org
> *Subject:* Re: Spilled shuffle files not being cleared
>
>
>
> Bump
>
>
>
> On Mon, Jun 9, 2014 at 3:22 PM, Mich
spark.cleaner.referenceTracking),
and it is enabled by default.
Thanks
Saisai
From: Michael Chang [mailto:m...@tellapart.com]
Sent: Friday, June 13, 2014 10:15 AM
To: user@spark.apache.org
Subject: Re: Spilled shuffle files not being cleared
Bump
On Mon, Jun 9, 2014 at 3:22 PM, Michael Chang
mailto:m
Bump
On Mon, Jun 9, 2014 at 3:22 PM, Michael Chang wrote:
> Hi all,
>
> I'm seeing exceptions that look like the below in Spark 0.9.1. It looks
> like I'm running out of inodes on my machines (I have around 300k each in a
> 12 machine cluster). I took a quick look and I'm seeing some shuffle
Hi all,
I'm seeing exceptions that look like the below in Spark 0.9.1. It looks
like I'm running out of inodes on my machines (I have around 300k each in a
12 machine cluster). I took a quick look and I'm seeing some shuffle spill
files that are around even around 12 minutes after they are creat
