now why they are not marked. Is this really intentional?
>
>
>
> From: Haopu Wang [mailto:hw...@qilinsoft.com]
> Sent: Friday, May 08, 2015 11:37 AM
> To: Taeyun Kim; Ted Yu; Todd Nist; user@spark.apache.org
>
>
> Subject: RE: Spark does not delete temporary directori
are not marked. Is this really intentional?
From: Haopu Wang [mailto:hw...@qilinsoft.com]
Sent: Friday, May 08, 2015 11:37 AM
To: Taeyun Kim; Ted Yu; Todd Nist; user@spark.apache.org
Subject: RE: Spark does not delete temporary directories
I think the temporary folders are used to store blo
aeyun Kim [mailto:taeyun@innowireless.com]
Sent: Friday, May 08, 2015 9:42 AM
To: 'Ted Yu'; 'Todd Nist'; user@spark.apache.org
Subject: RE: Spark does not delete temporary directories
Thanks, but it seems that the option is for Spark standalone mode only.
I've (li
Kim; user@spark.apache.org
Subject: Re: Spark does not delete temporary directories
Default value for spark.worker.cleanup.enabled is false:
private val CLEANUP_ENABLED = conf.getBoolean("spark.worker.cleanup.enabled",
false)
I wonder if the default should be set as true.
Che
Default value for spark.worker.cleanup.enabled is false:
private val CLEANUP_ENABLED =
conf.getBoolean("spark.worker.cleanup.enabled", false)
I wonder if the default should be set as true.
Cheers
On Thu, May 7, 2015 at 6:19 AM, Todd Nist wrote:
> Have you tried to set the following?
>
> spark
Have you tried to set the following?
spark.worker.cleanup.enabled=true
spark.worker.cleanup.appDataTtl=”
On Thu, May 7, 2015 at 2:39 AM, Taeyun Kim
wrote:
> Hi,
>
>
>
> After a spark program completes, there are 3 temporary directories remain
> in the temp directory.
>
> The file names are li
