Re: Spark SQL ExternalSorter not stopped

2015-03-20 Thread Yin Huai
Hi Michael, Thanks for reporting it. Yes, it is a bug. I have created https://issues.apache.org/jira/browse/SPARK-6437 to track it. Thanks, Yin On Thu, Mar 19, 2015 at 10:51 AM, Michael Allman wrote: > I've examined the experimental support for ExternalSorter in Spark SQL, > and it does not a

Spark SQL ExternalSorter not stopped

2015-03-19 Thread Michael Allman
I've examined the experimental support for ExternalSorter in Spark SQL, and it does not appear that the external sorted is ever stopped (ExternalSorter.stop). According to the API documentation, this suggests a resource leak. Before I file a bug report in Jira, can someone familiar with the code