Hi Michael,
Thanks for reporting it. Yes, it is a bug. I have created
https://issues.apache.org/jira/browse/SPARK-6437 to track it.
Thanks,
Yin
On Thu, Mar 19, 2015 at 10:51 AM, Michael Allman
wrote:
> I've examined the experimental support for ExternalSorter in Spark SQL,
> and it does not a
I've examined the experimental support for ExternalSorter in Spark SQL, and it
does not appear that the external sorted is ever stopped (ExternalSorter.stop).
According to the API documentation, this suggests a resource leak. Before I
file a bug report in Jira, can someone familiar with the code