Re: Memory leak warnings in Spark 2.0.1

👍 Thanks for the reference and PR. On Wed, Nov 23, 2016 at 2:59 AM Reynold Xin wrote: > See https://issues.apache.org/jira/browse/SPARK-18557 > > > On Mon, Nov 21, 2016 at 1:16 PM, Nicholas Chammas < > nicholas.cham...@gmail.com> wrote: > > I'

Re: Memory leak warnings in Spark 2.0.1

See https://issues.apache.org/jira/browse/SPARK-18557 On Mon, Nov 21, 2016 at 1:16 PM, Nicholas Chammas < nicholas.cham...@gmail.com> wrote: > I'm also curious about this. Is there something we can do to help > troubleshoot these leaks and file

Re: Memory leak warnings in Spark 2.0.1

I'm also curious about this. Is there something we can do to help troubleshoot these leaks and file useful bug reports? On Wed, Oct 12, 2016 at 4:33 PM vonnagy wrote: > I am getting excessive memory leak warnings when running multiple mapping > and > aggregations and using DataSets. Is there any

Memory leak warnings in Spark 2.0.1

I am getting excessive memory leak warnings when running multiple mapping and aggregations and using DataSets. Is there anything I should be looking for to resolve this or is this a known issue? WARN [Executor task launch worker-0] org.apache.spark.memory.TaskMemoryManager - leak 16.3 MB memory f