[
https://issues.apache.org/jira/browse/SPARK-19328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15833802#comment-15833802
]
roncenzhao commented on SPARK-19328:
------------------------------------
[~srowen] In the heap dump file, it shows that the `executorToLogUrls` and
`executorIdToData` hold the majority of memory.
So I think we should add some strategies to trim the stale data.
> using spark thrift server gets memory leak problem in `ExecutorsListener`
> -------------------------------------------------------------------------
>
> Key: SPARK-19328
> URL: https://issues.apache.org/jira/browse/SPARK-19328
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 2.0.2
> Environment: spark2.0.2
> Reporter: roncenzhao
> Attachments: screenshot-1.png
>
>
> When I use spark-thrift-server, the memory usage will gradually increase.
> I found that in `ExecutorsListener` all the data about executors is never
> trimmed.
> So do we need some operations to trim the data ?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
