[
https://issues.apache.org/jira/browse/SPARK-17822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yin Huai updated SPARK-17822:
-----------------------------
Description:
JVMObjectTracker.objMap is used to track JVM objects for SparkR. However, we
observed that JVM objects that are not used anymore are still trapped in this
map, which prevents those object get GCed.
Seems it makes sense to use weak reference (like persistentRdds in
SparkContext).
was:Seems it is pretty easy to remove objects from JVMObjectTracker.objMap.
So, seems it makes sense to use weak reference (like persistentRdds in
SparkContext).
> JVMObjectTracker.objMap may leak JVM objects
> --------------------------------------------
>
> Key: SPARK-17822
> URL: https://issues.apache.org/jira/browse/SPARK-17822
> Project: Spark
> Issue Type: Bug
> Components: SparkR
> Reporter: Yin Huai
> Attachments: screenshot-1.png
>
>
> JVMObjectTracker.objMap is used to track JVM objects for SparkR. However, we
> observed that JVM objects that are not used anymore are still trapped in this
> map, which prevents those object get GCed.
> Seems it makes sense to use weak reference (like persistentRdds in
> SparkContext).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
