Re: spark graphx storage RDD memory leak
, msg), > sendMsg = sendMessage, > mergeMsg = (a, b) => math.min(a, b)) > } // end of connectedComponents > } > thanks > juntao > > >> Begin forwarded message: >> >> From: Ted Yu mailto:yuzhih...@gmail.com>> >> Subject: R
Re: spark graphx storage RDD memory leak
I see the following code toward the end of the method: // Unpersist the RDDs hidden by newly-materialized RDDs oldMessages.unpersist(blocking = false) prevG.unpersistVertices(blocking = false) prevG.edges.unpersist(blocking = false) Wouldn't the above achieve same effect ?