I tried using serialization instead of broadcast, and my program exit with Error(beyond physical memory limits).
The large object can not be released by GC? because it is needed for recomputing? So what is the recomended way to solve this problem? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Cache-issue-for-iteration-with-broadcast-tp5350p5354.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
