thx for the help, unpersist is excatly what I want:) I see that spark will remove some cache automatically when memory is full, it is much more helpful if the rule satisfy something like LRU
~~~~ It seems that persist and cache is some kind of lazy? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/cache-not-work-as-expected-for-iteration-tp5292p5308.html Sent from the Apache Spark User List mailing list archive at Nabble.com.