Default is MEMORY_ONLY ... if you explicitly persist a RDD, you have to explicitly unpersist it if you want to free memory during the job.
On Thu, Mar 27, 2014 at 11:17 PM, Sai Prasanna <ansaiprasa...@gmail.com>wrote: > Oh sorry, that was a mistake, the default level is MEMORY_ONLY !! > My doubt was, between two different experiments, are the RDDs cached in > memory need to be unpersisted??? > Or it doesnt matter ? >
