I'm not sure why the example code didn't come through, so I'll try again: val x = spark.range(100) val y = x.map(_.toString)
println(x.storageLevel) //StorageLevel(1 replicas) println(y.storageLevel) //StorageLevel(1 replicas) x.cache().foreachPartition(_ => ()) y.cache().foreachPartition(_ => ()) println(x.storageLevel) //StorageLevel(disk, memory, deserialized, 1 replicas) println(y.storageLevel) //StorageLevel(disk, memory, deserialized, 1 replicas) x.unpersist() println(x.storageLevel) //StorageLevel(1 replicas) println(y.storageLevel) //StorageLevel(1 replicas) -- Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/ --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org
