Re: How to show RDD size

2014-10-20 Thread Nicholas Chammas
No, I believe unpersist acts immediately. On Mon, Oct 20, 2014 at 10:13 AM, marylucy wrote: > thank you for your reply! > is unpersist operation lazy?if yes,how to decrease memory size as quickly > as possible > > 在 Oct 20, 2014,21:26,"Nicholas Chammas" 写道: > > I believe it won't show up there

Re: How to show RDD size

2014-10-20 Thread marylucy
thank you for your reply! is unpersist operation lazy?if yes,how to decrease memory size as quickly as possible > 在 Oct 20, 2014,21:26,"Nicholas Chammas" 写道: > > I believe it won't show up there until you trigger an action that causes the > RDD to actually be cached. Remember that certain oper

Re: How to show RDD size

2014-10-20 Thread Nicholas Chammas
I believe it won't show up there until you trigger an action that causes the RDD to actually be cached. Remember that certain operations in Spark are *lazy*, and caching is one of them. Nick On Mon, Oct 20, 2014 at 9:19 AM, marylucy wrote: > in spark-shell,I do in follows > val input = sc.t