Re: persisting RDD in memory

2014-08-01 Thread Mayur Rustagi
Hi Yes data would be cached again in each spark context. Regards Mayur On Friday, August 1, 2014, Sujee Maniyam wrote: > Hi all, > I have a scenario of a web application submitting multiple jobs to Spark. > These jobs may be operating on the same RDD. > > It is possible to cache() the RDD durin

persisting RDD in memory

2014-08-01 Thread Sujee Maniyam
Hi all, I have a scenario of a web application submitting multiple jobs to Spark. These jobs may be operating on the same RDD. It is possible to cache() the RDD during one call... And all subsequent calls can use the cached RDD? basically, during one invocation val rdd1 = sparkContext1.textFil