Re: Necessity for rdd replication.

2014-12-04 Thread Sameer Farooqui
st the RDD, but again.. generally speaking, you shouldn't need to replicate it. On Wed, Dec 3, 2014 at 11:54 PM, rapelly kartheek wrote: > Hi, > > I was just thinking about necessity for rdd replication. One category > could be something like large number of threads requiring same

Necessity for rdd replication.

2014-12-03 Thread rapelly kartheek
Hi, I was just thinking about necessity for rdd replication. One category could be something like large number of threads requiring same rdd. Even though, a single rdd can be shared by multiple threads belonging to "same application" , I believe we can extract better parallelism if