Re: question about partitions

parts. Will >> calling RDD.coalesce(N) possibly cause processing bottlenecks? >> >> >> On Mon, Mar 24, 2014 at 1:28 PM, Walrus theCat wrote: >> >>> Hi, >>> >>> Quick question about partitions. If my RDD is partitioned into 5 >>> partitions, does that mean that I am constraining it to exist on at most 5 >>> machines? >>> >>> Thanks >>> >> >> >

Re: question about partitions

. On Mon, Mar 24, 2014 at 2:32 PM, Walrus theCat wrote: > For instance, I need to work with an RDD in terms of N parts. Will > calling RDD.coalesce(N) possibly cause processing bottlenecks? > > > On Mon, Mar 24, 2014 at 1:28 PM, Walrus theCat wrote: > >> Hi, >> >

Re: question about partitions

For instance, I need to work with an RDD in terms of N parts. Will calling RDD.coalesce(N) possibly cause processing bottlenecks? On Mon, Mar 24, 2014 at 1:28 PM, Walrus theCat wrote: > Hi, > > Quick question about partitions. If my RDD is partitioned into 5 > partitions, does th

question about partitions

Hi, Quick question about partitions. If my RDD is partitioned into 5 partitions, does that mean that I am constraining it to exist on at most 5 machines? Thanks