Re: CPU Parallelization not being used (local mode)

2015-07-30 Thread Akhil Das
When you give master as *local[1]* it occupies a single thread which will probably run on a single core, you can give *local[*]* to allocate the total # cores that you have. Thanks Best Regards On Tue, Jul 28, 2015 at 1:27 AM, wrote: > Hi all, > > would like some insight. I am currently comput

CPU Parallelization not being used (local mode)

2015-07-27 Thread Saif.A.Ellafi
Hi all, would like some insight. I am currently computing huge databases, and playing with monitoring and tunning. When monitoring the multiple cores I have, I see that even when RDDs are parallelized, computation on the RDD jump from core to core sporadically ( I guess, depending on where the