Re: Scaling issues due to contention in Random

2016-11-25 Thread Sean Owen
SparkPi is just an example, so its performance doesn't really matter. Simpler is better. Kryo could be an issue but that would be a change in Kryo. On Fri, Nov 25, 2016 at 7:30 AM Prasun Ratn wrote: > Hi, > > I am seeing perf degradation in the Spark/Pi example on a single-node > setup (using lo

Scaling issues due to contention in Random

2016-11-24 Thread Prasun Ratn
Hi, I am seeing perf degradation in the Spark/Pi example on a single-node setup (using local[K]) Using 1, 2, 4, and 8 cores, this is the execution time in seconds for the same number of iterations:- Random: 4.0, 7.0, 12.96, 17.96 If I change the code to use ThreadLocalRandom (https://github.com/