Re: Question about executor memory setting

2016-09-29 Thread mohan s
gt; > May I ask a question about executor memory setting? I was running PageRank > with input size 2.8GB on one workstation for testing. I gave PageRank one > executor. > > In case 1, I set --executor-cores to 4, and --executor-memory to 1GB, the > stage (stage 2) completion ti

Question about executor memory setting

2016-09-27 Thread Dogtail L
Hi all, May I ask a question about executor memory setting? I was running PageRank with input size 2.8GB on one workstation for testing. I gave PageRank one executor. In case 1, I set --executor-cores to 4, and --executor-memory to 1GB, the stage (stage 2) completion time is 14 min, the the