Re: RDD Blocks skewing to just few executors

2015-03-20 Thread Sean Owen
Hm is data locality a factor here? I don't know. Just a side note: this doesn't cause OOM errors per se since the cache won't exceed the % of heap it's allowed. However that will hasten OOM problems due to tasks using too much memory, of course. The solution is to get more memory to the tasks or r

Re: RDD Blocks skewing to just few executors

2015-03-20 Thread Alessandro Lulli
Hi All, I'm experiencing the same issue with Spark 120 (not verified with previous). Could you please help us on this? Thanks Alessandro On Tue, Nov 18, 2014 at 1:40 AM, mtimper wrote: > Hi I'm running a standalone cluster with 8 worker servers. > I'm developing a streaming app that is adding