015 at 12:29 AM, Davies Liu wrote:
> How many executors you have per machine? It will be helpful if you
> could list all the configs.
>
> Could you also try to run it without persist? Caching do hurt than
> help, if you don't have enough memory.
>
> On Fri, Feb 20, 2015 a
Thanks for the suggestions.
I'm experimenting with different values for spark memoryOverhead and
explictly giving the executors more memory, but still have not found the
golden medium to get it to finish in a proper time frame.
Is my cluster massively undersized at 5 boxes, 8gb 2cpu ?
Trying to fi