I am working with datasets of the order of 200 GB using 286 cores divided across 143 executor. Each executor has 32 Gb (which makes every core 15 Gb). And I am using Spark 1.6.
I would like to tune the spark.locality.wait. Does anyone can give me a range on the values of spark.locality wait that I can try ? Thanks a lot ! -- Cesar Flores