Hi, I am running some Spark code on my cluster in standalone mode. However, I have noticed that the most powerful machines (32 cores, 192 Gb mem) hardly get any tasks, whereas my small machines (8 cores, 128 Gb mem) all get plenty of tasks. The resources are all displayed correctly in the WebUI and machines all have the same configuration. When 'slaves' is to only contain the powerful machines they work well, though. However, I would like to make use of 'all' machines. Any idea what could be the reason? Or how the scheduler decides on which machine the task is assigned to? Would appreciate some help, Tassilo
-- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Standalone-Scheduling-tp19323.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
