Re: Spark job only starts tasks on a single node

2017-12-07 Thread Art Rand
EBUG log from Spark Driver, didn't see any mention of >> decline. But from log, it looks like it has only accepted one offer from >> Mesos. >> >> Also looks like there is no special role required on Spark part! >> >> On Wed, Dec 6, 2017 at 5:57 AM, Art Rand

Re: Spark job only starts tasks on a single node

2017-12-06 Thread Art Rand
Hello Ji, Spark will launch Executors round-robin on offers, so when the resources on an agent get broken into multiple resource offers it's possible that many Executrors get placed on a single agent. However, from your description, it's not clear why your other agents do not get Executors schedul