My Mesos cluster has 1.5 CPU and 17GB free. If I set: conf.set("spark.mesos.coarse", "true"); conf.set("spark.cores.max", "1");
in the SparkConf object, the job will run in the mesos cluster fine. But if I comment out those settings above so that it defaults to fine grained, the task never finishes. It just shows as 0 for everything in the mesos frameworks (# of tasks, cpu, memory are all 0). There's nothing in the log files anywhere as to what's going on. Thanks