Well, for what it's worth I found the answer on the Mesos spark documentation: https://github.com/mesos/spark/wiki/Spark-Programming-GuideThe quick start guide, say to use "--master local[4]" with spark-submit and that implies that it would indicate to use more than on processor. However that doesn't work, the example context creation needs to be change from this: "sc = SparkContext("*local*", "Simple App")" to this "sc = SparkContext("*local[*]"*, "Simple App")"
-- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/No-parallelism-in-map-transformation-tp9863p9870.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
