i am reading the spark configuration params from another configuration object (typesafe config) before setting them as system properties.
i noticed typesafe config has trouble with settings like: spark.speculation=true spark.speculation.interval=0.5 the issue seems to be that if spark.speculation is a "container" that has more values inside then it cannot be also a value itself, i think. so this would work fine: spark.speculation.enabled=true spark.speculation.interval=0.5 just a heads up. i would probably suggest we avoid this situation.