Hi to all, Our problem was passing configuration from Spark Driver to the Slaves. After a lot of time spent figuring out how things work, this is the solution I came up with. Hope this will be helpful for others as well.
You can read about it in my Blog Post <http://progexc.blogspot.co.il/2014/12/spark-configuration-mess-solved.html> -- Enjoy, Demi Ben-Ari Senior Software Engineer Windward LTD.