Hi all, We are running into a classpath issue when we upgrade our application from 1.2 to 1.6.
In 1.2, we load properties from a flat file (from working directory of the spark-submit script) using classloader resource approach. This was executed up front (by the driver) before any processing happened. val confStream = Thread.currentThread().getContextClassLoader().getResourceAsStream(appConfigPath) confProperties.load(confStream) In 1.6, the line getResourceAsStream returns a null and thus causes a subsequent NullPointerException when loading the properties. How do we pass flat files (there are many, so we really want to add a directory to the classpath) in Spark 1.6? We haven't had much luck with --files and --driver-class-path and spark.driver.extraClasspath. We also couldn't find much documentation on this. Thanks! Sumona