I believe you’ll have to use another way of creating StreamingContext by
passing create function in getOrCreate function.
private def setupSparkContext(): StreamingContext = {
val streamingSparkContext = {
val sparkConf = new
SparkConf().setAppName(config.appName).setMaster(config.master)
Have you looked at the driver and executor logs?
Without being able to see what's in the "do stuff with the dstream" section
of code... I'd suggest starting with a simpler job, e.g that does nothing
but print each message, and verify whether it checkpoints
On Fri, Nov 6, 2015 at 3:59 AM, Kathi St
