Hi, I don't think you can do that. The code inside the for each is running on the node level and you're trying to create another rdd within the node's specific execution context.
Try to load the text file before the streaming context on the driver app and use it later as a cached rdd on following operations. Rod -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Streaming-Checkpoint-SparkContext-is-not-serializable-class-tp10456p10985.html Sent from the Apache Spark User List mailing list archive at Nabble.com.