Re: Spark Streaming, Broadcast variables, java.lang.ClassCastException

2016-04-25 Thread mwol
I forgot the streamingContext.start() streamingContext.awaitTermination() in my example code, but the error stays the same... -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Streaming-Broadcast-variables-java-lang-ClassCastException-tp26828p26829.ht

Spark Streaming, Broadcast variables, java.lang.ClassCastException

2016-04-25 Thread mwol
Hi, I try to read data from a static textfile stored in HDFS, store its content into an ArrayBuffer which in turn should be broadcasted via sparkContext.broadcast as a BroadcastVariable. I am using cloudera's spark, version 1.6.0-cdh5.7.0 and spark-streaming_2.10. I start the application on yarn u