Task not serializable exception

2015-10-27 Thread Rohith Parameshwara
I am getting this spark not serializable exception when running spark submit in standalone mode. I am trying to use spark streaming which gets its stream from kafka queues.. but it is not able to process the mapping actions on the RDDs from the stream ..the code where the serialization exception

Unable to run applications on spark in standalone cluster mode

2015-10-19 Thread Rohith Parameshwara
Hi all, I am doing some experiments on spark standalone cluster setup and I am facing the following issue: I have a 4 node cluster setup. As per http://spark.apache.org/docs/latest/spark-standalone.html#starting-a-cluster-manually I tried to start the cluster with the scripts but