Not Serializable exception when integrating SQL and Spark Streaming

2014-12-23 Thread bigdata4u
I am trying to use sql over Spark streaming using Java. But i am getting Serialization Exception. public static void main(String args[]) { SparkConf sparkConf = new SparkConf().setAppName("NumberCount"); JavaSparkContext jc = new JavaSparkContext(sparkConf); JavaStreamingContext jssc =

Best to execute SQL in Streaming data

2014-12-23 Thread bigdata4u
Hi, I have a existing batch processing system which use SQL queries to extract information from data. I want to replace this with Real time system. I am coding in Java and to use SQL in Streaming data i found few examples but none of them is complete. http://apache-spark-user-list.1001560.n3.nabb