Re: Spark streaming with Kafka- couldnt find KafkaUtils

2015-04-07 Thread Felix C
Subject: Re: Spark streaming with Kafka- couldnt find KafkaUtils How are you submitting the application? Use a standard build tool like maven or sbt to build your project, it will download all the dependency jars, when you submit your application (if you are using spark-submit, then use --jars

Re: Spark streaming with Kafka- couldnt find KafkaUtils

2015-04-04 Thread Akhil Das
How are you submitting the application? Use a standard build tool like maven or sbt to build your project, it will download all the dependency jars, when you submit your application (if you are using spark-submit, then use --jars option to add those jars which are causing classNotFoundException). I

Spark streaming with Kafka- couldnt find KafkaUtils

2015-04-04 Thread Priya Ch
Hi All, I configured Kafka cluster on a single node and I have streaming application which reads data from kafka topic using KafkaUtils. When I execute the code in local mode from the IDE, the application runs fine. But when I submit the same to spark cluster in standalone mode, I end up with