Re: Kafka createDirectStream ​issue

2015-09-20 Thread Petr Novak
val topics="first" shouldn't it be val topics = Set("first") ? On Sun, Sep 20, 2015 at 1:01 PM, Petr Novak wrote: > val topics="first" > > shouldn't it be val topics = Set("first") ? > > On Sat, Sep 19, 2015 at 10:07 PM, kali.tumm...@gmail.com < > kali.tumm...@gmail.com> wrote: > >> Hi , >> >>

Re: Kafka createDirectStream ​issue

2015-09-19 Thread kali.tumm...@gmail.com
Hi , I am trying to develop in intellij Idea same code I am having the same issue is there any work around. Error in intellij:- cannot resolve symbol createDirectStream import kafka.serializer.StringDecoder import org.apache.spark._ import org.apache.spark.SparkContext._ import org.apache.spark.

Re: Kafka createDirectStream ​issue

2015-06-24 Thread syepes
Hello, Thanks for all the help on resolving this issue, especially to Cody who guided me to the solution. For other facing similar issues, basically the issue was that I was running Spark Streaming jobs from the spark-shell and this is not supported. Running the same job through spark-submit work

Re: Kafka createDirectStream ​issue

2015-06-23 Thread Tathagata Das
sage will be added to the >>> discussion below: >>> >>> http://apache-spark-user-list.1001560.n3.nabble.com/Kafka-createDirectStream-issue-tp23456.html >>> To start a new topic under Apache Spark User List, email [hidden email] >>> <http:///user/SendEmail.jtp

Re: Kafka createDirectStream ​issue

2015-06-23 Thread syepes
yes, I have two clusters one standalone an another using Mesos Sebastian YEPES http://sebastian-yepes.com On Wed, Jun 24, 2015 at 12:37 AM, drarse [via Apache Spark User List] < ml-node+s1001560n23457...@n3.nabble.com> wrote: > Hi syepes, > Are u run the application in standalone mode? > Reg

Re: Kafka createDirectStream ​issue

2015-06-23 Thread drarse
Hi syepes, Are u run the application in standalone mode? Regards El 23/06/2015 22:48, "syepes [via Apache Spark User List]" < ml-node+s1001560n23456...@n3.nabble.com> escribió: > Hello, > > I ​am trying ​use the new Kafka ​consumer > ​​"KafkaUtils.createDirectStream"​ but I am having some issues m

Re: Kafka createDirectStream ​issue

2015-06-23 Thread Cody Koeninger
The exception $line49 is referring to a line of the spark shell. Have you tried it from an actual assembled job with spark-submit ? On Tue, Jun 23, 2015 at 3:48 PM, syepes wrote: > Hello, > > I ​am trying ​use the new Kafka ​consumer > ​​"KafkaUtils.createDirectStream"​ > but I am having so