Re: using Spark Streaming with Kafka 0.9/0.10

2016-11-15 Thread aakash aakash
to consume from a 0.9 broker > >> > >> Where are you reading documentation indicating that the direct stream > >> only runs on the driver? It runs consumers on the worker nodes. > >> > >> > >> On Tue, Nov 15, 2016 at 10:58 AM, aakash aakash > >

Re: using Spark Streaming with Kafka 0.9/0.10

2016-11-15 Thread Cody Koeninger
cumentation indicating that the direct stream >> only runs on the driver? It runs consumers on the worker nodes. >> >> >> On Tue, Nov 15, 2016 at 10:58 AM, aakash aakash >> wrote: >> > Re-posting it at dev group. >> > >> > Thanks and Regard

Re: using Spark Streaming with Kafka 0.9/0.10

2016-11-15 Thread aakash aakash
aakash aakash > wrote: > > Re-posting it at dev group. > > > > Thanks and Regards, > > Aakash > > > > > > -- Forwarded message -- > > From: aakash aakash > > Date: Mon, Nov 14, 2016 at 4:10 PM > > Subject: using Spark Strea

Re: using Spark Streaming with Kafka 0.9/0.10

2016-11-15 Thread Cody Koeninger
14, 2016 at 4:10 PM > Subject: using Spark Streaming with Kafka 0.9/0.10 > To: user-subscr...@spark.apache.org > > > Hi, > > I am planning to use Spark Streaming to consume messages from Kafka 0.9. I > have couple of questions regarding this : > > I see APIs are annota

Fwd: using Spark Streaming with Kafka 0.9/0.10

2016-11-15 Thread aakash aakash
Re-posting it at dev group. Thanks and Regards, Aakash -- Forwarded message -- From: aakash aakash Date: Mon, Nov 14, 2016 at 4:10 PM Subject: using Spark Streaming with Kafka 0.9/0.10 To: user-subscr...@spark.apache.org Hi, I am planning to use Spark Streaming to consume