Re: Re: Many Receiver vs. Many threads per Receiver

2015-02-26 Thread Jeffrey Jedele
>> supported by Spark Streaming. So far, I don't see it mentioned/documented >> in the spark streaming programming guide. >> >> -- >> bit1...@163.com >> >> >> *From:* Akhil Das >> *Date:* 2015-02-24 16:21 >>

Re: Re: Many Receiver vs. Many threads per Receiver

2015-02-26 Thread bit1...@163.com
Sure, Thanks Tathagata! bit1...@163.com From: Tathagata Das Date: 2015-02-26 14:47 To: bit1...@163.com CC: Akhil Das; user Subject: Re: Re: Many Receiver vs. Many threads per Receiver Spark Streaming has a new Kafka direct stream, to be release as experimental feature with 1.3. That uses a

Re: Re: Many Receiver vs. Many threads per Receiver

2015-02-25 Thread Tathagata Das
treaming programming guide. > > -- > bit1...@163.com > > > *From:* Akhil Das > *Date:* 2015-02-24 16:21 > *To:* bit1...@163.com > *CC:* user > *Subject:* Re: Many Receiver vs. Many threads per Receiver > I believe when you go with 1, it will distribute the consume

Re: Re: Many Receiver vs. Many threads per Receiver

2015-02-24 Thread bit1...@163.com
Many Receiver vs. Many threads per Receiver I believe when you go with 1, it will distribute the consumer across your cluster (possibly on 6 machines), but still it i don't see a away to tell from which partition it will consume etc. If you are looking to have a consumer where you can s

Re: Many Receiver vs. Many threads per Receiver

2015-02-23 Thread Akhil Das
I believe when you go with 1, it will distribute the consumer across your cluster (possibly on 6 machines), but still it i don't see a away to tell from which partition it will consume etc. If you are looking to have a consumer where you can specify the partition details and all, then you are bette