Re: [E] Re: SPARK-19547

2017-06-15 Thread Sree V
Hi Pankaj, >> After the second consumer group comes upDo you mean a second consumer starts >> with the same consumer group as the first ? createDirectStream is overloaded. One of the method, doesn't need you to specify partitions of a topic. Cheers - Sree On Thursday, June 8, 2017 9:56 AM

Re: [E] Re: SPARK-19547

2017-06-08 Thread Rastogi, Pankaj
Hi, Thank you for your reply! You got it right! I am trying to run multiple streams using the same consumer, so that I can distribute different partitions among different instances of the consumer group. I don¹t want to provide the list of partitions in createDirectStream API. If I do that then i