Re: Strange behaviour of different SSCs with same Kafka topic

2014-04-22 Thread Tathagata Das
>>> >>>>> Thanks >>>>> >>>>> >>>>> >>>>> -- >>>>> View this message in context: >>>>> http://apache-spark-user-list.1001560.n3.nabble.com/Strange-behaviour-of-different-SSCs-with-same

Re: Strange behaviour of different SSCs with same Kafka topic

2014-04-21 Thread gaganbm
chive at Nabble.com. >>>> >>> >>> >>> >>> -- >>> If you reply to this email, your message will be added to the >>> discussion below: >>> >>> http://apache-spark-user-list.1001560.n3.nabble.com/Stra

Re: Strange behaviour of different SSCs with same Kafka topic

2014-04-21 Thread Tathagata Das
gt; discussion below: >> >> http://apache-spark-user-list.1001560.n3.nabble.com/Strange-behaviour-of-different-SSCs-with-same-Kafka-topic-tp4050p4238.html >> To start a new topic under Apache Spark User List, email [hidden >> email]<http://user/SendEmail.jtp?type=node&node=4434&

Re: Strange behaviour of different SSCs with same Kafka topic

2014-04-17 Thread gaganbm
It happens with normal data rate, i.e., lets say 20 records per second. Apart from that, I am also getting some more strange behavior. Let me explain. I establish two sscs. Start them one after another. In SSCs I get the streams from Kafka sources, and do some manipulations. Like, adding some "Re

Re: Strange behaviour of different SSCs with same Kafka topic

2014-04-14 Thread Tathagata Das
Does this happen at low event rate for that topic as well, or only for a high volume rate? TD On Wed, Apr 9, 2014 at 11:24 PM, gaganbm wrote: > I am really at my wits' end here. > > I have different Streaming contexts, lets say 2, and both listening to same > Kafka topics. I establish the Kafk