Re: Kafka Spout Drops messages when kafka broker fails, does not failover to kafka replicas

2015-01-26 Thread Milad Fatenejad
Hello Harsha: I am mainly just using the default settings... BrokerHosts zk = new ZkHosts(zkConnect); SpoutConfig spoutConfig = new SpoutConfig(zk, kafkaTopic, "/kafkaStorm", spoutComponentId); spoutConfig.scheme = new SchemeAsMultiScheme(new StringScheme()); Kafka

Re: Kafka Spout Drops messages when kafka broker fails, does not failover to kafka replicas

2015-01-26 Thread Harsha
Milad, Can you share your kafkaSpout config. -Harsha On Mon, Jan 26, 2015, at 01:31 PM, Milad Fatenejad wrote: > Hello: > > I reran my test with a replication factor of 2 but encountered the > same issue...any other suggestions? > > Thanks Milad > > On Mon, Jan 26, 2015 at 1:06 PM, Manoj Jaiswal

Re: Kafka Spout Drops messages when kafka broker fails, does not failover to kafka replicas

2015-01-26 Thread Milad Fatenejad
Hello: I reran my test with a replication factor of 2 but encountered the same issue...any other suggestions? Thanks Milad On Mon, Jan 26, 2015 at 1:06 PM, Manoj Jaiswal wrote: > three node kafka cluster with replication factor of 3 is bad design. > > It should always be less than the cluster

Re: Kafka Spout Drops messages when kafka broker fails, does not failover to kafka replicas

2015-01-26 Thread Manoj Jaiswal
three node kafka cluster with replication factor of 3 is bad design. It should always be less than the cluster size. Please change it to 2 and try again. -Manoj On Mon, Jan 26, 2015 at 7:19 AM, Milad Fatenejad wrote: > Hello: > > I have a three node kafka cluster with a single topic and a t

Kafka Spout Drops messages when kafka broker fails, does not failover to kafka replicas

2015-01-26 Thread Milad Fatenejad
Hello: I have a three node kafka cluster with a single topic and a topic replication factor of 3. I ran a test where I inserted a few hundred messages into kafka. While the topology was reading these messages, I killed one of the brokers. My hope was that the kafka spout would simply use one of t