Re: ticketing system Design

2017-06-20 Thread Neil Moore
It can be implemented on top of Kafka with some effort, but Kafka doesn't solve this problem for you directly. Amazon SQS does provide something like what you want, perhaps looking for other projects similar to SQS will yield some results. From: Abhimanyu Nag

Kafka streams questions

2017-02-28 Thread Neil Moore
Hello, I have a few questions that I couldn't find answers to in the documentation: * Can added partitions be auto-discovered by kafka-streams? In my informal tests I have had to restart the stream nodes. * Is it possible to rewind the consumer for a particular topic-partitions. e.g.

Re: Kafka streams questions

2017-03-06 Thread Neil Moore
l result in duplicate processing as there is currently no way to reset your state stores. -Matthias On 2/28/17 1:31 PM, Neil Moore wrote: > Hello, > > > I have a few questions that I couldn't find answers to in the documentation: > > > * Can added partitions be aut

Re: Kafka running but not listening to port 9092

2017-03-31 Thread Neil Moore
I don't know what the problem is but have you looked through the logs? If that doesn't suggest the resolution try posting them here. From: Rafael Telles Sent: 29 March 2017 14:53:27 To: users@kafka.apache.org Subject: Kafka running but not listening to port 9092

Broker asks other broker to shut down

2017-05-26 Thread Neil Moore
We have a case where one of our brokers running Kafka 0.10.1.1 is telling another one to shut down. There is nothing obvious (to me) in the logs of either source or destination of this message to explain why it would happen. Does anybody see anything in the logs (below) that I have missed, or kn

Turning on rack awareness

2017-06-06 Thread Neil Moore
I am practicing turning on rack awareness on a test cluster. With a cluster of 3 nodes that currently does not use rack awareness (broker.rack is not set). During a rolling restart of the brokers where broker.rack was filled in one by one, on each node I got the error [2017-06-06 15:41:08,780]