Does Kafka consumer api provide a way for you to search for partition number of a topic with key?

2018-01-21 Thread TSANG, Brilly
Hi folks, I'm working with a topic that have many messages. Kafka is scale horizontally. As a result, when they spread out to multiple processes, only 1 will work with the specific key. The rest are not related and should stop the processing. Is there a way from the client API to hash the part

Kafka functionality

2018-01-21 Thread Aman Shaikh
Dear sir/madam. Can we use Kafka for handling streams of data from gps device coming per sec from 1000's of device. Thanks and Regards, Aman

Re: How to always consume from latest offset in kafka-streams

2018-01-21 Thread Dan Markhasin
You can try generating a random consumer group ID to ensure that no existing offset is used. On 20 January 2018 at 01:11, Matthias J. Sax wrote: > That is not supported out-of-box. > > Configuration "auto.offset.reset" only triggers, if there are not > committed offsets and there is KS config to