Consumer position not returning correct offset - 0.10.0.1

Hi, In testing - i’ve got a 5 node Kafka cluster with min.insync.replicas set to 4. The cluster is currently running version 0.10.0.1. There’s an application that publishes to a topic - and on restart, it attempts to read the full contents of the topic up until the high watermark before then

Re: Consumer position not returning correct offset - 0.10.0.1

This was resolved internally - I realised that we had a second consumer running against the topic which was committing offsets without setting a group.id or auto.commit to false. Henry > On 5 Sep 2018, at 08:28, Henry Thacker wrote: > > Hi, > > In testing - i’ve got a 5 nod

Kafka Streams 0.10.0.1 - multiple consumers not receiving messages

ould work? Thanks, Henry -- Henry Thacker

Re: Kafka Streams 0.10.0.1 - multiple consumers not receiving messages

to the same topic & partition I could > understand this behaviour, but given that the subscriptions are for > different input topics, I would have thought this should work? > > Thanks, > Henry > > -- > Henry Thacker > > >

Re: Kafka Streams 0.10.0.1 - multiple consumers not receiving messages

s (200) so we don't run into heartbeating issues if we restart intraday. Thanks, Henry -- Henry Thacker On 28 April 2017 at 11:37:53, Henry Thacker (he...@henrythacker.com) wrote: > Hi Eno, > > Thanks for your reply - the code that builds the topology is something > like this

Re: Kafka Streams 0.10.0.1 - multiple consumers not receiving messages

lity to share state stores between the applications? Unfortunately the data on the input topics are provided by a third party component which sends these keyless messages on a single partition per topic, so I have little ability to fix this at source :-( Thanks, Henry -- Henry Thacker On 28 A

Re: Kafka Streams 0.10.0.1 - multiple consumers not receiving messages

fully unrelated point, is this cluster is all SSL encrypted. Thanks, Henry -- Henry Thacker On 29 April 2017 at 05:31:30, Matthias J. Sax (matth...@confluent.io) wrote: > Henry, > > you might want to check out the docs, that give an overview of the > architecture: > http://doc

Re: Kafka Streams 0.10.0.1 - multiple consumers not receiving messages

rs - "localhost:9092,localhost:9093,localhost:9094" zookeepers - "localhost:2181,localhost:2182,localhost:2183" maxMessageBytes - 3000 ssl - true Thanks, Henry -- Henry Thacker On 2 May 2017 at 10:16:25, Eno Thereska (eno.there...@gmail.com) wrote: > Hi Henry, > > Coul

Re: Kafka Streams 0.10.0.1 - multiple consumers not receiving messages

5 days, just need to work out how to tidy this all up in a semi-automated fashion. Thanks, Henry -- Henry Thacker On 2 May 2017 at 16:21:33, Eno Thereska (eno.there...@gmail.com) wrote: > Could you make sure you don’t have a firewall or that the Kafka brokers > are set up correctly and c