Re: Setting up the CooperativeStickyAssignor in Java

2022-03-18 Thread Richard Ney
Thanks for the additional information Bruno. Does this look like a possible bug in the CooperativeStickyAssignor? I have 5 consumers reading from a 50 partition topic. Based on the log messages this application instance is only getting assigned 8 partitions but when I ask the consumer group for LAG

Re: Setting up the CooperativeStickyAssignor in Java

2022-03-18 Thread Liam Clarke-Hutchinson
Kia ora Richard, I see support for the Cooperative Sticky Assignor in fs2-kafka is quite new. Have you discussed this issue with the community of that client at all? I ask because I see on GitHub that fs2-kafka is using kafka-clients 2.8.1 as the underlying client, and there's been a fair few bugf

Re: Setting up the CooperativeStickyAssignor in Java

2022-03-18 Thread Richard Ney
Hi Ngā mihi, I believe the log entry I included was from the underlying kafka-clients library given that the logger identified is “org.apache.kafka.clients.consumer.internals.ConsumerCoordinator”. I’ll admit at first I thought it also might be the fs2-kafka wrapper given that the 2.4.0 version

Re: Setting up the CooperativeStickyAssignor in Java

2022-03-18 Thread Richard Ney
Hi Liam, Sorry for the mis-identification in the last email. The fun of answering an email on a phone instead of a desktop. I confirmed the upper log messages I included in the message come from this location in the `kafka-clients` library https://github.com/apache/kafka/blob/trunk/clients/src/ma