Re: [DISCUSS] KIP-794: Strictly Uniform Sticky Partitioner

Hi Luke, Thank you for your feedback. I've updated the KIP with your suggestions. 1. Updated with a better example. 2. I removed the reference to ClassicDefaultPartitioner, it was probably confusing. 3. The logic doesn't rely on checking batches, I've updated the proposal to make it more explici

Re: [DISCUSS] KIP-778 KRaft Upgrades

Hi, David, Thanks for the reply. 16. My first concern is that the KIP picks up meta.version inconsistently during the deployment. If a new cluster is started, we pick up the highest version. If we upgrade, we leave the feature version unchanged. Intuitively, it seems that independent of how a clu

Re: [DISCUSS] KIP-791: Add Record Metadata to State Store Context

Thanks for the KIP, Patrick! It looks like you addressed Guozhang's and Bruno's very good feeback, and I like the result. The example especially helps clarify how this property might be useful. I'm in favor of this proposal. Thanks, -John On Fri, 2021-11-05 at 12:03 +0100, Bruno Cadonna wrote:

Re: New Kafka Consumer : unknown member id

Hello Luke i have build a new kafka environment with kafka 2.8.0 the consumer is a new consumer set up to this environment is throwing the below error... the old consumers for the same applications for the same environment -2.8.0 is working fine.. . could you please advise 2021-11-02 12:25:24 D

[jira] [Created] (KAFKA-13435) Group won't consume partitions added after static member restart

Ryan Leslie created KAFKA-13435: --- Summary: Group won't consume partitions added after static member restart Key: KAFKA-13435 URL: https://issues.apache.org/jira/browse/KAFKA-13435 Project: Kafka

[jira] [Created] (KAFKA-13434) Add a public API for AbstractCoordinatos

Hector G created KAFKA-13434: Summary: Add a public API for AbstractCoordinatos Key: KAFKA-13434 URL: https://issues.apache.org/jira/browse/KAFKA-13434 Project: Kafka Issue Type: Improvement

Re: [DISCUSS] KIP-778 KRaft Upgrades

Colin and Jun, thanks for the additional comments! Colin: > We've been talking about having an automated RPC compatibility checker Do we have a way to mark fields in schemas as deprecated? It can stay in the RPC, it just complicates the logic a bit. > It would be nice if the active controller c

RE: Re: [VOTE] KIP-714: Client Metrics and Observability

+1 We also have a lot of clients using our central Kafka cluster, and it would be great to have client metrics so we can provide end-to-end monitoring. Igor Buzatović Porsche Digital On 2021/11/01 20:19:20 J Rivers wrote: > +1 > > Thank you for the KIP! > > Our organization runs kafka at large s

Re: [DISCUSS] KIP-779: Allow Source Tasks to Handle Producer Exceptions

Good morning, If there is no additional feedback, I am going to call a vote for this KIP on Monday. Knowles On Tue, Nov 2, 2021 at 10:00 AM Knowles Atchison Jr wrote: > Third time's the charm. > > I've added a getter for the RetryWithToleranceOperator to get the > ToleranceType. I've updated W

Re: [DISCUSS] KIP-791: Add Record Metadata to State Store Context

Hi Patrick, Thank you for the KIP! - Maybe some more details in the motivation would help to better understand the background of the KIP. Currently, it is hard to judge whether record metadata should be exposed or not. Can you maybe give an example? - Could you please replace RYW abbreviati

Re: [VOTE] KIP-782: Expandable batch size in producer

Hi Mickael, Thanks for the good comments! Answering them below: - When under load, the producer may allocate extra buffers. Are these buffers ever released if the load drops? --> This is a good point that I've never considered before. Yes, after introducing the "batch.max.size", we should release