Re: KAFKA-2526: command line --producer-property wins

2025-05-29 Thread Tommi Vainikainen
Hi, The proposed standardization of property priority is a good improvement and looks clear to me. One convenience issue I'd like to point out is that almost all command line tools currently define --bootstrap-server as a required command line argument. However if one needs to pass e.g. SSL for a

Re: [DISCUSS] ConfigDef.ConfigKey builder and addition of deprecated information.

2025-05-29 Thread Claude Warren, Jr
Hello Chris, Thanks for the input. I can see the issue with the deprecation field as a potential breaking change to the API but my thought was that it would be used to generate help and log entries if it was present, but I will leave that out for now. I don't see that the builder will create a p

Re: KRaft Observer node unable to recover after (re-)bootstrapping to Follower node

2025-05-29 Thread Luke Chen
It's awesome you already reproduced the issue, Alyssa! But @Justin, if possible, could you still share the logs and the quorum state store file on the observer like Alyssa requested? Thank you. Luke On Fri, May 30, 2025 at 9:40 AM Alyssa Huang wrote: > Wanted to correct my wording and resend t

RE: [DISCUSS] KIP-1121: Compression acceleration in Kafka

2025-05-29 Thread Denloye, Olasoji
Hello all, any more comments? Thanks -Original Message- From: Denloye, Olasoji Sent: Wednesday, May 7, 2025 10:55 AM To: dev@kafka.apache.org Subject: RE: [DISCUSS] KIP-1121: Compression acceleration in Kafka Hi Greg, 2, 10 I figured a way to not expose any of these internal classes t

Re: [VOTE] KIP-1157: Enforce KafkaPrincipalSerde Implementation for KafkaPrincipalBuilder

2025-05-29 Thread Johnny Wang
Hi everyone, I want to bump this vote thread manually. Thanks for your attention. Best, Wang Johnny Wang 於 2025年5月9日 週五 上午1:25寫道: > Hi, Chia-Ping > > Updated, thanks for reminding me. > > Wang > > Chia-Ping Tsai 於 2025年5月9日 週五 上午12:55寫道: > >> hi Szu-Yung >> >> please update the KIP to include

Jenkins build is still unstable: Kafka » Kafka PowerPC Daily » test-powerpc #313

2025-05-29 Thread Apache Jenkins Server
See

Re: KRaft Observer node unable to recover after (re-)bootstrapping to Follower node

2025-05-29 Thread Alyssa Huang
Wanted to correct my wording and resend the original text of my email because I got a bounce back - > Thanks Justin, > > It's hard to say from the current details if it's simply a network issue > (e.g. broker never receives the response with the leaderId), bug (broker > does receive response with

Re: KRaft Observer node unable to recover after (re-)bootstrapping to Follower node

2025-05-29 Thread Alyssa Huang
Thanks Justin, It's hard to say from the current details if it's simply a network issue (e.g. broker never receives the response with the leaderId), bug (broker does receive response with leaderId, never transitions to follower), or something else. Could you potentially send over logs from the mis

Re: KRaft Observer node unable to recover after (re-)bootstrapping to Follower node

2025-05-29 Thread Justin Chen
To correct my original description: We have observed that KRaft observers (process.roles=broker) that typically send FETCH requests to the quorum Leader node can enter a state of indefinitely **sending FETCH requests to a voter (follower) node**, which we believe to be after a re-bootstrap due to

KRaft Observer node unable to recover after (re-)bootstrapping to Follower node

2025-05-29 Thread Justin Chen
Hello, In our Kafka 4.0 cluster (dynamic quorum, 5 controller nodes), we have observed that KRaft observers (process.roles=broker) that typically send FETCH requests to the quorum Leader node can enter a state of indefinitely re-bootstraping to a voter (follower) node, likely after some sort of re

Re: KIP-1155: Metadata Version Downgrades [DISCUSS]

2025-05-29 Thread Colin McCabe
On Thu, May 29, 2025, at 08:37, José Armando García Sancio wrote: > Hi Colin, > > On Tue, May 27, 2025 at 8:57 PM Colin McCabe wrote: >> My argument was that it would be unlikely that all three of these things >> would be true. One reason why I think this is that 3.7-IV3 is a pretty old >> MV at

[jira] [Resolved] (KAFKA-6629) SegmentedCacheFunctionTest does not cover session window serdes

2025-05-29 Thread Bill Bejeck (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck resolved KAFKA-6629. Resolution: Fixed > SegmentedCacheFunctionTest does not cover session window serdes > -

Re: KIP-1155: Metadata Version Downgrades [DISCUSS]

2025-05-29 Thread José Armando García Sancio
Hi Colin, On Tue, May 27, 2025 at 8:57 PM Colin McCabe wrote: > My argument was that it would be unlikely that all three of these things > would be true. One reason why I think this is that 3.7-IV3 is a pretty old MV > at this point anyway. Then why not enforce that in the KIP and code? You ar

[jira] [Created] (KAFKA-19352) PlaintextConsumerCommitTest > testCommitAsyncCompletedBeforeConsumerCloses [1] Type=Raft-Isolated

2025-05-29 Thread Bolin Lin (Jira)
Bolin Lin created KAFKA-19352: - Summary: PlaintextConsumerCommitTest > testCommitAsyncCompletedBeforeConsumerCloses [1] Type=Raft-Isolated Key: KAFKA-19352 URL: https://issues.apache.org/jira/browse/KAFKA-19352

[jira] [Created] (KAFKA-19351) AsyncConsumer#commitAsync should copy the input offsets

2025-05-29 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-19351: -- Summary: AsyncConsumer#commitAsync should copy the input offsets Key: KAFKA-19351 URL: https://issues.apache.org/jira/browse/KAFKA-19351 Project: Kafka I

[jira] [Resolved] (KAFKA-19337) Bug in ShareCoordinatorShard.generateShareStateRecord causes stateEpoch update misses.

2025-05-29 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19337. -- Fix Version/s: 4.1.0 Resolution: Fixed > Bug in ShareCoordinatorShard.generateS

Re: [DISCUSS] ConfigDef.ConfigKey builder and addition of deprecated information.

2025-05-29 Thread Chris Egerton
Hi Claude, As a general improvement to our config API, this sounds fine (I'm perhaps a little iffy on first-class support for deprecation instead of just adding a note to the docstring, but that's low-level enough that it can and should wait for a KIP before being discussed). However, if we're ta

[DISCUSS] ConfigDef.ConfigKey builder and addition of deprecated information.

2025-05-29 Thread Claude Warren, Jr
I would like to implement a ConfigDef.ConfigKey builder. The goal is to have a fluent builder that will build the configKey and provide the same defaults that the current constructor set does. In addition, I would like to add the ability to make a ConfigKey as deprecated with some optional inform

[jira] [Resolved] (KAFKA-19056) Move EndToEndClusterIdTest to server module

2025-05-29 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-19056. Fix Version/s: 4.1.0 Resolution: Fixed > Move EndToEndClusterIdTest to server modul

[jira] [Reopened] (KAFKA-16092) Queues for Kafka

2025-05-29 Thread Apoorv Mittal (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apoorv Mittal reopened KAFKA-16092: --- > Queues for Kafka > > > Key: KAFKA-16092 > URL

[jira] [Resolved] (KAFKA-19285) Improve test coverage for SharePartitionManager

2025-05-29 Thread Apoorv Mittal (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apoorv Mittal resolved KAFKA-19285. --- Fix Version/s: 4.1.0 Resolution: Fixed > Improve test coverage for SharePartitionMana

[jira] [Resolved] (KAFKA-19204) Timeouts in coordinator runtime operations can break share group initialization and deletion

2025-05-29 Thread Apoorv Mittal (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apoorv Mittal resolved KAFKA-19204. --- Fix Version/s: 4.1.0 Resolution: Fixed > Timeouts in coordinator runtime operations c

[jira] [Resolved] (KAFKA-19189) Handle deletion of __share_group_state topic in share coordinator

2025-05-29 Thread Apoorv Mittal (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apoorv Mittal resolved KAFKA-19189. --- Fix Version/s: 4.1.0 Resolution: Fixed > Handle deletion of __share_group_state topic

[jira] [Resolved] (KAFKA-16092) Queues for Kafka

2025-05-29 Thread Apoorv Mittal (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apoorv Mittal resolved KAFKA-16092. --- Fix Version/s: 4.1.0 Assignee: Sushant Mahajan (was: Andrew Schofield) Resol

[jira] [Resolved] (KAFKA-19316) Add share_group_command_test.py system test

2025-05-29 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19316. -- Fix Version/s: 4.1.0 Resolution: Fixed > Add share_group_command_test.py system

Re: [DISCUSS] KIP-1176: Tiered Storage for Active Log Segment

2025-05-29 Thread Henry Haiying Cai
Jorge, Thanks for your detailed questions, please see my answer inline below. On Tuesday, May 27, 2025 at 12:48:01 AM PDT, Jorge Esteban Quilcate Otoya wrote: Hi Henry, Thanks for the proposal and the effort put on this! I have some comments on the KIP and the ongoing discussion: JQ1