Re: [DISCUSS] KIP-1030: Change constraints and default values for various configurations

Hi Kamal, Thanks for updating the KIP with the offline discussion we had, especially on remotelog.manager.* thread pools with the new behaviour. Hi Divij, We should target having a validation tool in 4.0 so that users can run it before they run their upgrade and take necessary actions on it. I am

[jira] [Created] (KAFKA-18114) Add Use Case Descriptions to README

Swikar Patel created KAFKA-18114: Summary: Add Use Case Descriptions to README Key: KAFKA-18114 URL: https://issues.apache.org/jira/browse/KAFKA-18114 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-18113) Create Component Table in README

Swikar Patel created KAFKA-18113: Summary: Create Component Table in README Key: KAFKA-18113 URL: https://issues.apache.org/jira/browse/KAFKA-18113 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-18112) Add Kafka Logo to README

Swikar Patel created KAFKA-18112: Summary: Add Kafka Logo to README Key: KAFKA-18112 URL: https://issues.apache.org/jira/browse/KAFKA-18112 Project: Kafka Issue Type: Sub-task Compo

[jira] [Created] (KAFKA-18111) Improve README: Add logo, component table, and use case descriptions

Swikar Patel created KAFKA-18111: Summary: Improve README: Add logo, component table, and use case descriptions Key: KAFKA-18111 URL: https://issues.apache.org/jira/browse/KAFKA-18111 Project: Kafka

[jira] [Resolved] (KAFKA-18109) Fix failed SaslClientsWithInvalidCredentialsTest in tools module

[ https://issues.apache.org/jira/browse/KAFKA-18109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-18109. Fix Version/s: 4.0.0 Assignee: TaiJuWu (was: Chia-Ping Tsai) Resolution: F

Re: Plz help on kafka consumer API performance(taking time on the first consumer.poll())

Hi all, Please give suggestion on this.please help ,Iam stuck with this. Thanks Giri On Mon, 25 Nov 2024 at 9:22 AM, giri mungi wrote: > Hi Ping, > > 1) Yes the records are already existent. > 2) Yeah the Kafka broker also upgraded to 3.6 version. > That’s why we are upgrading the client code

Re: [VOTE] KIP-1030: Change constraints and default values for various configurations

Hi Divij, +1 (Binding). Thanks for the KIP! Kamal On Thu, Nov 28, 2024, 05:37 Luke Chen wrote: > Hi Divij, > > +1 (binding) from me. > Thanks for the KIP! > > Luke > > On Thu, Nov 28, 2024 at 12:21 AM Divij Vaidya > wrote: > > > Corresponding discussion thread: > > https://lists.apache.org/th

Jenkins build is still unstable: Kafka » Kafka PowerPC Daily » test-powerpc #131

See

[jira] [Created] (KAFKA-18110) Fail Test: PlaintextAdminIntegrationTest#testDeleteConsumerGroupOffsets

黃竣陽 created KAFKA-18110: --- Summary: Fail Test: PlaintextAdminIntegrationTest#testDeleteConsumerGroupOffsets Key: KAFKA-18110 URL: https://issues.apache.org/jira/browse/KAFKA-18110 Project: Kafka Issue

[jira] [Created] (KAFKA-18109) Fix failed SaslClientsWithInvalidCredentialsTest in tools module

Chia-Ping Tsai created KAFKA-18109: -- Summary: Fix failed SaslClientsWithInvalidCredentialsTest in tools module Key: KAFKA-18109 URL: https://issues.apache.org/jira/browse/KAFKA-18109 Project: Kafka

[jira] [Created] (KAFKA-18108) De-flake DynamicBrokerReconfigurationTest.testUncleanLeaderElectionEnable

Colin McCabe created KAFKA-18108: Summary: De-flake DynamicBrokerReconfigurationTest.testUncleanLeaderElectionEnable Key: KAFKA-18108 URL: https://issues.apache.org/jira/browse/KAFKA-18108 Project: Ka

Re: Lingnan - Request Permission to Contribute to Apache Kafka

Thanks for your interest! You should be all set now. Let me know if you have any issues with contributing! Justine On Wed, Nov 27, 2024 at 3:38 PM Lingnan Liu wrote: > Hi there, > > This is Lingnan. I want to make some contributions to Apache Kafka and here > is my wiki ID and jira ID: > > Wiki

Re: [VOTE] KIP-1030: Change constraints and default values for various configurations

Hi Divij, +1 (binding) from me. Thanks for the KIP! Luke On Thu, Nov 28, 2024 at 12:21 AM Divij Vaidya wrote: > Corresponding discussion thread: > https://lists.apache.org/thread/kxw9kxn49kt30kwckzwp8vq3k7kmrz9m > > Please vote if you agree with proceeding ahead with the proposal. Votes > from

[jira] [Created] (KAFKA-18107) Sensor Access Concurrency Enhancements

Lingnan Liu created KAFKA-18107: --- Summary: Sensor Access Concurrency Enhancements Key: KAFKA-18107 URL: https://issues.apache.org/jira/browse/KAFKA-18107 Project: Kafka Issue Type: Improvement

Lingnan - Request Permission to Contribute to Apache Kafka

Hi there, This is Lingnan. I want to make some contributions to Apache Kafka and here is my wiki ID and jira ID: Wiki: shinthirty Jira: shinthirty Thanks in advance! -Lingnan

[jira] [Resolved] (KAFKA-17113) Flaky Test in GlobalStreamThreadTest#shouldThrowStreamsExceptionOnStartupIfExceptionOccurred

[ https://issues.apache.org/jira/browse/KAFKA-17113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ao Li resolved KAFKA-17113. --- Resolution: Fixed The CDL has fixed this concurrency issue. > Flaky Test in > GlobalStreamThreadTest#shou

Re: [DISCUSS] KIP-1109: Unifying Kafka Consumer Topic Metrics

Thanks Jun and Chia for review and feedback. Initially I thought this might be a breaking change for someone who has written a transformation over topic name and expects them to be "_" replaced, if dot exists. But the fix is actually a correction of the topic name itself hence was wondering if we

Re: [VOTE]: KIP-1071: Streams Rebalance Protocol

Thanks for the KIP Bruno and Lucas! This is a great addition to Kafka Streams. +1(binding) Regards, Bill On Wed, Nov 27, 2024 at 5:31 AM Bruno Cadonna wrote: > Hi all, > > We (Lucas and myself) would like to call for a vote on KIP-1071: Streams > Rebalance Protocol: https://cwiki.apache.org/co

[jira] [Resolved] (KAFKA-18097) Upgrade readme to include min JDK changes

[ https://issues.apache.org/jira/browse/KAFKA-18097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-18097. Fix Version/s: 4.0.0 Resolution: Fixed > Upgrade readme to include min JDK changes

[jira] [Resolved] (KAFKA-18098) add kraft support to testReplicaPlacementAllServers and testReplicaPlacementPartialServers

[ https://issues.apache.org/jira/browse/KAFKA-18098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-18098. Fix Version/s: 4.0.0 Resolution: Fixed > add kraft support to testReplicaPlacementA

[jira] [Resolved] (KAFKA-17010) Remove DescribeLogDirsResponse#ReplicaInfo

[ https://issues.apache.org/jira/browse/KAFKA-17010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17010. Resolution: Fixed > Remove DescribeLogDirsResponse#ReplicaInfo > -

[jira] [Resolved] (KAFKA-18100) `Using` block suppresses all errors

[ https://issues.apache.org/jira/browse/KAFKA-18100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-18100. Fix Version/s: 4.0.0 Resolution: Fixed > `Using` block suppresses all errors >

[jira] [Created] (KAFKA-18106) Brokers should be removed from the ISR if possible on unclean restart

Colin McCabe created KAFKA-18106: Summary: Brokers should be removed from the ISR if possible on unclean restart Key: KAFKA-18106 URL: https://issues.apache.org/jira/browse/KAFKA-18106 Project: Kafka

[jira] [Created] (KAFKA-18105) Fix flaky PlaintextAdminIntegrationTest#testElectPreferredLeaders

Chia-Ping Tsai created KAFKA-18105: -- Summary: Fix flaky PlaintextAdminIntegrationTest#testElectPreferredLeaders Key: KAFKA-18105 URL: https://issues.apache.org/jira/browse/KAFKA-18105 Project: Kafka

Re: [DISCUSS] KIP-1030: Change constraints and default values for various configurations

Yes, Kamal, we will fix the tests that rely on low values of segment.ms as part of the KIP implementation. -- Divij Vaidya On Wed, Nov 27, 2024 at 7:40 PM Jun Rao wrote: > Hi, Kamal, > > Thanks for the explanation. This change sounds good to me then. > > Jun > > On Wed, Nov 27, 2024 at 10:31 

Re: [DISCUSS] KIP-1030: Change constraints and default values for various configurations

Hi, Kamal, Thanks for the explanation. This change sounds good to me then. Jun On Wed, Nov 27, 2024 at 10:31 AM Kamal Chandraprakash < kamal.chandraprak...@gmail.com> wrote: > Hi Jun, > > Thanks for the review! I've made the addendum to this KIP about the remote > storage configs: > > > 13. Why

Re: [DISCUSS] KIP-1030: Change constraints and default values for various configurations

Hi Jun, Thanks for the review! I've made the addendum to this KIP about the remote storage configs: > 13. Why are the defaults for remote.log.manager.copier.thread.pool.size and remote.log.manager.thread.pool.size different? We have 3 thread pools in remote log manager: a. remote.log.manager.th

Re: [DISCUSS] KIP-1030: Change constraints and default values for various configurations

Hi Divij, I also share the same concern as Greg pointed out for segment.bytes / segment.index.bytes. All the tiered storage tests might start to fai

Re: [DISCUSS] KIP-1030: Change constraints and default values for various configurations

Hi, Divij, Thanks for the reply. One more comment. 13. Why are the defaults for remote.log.manager.copier.thread.pool.size and remote.log.manager.thread.pool.size different? The latter also copies the segments to remote storage and is just deprecated. Jun On Wed, Nov 27, 2024 at 8:26 AM Divij V

[jira] [Reopened] (KAFKA-18104) Add test for in Loggers#currentLoggers

[ https://issues.apache.org/jira/browse/KAFKA-18104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison reopened KAFKA-18104: > Add test for in Loggers#currentLoggers > -- > >

Re: Readme file

HI Josep, Thanks for reading my email. My only changes in Readme file such as adding About section and logo of Kafka and adding table for list of Components and some useful content for new people. For that I would fork in my local and then create PR to merge into trunk. Thanks, Swikar > On No

Re: [DISCUSS] KIP-1030: Change constraints and default values for various configurations

Hello everyone Since, I believe I have addressed all the concerns that were raised here, I have started a vote thread for this KIP at https://lists.apache.org/thread/39dmfkd7ktb0oo44yqrkndcn4kcqt5hc Please participate in the vote. -- Divij Vaidya On Wed, Nov 27, 2024 at 12:33 PM Divij Vaidya

[VOTE] KIP-1030: Change constraints and default values for various configurations

Corresponding discussion thread: https://lists.apache.org/thread/kxw9kxn49kt30kwckzwp8vq3k7kmrz9m Please vote if you agree with proceeding ahead with the proposal. Votes from all community members are cordially invited. -- Divij Vaidya

Re: Readme file

Hi Swikar, Thanks for your interest in Apache Kafka! KIPs are needed when one does a "major change" in Kafka (for example changing public APIs). I haven't seen the changes you want to propose to the file, but I doubt it would require a KIP. Best, On Wed, Nov 27, 2024 at 5:05 PM Swikar Patel wro

Readme file

Hi Team, I am new here to contribute Kafka. I would like to add some additional information in Readme.md file. Do I have to create KIP for that. The changes would be very small. Thanks Swikar

[jira] [Resolved] (KAFKA-18104) Fix bug in Loggers#currentLoggers

[ https://issues.apache.org/jira/browse/KAFKA-18104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-18104. Resolution: Invalid > Fix bug in Loggers#currentLoggers >

[jira] [Created] (KAFKA-18104) Fix bug in Loggers#currentLoggers

TengYao Chi created KAFKA-18104: --- Summary: Fix bug in Loggers#currentLoggers Key: KAFKA-18104 URL: https://issues.apache.org/jira/browse/KAFKA-18104 Project: Kafka Issue Type: Bug R

Re: [VOTE] KIP-655: Add deduplication processor in kafka-streams

Hi Ayoub, Thanks for the KIP! This will be a welcomed addition. +1(binding) Regards, Bill On Tue, Nov 19, 2024 at 9:12 AM Lucas Brutschy wrote: > Hi, > > thanks for the KIP! > > +1 (binding) > > Cheers, > Lucas > > Ayoub Omari schrieb am Di., 19. Nov. 2024, 13:40: > > > Hi everyone, > > > >

[jira] [Resolved] (KAFKA-17892) Update README after migration to log4j2

[ https://issues.apache.org/jira/browse/KAFKA-17892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TengYao Chi resolved KAFKA-17892. - Resolution: Invalid > Update README after migration to log4j2 >

[jira] [Created] (KAFKA-18103) Kafka's Confluence Wiki appears to reference the wrong Hive integration site

Qiheng He created KAFKA-18103: - Summary: Kafka's Confluence Wiki appears to reference the wrong Hive integration site Key: KAFKA-18103 URL: https://issues.apache.org/jira/browse/KAFKA-18103 Project: Kafka

Re: [DISCUSS] KIP-1030: Change constraints and default values for various configurations

Thanks for the feedback folks. *Jun* 10. Fixed it. It now says 2 as the new default for recovery threads. 11. I have added a sentence that we will apply the defaults for both broker level and equivalent topic level configs. I have further added both the broker level and the topic level config to

[jira] [Resolved] (KAFKA-18081) Remove isKRaftTest from the kraft-only tests

[ https://issues.apache.org/jira/browse/KAFKA-18081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-18081. Fix Version/s: 4.0.0 Resolution: Fixed > Remove isKRaftTest from the kraft-only tes

[jira] [Resolved] (KAFKA-18012) Update the Scram configuration section for KRaft

[ https://issues.apache.org/jira/browse/KAFKA-18012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-18012. Fix Version/s: 4.0.0 Resolution: Fixed > Update the Scram configuration section for

[VOTE]: KIP-1071: Streams Rebalance Protocol

Hi all, We (Lucas and myself) would like to call for a vote on KIP-1071: Streams Rebalance Protocol: https://cwiki.apache.org/confluence/x/2BCTEg Discussion thread: https://lists.apache.org/thread/h8lfcwm1ljq5d84194jfnqp9wh148r1v Best, Bruno

[jira] [Created] (KAFKA-18102) All consumer groups stop to receive message

George Yang created KAFKA-18102: --- Summary: All consumer groups stop to receive message Key: KAFKA-18102 URL: https://issues.apache.org/jira/browse/KAFKA-18102 Project: Kafka Issue Type: Bug

[jira] [Resolved] (KAFKA-18099) The lkc prefix should be removed from the topic name when generating sync response for classic members in consumer group

[ https://issues.apache.org/jira/browse/KAFKA-18099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-18099. - Resolution: Invalid > The lkc prefix should be removed from the topic name when generating sync