Re: [DISCUSS] KIP-1188: New ConnectorClientConfigOverridePolicy with allowlist of configurations

Thanks for the KIP! +1 from me to make Kafka safer! Luke On Fri, Jun 20, 2025 at 8:47 PM Mickael Maison wrote: > Link to the KIP: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-1188%3A+New+ConnectorClientConfigOverridePolicy+with+allowlist+of+configurations > > On Fri, Jun 20, 2025

Librdkafka on Linux

Hello All, Has anyone here tried using librdkafka on Linux? I could generate the librdkafka so and .a files and the rdkafka header file as well. But when I integrate it into my project, I see build failures. From the errors, it looks like it is trying to internally build winsock2.h. It almost appe

Re: [PR] Apache Kafka documentation in markdown [kafka-site]

hvishwanath closed pull request #692: Apache Kafka documentation in markdown URL: https://github.com/apache/kafka-site/pull/692 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Created] (KAFKA-19484) Tiered Storage Quota Metrics can stop reporting

George Wu created KAFKA-19484: - Summary: Tiered Storage Quota Metrics can stop reporting Key: KAFKA-19484 URL: https://issues.apache.org/jira/browse/KAFKA-19484 Project: Kafka Issue Type: Bug

Re: [VOTE] KIP-1066: Mechanism to cordon brokers and log directories

Re-read the KIP after 1 year, LGTM! :) +1 from me. Thanks. Luke On Tue, Jul 1, 2025 at 11:32 PM Mickael Maison wrote: > Hi, > > I've not seen new comments in the DISCUSS thread in a while so I'm > starting a vote on KIP-1066 > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-1066%3A+Mec

[jira] [Created] (KAFKA-19479) at_least_once mode in Kafka Streams silently drops messages when the producer fails with MESSAGE_TOO_LARGE, violating delivery guarantees.

Mihai Lucian created KAFKA-19479: Summary: at_least_once mode in Kafka Streams silently drops messages when the producer fails with MESSAGE_TOO_LARGE, violating delivery guarantees. Key: KAFKA-19479 URL: https://

[DISCUSS]: KIP-1191: Dead-letter queues for share groups

Hi, I'd like to start discussion on KIP-1191 which adds dead-letter queue support for share groups. Records which cannot be processed by consumers in a share group can be automatically copied onto another topic for a closer look. KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1191%3

Re: [DISCUSS] KIP-1172: Improve EndToEndLatency tool

Hi everyone, Just giving this thread a gentle nudge. If there's no further feedback, I plan to start the vote tomorrow. Regards, Nick On Wed, Jun 11, 2025 at 6:04 PM Junwang Guo wrote: > Hi Chia-Ping > > Thanks for the feedback! > > > chia_0: Good suggestion! I've expanded the "Compatibility"

[jira] [Created] (KAFKA-19480) KRaft migration hangs when /migration has null value

Gergely Harmadás created KAFKA-19480: Summary: KRaft migration hangs when /migration has null value Key: KAFKA-19480 URL: https://issues.apache.org/jira/browse/KAFKA-19480 Project: Kafka

Re: [DISCUSS] KIP-1161: cleanup.policy shouldn't be empty

hi Jiunn Thanks for the explanation. I have updated the KIP accordingly: in Kafka > 4.x, cleanup.policy > can be set to an empty list with a warning message emitted; however, in > Kafka 5.0, setting an > empty list for cleanup.policy will no longer be allowed. If we agree to support "empty list"

Re: [DISCUSS] KIP-1161: cleanup.policy shouldn't be empty

Hi, Jiunn-Yang, I agree with Chia-Ping. If we allow cleanup.policy to be empty, we will just continue to allow it in all future releases. For ssl.cipher.suites, changing the default value from null to empty is actually a breaking change. According to the doc, null means that all the available cip

Re: [PR] Add Dattell as powered by Kafka [kafka-site]

scientistprogrammer commented on code in PR #698: URL: https://github.com/apache/kafka-site/pull/698#discussion_r2192876937 ## powered-by.html: ## @@ -2,6 +2,12 @@

Re: [PR] Add Dattell as powered by Kafka [kafka-site]

chia7712 merged PR #698: URL: https://github.com/apache/kafka-site/pull/698 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@kafka.apache

Re: [PR] Add Dattell as powered by Kafka [kafka-site]

chia7712 commented on code in PR #698: URL: https://github.com/apache/kafka-site/pull/698#discussion_r2192880356 ## powered-by.html: ## @@ -2,6 +2,12 @@

Re: [PR] Add Dattell as powered by Kafka [kafka-site]

Logo looks good ☺️ On Tue, Jul 8, 2025, 21:20 chia7712 (via GitHub) wrote: > > chia7712 merged PR #698: > URL: https://github.com/apache/kafka-site/pull/698 > > > -- > This is an automated message from the Apache Git Service. > To respond to the message, please log on to GitHub and use the > URL

Re: [DISCUSS] KIP-1186: Update AddRaftVoterRequest RPC to support auto-join

Hi Jun, > So, the new controller > should be able to send a version of the AddRaftVoter request that the > leader supports, right? The new controller can send a supported version for the RPC, but we do not want that to happen. This is because a controller sending AddRaftVoter with version 0 can c

Re: [DISCUSS] KIP-1186: Update AddRaftVoterRequest RPC to support auto-join

Hi, Kevin, Thanks for the explanation. The KIP looks good to me now. Jun On Tue, Jul 8, 2025 at 9:07 AM Kevin Wu wrote: > Hi Jun, > > > So, the new controller > > should be able to send a version of the AddRaftVoter request that the > > leader supports, right? > > The new controller can send a

Re: [VOTE] KIP-1186: Update AddRaftVoterRequest RPC to support auto-join

Hi, Kevin, Thanks for the KIP. +1 Jun On Wed, Jun 25, 2025 at 7:54 AM Kevin Wu wrote: > Hello all, > > I am manually bumping this thread. > Any feedback or votes would be appreciated. > > Best regards, > Kevin Wu > > On Tue, Jun 17, 2025 at 9:55 AM Kevin Wu wrote: > > > Hello all, > > > > I w

[jira] [Resolved] (KAFKA-19463) nextFetchOffset does not take ongoing state transition into account

[ https://issues.apache.org/jira/browse/KAFKA-19463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19463. -- Fix Version/s: 4.2.0 Resolution: Fixed > nextFetchOffset does not take ongoing

[jira] [Resolved] (KAFKA-7442) forceUnmap mmap on linux when index resize

[ https://issues.apache.org/jira/browse/KAFKA-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-7442. Fix Version/s: 4.2.0 Resolution: Duplicate This is not fixed in https://issues.apache.org/jira/brows

[jira] [Resolved] (KAFKA-19390) AbstractIndex#resize() does not release old mmap on Linux

[ https://issues.apache.org/jira/browse/KAFKA-19390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-19390. - Fix Version/s: 4.2.0 Resolution: Fixed merged the PR to trunk > AbstractIndex#resize() does not

Re: [DISCUSS] KIP-1161: cleanup.policy shouldn't be empty

Hi all, >> Null could make sense as the default value, but it just means that the >> config key is not set explicitly. >> Given that, it's probably simpler to just allow >> log.cleanup.policy to be empty and properly support it? Thanks for the explanation. I have updated the KIP accordingly: in K

[jira] [Created] (KAFKA-19481) Fix flaky test AuthorizerIntegrationTest.testConsumerGroupHeartbeatWithRegex()

Sushant Mahajan created KAFKA-19481: --- Summary: Fix flaky test AuthorizerIntegrationTest.testConsumerGroupHeartbeatWithRegex() Key: KAFKA-19481 URL: https://issues.apache.org/jira/browse/KAFKA-19481

[jira] [Resolved] (KAFKA-15955) Migrating ZK brokers send dir assignments

[ https://issues.apache.org/jira/browse/KAFKA-15955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-15955. -- Resolution: Won't Fix > Migrating ZK brokers send dir assignments > --

[jira] [Resolved] (KAFKA-16061) KRaft JBOD follow-ups and improvements

[ https://issues.apache.org/jira/browse/KAFKA-16061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-16061. -- Fix Version/s: 3.7.0 Resolution: Fixed > KRaft JBOD follow-ups and improvements > -

[jira] [Created] (KAFKA-19483) Fix flaky test RemoteIndexCacheTest.testConcurrentCacheDeletedFileExists()

Sushant Mahajan created KAFKA-19483: --- Summary: Fix flaky test RemoteIndexCacheTest.testConcurrentCacheDeletedFileExists() Key: KAFKA-19483 URL: https://issues.apache.org/jira/browse/KAFKA-19483 Proj

[jira] [Created] (KAFKA-19482) Fix flaky test KafkaStreamsTelemetryIntegrationTest.shouldPassMetrics

Sushant Mahajan created KAFKA-19482: --- Summary: Fix flaky test KafkaStreamsTelemetryIntegrationTest.shouldPassMetrics Key: KAFKA-19482 URL: https://issues.apache.org/jira/browse/KAFKA-19482 Project:

[VOTE] KIP-1097: Add Kafka Connect exception handler

hi Kafka Community, I would like to start a vote on KIP-1097. KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1097%3A+Add+Kafka+Connect+exception+handler

Jenkins build is still unstable: Kafka » Kafka PowerPC Daily » test-powerpc #353

See