Jenkins build is still unstable: Kafka » Kafka PowerPC Daily » test-powerpc #237

See

[DISCUSS] KIP-1140: Avoid to return null value in Map from public api of consumer

Hello everyone, I would like to start a discussion on KIP-1140: Avoid to return null value in Map from public api of consumer This proposal aims to improve the Kafka consumer API by ensuring that the Map it returns contains only non-null values,

Re: [VOTE] 4.0.0 RC4

David, thanks for running this behemoth of a release. With the help of my coworker Mahsa Seifikar, we have verified the following upgrade scenario: * Provision a ZK based Kafka cluster on 3.5 and create some topics * Upgrade to 3.9 * Migrate to KRaft * Upgrade to 4.0 We found a few docs issues w

Re: [DISCUSS] KIP-1144: Exposing a new public REST API for MirrorMaker2

Hi All, I have to make some correction to the description: so the KIP-710 introduced the REST API to solve the problem with the inter worker communication. Previously, there were no REST APIs in MM2. Exposing the full Connect API is a rejected alternative. On Fri, Mar 14, 2025 at 12:38 PM Kondr

[jira] [Created] (KAFKA-18986) Properly handle configured topology soft-state using KIP-1101

Lucas Brutschy created KAFKA-18986: -- Summary: Properly handle configured topology soft-state using KIP-1101 Key: KAFKA-18986 URL: https://issues.apache.org/jira/browse/KAFKA-18986 Project: Kafka

Re: [VOTE] 4.0.0 RC4

Hi David, Thanks for this next release candidate. Maybe I'm missing something, but I was trying to test out some of the changes that Jose provided, by configuring a static quorum (kraft.version=0) and I seem to be unable to do so. I set controller.quorum.voters=1@localhost:9093 as per how it look

[jira] [Resolved] (KAFKA-18924) Running the storage module tests produces a storage/storage.log file

[ https://issues.apache.org/jira/browse/KAFKA-18924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-18924. Fix Version/s: 4.1.0 Resolution: Fixed > Running the storage module tests produces

Re: [VOTE] 4.0.0 RC4

Hi David, I verified the latest RC with the following steps: - Checked the javadoc and protocol documentation - Built from source - Followed the quickstart - Checked that attempting to use KIP-932 when not enabled behaves as expected - Enabled KIP-932 and ran the steps in the KIP-932 EA release no

Re: [VOTE] 4.0.0 RC3

Cancelling this vote because we need a new RC to include KAFKA-18979. Best, David On Fri, Mar 14, 2025 at 8:30 AM Luke Chen wrote: > Hi José, > > Thanks for the fix. > The change makes sense to me. > > Thanks. > Luke > > On Fri, Mar 14, 2025 at 8:03 AM José Armando García Sancio < > jsan...@con

[jira] [Created] (KAFKA-18984) Support to delete specific config by kafka-client-metrics.sh

Chia-Ping Tsai created KAFKA-18984: -- Summary: Support to delete specific config by kafka-client-metrics.sh Key: KAFKA-18984 URL: https://issues.apache.org/jira/browse/KAFKA-18984 Project: Kafka

[jira] [Created] (KAFKA-18985) Exposing a new public REST API for MirrorMaker2

Bertalan Kondrat created KAFKA-18985: Summary: Exposing a new public REST API for MirrorMaker2 Key: KAFKA-18985 URL: https://issues.apache.org/jira/browse/KAFKA-18985 Project: Kafka Issue

RE: [DISCUSS] KIP-1092: Extend Consumer#close with an option to leave the group or not

Hello TengYao, I have a question about this KIP. Given it's not mentioned the *unsubscribe* behaviour should be the current default one in the Java client, that is to send a *LeaveGroup *or *ConsumerGroupHeartbeat(-1)* if the member is dynamic and *no LeaveGroup* or *ConsumerGroupHeartbeat(-2)* if

[jira] [Created] (KAFKA-18991) AbstractFetcherThread should verify the current leader epoch in the fetch request matches the leader epoch in the fetch state

Jun Rao created KAFKA-18991: --- Summary: AbstractFetcherThread should verify the current leader epoch in the fetch request matches the leader epoch in the fetch state Key: KAFKA-18991 URL: https://issues.apache.org/jira/b

Re: [DISCUSS] KIP-1142: Allow to list non-existent group which has dynamic config

Hi PoAn, Thanks for the KIP. It would certainly be good to fix this slightly odd behaviour in Kafka configs. AS1: I'd like to confirm that the KIP also alters the behaviour of kafka-client-metrics.sh --describe for the case where the resource does not exist. You do show this in an example, but

Re: [VOTE] 4.0.0 RC3

Hi José, Thanks for the fix. The change makes sense to me. Thanks. Luke On Fri, Mar 14, 2025 at 8:03 AM José Armando García Sancio < jsan...@confluent.io> wrote: > Hi Luke and David, > > I merged my fix to the trunk and cherry-picked it to the 4.0 branch. > It is not a full fix but it improves

Re: [VOTE] 4.0.0 RC4

Hi David, I've tested the RC4 and this is what I've done: - Used the binaries to create a cluster and run clients from exampled module - Tested the upgrade issue we found in KAFKA-18979 - Tested the dynamic quorum feature (both scale up and down) - Tested group.protocol=consumer with a simple Java

[jira] [Resolved] (KAFKA-18901) Improve redistribution of share group SimpleAssignor

[ https://issues.apache.org/jira/browse/KAFKA-18901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-18901. -- Resolution: Fixed > Improve redistribution of share group SimpleAssignor > ---

Wrong configuration in docker-compose.yml example

Hi together, I found a wrong configuration for the docker-compose.yml example in https://hub.docker.com/r/apache/kafka The configurations KAFKA_LISTENERS: PLAINTEXT://localhost:9092,CONTROLLER://localhost:9093 KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://localhost:9092 do not work. I ha

[jira] [Resolved] (KAFKA-18606) Flaky test DeleteSegmentsByRetentionTimeTest#executeTieredStorageTest

[ https://issues.apache.org/jira/browse/KAFKA-18606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-18606. - Resolution: Fixed merged the PR to trunk. > Flaky test DeleteSegmentsByRetentionTimeTest#executeTieredS

Re: [VOTE] 4.0.0 RC4

Hello again folks, I chatted with Jose offline about this issue and he explained we need to remove the --standalone flag to get kraft.version=0. I filed a ticket for this here: https://issues.apache.org/jira/browse/KAFKA-18987 I was able to run the tests I wanted and I found when I use the upgrad

[DISCUSS] KIP-1139: Add support for OAuth jwt-bearer grant type

Hi all, I would like to start a discussion for KIP-1139: Add support for OAuth jwt-bearer grant type: https://cwiki.apache.org/confluence/x/uIxEF The proposal is twofold: * Add support for the OAuth 2.0 JWT Bearer grant type to avoid use of plaintext client secrets * Promote internal APIs for

Re: [VOTE] 4.0.0 RC4

Hi David, I have done the following tests: - Built from 4.0.0-rc4 with JDK21-zulu/JDK21-amzn and ran all unit and integration tests in a container - a few tests failed at the first attempt, but failed tests passed after retried - Ran all system tests - The network_degrade_test and replica

Re: [DISCUSS] KIP-1092: Extend Consumer#close with an option to leave the group or not

Hi Emanuele Thanks for raising the question. You're absolutely right. The KIP defines the behavior of membership on close, so the other consumer API should not be affected by this one. Best, TengYao Emanuele Sabellico 於 2025年3月15日 週六 上午1:06寫道： > Hello TengYao, I have a question about this KIP