Jenkins build is still unstable: Kafka » Kafka PowerPC Daily » test-powerpc #366

See

[jira] [Resolved] (KAFKA-13869) Update quota callback metadata in KRaft

[ https://issues.apache.org/jira/browse/KAFKA-13869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-13869. Resolution: Duplicate > Update quota callback metadata in KRaft >

Re: [DISCUSS] KIP-1162: Redesign ClientQuotaCallback#updateClusterMetadata

hi Kuan-Po The method `updateClusterMetadata` hasn't been implemented for over three years after kraft was introduced. It seems we still function well without it. If the method is rarely used, introducing so many new public APIs for it seems a bit overkill. We could file a KIP to just deprecate

[jira] [Created] (KAFKA-19533) correct the docs of "messages" for `kafka-consumer-perf-test.sh` and `kafka-share-consumer-perf-test.sh`

Chia-Ping Tsai created KAFKA-19533: -- Summary: correct the docs of "messages" for `kafka-consumer-perf-test.sh` and `kafka-share-consumer-perf-test.sh` Key: KAFKA-19533 URL: https://issues.apache.org/jira/browse/K

Re: [DISCUSS] KIP-1147: Improve consistency of command-line arguments

hi Andrew Thanks for this KIP. some questions are listed below. chia_00: Should we introduce `--consumer-property` to `kafka-consumer-perf-test.sh` and `kafka-share-consumer-perf-test.sh` since another perf tool, `kafka-producer-perf-test.sh`, has `--producer-property`? chia_01: should we al

Re: [VOTE] KIP-1192: Add include argument to ConsumerPerformance tool

Thanks for the KIP Federico. +1 binding Omnia > On 21 Jul 2025, at 16:22, Kirk True wrote: > > Thanks Fede! +1 (non-binding) > > On Sat, Jul 19, 2025, at 6:44 AM, Andrew Schofield wrote: >> Hi, >> Thanks for the KIP. >> >> +1 (binding) >> >> Andrew >> >> __

[jira] [Resolved] (KAFKA-19194) IOException thrown while starting Kafka broker if a file is present inside kafka data directory.

[ https://issues.apache.org/jira/browse/KAFKA-19194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinath PS resolved KAFKA-19194. Resolution: Not A Problem > IOException thrown while starting Kafka broker if a file is present in

Re: [VOTE] KIP-1100: Rename org.apache.kafka.server:type=AssignmentsManager and org.apache.kafka.storage.internals.log.RemoteStorageThreadPool metrics

Thanks Jiunn-Yang for the KIP, really nice cleanup to keep thing consistent. +1 binding Omnia > On 18 Jul 2025, at 12:18, 黃竣陽 wrote: > > Hello everyone, > > I would like to start a vote on KIP-1100 Rename > org.apache.kafka.server:type=AssignmentsManager > and org.apache.kafka.storage.inter

Re: [VOTE] KIP-1147: Improve consistency of command-line arguments

Thanks Andrew for the KIP. The inconsistency always drives me crazy. +1 (binding) Regards, Omnia > On 21 Jul 2025, at 09:48, Andrew Schofield > wrote: > > Hi, > I would like to start a vote for KIP-1147 which improves the consistency of > command-line arguments of the various Kafka CLI tools.

Jenkins build is still unstable: Kafka » Kafka PowerPC Daily » test-powerpc #367

See

[jira] [Created] (KAFKA-19537) StreamsGroupCommand should return exit code

Matthias J. Sax created KAFKA-19537: --- Summary: StreamsGroupCommand should return exit code Key: KAFKA-19537 URL: https://issues.apache.org/jira/browse/KAFKA-19537 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-19536) KStream-KStream leftJoin didn't consider gracePeriod for out-of-order records

congye created KAFKA-19536: -- Summary: KStream-KStream leftJoin didn't consider gracePeriod for out-of-order records Key: KAFKA-19536 URL: https://issues.apache.org/jira/browse/KAFKA-19536 Project: Kafka

Re: [DISCUSS] KIP-1162: Redesign ClientQuotaCallback#updateClusterMetadata

Hi Chia-Ping, Thanks for bringing some momentum back to this discussion. The original implementation of this API had some flaws, which I attempted to address in KAFKA-19122 . However, I later realized that properly fixing the issue would require s

[jira] [Resolved] (KAFKA-19503) Deprecate MX4j support

[ https://issues.apache.org/jira/browse/KAFKA-19503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TengYao Chi resolved KAFKA-19503. - Fix Version/s: 4.2.0 Resolution: Fixed > Deprecate MX4j support > --

Re: [VOTE] KIP-1100: Rename org.apache.kafka.server:type=AssignmentsManager and org.apache.kafka.storage.internals.log.RemoteStorageThreadPool metrics

+1 (binding) > On Jul 22, 2025, at 4:54 PM, Omnia Ibrahim wrote: > > Thanks Jiunn-Yang for the KIP, really nice cleanup to keep thing consistent. > +1 binding > > Omnia > >> On 18 Jul 2025, at 12:18, 黃竣陽 wrote: >> >> Hello everyone, >> >> I would like to start a vote on KIP-1100 Rename >>

[jira] [Created] (KAFKA-19534) Remove MX4J support

Federico Valeri created KAFKA-19534: --- Summary: Remove MX4J support Key: KAFKA-19534 URL: https://issues.apache.org/jira/browse/KAFKA-19534 Project: Kafka Issue Type: Task Componen

Re: [DISCUSS] KIP-1195: cleanup deprecated exceptions in org.apache.kafka.streams.errors.*

hi Rajani could you please add the "remove directly" to the Rejected Alternatives section? Best, Chia-Ping Rajani Karuturi 於 2025年7月22日 週二 下午12:11寫道： > Can I start a vote on this? > > ~ Rajani > > > On Mon, Jul 21, 2025 at 10:23 AM Rajani Karuturi > > wrote: > > > Hi Matthias and Chia-Ping >

Re: [VOTE] KIP-1192: Add include argument to ConsumerPerformance tool

Hi, KIP-1192 has been approved. +3 (binding): Andrew Schofield, Omnia Ibrahim, Chia-Ping Tsai. +1 (non-binding): Kirk True. Thanks everyone for the votes. Best regards, Fede On Tue, Jul 22, 2025 at 11:44 AM Chia-Ping Tsai wrote: > > +1 (binding) > > Omnia Ibrahim 於 2025年7月22日 週二 下午4:52寫道： >

[PR] Add clolov PGP key [kafka-site]

clolov opened a new pull request, #706: URL: https://github.com/apache/kafka-site/pull/706 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-ma

[jira] [Resolved] (KAFKA-19533) correct the docs of "messages" for `kafka-consumer-perf-test.sh` and `kafka-share-consumer-perf-test.sh`

[ https://issues.apache.org/jira/browse/KAFKA-19533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TengYao Chi resolved KAFKA-19533. - Fix Version/s: 4.2.0 Resolution: Fixed > correct the docs of "messages" for `kafka-consum

Re: [VOTE] 4.1.0 RC1

Hi, Quick update regarding the system tests. My environment is back but now we're hitting https://issues.apache.org/jira/browse/KAFKA-19501. Debian buster which is used in the system tests is out of support and it's apt repository has now been archived. It worked till last week but now it's gone

Re: [VOTE] 4.1.0 RC1

Hi Mickael, I don't think we need a new RC just because of these files. Technically speaking these files are part of the source tarball (which we release), but as they are test files, I wouldn't consider them as a blocker that would grant a new RC. Best, On Tue, Jul 22, 2025 at 4:51 PM Mickael Ma

Re: [VOTE] KIP-1147: Improve consistency of command-line arguments

Hi Andrew, Thanks for the KIP and efforts to solve this inconsistency. I should have asked on discussion thread but as we have the voting thread hence just writing 2 minor things: 1. Very Minor - There isn't mention of "kafka-streams-groups.sh" in the table, however "kafka-streams-groups.sh" does

Re: [VOTE] 4.1.0 RC1

Hi folks, I tested upgrading Kafka from both 3.7.2 and 3.8.1 to 4.1.0 and everything seems good: - Three-node KRaft cluster; verified produce/consume records worked correctly using `kafka-producer-perf-test.sh` and `kafka-console-consumer.sh` before and after each server upgrade. - After upgrading

Re: [DISCUSS] KIP-1190: Add a metric for controller thread idleness

Thanks Jonah and Kevin for the feedback. I have updated the KIP accordingly. We ideally want to use something like the TimeRatio type for this metric, similar to how "poll-idle-ratio" is measured in KafkaRaftMetrics. Please let me know if you have any further feedback. Best, Mahsa Seifikar On F

Re: [VOTE] KIP-1147: Improve consistency of command-line arguments

Hi Apoorv, 1) Yes, I think "kafka-streams-groups.sh" has been written since I originally wrote the KIP. It is consistent and I'll add it for completeness right now. 2) "kafka-replica-verification.sh" is deprecated which why I skipped it. Thanks, Andrew From

Re: [VOTE] 4.1.0 RC1

hi If anyone wants to test 4.1.0-RC1 without the backport fix, please simply configure the jdk_version to use another image. For example: jdk_version="openjdk:17-bullseye" /bin/bash tests/docker/run_tests.sh Best, Chia-Ping Josep Prat 於 2025年7月22日 週二 下午10:56寫道： > Hi Mickael, > I don't think we

Re: [VOTE] KIP-1147: Improve consistency of command-line arguments

Thanks Andrew, it makes sense. +1 (binding) Regards, Apoorv Mittal On Tue, Jul 22, 2025 at 4:49 PM Andrew Schofield < andrew_schofield_j...@outlook.com> wrote: > Hi Apoorv, > 1) Yes, I think "kafka-streams-groups.sh" has been written since I > originally > wrote the KIP. It is consistent and I

[jira] [Resolved] (KAFKA-19213) Kafka java client ignores default properties

[ https://issues.apache.org/jira/browse/KAFKA-19213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-19213. Fix Version/s: 4.2.0 Resolution: Fixed > Kafka java client ignores default properti

Re: [DISCUSS] KIP-1190: Add a metric for controller thread idleness

Hi Mahsa, I see you have the definition of the metric value as: controller idle ratio = idle_time/active_time Shouldn't the value for a ratio be: controller idle ratio = idle_time/total_time where total_time = idle_time + active_time? This lines up with the definition you outlined earlier in the

Re: [DISCUSS] KIP-1161: cleanup.policy shouldn't be empty

Hi, Jiunn-Yang and Chia-Ping, Thanks for the reply. JR34. Sounds good. JR36. Could you document that the default value for sasl.oauthbearer.expected.audience and ssl.cipher.suites have been changed? JR38. My concern wasn't quite addressed. "If the configuration is optional, we will reject any d

Re: [DISCUSS] KIP-1160: Enable returning supported features from a specific broker

hi PoAn thanks for this KIP. Please take a look at following questions. chia_00: The behavior of "-1" defined by `DescribeFeaturesOptions#nodeId` is too detailed. That could obstructs us from tweaking the behavior in the future. Perhaps we could use "arbitrary controller/broker" instead. chia

[jira] [Created] (KAFKA-19535) add integration tests for DescribeProducersOptions#brokerId

Chia-Ping Tsai created KAFKA-19535: -- Summary: add integration tests for DescribeProducersOptions#brokerId Key: KAFKA-19535 URL: https://issues.apache.org/jira/browse/KAFKA-19535 Project: Kafka

Re: [DISCUSS] KIP-1159: Large message reference based Serializer

Hi, Omnia, Thanks for the KIP. A few comments. JR1. While the KIP is potentially useful, I am wondering who is responsible for retention for the objects in the payload store. Once a message with a reference is deleted, the key of the external object is lost and the object may never be deleted. J

[jira] [Created] (KAFKA-19538) Kafka uses vulnerable Apache Commons Lang3 version (3.12.0) – Uncontrolled Recursion (CVE-2025-48924)

Mangesh Dushman created KAFKA-19538: --- Summary: Kafka uses vulnerable Apache Commons Lang3 version (3.12.0) – Uncontrolled Recursion (CVE-2025-48924) Key: KAFKA-19538 URL: https://issues.apache.org/jira/browse/KA

Re: [DISCUSS] KIP-1195: cleanup deprecated exceptions in org.apache.kafka.streams.errors.*

Hi Chia-Ping, Updated KIP with rejected Alternatives. Please take a look https://cwiki.apache.org/confluence/x/8AxJFg Thanks, ~ Rajani On Tue, Jul 22, 2025 at 3:22 PM Chia-Ping Tsai wrote: > hi Rajani > > could you please add the "remove directly" to the Rejected Alternatives > section? > > Be

Re: [VOTE] KIP-1192: Add include argument to ConsumerPerformance tool

+1 (binding) Omnia Ibrahim 於 2025年7月22日 週二 下午4:52寫道： > Thanks for the KIP Federico. > > +1 binding > > Omnia > > > On 21 Jul 2025, at 16:22, Kirk True wrote: > > > > Thanks Fede! +1 (non-binding) > > > > On Sat, Jul 19, 2025, at 6:44 AM, Andrew Schofield wrote: > >> Hi, > >> Thanks for the KIP.

Re: [DISCUSS] KIP-1161: cleanup.policy shouldn't be empty

JR34. Hmm, it seems that the code in taskConfigs() could return an empty list for a task if knownSourceTopicPartitions is less than maxTasks, Chia-Ping? Yes, `MirrorSourceConnector#taskConfigs` could return an empty list, which means no `MirrorSourceTask` can be created. By contrast, if any `Mir

Re: [DISCUSS] KIP-1161: cleanup.policy shouldn't be empty

Hello Jun, Chia, Thanks for the reply, JR36: I’ve updated the following configurations: - sasl.oauthbearer.expected.audience - ssl.cipher.suites - ssl.enabled.protocols These now allow both empty and non-empty lists. Since the default values of sasl.oauthbearer.expected.audience and ssl.ciph

Re: [VOTE] KIP-1100: Rename org.apache.kafka.server:type=AssignmentsManager and org.apache.kafka.storage.internals.log.RemoteStorageThreadPool metrics

Thanks for this great cleanup. +1 (binding) Best, TengYao PoAn Yang 於 2025年7月22日 週二 下午9:48寫道： > +1 (binding) > > > On Jul 22, 2025, at 4:54 PM, Omnia Ibrahim > wrote: > > > > Thanks Jiunn-Yang for the KIP, really nice cleanup to keep thing > consistent. > > +1 binding > > > > Omnia > > > >> On

Re: [DISCUSS] KIP-1190: Add a metric for controller thread idleness

Hi Kevin, You're right. I wanted to change the formula format and forgot to switch it back to the original formula, which should be `idle_time/total_time`. I've updated KIP. Thanks, Mahsa Seifikar On Tue, Jul 22, 2025 at 2:18 PM Kevin Wu wrote: > Hi Mahsa, > > I see you have the definition of