[jira] [Created] (KAFKA-19725) Deprecate --property and replace with --reader-property in console producer

2025-09-19 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-19725: Summary: Deprecate --property and replace with --reader-property in console producer Key: KAFKA-19725 URL: https://issues.apache.org/jira/browse/KAFKA-19725

[jira] [Created] (KAFKA-19721) Update streams documentation with KIP-1147 changes

2025-09-18 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-19721: Summary: Update streams documentation with KIP-1147 changes Key: KAFKA-19721 URL: https://issues.apache.org/jira/browse/KAFKA-19721 Project: Kafka

[jira] [Resolved] (KAFKA-19623) Consistency of command-line arguments for console producer/consumer

2025-09-17 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19623. -- Fix Version/s: 4.2.0 Resolution: Fixed > Consistency of command-line argume

Re: [DISCUSS] KIP-1217: Include push interval in ClientTelemetryReceiver context

2025-09-11 Thread Andrew Schofield
Hi Mickael, Thanks for the KIP. It looks like a nice improvement. I previously read an earlier version and had some comments, but you've already addressed them and added to the rejected alternatives :) Just one additional comment. AS1: I suggest the method in the ClientTelemetryExporterProvider i

[jira] [Resolved] (KAFKA-19659) Wrong generic type for UnregisterBrokerOptions

2025-09-05 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19659. -- Resolution: Fixed > Wrong generic type for UnregisterBrokerOpti

[jira] [Resolved] (KAFKA-19667) Close ShareConsumer in ShareConsumerPerformance only after metrics displayed

2025-09-04 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19667. -- Resolution: Fixed > Close ShareConsumer in ShareConsumerPerformance only af

Re: [DISCUSS] KIP-1206: Strict max fetch records in share fetch

2025-09-03 Thread Andrew Schofield
Hi Jimmy, Thank you for the KIP. I'm sure I'll have more comments yet as I think through how it will work in practice, and also the work that we are looking to do in the consumer as part of Kafka 4.2 around flow control and memory usage. The behaviour in KIP-932 is expecting that the consuming ap

[jira] [Resolved] (KAFKA-19653) Improve metavariable names for verifiable producer/consumer

2025-09-03 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19653. -- Resolution: Fixed > Improve metavariable names for verifiable producer/consu

[jira] [Resolved] (KAFKA-18220) Refactor AsyncConsumerMetrics so they are appropriate for share consumers

2025-09-03 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-18220. -- Fix Version/s: 4.2.0 Resolution: Fixed > Refactor AsyncConsumerMetrics so t

[jira] [Created] (KAFKA-19667) Close ShareConsumer in ShareConsumerPerformance only after metrics displayed

2025-09-03 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-19667: Summary: Close ShareConsumer in ShareConsumerPerformance only after metrics displayed Key: KAFKA-19667 URL: https://issues.apache.org/jira/browse/KAFKA-19667

[jira] [Created] (KAFKA-19662) Support resetting offsets in kafka-share-groups.sh for topics which are not currently subscribed

2025-09-01 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-19662: Summary: Support resetting offsets in kafka-share-groups.sh for topics which are not currently subscribed Key: KAFKA-19662 URL: https://issues.apache.org/jira/browse

Re: [VOTE] 4.1.0 RC3

2025-08-31 Thread Andrew Schofield
Hi Mickael, I did the following: * Built from source with Java 17 * Ran client tests * Validated that share groups are not enabled by default, and give correct message if use attempted * Enabled share.version=1 feature * Validated that share groups worked with console tools * Checked protocol and

Re: Kafka 4.1 Queue Semantics missing APIs

2025-08-29 Thread Andrew Schofield
ng interface. 3) We have already added another overload of ShareConsumer.acknowledge. void acknowledge(String topic, int partition, long offset, AcknowledgeType type) This will be in Kafka 4.2. Thanks, Andrew Schofield From: RShekhar Prasad Sent: 29

[jira] [Created] (KAFKA-19656) Investigate stalling share consumer poll when empty response is returned early

2025-08-29 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-19656: Summary: Investigate stalling share consumer poll when empty response is returned early Key: KAFKA-19656 URL: https://issues.apache.org/jira/browse/KAFKA-19656

[jira] [Resolved] (KAFKA-19626) Consistency of command-line arguments for remaining CLI tools

2025-08-29 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19626. -- Fix Version/s: 4.2.0 Resolution: Fixed > Consistency of command-line argume

[jira] [Created] (KAFKA-19653) Improve metavariable names for verifiable producer/consumer

2025-08-29 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-19653: Summary: Improve metavariable names for verifiable producer/consumer Key: KAFKA-19653 URL: https://issues.apache.org/jira/browse/KAFKA-19653 Project: Kafka

[jira] [Resolved] (KAFKA-19635) Update upgrade.html with the changes in Apache Kafka 4.2

2025-08-28 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19635. -- Resolution: Fixed > Update upgrade.html with the changes in Apache Kafka

[jira] [Resolved] (KAFKA-19625) Consistency of command-line arguments for verifiable producer/consumer

2025-08-27 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19625. -- Fix Version/s: 4.2.0 Resolution: Fixed > Consistency of command-line argume

[jira] [Created] (KAFKA-19635) Update upgrade.html with the changes in Apache Kafka 4.2

2025-08-22 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-19635: Summary: Update upgrade.html with the changes in Apache Kafka 4.2 Key: KAFKA-19635 URL: https://issues.apache.org/jira/browse/KAFKA-19635 Project: Kafka

Re: [DISCUSS] KIP-1196: Introduce group.coordinator.append.max.bytes config

2025-08-20 Thread Andrew Schofield
Hi Lan, Thanks for the KIP. Decoupling these is a good idea. AS1: This is a change to the coordinator runtime and there are two concrete implementations, the group coordinator and the share coordinator. I think it would be equally valuable to have `share.coordinator.append.max.buffer.size`. The sa

[jira] [Created] (KAFKA-19627) Remove command-line arguments deprecated to implement KIP-1147

2025-08-20 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-19627: Summary: Remove command-line arguments deprecated to implement KIP-1147 Key: KAFKA-19627 URL: https://issues.apache.org/jira/browse/KAFKA-19627 Project

[jira] [Created] (KAFKA-19625) Consistency of command-line arguments for verifiable producer/consumer

2025-08-20 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-19625: Summary: Consistency of command-line arguments for verifiable producer/consumer Key: KAFKA-19625 URL: https://issues.apache.org/jira/browse/KAFKA-19625

[jira] [Created] (KAFKA-19623) Consistency of command-line arguments for console producer/consumer

2025-08-20 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-19623: Summary: Consistency of command-line arguments for console producer/consumer Key: KAFKA-19623 URL: https://issues.apache.org/jira/browse/KAFKA-19623 Project

[jira] [Created] (KAFKA-19626) Consistency of command-line arguments for remaining CLI tools

2025-08-20 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-19626: Summary: Consistency of command-line arguments for remaining CLI tools Key: KAFKA-19626 URL: https://issues.apache.org/jira/browse/KAFKA-19626 Project: Kafka

[jira] [Created] (KAFKA-19624) Consistency of command-line arguments for consumer performance tests

2025-08-20 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-19624: Summary: Consistency of command-line arguments for consumer performance tests Key: KAFKA-19624 URL: https://issues.apache.org/jira/browse/KAFKA-19624 Project

Re: [VOTE] KIP-1147: Improve consistency of command-line arguments

2025-08-20 Thread Andrew Schofield
t; > argument. > > > > > > How about also defining standard precedence of different ways of > passing > > > e.g. bootstrap server, but also some other properties (in cases like > > > --consumer-property or --producer-property arguments)? And what about &

Re: [DISCUSS] KIP-1147: Improve consistency of command-line arguments

2025-08-19 Thread Andrew Schofield
Interfaces is not in sync with recent changes as it still refers to --producer-property in the sentence about order of precedence. That should be now --command-property. On Tue, Aug 19, 2025 at 10:48 AM Andrew Schofield < andrew_schofield_j...@outlook.com> wrote: > Hi Jun and Lianet, > Th

Re: [DISCUSS] KIP-1147: Improve consistency of command-line arguments

2025-08-19 Thread Andrew Schofield
t *-property with > --command-property), correct? If my expectation is right then we just need > to update the KIP to mention it. > > Thanks! > > On Sat, Aug 16, 2025 at 5:49 AM Andrew Schofield < > andrew_schofield_j...@outlook.com> wrote: > > > Hi Jun, > >

Re: [DISCUSS] KIP-1147: Improve consistency of command-line arguments

2025-08-16 Thread Andrew Schofield
*-property with --command-property. Jun On Thu, Aug 14, 2025 at 1:51 PM Andrew Schofield < andrew_schofield_j...@outlook.com> wrote: > Hi Jun, > Thanks for your comment. > > These things are never straightforward because of history. > > There are broadly speaking the followi

Re: [DISCUSS] KIP-1147: Improve consistency of command-line arguments

2025-08-14 Thread Andrew Schofield
s for the KIP. If we are replacing --consumer.config with --command-config, should we do the same for --consumer-property for consistency? Jun On Wed, Aug 13, 2025 at 9:21 AM Andrew Schofield < andrew_schofield_j...@outlook.com> wrote: > Hi Jiunn, > Thanks for your comment. > &

Re: [DISCUSS] KIP-1147: Improve consistency of command-line arguments

2025-08-13 Thread Andrew Schofield
llo Andrew, Jiunn_00: The kafka-cluster.sh script also has the --config argument. Should we align this with --command-config for consistency? Best Regards, Jiunn-Yang > Andrew Schofield 於 2025年8月13日 晚上11:06 寫道: > > Hi Chia-Ping, > It's come to my attention that I completely missed a se

Re: [DISCUSS] KIP-1147: Improve consistency of command-line arguments

2025-08-13 Thread Andrew Schofield
From: Federico Valeri Sent: 17 July 2025 09:50 To: dev@kafka.apache.org Subject: Re: [DISCUSS] KIP-1147: Improve consistency of command-line arguments Hi Andrew, thanks for this useful KIP. This is something that I also though while working on tools migration from Scala to Java, but th

Re: [VOTE] KIP-1147: Improve consistency of command-line arguments

2025-08-13 Thread Andrew Schofield
; --command-config? > > There was a little bit related thread about precedence issue in May > https://lists.apache.org/thread/nzov19dm1xckp1l8pl2zkcn6w4zgp8rb > > On Mon, Jul 21, 2025 at 11:49 AM Andrew Schofield < > andrew_schofield_j...@outlook.com> wrote: > > > Hi, > >

Re: [VOTE] KIP-1147: Improve consistency of command-line arguments

2025-08-13 Thread Andrew Schofield
perty file passed with --command-config? There was a little bit related thread about precedence issue in May https://lists.apache.org/thread/nzov19dm1xckp1l8pl2zkcn6w4zgp8rb On Mon, Jul 21, 2025 at 11:49 AM Andrew Schofield < andrew_schofield_j...@outlook.com> wrote: > Hi, > I woul

[jira] [Created] (KAFKA-19598) Consistency of command-line arguments for kafka-producer-perf-test.sh

2025-08-12 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-19598: Summary: Consistency of command-line arguments for kafka-producer-perf-test.sh Key: KAFKA-19598 URL: https://issues.apache.org/jira/browse/KAFKA-19598

Re: [DISCUSS]: KIP-1191: Dead-letter queues for share groups

2025-08-04 Thread Andrew Schofield
eployments. Can we introduce a configuration parameter auto.create.dlq.topics.enable to govern this behavior? D03: How should we handle failure scenarios when brokers attempt to write records to the DLQ? Replied Message | From | Andrew Schofield | | Date | 07/08/2025 17:54 | | To |

Re: [DISCUSS] KIP-XXXX: Add max record count limit to FetchRequest

2025-07-29 Thread Andrew Schofield
Hi Corki, Thanks for the KIP. You need to assign a number to your KIP. I think it should be 1199. You can find instructions here (1198 already exists): https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals If you need help, let me know. Thanks, Andrew _

[jira] [Resolved] (KAFKA-16717) Add AdminClient.alterShareGroupOffsets

2025-07-29 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-16717. -- Fix Version/s: 4.2.0 Resolution: Fixed >

[jira] [Resolved] (KAFKA-19471) Enable acknowledgement for a record which could not be deserialized

2025-07-27 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19471. -- Resolution: Fixed > Enable acknowledgement for a record which could not

Re: [VOTE] 4.1.0 RC1

2025-07-26 Thread Andrew Schofield
Hi, I downloaded and tested 4.1.0 RC1. I successfully checked the enablement and administration of the share group and streams groups features. I also downloaded the documentation from the pending kafka-site PR. I observe that it was necessary to manually change the #include directives from 40 to

Re: 回复: [DISCUSS] KIP-1134: Virtual Clusters in Kafka

2025-07-24 Thread Andrew Schofield
Hi Viktor, Thanks for the KIP. Personally, I like large KIPs to be published while there are still details to be worked out because it gives an opportunity to do the discussion in the community. I like the idea of being able to subdivide and virtualise clusters, and I agree that it would be goo

Re: [VOTE] KIP-1147: Improve consistency of command-line arguments

2025-07-22 Thread Andrew Schofield
rote: > Thanks Andrew for the KIP. The inconsistency always drives me crazy. > +1 (binding) > > Regards, > Omnia > > On 21 Jul 2025, at 09:48, Andrew Schofield < > andrew_schofield_j...@outlook.com> wrote: > > > > Hi, > > I would like to start a vot

[VOTE] KIP-1147: Improve consistency of command-line arguments

2025-07-21 Thread Andrew Schofield
Hi, I would like to start a vote for KIP-1147 which improves the consistency of command-line arguments of the various Kafka CLI tools. https://cwiki.apache.org/confluence/display/KAFKA/KIP-1147%3A+Improve+consistency+of+command-line+arguments Thanks, Andrew

[jira] [Resolved] (KAFKA-19500) kafka-consumer-groups.sh should fail quickly if the partition leader is unavailable

2025-07-21 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19500. -- Fix Version/s: 4.2.0 Resolution: Fixed > kafka-consumer-groups.sh should f

[jira] [Resolved] (KAFKA-19461) Add share group admin integration tests to PlaintextAdminIntegrationTest

2025-07-21 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19461. -- Fix Version/s: 4.2.0 Resolution: Fixed > Add share group admin integrat

Re: [VOTE] KIP-1192: Add include argument to ConsumerPerformance tool

2025-07-19 Thread Andrew Schofield
Hi, Thanks for the KIP. +1 (binding) Andrew From: Federico Valeri Sent: 18 July 2025 11:03 To: dev@kafka.apache.org Subject: [VOTE] KIP-1192: Add include argument to ConsumerPerformance tool Hello, I would like to call a vote for KIP-1192: https://cwi

Re: [DISCUSS] KIP-1192: Add include argument to ConsumerPerformance tool

2025-07-15 Thread Andrew Schofield
Hi Fede (and Kirk), Thanks for the KIP. A comment on Kirk's comment :) KT01: This is certainly an interesting question. I think we need a small KIP for kafka-console-consumer.sh because it only supports Consumer.subscribe(Pattern), and not the newer KIP-848 Consumer.subscribe(SubscriptionPattern)

Re: [ANNOUNCE] New Kafka PMC member: Lucas Brutschy

2025-07-15 Thread Andrew Schofield
Congratulations Lucas. From: Apoorv Mittal Sent: 15 July 2025 10:48 To: dev@kafka.apache.org Subject: Re: [ANNOUNCE] New Kafka PMC member: Lucas Brutschy   Congratulations Lucas! Regards, Apoorv Mittal On Tue, Jul 15, 2025 at 9:53 AM Bruno Cadonna wro

Re: [DISCUSS] KIP-1147: Improve consistency of command-line arguments

2025-07-14 Thread Andrew Schofield
operty), which takes precedence? I'm not ecstatic about the existing naming of "--command-config" because it's ambiguous, but that's a battle for another day... Thanks, Kirk On Wed, Jul 9, 2025, at 6:53 AM, Andrew Schofield wrote: > Hi, > I'd like to start

Re: [DISCUSS] KIP-1147: Improve consistency of command-line arguments

2025-07-14 Thread Andrew Schofield
ence? > > I'm not ecstatic about the existing naming of "--command-config" because > it's ambiguous, but that's a battle for another day... > > Thanks, > Kirk > > On Wed, Jul 9, 2025, at 6:53 AM, Andrew Schofield wrote: > > Hi, > > I'd l

Re: [ANNOUNCE] New Kafka Committer: PoAn Yang

2025-07-13 Thread Andrew Schofield
Great news. Well done PoAn. From: Lianet M. Sent: 13 July 2025 20:48 To: dev@kafka.apache.org Subject: Re: [ANNOUNCE] New Kafka Committer: PoAn Yang   Glad to hear! Congrats PoAn!!! On Sun, Jul 13, 2025, 8:53 p.m. Gaurav Narula wrote: > Congratulations

Re: [VOTE] KIP-932: Queues for Kafka

2025-07-12 Thread Andrew Schofield
eType type); Thanks, Jun On Fri, Jul 11, 2025 at 2:30 AM Andrew Schofield < andrew_schofield_j...@outlook.com> wrote: > Hi, > As we've written the code for KIP-932, we've made some small changes to > the KIP > to correct mistakes, align with other accepted KIPs and

Re: [VOTE] KIP-932: Queues for Kafka

2025-07-11 Thread Andrew Schofield
t 2024 19:07 To: dev@kafka.apache.org Subject: Re: [VOTE] KIP-932: Queues for Kafka Hi, Andrew, Thanks for the clarification. Sounds good. Jun On Thu, Aug 15, 2024 at 2:53 AM Andrew Schofield wrote: > Hi Jun, > Thanks for the questions. > > 1. The PartitionMetadata is only

Re: [VOTE] KIP-1172: Improve EndToEndLatency tool

2025-07-10 Thread Andrew Schofield
Thanks for the KIP. +1 (binding) Andrew From: Junwang Guo Sent: 09 July 2025 14:04 To: dev@kafka.apache.org Subject: [VOTE] KIP-1172: Improve EndToEndLatency tool Hi all, I would like to start a vote on KIP-1172: Improve EndToEndLatency tool. KIP: ht

Re: [DISCUSS] KIP-1172: Improve EndToEndLatency tool

2025-07-09 Thread Andrew Schofield
rning will also be added to guide users to the new syntax. AS2: Thanks for pointing that out. I'll update the parameter names as suggested. Appreciate your comments! Best, Nick On Wed, Jul 9, 2025 at 9:28 PM Andrew Schofield < andrew_schofield_j...@outlook.com> wrote: > Hi Ni

[jira] [Created] (KAFKA-19487) Improve consistency of command-line arguments

2025-07-09 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-19487: Summary: Improve consistency of command-line arguments Key: KAFKA-19487 URL: https://issues.apache.org/jira/browse/KAFKA-19487 Project: Kafka Issue

[DISCUSS] KIP-1147: Improve consistency of command-line arguments

2025-07-09 Thread Andrew Schofield
Hi, I'd like to start discussion of KIP-1147. This KIP aligns the names of the command-line arguments across all of the Apache Kafka command-line tools. KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1147%3A+Improve+consistency+of+command-line+arguments Thanks, Andrew

Re: [DISCUSS] KIP-1172: Improve EndToEndLatency tool

2025-07-09 Thread Andrew Schofield
Hi Nick, Thanks for the KIP. Sorry for the late discussion. I was reading the KIP, nudged by the voting thread and I have a couple of comments. AS1: The old syntax should eventually not be supported. Please could the KIP say something like "The previous syntax using positional arguments is depre

[jira] [Resolved] (KAFKA-19457) Revisit the threshold to retry initialize share state RPC in group coordinator.

2025-07-09 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19457. -- Fix Version/s: 4.2.0 Resolution: Fixed > Revisit the threshold to re

[jira] [Resolved] (KAFKA-19450) ShareConsumerPerformance does not handle exceptions from consumeMessagesForSingleShareConsumer

2025-07-09 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19450. -- Resolution: Fixed > ShareConsumerPerformance does not handle exceptions f

[jira] [Resolved] (KAFKA-19463) nextFetchOffset does not take ongoing state transition into account

2025-07-08 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19463. -- Fix Version/s: 4.2.0 Resolution: Fixed > nextFetchOffset does not take ongo

[DISCUSS]: KIP-1191: Dead-letter queues for share groups

2025-07-08 Thread Andrew Schofield
Hi, I'd like to start discussion on KIP-1191 which adds dead-letter queue support for share groups. Records which cannot be processed by consumers in a share group can be automatically copied onto another topic for a closer look. KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1191%3

[jira] [Created] (KAFKA-19471) Enable acknowledgement for a record which could not be deserialized

2025-07-04 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-19471: Summary: Enable acknowledgement for a record which could not be deserialized Key: KAFKA-19471 URL: https://issues.apache.org/jira/browse/KAFKA-19471 Project

[jira] [Resolved] (KAFKA-19468) Share group epoch increments on every heartbeat if subscribed topics removed

2025-07-04 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19468. -- Resolution: Fixed > Share group epoch increments on every heartbeat if subscri

[jira] [Resolved] (KAFKA-19363) Enhance share group assignor for heterogeneous subscription type

2025-07-04 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19363. -- Resolution: Fixed > Enhance share group assignor for heterogeneous subscription t

[jira] [Resolved] (KAFKA-19362) Enhance share group assignor for homogeneous subscription type

2025-07-04 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19362. -- Resolution: Fixed > Enhance share group assignor for homogeneous subscription t

[jira] [Created] (KAFKA-19468) Share group epoch increments on every heartbeat if subscribed topics removed

2025-07-03 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-19468: Summary: Share group epoch increments on every heartbeat if subscribed topics removed Key: KAFKA-19468 URL: https://issues.apache.org/jira/browse/KAFKA-19468

[jira] [Resolved] (KAFKA-19440) Admin.alterShareGroupOffsets doesn't handle exceptions correctly

2025-07-03 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19440. -- Fix Version/s: 4.2.0 Resolution: Fixed > Admin.alterShareGroupOffsets does

Re: [DISCUSS] Apache Kafka 4.1.0 release

2025-07-02 Thread Andrew Schofield
Andrew Schofield wrote: > > Hi Mickael, > We have found an NPE in the group coordinator while stress testing which > should probably be fixed. > There is a chance that a topic being looked up is not present in the metadata > image > in GroupCoordinatorService.onPartitionsDeleted

Re: [DISCUSS] Apache Kafka 4.1.0 release

2025-07-02 Thread Andrew Schofield
Hi Mickael, We have found an NPE in the group coordinator while stress testing which should probably be fixed. There is a chance that a topic being looked up is not present in the metadata image in GroupCoordinatorService.onPartitionsDeleted. This is KAFKA-19454. Here's the trunk PR https://gith

[jira] [Created] (KAFKA-19461) Add share group admin integration tests to PlaintextAdminIntegrationTest

2025-07-01 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-19461: Summary: Add share group admin integration tests to PlaintextAdminIntegrationTest Key: KAFKA-19461 URL: https://issues.apache.org/jira/browse/KAFKA-19461

[jira] [Created] (KAFKA-19440) Admin.alterShareGroupOffsets doesn't handle exceptions correctly

2025-06-26 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-19440: Summary: Admin.alterShareGroupOffsets doesn't handle exceptions correctly Key: KAFKA-19440 URL: https://issues.apache.org/jira/browse/KAFKA-19440 Pr

[jira] [Created] (KAFKA-19437) Review incidence of null metadata image in share coordinator

2025-06-26 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-19437: Summary: Review incidence of null metadata image in share coordinator Key: KAFKA-19437 URL: https://issues.apache.org/jira/browse/KAFKA-19437 Project: Kafka

Re: [ANNOUNCE] New Kafka Committer: Omnia Ibrahim

2025-06-25 Thread Andrew Schofield
Congrats, Omnia. Very good to hear. From: Lianet M. Sent: 25 June 2025 17:57 To: dev@kafka.apache.org Subject: Re: [ANNOUNCE] New Kafka Committer: Omnia Ibrahim Congrats Omnia!!! On Wed, Jun 25, 2025, 12:48 p.m. Kamal Chandraprakash < kamal.chandraprak.

Re: [VOTE] KIP-1160: Enable returning supported features from a specific broker

2025-06-25 Thread Andrew Schofield
Hi, Thanks for the KIP. Since we are making more use of features these days, this is timely. +1 (binding) Thanks, Andrew From: PoAn Yang Sent: 25 June 2025 07:18 To: dev@kafka.apache.org Subject: [VOTE] KIP-1160: Enable returning supported features fro

[jira] [Resolved] (KAFKA-19416) Reduce running time of ShareConsumerTest

2025-06-19 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19416. -- Fix Version/s: 4.2.0 Resolution: Fixed > Reduce running time

[jira] [Created] (KAFKA-19416) Reduce running time of ShareConsumerTest

2025-06-18 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-19416: Summary: Reduce running time of ShareConsumerTest Key: KAFKA-19416 URL: https://issues.apache.org/jira/browse/KAFKA-19416 Project: Kafka Issue Type

[jira] [Created] (KAFKA-19410) Validate alignment of subscribed topics and assigned partitions in share consumer

2025-06-16 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-19410: Summary: Validate alignment of subscribed topics and assigned partitions in share consumer Key: KAFKA-19410 URL: https://issues.apache.org/jira/browse/KAFKA-19410

[jira] [Resolved] (KAFKA-19369) Add group.share.assignors config

2025-06-06 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19369. -- Fix Version/s: 4.1.0 Resolution: Fixed > Add group.share.assignors con

[jira] [Resolved] (KAFKA-19290) Exploit mapKey optimisation in protocol requests and responses

2025-06-06 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19290. -- Fix Version/s: 4.1.0 Resolution: Fixed > Exploit mapKey optimisation

[jira] [Resolved] (KAFKA-19370) Create JMH benchmark for assessing performance of share group assignor

2025-06-06 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19370. -- Fix Version/s: 4.1.0 Resolution: Fixed > Create JMH benchmark for assess

Re: [VOTE] KIP-1175: Fix the typo `PARTITIONER_ADPATIVE_PARTITIONING_ENABLE` in ProducerConfig

2025-06-05 Thread Andrew Schofield
+1 (binding) Thanks, Andrew From: TengYao Chi Sent: 05 June 2025 17:05 To: dev@kafka.apache.org Subject: Re: [VOTE] KIP-1175: Fix the typo `PARTITIONER_ADPATIVE_PARTITIONING_ENABLE` in ProducerConfig +1 (binding) Best, TYC Chia-Ping Tsai 於 2025年6月5日 週

[jira] [Resolved] (KAFKA-19328) SharePartitionManagerTest testMultipleConcurrentShareFetches doAnswer chaining needs verification

2025-06-04 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19328. -- Fix Version/s: 4.1.0 Resolution: Resolved Test removed

[jira] [Created] (KAFKA-19370) Create JMH benchmark for assessing performance of share group assignor

2025-06-04 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-19370: Summary: Create JMH benchmark for assessing performance of share group assignor Key: KAFKA-19370 URL: https://issues.apache.org/jira/browse/KAFKA-19370

[jira] [Created] (KAFKA-19369) Add group.share.assignors config

2025-06-04 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-19369: Summary: Add group.share.assignors config Key: KAFKA-19369 URL: https://issues.apache.org/jira/browse/KAFKA-19369 Project: Kafka Issue Type: Sub

[jira] [Created] (KAFKA-19364) Production-ready documentation

2025-06-03 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-19364: Summary: Production-ready documentation Key: KAFKA-19364 URL: https://issues.apache.org/jira/browse/KAFKA-19364 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-19363) Enhance share group assignor for heterogeneous subscription type

2025-06-03 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-19363: Summary: Enhance share group assignor for heterogeneous subscription type Key: KAFKA-19363 URL: https://issues.apache.org/jira/browse/KAFKA-19363 Project

[jira] [Created] (KAFKA-19362) Enhance share group assignor for homogeneous subscription type

2025-06-03 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-19362: Summary: Enhance share group assignor for homogeneous subscription type Key: KAFKA-19362 URL: https://issues.apache.org/jira/browse/KAFKA-19362 Project

[jira] [Resolved] (KAFKA-19353) Preview documentation

2025-06-03 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19353. -- Fix Version/s: 4.1.0 Resolution: Fixed > Preview documentat

[jira] [Resolved] (KAFKA-19338) Share coordinator read state and write state should return error, if the share partition is not initialized.

2025-06-03 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19338. -- Fix Version/s: 4.1.0 Resolution: Fixed > Share coordinator read state

[jira] [Resolved] (KAFKA-19358) Do not update share group offset reset strategy from VerifiableShareConsumer in share_consumer_test.py tests

2025-06-02 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19358. -- Fix Version/s: 4.1.0 Resolution: Fixed > Do not update share group off

[jira] [Resolved] (KAFKA-19320) Add share_consume_bench_test.py system tests

2025-06-02 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19320. -- Fix Version/s: 4.1.0 Resolution: Fixed > Add share_consume_bench_test

[jira] [Resolved] (KAFKA-16894) Define switch to enable share groups for preview

2025-06-02 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-16894. -- Resolution: Fixed > Define switch to enable share groups for prev

[jira] [Resolved] (KAFKA-19321) Add share_consumer_performance.py and related system tests

2025-06-02 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19321. -- Fix Version/s: 4.1.0 Resolution: Fixed > Add share_consumer_performance.py

[jira] [Created] (KAFKA-19353) Preview documentation

2025-05-30 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-19353: Summary: Preview documentation Key: KAFKA-19353 URL: https://issues.apache.org/jira/browse/KAFKA-19353 Project: Kafka Issue Type: Sub-task

[jira] [Resolved] (KAFKA-19337) Bug in ShareCoordinatorShard.generateShareStateRecord causes stateEpoch update misses.

2025-05-29 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19337. -- Fix Version/s: 4.1.0 Resolution: Fixed > Bug

[jira] [Resolved] (KAFKA-19316) Add share_group_command_test.py system test

2025-05-29 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19316. -- Fix Version/s: 4.1.0 Resolution: Fixed > Add share_group_command_test

[jira] [Resolved] (KAFKA-19344) Move assignable share partition method from describer to group spec.

2025-05-28 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19344. -- Fix Version/s: 4.1.0 Resolution: Fixed > Move assignable share partit

[jira] [Resolved] (KAFKA-19342) Add AuthorizerIntegrationTest for alter share group offsets

2025-05-28 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19342. -- Fix Version/s: 4.1.0 Resolution: Fixed > Add AuthorizerIntegrationTest

[jira] [Created] (KAFKA-19342) Add AuthorizerIntegrationTest for alter share group offsets

2025-05-27 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-19342: Summary: Add AuthorizerIntegrationTest for alter share group offsets Key: KAFKA-19342 URL: https://issues.apache.org/jira/browse/KAFKA-19342 Project: Kafka

  1   2   3   4   5   6   7   >