[jira] [Resolved] (KAFKA-17022) Fix error-prone in KafkaApis#handleFetchRequest

2024-06-27 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17022. Fix Version/s: 3.9.0 Resolution: Fixed > Fix error-prone in KafkaApis#handleFetchRe

Re: [DISCUSS] KIP-1014: Managing Unstable Features in Apache Kafka

2024-06-27 Thread Chia-Ping Tsai
On Wed, Jun 26, 2024, at 13:16, Jun Rao wrote: > > Hi, Colin, > > > > Thanks for the reply. > > > > 1. > https://kafka.apache.org/protocol.html#The_Messages_ConsumerGroupDescribe > > lists ConsumerGroupDescribeRequest, whose latest version is unstable. > > > > Hi Jun, > > I think that is a bug. >

[jira] [Created] (KAFKA-17051) ApiKeys#toHtml should exclude the APIs having unstable latest version

2024-06-27 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-17051: -- Summary: ApiKeys#toHtml should exclude the APIs having unstable latest version Key: KAFKA-17051 URL: https://issues.apache.org/jira/browse/KAFKA-17051 Project: Ka

Re: [DISCUSS] KIP-1054: Support external schemas in JSONConverter

2024-06-27 Thread Priyanka K U
Hello everyone, It's been over 10 days without further discussions. Assuming everyone is satisfied with the proposal and all questions have been addressed, we are planning to proceed with the voting. Thank you, Priyanka From: Priyanka K U Date: Friday, 7 June 2024 at 1:53 PM To: dev@kafka.a

Re: [DISCUSS] Apache Kafka 3.9.0 release

2024-06-27 Thread Nelson B.
Hi Colin, If you have time could you please have a look at KIP-1025 and cast your vote? It is currently one vote short of being accepted. Any sort of feedback would be appreciated. Thanks. On Thu, Jun 27, 2024 at 4:45 PM Mario Fiore Vitale wrote: > Hi Colin, > > > Do we feel that KIP-1040 can

Re: [DISCUSS] KIP-1014: Managing Unstable Features in Apache Kafka

2024-06-27 Thread Colin McCabe
Hi David, Do most people feel that it's OK to break compatibility when transitioning a feature from EA to GA? I always had the impression we tried hard to avoid doing this. But I'm curious if this is documented somewhere. My concern about making this configuration externally useable is that peo

Re: [VOTE] KIP-1022 Formatting and Updating Features

2024-06-27 Thread Colin McCabe
Hi Jun, This is a fair question. I think there's a few different scenarios to consider: 1. mixed server software versions in a single cluster 2. new client software + old server software 3. old client software + new server software In scenario #1 and #2, we have old (pre-3.9) server software i

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #3056

2024-06-27 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-16781) Expose advertised.listeners in controller node

2024-06-27 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-16781. --- Fix Version/s: 3.9.0 Resolution: Fixed > Expose advertised.listeners in controller node > ---

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #3055

2024-06-27 Thread Apache Jenkins Server
See

Re: [VOTE] KIP-1056 - Deprecate `default.` prefix for exception handler in StreamsConfig

2024-06-27 Thread Sophie Blee-Goldman
I'll just note that I will personally be abstaining from this vote, but won't vote -1 and just want to defer to the rest of the community on this. I've stated my concerns in the discussion thread and will leave it at that -- if we hear from users who actively support this change and want it to happ

Re: [DISCUSS] Apache Kafka 3.8.0 release

2024-06-27 Thread Justine Olshan
Here is the PR: https://github.com/apache/kafka/pull/16478 Justine On Thu, Jun 27, 2024 at 2:21 PM Justine Olshan wrote: > Hey all, > Thanks for your patience. After some discussion, we decided to revert > group version from 3.8 since there were too many complexities associated > with getting i

Re: [DISCUSS] Apache Kafka 3.8.0 release

2024-06-27 Thread Justine Olshan
Hey all, Thanks for your patience. After some discussion, we decided to revert group version from 3.8 since there were too many complexities associated with getting it to work. I've downgraded the severity of KAFKA-17011 to not be a blocker and opened a ticket (https://issues.apache.org/jira/browse

[jira] [Created] (KAFKA-17050) Revert group.version for 3.8 and 3.9

2024-06-27 Thread Justine Olshan (Jira)
Justine Olshan created KAFKA-17050: -- Summary: Revert group.version for 3.8 and 3.9 Key: KAFKA-17050 URL: https://issues.apache.org/jira/browse/KAFKA-17050 Project: Kafka Issue Type: Task

Re: [VOTE] KIP-1056 - Deprecate `default.` prefix for exception handler in StreamsConfig

2024-06-27 Thread Muralidhar Basani
Bumping this thread. Thanks, Murali On Sat, Jun 22, 2024 at 4:13 AM Matthias J. Sax wrote: > +1 (binding) from my side. > > > I understand the concerns raised, but would personally move forward with > this KIP as-is. If we cannot get three votes, it would get naturally > discarded. > > > -Matth

Re: [VOTE] KIP-1022 Formatting and Updating Features

2024-06-27 Thread Jun Rao
Hi, Colin, ApiVersionResponse includes both supported and finalized features. If we only suppress features in the supported field, but not in the finalized field, it can potentially lead to inconsistency in the older client. For example, if a future feature supporting V0 is finalized in the broker

Re: [DISCUSS] KIP-1059: Enable the Producer flush() method to clear the latest send() error

2024-06-27 Thread Alieh Saeedi
Hi Justine, Thanks for the suggestion. Making applications to validate every single record is not the best way, from an efficiency point of view. Moreover, between changing the behavior of the Producer in `send` and `commitTnx`, the former seems more reasonable and clean. Bests, Alieh On Thu, Ju

Re: [DISCUSS] KIP-1059: Enable the Producer flush() method to clear the latest send() error

2024-06-27 Thread Alieh Saeedi
Hi all, I updated the KIP as follows: 1) added `TxnSendOption` with two possible values (NONE, IGNORE_SEND_ERRORS). 2) added the new `send` method with three input parameters to `Producer` and `KafkaProducer`. 3) removed `CommitOption` and `commitTransaction(CommitOption)` from `Producer` and `Kaf

Re: [DISCUSS] KIP-1059: Enable the Producer flush() method to clear the latest send() error

2024-06-27 Thread Justine Olshan
Hey Alieh, I see there are two options now. So folks will be discussing the approaches and deciding the best way forward before we vote? I do think there could be a problem with the approach on commit if we get stuck on an earlier error and have more records (potentially on new partitions) to comm

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #3054

2024-06-27 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-1062: Introduce Pagination for some requests used by Admin API

2024-06-27 Thread Andrew Schofield
Hi Omnia, Thanks for the KIP. This is a really nice improvement for administering large clusters. AS1: Besides topics, the most numerous resources in Kafka clusters in my experience are consumer groups. Would it be possible to extend the KIP to cover ListGroups while you’re in here? I’ve heard

Re: [VOTE] KIP-1057: Add remote log metadata flag to the dump log tool

2024-06-27 Thread Federico Valeri
Hi all, Thanks for voting! KIP-1057 has been accepted with the following +1 votes: - Luke Chen (binding) - Kamal Chandraprakash (non binding) - Satish Duggana (binding) - Divij Vaidya (binding) Cheers, Fede On Thu, Jun 27, 2024 at 1:21 PM Divij Vaidya wrote: > > +1 (binding) > > I have partici

[jira] [Created] (KAFKA-17049) unbalanced connectors

2024-06-27 Thread yazgoo (Jira)
yazgoo created KAFKA-17049: -- Summary: unbalanced connectors Key: KAFKA-17049 URL: https://issues.apache.org/jira/browse/KAFKA-17049 Project: Kafka Issue Type: Bug Reporter: yazgoo This

Re: [DISCUSS] KIP-1060: Expose advertised.listeners for KRaft controllers

2024-06-27 Thread José Armando García Sancio
Thanks. I also created this Jira so that we document all of the changes and what is the recommended configuration for new clusters. https://issues.apache.org/jira/browse/KAFKA-17048 On Thu, Jun 27, 2024 at 11:05 AM Gantigmaa Selenge wrote: > > Thanks José. Glad to see it already being implement

[jira] [Created] (KAFKA-17048) Document how to use KIP-853

2024-06-27 Thread Jira
José Armando García Sancio created KAFKA-17048: -- Summary: Document how to use KIP-853 Key: KAFKA-17048 URL: https://issues.apache.org/jira/browse/KAFKA-17048 Project: Kafka Issue

Re: [DISCUSS] KIP-1060: Expose advertised.listeners for KRaft controllers

2024-06-27 Thread Gantigmaa Selenge
Thanks José. Glad to see it already being implemented! I raised a small PR to make users aware that they can configure advertised.listeners for controllers. I will also move the KIP to the discarded section. Regards, Gantigmaa Selenge On Mon, Jun 24, 2

[jira] [Resolved] (KAFKA-17028) FindCoordinator v6 initial implementation

2024-06-27 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-17028. -- Fix Version/s: 3.9.0 Resolution: Fixed > FindCoordinator v6 initial implementat

[jira] [Created] (KAFKA-17047) Refactor Consumer group and shared classes with Share to modern package

2024-06-27 Thread Apoorv Mittal (Jira)
Apoorv Mittal created KAFKA-17047: - Summary: Refactor Consumer group and shared classes with Share to modern package Key: KAFKA-17047 URL: https://issues.apache.org/jira/browse/KAFKA-17047 Project: Ka

[DISCUSS] KIP-1062: Introduce Pagination for some requests used by Admin API

2024-06-27 Thread Omnia Ibrahim
Hi everyone, I would like to start a discussion thread for KIP-1062 https://cwiki.apache.org/confluence/display/KAFKA/KIP-1062%3A+Introduce+Pagination+for+some+requests+used+by+Admin+API Thanks Omnia

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #3053

2024-06-27 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-12910) Configure automatic formatter for org.apache.kafka.streams.state

2024-06-27 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-12910. Resolution: Duplicate > Configure automatic formatter for org.apache.kafka.streams.state >

[jira] [Resolved] (KAFKA-10787) Introduce an import order in Java sources

2024-06-27 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-10787. Resolution: Fixed > Introduce an import order in Java sources > --

[jira] [Resolved] (KAFKA-12911) Configure automatic formatter for org.apache.kafka.streams.processor

2024-06-27 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-12911. Resolution: Duplicate > Configure automatic formatter for org.apache.kafka.streams.process

[jira] [Resolved] (KAFKA-16822) Abstract consumer group in coordinator to share functionality with share group

2024-06-27 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16822. - Fix Version/s: 3.9.0 Resolution: Fixed > Abstract consumer group in coordinator to share

Re: [VOTE] KIP-1057: Add remote log metadata flag to the dump log tool

2024-06-27 Thread Divij Vaidya
+1 (binding) I have participated in the discussion and agree with the proposal. -- Divij Vaidya On Thu, Jun 27, 2024 at 12:56 PM Satish Duggana wrote: > Thanks Federico for the KIP. > > +1 > > ~Satish. > > On Thu, 27 Jun 2024 at 13:44, Federico Valeri > wrote: > > > > Thanks for the votes s

Re: [VOTE] KIP-1057: Add remote log metadata flag to the dump log tool

2024-06-27 Thread Satish Duggana
Thanks Federico for the KIP. +1 ~Satish. On Thu, 27 Jun 2024 at 13:44, Federico Valeri wrote: > > Thanks for the votes so far, bumping this thread to get more. > > On Fri, Jun 21, 2024 at 4:23 PM Kamal Chandraprakash > wrote: > > > > Hi Federico, > > > > Thanks for the KIP! +1 from me. > > > >

[jira] [Resolved] (KAFKA-16754) Implement release acquired records functionality in SharePartition

2024-06-27 Thread Abhinav Dixit (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhinav Dixit resolved KAFKA-16754. --- Fix Version/s: 4.0.0 3.9.0 Resolution: Fixed > Implement release a

[jira] [Resolved] (KAFKA-14109) Clean up JUnit 4 test infrastructure

2024-06-27 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-14109. Resolution: Duplicate > Clean up JUnit 4 test infrastructure > ---

[jira] [Resolved] (KAFKA-7342) Migrate streams modules to JUnit 5

2024-06-27 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-7342. --- Resolution: Duplicate > Migrate streams modules to JUnit 5 >

[jira] [Created] (KAFKA-17046) Upgrade netty version to 4.1.111.Final

2024-06-27 Thread XiDuo You (Jira)
XiDuo You created KAFKA-17046: - Summary: Upgrade netty version to 4.1.111.Final Key: KAFKA-17046 URL: https://issues.apache.org/jira/browse/KAFKA-17046 Project: Kafka Issue Type: Improvement

Re: [DISCUSS] Apache Kafka 3.8.0 release

2024-06-27 Thread Josep Prat
Hi all, I just wanted to ask again for your help in reviewing these 2 last blockers for the 3.8.0 release: https://github.com/apache/kafka/pull/16400 https://github.com/apache/kafka/pull/16420 Thanks! On Mon, Jun 24, 2024 at 9:27 AM Josep Prat wrote: > Hi all, > > We currently have a couple o

Re: [VOTE] KIP-1057: Add remote log metadata flag to the dump log tool

2024-06-27 Thread Federico Valeri
Thanks for the votes so far, bumping this thread to get more. On Fri, Jun 21, 2024 at 4:23 PM Kamal Chandraprakash wrote: > > Hi Federico, > > Thanks for the KIP! +1 from me. > > On Fri, Jun 21, 2024 at 5:47 PM Luke Chen wrote: > > > Hi Fede, > > > > Thanks for the KIP! > > +1 from me. > > > > L

[jira] [Created] (KAFKA-17045) Move MetadataLogConfig from kafka to kafka.raft

2024-06-27 Thread XiDuo You (Jira)
XiDuo You created KAFKA-17045: - Summary: Move MetadataLogConfig from kafka to kafka.raft Key: KAFKA-17045 URL: https://issues.apache.org/jira/browse/KAFKA-17045 Project: Kafka Issue Type: Improve

Re: [DISCUSS] Apache Kafka 3.9.0 release

2024-06-27 Thread Mario Fiore Vitale
Hi Colin, > Do we feel that KIP-1040 can make feature freeze? I think yes but it all depends on the review. In any case the changes are not so complex. Mario. On Wed, Jun 26, 2024 at 10:06 PM Colin McCabe wrote: > Hi Mario and Nelson, > > Thanks for asking. Both of these KIPs can certainly go

Re: [DISCUSS] KIP-1014: Managing Unstable Features in Apache Kafka

2024-06-27 Thread David Jacot
Hi all, I think that it would be nice to have an official way to enable non-production-ready features in order to have a way to test them in development/soak clusters. For instance, I would like the new consumer protocol to be disabled by default but users should be able to enable it if they want

[jira] [Resolved] (KAFKA-15623) Migrate remaining tests in streams module to JUnit 5

2024-06-27 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-15623. Fix Version/s: 3.9.0 Resolution: Fixed > Migrate remaining tests in streams module

[jira] [Resolved] (KAFKA-7339) Migrate from JUnit 4 to JUnit 5

2024-06-27 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-7339. --- Fix Version/s: 3.9.0 Resolution: Fixed > Migrate from JUnit 4 to JUnit 5 > ---