Re: [VOTE] KIP-1094 Add a new constructor method with nextOffsets to ConsumerRecords

2024-10-03 Thread Lucas Brutschy
+1 (binding) Thanks for the KIP! Lucas On Fri, Oct 4, 2024 at 2:29 AM Matthias J. Sax wrote: > > +1 (binding) > > On 10/3/24 4:35 PM, Kirk True wrote: > > +1 (non-binding) > > > > On Wed, Oct 2, 2024, at 12:41 PM, Alieh Saeedi wrote: > >> Hi all > >> > >> I would like to call a vote for KIP-1094

[jira] [Created] (KAFKA-17703) Move DelayedActionsQueue outside DelayedShareFetch

2024-10-03 Thread Abhinav Dixit (Jira)
Abhinav Dixit created KAFKA-17703: - Summary: Move DelayedActionsQueue outside DelayedShareFetch Key: KAFKA-17703 URL: https://issues.apache.org/jira/browse/KAFKA-17703 Project: Kafka Issue Ty

[jira] [Resolved] (KAFKA-16812) The tools-related tests are slow

2024-10-03 Thread TaiJuWu (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TaiJuWu resolved KAFKA-16812. - Resolution: Not A Problem > The tools-related tests are slow > > >

[jira] [Reopened] (KAFKA-15369) Allow AdminClient to Talk Directly with the KRaft Controller Quorum and add Controller Registration

2024-10-03 Thread TengYao Chi (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TengYao Chi reopened KAFKA-15369: - > Allow AdminClient to Talk Directly with the KRaft Controller Quorum and add > Controller Registra

[jira] [Created] (KAFKA-17702) KIP 919 support describeMetadataQuorum for controller

2024-10-03 Thread TaiJuWu (Jira)
TaiJuWu created KAFKA-17702: --- Summary: KIP 919 support describeMetadataQuorum for controller Key: KAFKA-17702 URL: https://issues.apache.org/jira/browse/KAFKA-17702 Project: Kafka Issue Type: Sub-t

[jira] [Created] (KAFKA-17701) KIP 919 support describeFeatures for controller

2024-10-03 Thread TaiJuWu (Jira)
TaiJuWu created KAFKA-17701: --- Summary: KIP 919 support describeFeatures for controller Key: KAFKA-17701 URL: https://issues.apache.org/jira/browse/KAFKA-17701 Project: Kafka Issue Type: Sub-task

[jira] [Resolved] (KAFKA-17525) Convert the UnknownServerException to InvalidRequestException when altering client-metrics config at runtime

2024-10-03 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17525. Fix Version/s: 4.0.0 Resolution: Fixed > Convert the UnknownServerException to Inva

[jira] [Resolved] (KAFKA-17658) Move BootstrapControllersIntegrationTest to kafka.server

2024-10-03 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17658. Fix Version/s: 4.0.0 Resolution: Fixed > Move BootstrapControllersIntegrationTest t

[jira] [Resolved] (KAFKA-17684) Run tests on Java 11 and Java 21

2024-10-03 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17684. Fix Version/s: 4.0.0 Assignee: David Arthur Resolution: Fixed > Run tests

Jenkins build is still unstable: Kafka » Kafka PowerPC Daily » test-powerpc #76

2024-10-03 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-655: Add deduplication processor in kafka-streams

2024-10-03 Thread Matthias J. Sax
Thanks Ayoub! (102) let's hear what others think. (103) Keeping it internal if fine with me. Was just curious. (104) The offset checking was specifically added for the case of reprocessing the same input record. Yes. Punctuation records are generated by the application. And I assume we c

[jira] [Resolved] (KAFKA-17659) Remove BrokerRegistrationRequestTest and remove EmbeddedZookeeper from RaftClusterInvocationContext

2024-10-03 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17659. Resolution: Duplicate > Remove BrokerRegistrationRequestTest and remove EmbeddedZookeeper

Community Over Code NA next week - Data Engineering track (with Security twist)

2024-10-03 Thread Jarek Potiuk
Hello Kafka committers and contributors. As you know - next week we have the flagship Community Over Code conference in Denver and together with Ismaël we are co-charing data engineering track. There are many parallel tracks in Denver, but Data Engineering is held on Wednesday and Thursday in Mt.

Re: [VOTE]: KIP-1050: Consistent error handling for Transactions

2024-10-03 Thread Matthias J. Sax
Thanks for updating the KIP. Very happy to see this moving forward! +1 (binding). On 8/26/24 9:54 AM, Justine Olshan wrote: +1 from me Thanks, Justine On Sun, Aug 25, 2024 at 11:54 PM Kaushik Raina wrote: Hi everyone, I would like to start a voting thread for KIP-1050: Consistent error ha

Re: [DISCUSS] KIP-1081: Graduation Steps for Features

2024-10-03 Thread Matthias J. Sax
I also never like "early access" and "preview" as I think they are too similar. (And frankly: I personally always felt that "preview" should be before "early access", ie, the exact opposite of how we used it in the past :D) I do like "experimental", "preview"" and "production ready", and would

Re: [VOTE] KIP-1094 Add a new constructor method with nextOffsets to ConsumerRecords

2024-10-03 Thread Matthias J. Sax
+1 (binding) On 10/3/24 4:35 PM, Kirk True wrote: +1 (non-binding) On Wed, Oct 2, 2024, at 12:41 PM, Alieh Saeedi wrote: Hi all I would like to call a vote for KIP-1094. Please take a moment to review the proposal and submit your vote. KIP: https://cwiki.apache.org/confluence/display/KAFKA/K

Re: [DISCUSS] KIP-1088: Replace KafkaClientSupplier with KafkaClientInterceptor

2024-10-03 Thread Matthias J. Sax
Thanks for your feedback Alieh and Sophie. For everybody: we did sync about open questions in person, and I hope to reply w/o forgetting to add enough context about what we did discuss in person. If anything is missing/unclear, please let us know. Based on the in-person discussion, we agree

Re: [VOTE] KIP-1094 Add a new constructor method with nextOffsets to ConsumerRecords

2024-10-03 Thread Kirk True
+1 (non-binding) On Wed, Oct 2, 2024, at 12:41 PM, Alieh Saeedi wrote: > Hi all > > I would like to call a vote for KIP-1094. Please take a moment to review > the proposal and submit your vote. > > KIP: > https://cwiki.apache.org/confluence/display/KAFKA/KIP-1094%3A+Add+a+new+constructor+method+

Re: New release branch 3.9

2024-10-03 Thread Colin McCabe
Also, as a quick update, the PR for KAFKA-17608 has been merged to 3.9. KAFKA-16927 is the only current remaining blocker. best, Colin On Thu, Oct 3, 2024, at 12:49, Colin McCabe wrote: > Hi José, > > Yes, this seems like a regression in 3.9, so we need to fix it there. > Thanks for the heads u

[jira] [Created] (KAFKA-17700) Override the follower's leader endpoint by preferring BEGIN_QUORUM_EPOCH

2024-10-03 Thread Jira
José Armando García Sancio created KAFKA-17700: -- Summary: Override the follower's leader endpoint by preferring BEGIN_QUORUM_EPOCH Key: KAFKA-17700 URL: https://issues.apache.org/jira/browse/KAFKA-177

[jira] [Created] (KAFKA-17699) Set default test quorum to kraft

2024-10-03 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-17699: Summary: Set default test quorum to kraft Key: KAFKA-17699 URL: https://issues.apache.org/jira/browse/KAFKA-17699 Project: Kafka Issue Type: Sub-task

Re: New release branch 3.9

2024-10-03 Thread Colin McCabe
Hi José, Yes, this seems like a regression in 3.9, so we need to fix it there. Thanks for the heads up. best, Colin On Thu, Oct 3, 2024, at 11:59, José Armando García Sancio wrote: > Hi all, > > We found a bug that should be fixed for 3.9.0: > https://issues.apache.org/jira/browse/KAFKA-16927 >

[jira] [Created] (KAFKA-17698) Convert MultipleListenersWithSameSecurityProtocolBaseTest to KRaft

2024-10-03 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-17698: Summary: Convert MultipleListenersWithSameSecurityProtocolBaseTest to KRaft Key: KAFKA-17698 URL: https://issues.apache.org/jira/browse/KAFKA-17698 Project: Kafka

[jira] [Reopened] (KAFKA-15914) Flaky test - testAlterSinkConnectorOffsetsOverriddenConsumerGroupId - OffsetsApiIntegrationTest

2024-10-03 Thread David Arthur (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Arthur reopened KAFKA-15914: -- This has re-occurred on trunk   [https://ge.apache.org/scans/tests?search.names=CI%20workflow%2C

[jira] [Resolved] (KAFKA-17613) Remove ZK migration code

2024-10-03 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-17613. -- Fix Version/s: 4.0.0 Resolution: Fixed > Remove ZK migration code > ---

Re: New release branch 3.9

2024-10-03 Thread José Armando García Sancio
Hi all, We found a bug that should be fixed for 3.9.0: https://issues.apache.org/jira/browse/KAFKA-16927 I have created a PR to fix this issue: https://github.com/apache/kafka/pull/17363 Colin, can we include this in 3.9.0? Thanks, -- -José

[jira] [Created] (KAFKA-17697) Fix flaky DefaultStateUpdaterTest.shouldRestoreSingleActiveStatefulTask

2024-10-03 Thread Yu-Lin Chen (Jira)
Yu-Lin Chen created KAFKA-17697: --- Summary: Fix flaky DefaultStateUpdaterTest.shouldRestoreSingleActiveStatefulTask Key: KAFKA-17697 URL: https://issues.apache.org/jira/browse/KAFKA-17697 Project: Kafka

[jira] [Created] (KAFKA-17696) New consumer background operations unaware of metadata errors

2024-10-03 Thread Lianet Magrans (Jira)
Lianet Magrans created KAFKA-17696: -- Summary: New consumer background operations unaware of metadata errors Key: KAFKA-17696 URL: https://issues.apache.org/jira/browse/KAFKA-17696 Project: Kafka

[jira] [Created] (KAFKA-17695) cleanup org.apache.kafka.common.test.TestUtils

2024-10-03 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-17695: -- Summary: cleanup org.apache.kafka.common.test.TestUtils Key: KAFKA-17695 URL: https://issues.apache.org/jira/browse/KAFKA-17695 Project: Kafka Issue Type

[jira] [Created] (KAFKA-17694) Migrate TopicCommandIntegrationTest to new test infra

2024-10-03 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-17694: -- Summary: Migrate TopicCommandIntegrationTest to new test infra Key: KAFKA-17694 URL: https://issues.apache.org/jira/browse/KAFKA-17694 Project: Kafka Iss

[jira] [Created] (KAFKA-17693) Remove testCheckEarliestLocalTimestampVersion and testCheckLatestTieredTimestampVersion

2024-10-03 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-17693: -- Summary: Remove testCheckEarliestLocalTimestampVersion and testCheckLatestTieredTimestampVersion Key: KAFKA-17693 URL: https://issues.apache.org/jira/browse/KAFKA-17693

[jira] [Created] (KAFKA-17692) Remove KafkaServer references in streams tests

2024-10-03 Thread Mickael Maison (Jira)
Mickael Maison created KAFKA-17692: -- Summary: Remove KafkaServer references in streams tests Key: KAFKA-17692 URL: https://issues.apache.org/jira/browse/KAFKA-17692 Project: Kafka Issue Type

[jira] [Created] (KAFKA-17691) Remove KafkaServer references in tools tests

2024-10-03 Thread Mickael Maison (Jira)
Mickael Maison created KAFKA-17691: -- Summary: Remove KafkaServer references in tools tests Key: KAFKA-17691 URL: https://issues.apache.org/jira/browse/KAFKA-17691 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-17690) add checkstyle file to test-common and test-common-api

2024-10-03 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-17690: -- Summary: add checkstyle file to test-common and test-common-api Key: KAFKA-17690 URL: https://issues.apache.org/jira/browse/KAFKA-17690 Project: Kafka Is

Re: So long, Jenkins 👋

2024-10-03 Thread Chia-Ping Tsai
> Chia-Ping, thanks for bringing this up. I assumed that was done by a Jira + > GitHub integration, not Jenkins. I'll ask the Infra team for suggestions. You are right, that is unrelated to INFRA (https://issues.apache.org/jira/browse/INFRA-26174). Apologies for asking a strange question :( Bes

[jira] [Resolved] (KAFKA-17469) Move appropriate classes and interfaces to the new share module

2024-10-03 Thread Sushant Mahajan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushant Mahajan resolved KAFKA-17469. - Resolution: Fixed > Move appropriate classes and interfaces to the new share module > --

Re: [VOTE] KIP-1082: Require Client-Generated IDs over the ConsumerGroupHeartbeat RPC

2024-10-03 Thread TengYao Chi
Hi Lianet, Thank you for the reminder. I have updated the content. 😀 Best, TengYao Lianet M. 於 2024年10月3日 週四 下午6:50寫道: > Hello TengYao, just one last minor comment. The KIP refers in multiple > places to bumping the heartbeat RPC from version 0 to version 1. We should > update that given that t

[jira] [Resolved] (KAFKA-17674) New consumer reset positions for newly added partitions before retrieving committed offsets

2024-10-03 Thread Lianet Magrans (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianet Magrans resolved KAFKA-17674. Reviewer: Chia-Ping Tsai Resolution: Fixed > New consumer reset positions for newly

Re: [VOTE] KIP-1082: Require Client-Generated IDs over the ConsumerGroupHeartbeat RPC

2024-10-03 Thread Lianet M.
Hello TengYao, just one last minor comment. The KIP refers in multiple places to bumping the heartbeat RPC from version 0 to version 1. We should update that given that the RPC is already in version 1. With that I'm +1 (binding) Thanks! Lianet On Thu, Oct 3, 2024 at 5:01 AM David Jacot wrote:

Re: [DISCUSS] KIP-1058: Txn consumer exerts pressure on remote storage when reading non-txn topic

2024-10-03 Thread Luke Chen
Hi Kamal, Sorry for the late review. Thanks for the KIP, this will improve the transaction reading for remote storage. Overall LGTM, just one minor thought: Currently, we only store the `TxnIndexEmpty` bool value in the segment metadata. Do you think it is helpful if we store the "least abort sta

Re: [VOTE] KIP-1082: Require Client-Generated IDs over the ConsumerGroupHeartbeat RPC

2024-10-03 Thread David Jacot
+1 (binding) Thanks for the KIP! Best, David On Thu, Oct 3, 2024 at 10:49 AM TengYao Chi wrote: > Hello everyone, > As the vote has been pending for two weeks, I would like to push it > manually. > Thank you for your attention. > > Best, > TengYao > > Chris Egerton 於 2024年9月19日 週四 上午1:42寫道: >

Re: [VOTE] KIP-1082: Require Client-Generated IDs over the ConsumerGroupHeartbeat RPC

2024-10-03 Thread TengYao Chi
Hello everyone, As the vote has been pending for two weeks, I would like to push it manually. Thank you for your attention. Best, TengYao Chris Egerton 於 2024年9月19日 週四 上午1:42寫道: > Thanks for the KIP! +1 (binding) > > On Tue, Sep 17, 2024 at 12:45 PM Andrew Schofield < > andrew_schofield_j...@ou

[jira] [Resolved] (KAFKA-16733) Add support for formatting new records written to offsets topic in kafka-dump-log.sh

2024-10-03 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-16733. -- Fix Version/s: 4.0.0 Resolution: Fixed > Add support for formatting new records

[jira] [Resolved] (KAFKA-17500) NOT_LEADER_OR_FOLLOWER with metadata redirection in share group response

2024-10-03 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-17500. -- Resolution: Fixed > NOT_LEADER_OR_FOLLOWER with metadata redirection in share group re

Re: [VOTE] KIP-1074: Allow the replication of user internal topics

2024-10-03 Thread Patrik Marton
Hi All, Thank you all for the votes so far! We currently have 2 binding votes and 1 non-binding vote, leaving us just 1 binding vote away from passing the KIP. If anyone has a moment to review and cast their vote or share any feedback, it would be greatly appreciated! Best, Patrik On Wed, Sep 25