Re: [DISCUSS] KIP-1091: Improved Kafka Streams operator metrics

Hey Bill, Thanks for the KIP! That all makes sense to me, just one minor note: while you mentioned the TRACE recording level in the Motivation section, it seems to be missing from the table in the Public Interfaces section. I assume this will also be included, presumably with a value of 2? Cheers

Re: [VOTE] 3.8.1 RC1

Hi Josep, I did the following - built from source and docker image - ran all the unit test and integration test in container. - ran quickstart with the 2.13 binaries. +1 (non-binding) Thanks, Wei-Ting On 2024/10/28 15:56:22 Chia-Ping Tsai wrote: > hi Josep > > +1 (binding) with following checks

Re: [VOTE] 3.8.1 RC1

+1 (non-binding) ... I used the staged Scala 2.13 binaries and Maven artifacts and run my tests. All seems to work fine. Thanks for the release. Jakub On Thu, Oct 17, 2024 at 10:27 PM Josep Prat wrote: > Hello Kafka users, developers and client-developers, > > This is the second release candida

[jira] [Created] (KAFKA-17889) Consider replacing `.properties` files with yaml format for Log4j configuration

TengYao Chi created KAFKA-17889: --- Summary: Consider replacing `.properties` files with yaml format for Log4j configuration Key: KAFKA-17889 URL: https://issues.apache.org/jira/browse/KAFKA-17889 Project

Jenkins build is still unstable: Kafka » Kafka PowerPC Daily » test-powerpc #101

See

[jira] [Resolved] (KAFKA-17874) Fix the KRaft metric names in the documentation

[ https://issues.apache.org/jira/browse/KAFKA-17874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-17874. Fix Version/s: 4.0.0 Resolution: Fixed > Fix the KRaft metric names in the document

Re: [VOTE] 3.8.1 RC1

Hi Josep, - compiled from source - ran all unit and integration tests - ran ZK and KRaft quickstarts - spot checked documentation +1 (non binding) Thanks Fede On Mon, Oct 28, 2024 at 4:31 AM Luke Chen wrote: > > Hi Josep, > > Thanks for the RC. > > I did the following > - checked the checksums

Re: [VOTE] 3.9.0 RC2

Hi Anton, Thanks for raising the discussion. I read through this discussion and I can understand your confusion. > The behavior is new. I think like Colin said, this behavior actually stays consistent as in the tagged field in ApiVersionsResponse.json named SupportedFeatures. It doesn't specify

[jira] [Created] (KAFKA-17885) Enable clients to rebootstrap based on timeout or error code

Rajini Sivaram created KAFKA-17885: -- Summary: Enable clients to rebootstrap based on timeout or error code Key: KAFKA-17885 URL: https://issues.apache.org/jira/browse/KAFKA-17885 Project: Kafka

Re: [VOTE] 3.8.1 RC1

Hi Luke, Thanks! I don't have any special hurry to release. I'll wait a couple of days for the third binding +1 to come. Best, -- Josep Prat Open Source Engineering Director, Aiven josep.p...@aiven.io | +491715557497 | aiven.io Aiven Deutschland GmbH Alexanderufer 3-7, 10117

Re: [DISCUSS] KIP-1043: Administration of groups

Hi Andrew, Thanks for your response. I think that your last proposal makes sense to me. It seems that we have no choice but to also change the DescribeGroups API. However, I still have a preference for the GROUP_ID_NOT_FOUND approach. It is simpler in my opinion and consistent across all APIs. Fro

Re: [VOTE] 3.8.1 RC1

hi Josep +1 (binding) with following checks: 1. run all unit tests and integration tests 2. run all clients e2e 3. run a cluster with 1 quorum + 5 brokers Thanks, Chia-Ping On 2024/10/28 11:36:41 Josep Prat wrote: > Hi all, > > Thanks for all the ones testing and voting! > > @Luke Chen and @

Re: [DISCUSS] KIP-1098: Reverse Checkpointing in MirrorMaker

Hi Viktor, SVV1. Not easy to provide a number, but yes, it does scale with the number of replicated topic partitions. Enabling this feature will add the overhead of an extra consumer, and allocates memory for an offset-sync index for each partition. The index is limited to 64 entries. I could give

Re: [DISCUSS] KIP-1098: Reverse Checkpointing in MirrorMaker

Hi Daniel, This would indeed greatly reduce the duplicate processing on failbacks. Few questions: 1. Adding another offset sync store might be memory intensive. Would it make sense (if possible) to filter the topics in it based on the reverseCheckpointingTopicFilter? 2. Would it make sen

[jira] [Created] (KAFKA-17886) BrokerLifecycleManagerTest testAlwaysSendsAccumulatedOfflineDirs hanging in CI

David Arthur created KAFKA-17886: Summary: BrokerLifecycleManagerTest testAlwaysSendsAccumulatedOfflineDirs hanging in CI Key: KAFKA-17886 URL: https://issues.apache.org/jira/browse/KAFKA-17886 Projec

Re: [VOTE] 3.8.1 RC1

Hi Josep, There is no such rule to explicitly exclude RM or not. But it'd be better if there is the 3rd +1 binding other than RM to have one more validation. So, maybe you can give people 1 last day to validate it, then close the vote with your +1. Thanks. Luke On Mon, Oct 28, 2024 at 7:36 PM Jo

Re: [VOTE] 3.8.1 RC1

Hi all, Thanks for all the ones testing and voting! @Luke Chen and @Mickael Maison , would my implicit +1 count towards the 3 PMCs needed to approve the PR? Or as a RM am I excluded? Best, -- Josep Prat Open Source Engineering Director, Aiven josep.p...@aiven.io | +49171555

Re: [DISCUSS] KIP-1098: Reverse Checkpointing

Hi Daniel, This would indeed greatly reduce the duplicate processing on failbacks. Few questions: 1. Adding another offset sync store might be memory intensive. Would it make sense (if possible) to filter the topics in it based on the reverseCheckpointingTopicFilter? 2. Would it make sen

[jira] [Reopened] (KAFKA-17402) Test failure: DefaultStateUpdaterTest.shouldGetTasksFromRestoredActiveTasks expected: <2> but was: <3>

[ https://issues.apache.org/jira/browse/KAFKA-17402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ao Li reopened KAFKA-17402: --- I don't think this bug is fixed. I've rebased the branch to the current truck and can still reproduce the fai

[jira] [Reopened] (KAFKA-17114) DefaultStateUpdater::handleRuntimeException should update isRunning before calling `addToExceptionsAndFailedTasksThenClearUpdatingAndPausedTasks`

[ https://issues.apache.org/jira/browse/KAFKA-17114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ao Li reopened KAFKA-17114: --- This bug is not resolved. Please check the fork to reproduce the failure: https://github.com/aoli-al/kafka/tre

[jira] [Resolved] (KAFKA-17883) Fix jvm error caused by UseParNewGC when running old kafka client in e2e

[ https://issues.apache.org/jira/browse/KAFKA-17883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17883. Fix Version/s: 4.0.0 Resolution: Fixed > Fix jvm error caused by UseParNewGC when r

RE: [DISCUSS] KIP-1098: Reverse Checkpointing

Hi Daniel, This would indeed greatly reduce the duplicate processing on failbacks. Few questions: 1. Adding another offset sync store might be memory intensive. Would it make sense (if possible) to filter the topics in it based on the reverseCheckpointingTopicFilter? 2. Would it make sen

Re: [DISCUSS] KIP-1043: Administration of groups

Hi David, I've updated the KIP accordingly. GROUP_ID_NOT_FOUND and an error message is used to disambiguate the error cases when the group ID cannot be found. Thanks for your time reviewing this KIP. Andrew From: David Jacot Sent: 28 October 2024 13:37 T

Re: [PR] [Docs] Update site for 3.8.1 [kafka-site]

jlprat commented on code in PR #635: URL: https://github.com/apache/kafka-site/pull/635#discussion_r1818908019 ## 38/js/templateData.js: ## @@ -19,6 +19,6 @@ limitations under the License. var context={ "version": "38", "dotVersion": "3.8", -"fullDotVersion": "3.8

[jira] [Resolved] (KAFKA-14483) Move LocalLog to storage module

[ https://issues.apache.org/jira/browse/KAFKA-14483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-14483. Fix Version/s: 4.0.0 Resolution: Fixed > Move LocalLog to storage module >

Re: [VOTE] 3.9.0 RC2

On Sun, Oct 27, 2024, at 01:44, Anton Agestam wrote: > Colin > > I have presented four reasons, I'll list them again below. Please let me > know which ones there isn't already enough information on the thread > already. > > - The behavior is new. Hi Anton, This behavior isn't new. I gave an examp

Re: [DISCUSS] KIP-1098: Reverse Checkpointing in MirrorMaker

Hi Daniel, SVV1. Fair points about the performance impact. The next question is that can we quantify it somehow, ie. does it scale with the number of topics to reverse checkpoints, the offsets emitted, etc.? I'll do one more pass on the KIP in the following days but I wanted to reply to you with

[DISCUSS] KIP-1102: Enable clients to rebootstrap based on timeout or error code

Hi everyone, I would like to start discussion on KIP-1102 ( https://cwiki.apache.org/confluence/display/KAFKA/KIP-1102%3A+Enable+clients+to+rebootstrap+based+on+timeout+or+error+code). This KIP extends KIP-899 by introducing a timeout configuration and error code that can be used to trigger reboot

[jira] [Created] (KAFKA-17887) Handle response log result error in DelayedShareFetch

Apoorv Mittal created KAFKA-17887: - Summary: Handle response log result error in DelayedShareFetch Key: KAFKA-17887 URL: https://issues.apache.org/jira/browse/KAFKA-17887 Project: Kafka Issue

[jira] [Created] (KAFKA-17888) e2e should support to run <2.3 kafka under JDK 11

Chia-Ping Tsai created KAFKA-17888: -- Summary: e2e should support to run <2.3 kafka under JDK 11 Key: KAFKA-17888 URL: https://issues.apache.org/jira/browse/KAFKA-17888 Project: Kafka Issue T

Developer needed

Hi there, I am currently working on a project for the logistic industry, and I think Kafka will be a great fit for us. I was wondering if you can recommend any software companies (maybe partner) that can help us achieving this project. Let me know if it's something we can help with. Looking for