[jira] [Resolved] (KAFKA-17905) Remove the specified type of using lambda for BaseFunction

2024-10-31 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17905. Fix Version/s: 4.0.0 Resolution: Fixed > Remove the specified type of using lambda

[jira] [Resolved] (KAFKA-17116) New consumer may not send effective leave group if member ID received after close

2024-10-31 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17116. Resolution: Fixed > New consumer may not send effective leave group if member ID received

[jira] [Resolved] (KAFKA-17899) Add more unit tests for NetworkReceive

2024-10-31 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17899. Fix Version/s: 4.0.0 Resolution: Fixed > Add more unit tests for NetworkReceive >

Re: Configuration format for Log4j Core 2.x

2024-10-31 Thread Piotr P. Karwasz
Hi Viktor, On 31.10.2024 10:19, Viktor Somogyi-Vass wrote: I could see a transition for Kafka configs too to YAML. It's widely used in other projects as well and for Kafka too it would make sense to group them for instance by log, storage, networking, security etc.. It definitely has an advantag

[jira] [Created] (KAFKA-17909) Clean-up RPC#listeners

2024-10-31 Thread TengYao Chi (Jira)
TengYao Chi created KAFKA-17909: --- Summary: Clean-up RPC#listeners Key: KAFKA-17909 URL: https://issues.apache.org/jira/browse/KAFKA-17909 Project: Kafka Issue Type: Task Reporter: T

Re: [VOTE] 3.9.0 RC5

2024-10-31 Thread David Arthur
Assuming the Maven artifacts are not an issue, I'll go ahead and give my vote. For validation, I downloaded the Scala 2.13 binaries and manually ran through a ZK to KRaft migration. +1 binding -David On Thu, Oct 31, 2024 at 11:35 AM Bill Bejeck wrote: > Hi Colin, > > Thanks for the new RC. >

Re: [VOTE] 3.9.0 RC5

2024-10-31 Thread Bill Bejeck
Hi Colin, Thanks for the new RC. - I checked the signatures and checksums - Built from source - Ran though the quickstart - Spot checked the docs +1(binding) from me modulo the previous issues pointed out. Thanks, Bill On Wed, Oct 30, 2024 at 2:02 PM David Arthur wrote: > Should

[jira] [Created] (KAFKA-17912) Align string conversion of SharePartitionKey

2024-10-31 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-17912: Summary: Align string conversion of SharePartitionKey Key: KAFKA-17912 URL: https://issues.apache.org/jira/browse/KAFKA-17912 Project: Kafka Issue Ty

Re: [VOTE] 3.9.0 RC5

2024-10-31 Thread Mickael Maison
Hi, Can we add sanity checks to ensure all artifacts are present when running the release? Also should we use a different folder for each RC? This would eliminate the risk of artifacts from previous RCs hiding an issue. Luke spotted the old artifacts this time but this could have been missed. Tha

[jira] [Created] (KAFKA-17911) Unable to set kafka.metrics.reporter via environment variables in docker image

2024-10-31 Thread Mickael Maison (Jira)
Mickael Maison created KAFKA-17911: -- Summary: Unable to set kafka.metrics.reporter via environment variables in docker image Key: KAFKA-17911 URL: https://issues.apache.org/jira/browse/KAFKA-17911 Pr

Re: [VOTE] 3.9.0 RC5

2024-10-31 Thread Colin McCabe
Hi David, Thanks for checking. I took a look and yes, I did forget to upload the Scala 2.12 artifacts previously. The script runs gradlewAll, but when I was trying to do the steps manually, I missed that and just ran gradlew, which only did Scala 2.13. This should be fixed now! The scala 2.12

[jira] [Created] (KAFKA-17910) Create integration tests for Admin.listGroups and Admin.describeClassicGroups

2024-10-31 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-17910: Summary: Create integration tests for Admin.listGroups and Admin.describeClassicGroups Key: KAFKA-17910 URL: https://issues.apache.org/jira/browse/KAFKA-17910

Re: [DISCUSS] KIP-1099: Extend kafka-consumer-groups command line tool to support new consumer group

2024-10-31 Thread Andrew Schofield
Hi PoAn, Thanks for the KIP. I have a few comments. AS1: It seems to me that these new additions are most useful to people trying to understand the progress of rebalancing in quite some detail. The information is really not understandable for most users who do not have deep knowledge of KIP-848/

Re: [DISCUSS] Require KIPs to include "How to teach this section"

2024-10-31 Thread Anton Agestam
Thanks for your response here Colin, > Perhaps there should be a "documentation" section in the KIP template? I think that would do the trick. The nice idea behind formulating the section as "How to teach this?", is that it leaves it to the KIP author how to answer it. In most cases I would expe

[jira] [Created] (KAFKA-17906) remove redundant sourceSets from build.gradle

2024-10-31 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-17906: -- Summary: remove redundant sourceSets from build.gradle Key: KAFKA-17906 URL: https://issues.apache.org/jira/browse/KAFKA-17906 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-17907) PersisterStateManagerTest hangs

2024-10-31 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-17907: -- Summary: PersisterStateManagerTest hangs Key: KAFKA-17907 URL: https://issues.apache.org/jira/browse/KAFKA-17907 Project: Kafka Issue Type: Improvement

[jira] [Resolved] (KAFKA-17907) PersisterStateManagerTest hangs

2024-10-31 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17907. Resolution: Won't Fix this happens in the PR rather than trunk > PersisterStateManagerTes

[jira] [Created] (KAFKA-17908) Tidy up log messages for consumer group in group metadata manager

2024-10-31 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-17908: Summary: Tidy up log messages for consumer group in group metadata manager Key: KAFKA-17908 URL: https://issues.apache.org/jira/browse/KAFKA-17908 Project: Ka

Re: [VOTE] 3.9.0 RC5

2024-10-31 Thread Luke Chen
Hi Colin, Thanks for the update. I've ran a sanity check as Mickael suggested for the maven artifacts with the one in https://dist.apache.org/repos/dist/dev/kafka/3.9.0-rc5/. I used jarcomp to verify: 1. kafka_2.13-3.9.0.jar 2. kafka-clien

Re: [DISCUSS] KIP-1099: Extend kafka-consumer-groups command line tool to support new consumer group

2024-10-31 Thread Frank Yang
Hi Sean / Andrew / Lianet, Thanks for all your review and suggestions. AS1, LM1, LM4: Change to add KIP-848 information when users give —verbose option. —describe —verbose: shows group epoch and target assignment epoch. —describe —members —verbose: shows above information, member epoch, and targ

Re: [DISCUSS] KIP-1091: Improved Kafka Streams operator metrics

2024-10-31 Thread Bill Bejeck
Hi Sophie, Thanks for the feedback. You are correct, that was an oversight on my part. I've updated the KIP. Regards, Bill On Tue, Oct 29, 2024 at 1:16 AM Sophie Blee-Goldman wrote: > Hey Bill, > > Thanks for the KIP! That all makes sense to me, just one minor note: while > you mentioned the

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.9 #96

2024-10-31 Thread Apache Jenkins Server
See Changes: -- [...truncated 3329 lines...] [2024-10-31T21:03:21.824Z] > Task :connect:transforms:check [2024-10-31T21:03:26.364Z] > Task :streams:test-utils:checkstyleTest [2

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.8 #105

2024-10-31 Thread Apache Jenkins Server
See Changes: -- [...truncated 2946 lines...] [2024-10-31T21:03:04.259Z] [Warn] /home/jenkins/jenkins-agent/workspace/Kafka_kafka_3.8/core/src/main/scala/kafka/utils/Implicits

Re: [DISCUSS] KIP-1099: Extend kafka-consumer-groups command line tool to support new consumer group

2024-10-31 Thread Lianet M.
Hello Frank, thanks for the KIP! A few comments: LM1. I strongly agree with Andrew's suggestion of moving this into a --verbose option. I expect someone would only attempt to make sense of the epochs while debugging an issue, not while trying to view the group or member's info. (Also member-epoch

[jira] [Created] (KAFKA-17916) Convert Kafka Connect system tests to use KRaft

2024-10-31 Thread Kevin Wu (Jira)
Kevin Wu created KAFKA-17916: Summary: Convert Kafka Connect system tests to use KRaft Key: KAFKA-17916 URL: https://issues.apache.org/jira/browse/KAFKA-17916 Project: Kafka Issue Type: Improveme

[jira] [Created] (KAFKA-17915) Convert Kafka Client tests to use KRaft

2024-10-31 Thread Kevin Wu (Jira)
Kevin Wu created KAFKA-17915: Summary: Convert Kafka Client tests to use KRaft Key: KAFKA-17915 URL: https://issues.apache.org/jira/browse/KAFKA-17915 Project: Kafka Issue Type: Improvement

[jira] [Created] (KAFKA-17917) Convert Kafka core system tests to use KRaft

2024-10-31 Thread Kevin Wu (Jira)
Kevin Wu created KAFKA-17917: Summary: Convert Kafka core system tests to use KRaft Key: KAFKA-17917 URL: https://issues.apache.org/jira/browse/KAFKA-17917 Project: Kafka Issue Type: Improvement

[jira] [Created] (KAFKA-17913) Fix KRaft controller count recommendations

2024-10-31 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-17913: Summary: Fix KRaft controller count recommendations Key: KAFKA-17913 URL: https://issues.apache.org/jira/browse/KAFKA-17913 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-17914) Refactor ShareCoordinator.partitionFor to use SharePartitionKey argument

2024-10-31 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-17914: Summary: Refactor ShareCoordinator.partitionFor to use SharePartitionKey argument Key: KAFKA-17914 URL: https://issues.apache.org/jira/browse/KAFKA-17914 Proj

Re: Configuration format for Log4j Core 2.x

2024-10-31 Thread Viktor Somogyi-Vass
Hi all, I think it's a great idea to use a different configuration method as default. Personally I'd prefer YAML as well because it's the most concise and easy to read format. 1. This would establish two different config formats in Kafka. Properties for kafka configs and YAML/XML/JSON for log con

Re: [DISCUSS] KIP-1103: Additional metrics for cooperative consumption

2024-10-31 Thread Andrew Schofield
Hi Apoorv, Thanks for the KIP. I have some comments. AS0: These are broker metrics and not client metrics. I don't think the KIP states that and it probably should. AS1: TotalShareFetchRequestsPerSec is inspired by the existing metric TotalFetchRequestsPerSec. That one is in the BrokerTopicMetric

Re: [DISCUSS] KIP-1091: Improved Kafka Streams operator metrics

2024-10-31 Thread Bill Bejeck
Hi Apoorv, Thanks for the comments. I've updated the table to include the information you requested. Note that the "Name" column is the MBean name. Regards, Bill On Tue, Oct 29, 2024 at 1:00 PM Apoorv Mittal wrote: > Hi Bill, > Thanks for the KIP. I have a request, can we please define MBe

[jira] [Created] (KAFKA-17918) The Kafka producer's RecordAccumulator object stores more callback methods than messages.

2024-10-31 Thread hejie (Jira)
hejie created KAFKA-17918: - Summary: The Kafka producer's RecordAccumulator object stores more callback methods than messages. Key: KAFKA-17918 URL: https://issues.apache.org/jira/browse/KAFKA-17918 Project:

Jenkins build is still unstable: Kafka » Kafka PowerPC Daily » test-powerpc #104

2024-10-31 Thread Apache Jenkins Server
See