Re: [PR] [Docs] Update site for 3.8.1 [kafka-site]

jlprat commented on code in PR #635: URL: https://github.com/apache/kafka-site/pull/635#discussion_r1820689299 ## 38/js/templateData.js: ## @@ -19,6 +19,6 @@ limitations under the License. var context={ "version": "38", "dotVersion": "3.8", -"fullDotVersion": "3.8

Re: [VOTE] 3.9.0 RC2

Hi Colin, > Why is it bad API design? Because rather than forcing API designers to specify good defaults, it forces protocol implementers to inject bad defaults. The good examples from this thread are host and port, empty string is not a valid hostname, and zero is not a valid port, so those are

[jira] [Resolved] (KAFKA-17891) Kafka 3.8 no longer works on z/OS due to hard dependency on zstd-jni

[ https://issues.apache.org/jira/browse/KAFKA-17891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-17891. Resolution: Duplicate > Kafka 3.8 no longer works on z/OS due to hard dependency on zstd-j

[jira] [Created] (KAFKA-17890) Move DelayedOperationPurgatory to server-common

Mickael Maison created KAFKA-17890: -- Summary: Move DelayedOperationPurgatory to server-common Key: KAFKA-17890 URL: https://issues.apache.org/jira/browse/KAFKA-17890 Project: Kafka Issue Typ

Re: [DISCUSS] KIP-1058: Txn consumer exerts pressure on remote storage when reading non-txn topic

Let's get the ball rolling (again) on this one. Kamal, could you please add the following to the KIP: 1. the API as discussed above. Please add the failure modes for this API as well such as the exceptions thrown and a recommendation on how a caller is expected to handle those. I am assuming that

[jira] [Resolved] (KAFKA-17875) Align KRaft controller count recommendations

[ https://issues.apache.org/jira/browse/KAFKA-17875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-17875. Fix Version/s: 4.0.0 Resolution: Fixed > Align KRaft controller count recommendatio

Re: [DISCUSS] KIP-1043: Administration of groups

Thanks, Andrew. LGTM. On Mon, Oct 28, 2024 at 3:58 PM Andrew Schofield < andrew_schofield_j...@outlook.com> wrote: > Hi David, > I've updated the KIP accordingly. GROUP_ID_NOT_FOUND and an > error message is used to disambiguate the error cases when the group > ID cannot be found. > > Thanks for

Kafka Appender for Log4j Core 2.x/3.x

Hi all, As some of you are probably aware the Log4j 1.x Kafka Appender was removed in KAFKA-17860. The Apache Log4j project currently maintains a Kafka Appender for Log4j Core 2.x[2], but following a poll on `log4j-user@logging`[3] last year and a long discussion in the PMC, the appender has

[jira] [Created] (KAFKA-17891) Kafka 3.8 no longer works on z/OS due to hard dependency on zstd-jni

Dave Crighton created KAFKA-17891: - Summary: Kafka 3.8 no longer works on z/OS due to hard dependency on zstd-jni Key: KAFKA-17891 URL: https://issues.apache.org/jira/browse/KAFKA-17891 Project: Kafka

Configuration format for Log4j Core 2.x

Hi, In the context of the current migration process from Log4j 1.x/Reload4j to Log4j Core 2.x[1], I believe that the choice of configuration format used by the Kafka binary distribution, should receive a particular attention. Log4j Core 2.x supports four native configuration formats (XML, JS

Re: [PR] [Docs] Update site for 3.8.1 [kafka-site]

jlprat merged PR #635: URL: https://github.com/apache/kafka-site/pull/635 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@kafka.apache.o

[jira] [Resolved] (KAFKA-15961) Flaky test: testTopicIdPersistsThroughControllerRestart() – kafka.controller.ControllerIntegrationTest

[ https://issues.apache.org/jira/browse/KAFKA-15961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apoorv Mittal resolved KAFKA-15961. --- Resolution: Won't Fix Marking ZK failed test as won't fix. > Flaky test: testTopicIdPersis

Re: [VOTE] 3.9.0 RC5

Hey Colin, Thanks for the new RC. I've tested the --feature functionality that was missing before. Seems to be working as expected now. As a side note, I was looking into how to configure kip-853 and it took me a moment to find the instructions in the documentation, I wonder if it could be include

Re: [VOTE] 3.9.0 RC5

Thanks, Anton. And thanks Chia-Ping Tsai for taking a look at how we can improve the docs here... best, Colin On Tue, Oct 29, 2024, at 02:39, Anton Agestam wrote: > Hi Chia-Ping, > > Thanks for pointing those two fields out. I retract my -1. > > Cheers, > Anton > > Den sön 27 okt. 2024 kl 17:40

[jira] [Created] (KAFKA-17898) Seperate Epoch Bump Scenarios and Error Handling in TV2

Ritika Reddy created KAFKA-17898: Summary: Seperate Epoch Bump Scenarios and Error Handling in TV2 Key: KAFKA-17898 URL: https://issues.apache.org/jira/browse/KAFKA-17898 Project: Kafka Issue

Re: Configuration format for Log4j Core 2.x

Thanks for starting this discussion, Piotr! I think moving towards a more modern format for our logging config would be great. Personally, I think YAML would be the nicest to work with as an operator. It should also be very familiar to those who work in Docker and Kubernetes. A few thoughts 1. T

[jira] [Resolved] (KAFKA-17128) Make node.id immutable after removing zookeeper migration

[ https://issues.apache.org/jira/browse/KAFKA-17128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17128. Fix Version/s: 4.0.0 Resolution: Fixed > Make node.id immutable after removing zook

[jira] [Created] (KAFKA-17893) Support record keys in the foreignKeyExtractor argument of KTable foreign join

Piotr Jaszkowski created KAFKA-17893: Summary: Support record keys in the foreignKeyExtractor argument of KTable foreign join Key: KAFKA-17893 URL: https://issues.apache.org/jira/browse/KAFKA-17893

Re: [ANNOUNCE] Apache Kafka 3.8.1

Thanks Josep for all the hard work for the release. Regards, Apoorv Mittal On Tue, Oct 29, 2024 at 2:51 PM Mickael Maison wrote: > Thanks Josep for running this release! > > Mickael > > On Tue, Oct 29, 2024 at 3:23 PM Josep Prat wrote: > > > > The Apache Kafka community is pleased to announc

Re: Configuration format for Log4j Core 2.x

Hi David, On 29.10.2024 16:30, David Arthur wrote: 2. How do we determine which type of config file has been given? Do we try to infer it based on file extension? What is the behavior if both old and new files exist? I believe that the current PR[1] shows the correct behavior. Upgraded system

[jira] [Created] (KAFKA-17895) Expose KeyValueStore's approximateNumEntries as a metric

Clément MATHIEU created KAFKA-17895: --- Summary: Expose KeyValueStore's approximateNumEntries as a metric Key: KAFKA-17895 URL: https://issues.apache.org/jira/browse/KAFKA-17895 Project: Kafka

Re: [PR] MINOR: Move 3.8.0 to archived releases [kafka-site]

jlprat merged PR #638: URL: https://github.com/apache/kafka-site/pull/638 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@kafka.apache.o

[ANNOUNCE] Apache Kafka 3.8.1

The Apache Kafka community is pleased to announce the release for Apache Kafka 3.8.1 This is a bug fix release and it includes fixes and improvements. All of the changes in this release can be found in the release notes: https://www.apache.org/dist/kafka/3.8.1/RELEASE_NOTES.html An overview of

[jira] [Created] (KAFKA-17896) Create Admin.describeClassicGroups

Andrew Schofield created KAFKA-17896: Summary: Create Admin.describeClassicGroups Key: KAFKA-17896 URL: https://issues.apache.org/jira/browse/KAFKA-17896 Project: Kafka Issue Type: Sub-ta

[jira] [Resolved] (KAFKA-16248) Kafka consumer should cache leader offset ranges

[ https://issues.apache.org/jira/browse/KAFKA-16248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alieh Saeedi resolved KAFKA-16248. -- Resolution: Fixed > Kafka consumer should cache leader offset ranges > ---

Re: [ANNOUNCE] Apache Kafka 3.8.1

Hello Josep Thanks for hard working on running this release! Best regards, Jiunn-Yang > TengYao Chi 於 2024年10月30日 凌晨12:35 寫道： > > Hi Josep > Thanks for running this release > > Cheers, > TengYao > > Apoorv Mittal 於 2024年10月30日 週三 上午12:18寫道： > >> Thanks Josep for all the hard work for the r

[jira] [Created] (KAFKA-17897) Deprecate Admin.listConsumerGroups

Andrew Schofield created KAFKA-17897: Summary: Deprecate Admin.listConsumerGroups Key: KAFKA-17897 URL: https://issues.apache.org/jira/browse/KAFKA-17897 Project: Kafka Issue Type: Sub-ta

[PR] MINOR: Move 3.8.0 to archived releases [kafka-site]

jlprat opened a new pull request, #638: URL: https://github.com/apache/kafka-site/pull/638 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-ma

Re: [PR] MINOR: Move 3.8.0 to archived releases [kafka-site]

jlprat commented on PR #638: URL: https://github.com/apache/kafka-site/pull/638#issuecomment-2444510344 ping @mimaison -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u

Re: [ANNOUNCE] Apache Kafka 3.8.1

Hi Josep Thanks for running this release Cheers, TengYao Apoorv Mittal 於 2024年10月30日 週三 上午12:18寫道： > Thanks Josep for all the hard work for the release. > > Regards, > Apoorv Mittal > > > > On Tue, Oct 29, 2024 at 2:51 PM Mickael Maison > wrote: > > > Thanks Josep for running this release! > >

[jira] [Created] (KAFKA-17894) Additional metrics for cooperative consumption

Apoorv Mittal created KAFKA-17894: - Summary: Additional metrics for cooperative consumption Key: KAFKA-17894 URL: https://issues.apache.org/jira/browse/KAFKA-17894 Project: Kafka Issue Type:

Re: [PR] MINOR: Move 3.8.0 to archived releases [kafka-site]

mimaison commented on code in PR #638: URL: https://github.com/apache/kafka-site/pull/638#discussion_r1821100757 ## downloads.html: ## @@ -145,6 +110,41 @@ 3.6.2Archived releases + +3.8.0 + + +Released Jul

[jira] [Created] (KAFKA-17892) Update README after migration to log4j2

TengYao Chi created KAFKA-17892: --- Summary: Update README after migration to log4j2 Key: KAFKA-17892 URL: https://issues.apache.org/jira/browse/KAFKA-17892 Project: Kafka Issue Type: Improvement

Re: [PR] [DOCS] Update Javadoc 3.8.1 [kafka-site]

jlprat merged PR #636: URL: https://github.com/apache/kafka-site/pull/636 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@kafka.apache.o

[DISCUSS] KIP-1103: Additional metrics for cooperative consumption

Hi Everyone, I would like to start a discussion on KIP-1103: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1103%3A+Additional+metrics+for+cooperative+consumption This KIP extends KIP-932 to provide additional metrics for Queues/Cooperative consumption. Regards, Apoorv Mittal

Re: [PR] [Docs] Update site for 3.8.1 [kafka-site]

jlprat commented on PR #635: URL: https://github.com/apache/kafka-site/pull/635#issuecomment-2444520341 Here there is the PR: https://github.com/apache/kafka-site/pull/638 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and us

Re: [PR] [Docs] Update site for 3.8.1 [kafka-site]

jlprat commented on PR #635: URL: https://github.com/apache/kafka-site/pull/635#issuecomment-295088 I guess so. As 3.8.1 superseeded 3.8.0. I'll push a PR changing it -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [ANNOUNCE] Apache Kafka 3.8.1

Thanks Josep for running this release! Mickael On Tue, Oct 29, 2024 at 3:23 PM Josep Prat wrote: > > The Apache Kafka community is pleased to announce the release for > Apache Kafka 3.8.1 > > This is a bug fix release and it includes fixes and improvements. > > All of the changes in this release

Re: [PR] MINOR: Move 3.8.0 to archived releases [kafka-site]

jlprat commented on code in PR #638: URL: https://github.com/apache/kafka-site/pull/638#discussion_r1821110671 ## downloads.html: ## @@ -145,6 +110,41 @@ 3.6.2Archived releases + +3.8.0 + + +Released July

Re: [DISCUSS] KIP-1058: Txn consumer exerts pressure on remote storage when reading non-txn topic

A few more points to discuss (please add to the KIP as well) 5. How are we determining the value of the TrxIndexEmpty field on segment rotation? One option is to do a boolean txnIdxEmpty = segment.txnIndex().allAbortedTxns().isEmpty() but this will have an overhead of reading the contents of the

Re: [PR] [Docs] Update site for 3.8.1 [kafka-site]

mimaison commented on PR #635: URL: https://github.com/apache/kafka-site/pull/635#issuecomment-267996 Should we move 3.8.0 out of the supported releases? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

Re: [DISCUSS] KIP-1091: Improved Kafka Streams operator metrics

Hi Bill, Thanks for the KIP. I have a request, can we please define MBean and telemetry names for the new metrics so it's easier to see where they will be added (group, tags etc.) Regards, Apoorv Mittal On Tue, Oct 29, 2024 at 5:15 AM Sophie Blee-Goldman wrote: > Hey Bill, > > Thanks for the K

Re: [VOTE] 3.9.0 RC2

On Tue, Oct 29, 2024, at 02:38, Anton Agestam wrote: > > Because rather than forcing API designers to specify good defaults, > [implicit defaults] force protocol implementers to inject bad defaults. > > The good examples from this thread are host and port, empty string is not a > valid hostname, a

Re: [DISCUSS] Require KIPs to include "How to teach this section"

Hi Anton, Perhaps there should be a "documentation" section in the KIP template? That might help raise awareness of the need to document these changes. I want to add, in the case of the wire protocol, the KIPs themselves are part of the documentation. But they shouldn't be all of the documentat

Re: [VOTE] 3.8.1 RC1

Hi all, Thanks to all the reviewers! This vote passes with 7 +1 votes (3 bindings) and no 0 or -1 votes. +1 votes PMC Members: * Mickael Maison * Luke Chen * Chia-Ping Tsai Community: * TengYao Chi * Jiunn-Yang * Federico Valeri * Jakub Scholz 0 votes * No votes -1 votes * No votes I'll conti

Re: [VOTE] KIP-1043: Administration of groups

Thanks for the KIP and the good discussion. +1 (binding) Best, DJ On Wed, Oct 2, 2024 at 3:16 AM David Arthur wrote: > +1 binding > > Cheers, > David A > > On Mon, Sep 23, 2024 at 6:43 AM Apoorv Mittal > wrote: > > > Hi Andrew, > > Thanks for the KIP, this will be very helpful. > > > > +1 (non

Re: [VOTE] 3.9.0 RC5

Hi Chia-Ping, Thanks for pointing those two fields out. I retract my -1. Cheers, Anton Den sön 27 okt. 2024 kl 17:40 skrev Chia-Ping Tsai : > hi Anton > > Thanks for sharing your insights on Kafka serialization—it’s really cool > and interesting to me. Additionally, you inspired me to file a JI

Re: [VOTE] 3.9.0 RC2

Hi, Chia-Ping shared in the RC5 thread now two cases where the behavior under discussion actually exists prior to 3.9 so all my arguments here are moot. I missed those two cases because they have the same name as the struct introduced in 3.9, and my regex excluded that by name when I was looking f

Re: [VOTE] 3.9.0 RC5

Hi Colin, I was trying to test the RC, but I found the artifacts in Maven artifacts to be voted upon are not up-to-date. Not only the "Last Modified" time in the 3.9.0 artifacts are on Oct. 10, but also the source code in the artifacts didn't include the latest commits in RC5 here

[jira] [Resolved] (KAFKA-17804) optimize ReplicaManager.completeDelayedOperationsWhenNotPartitionLeader

[ https://issues.apache.org/jira/browse/KAFKA-17804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-17804. - Resolution: Won't Fix > optimize ReplicaManager.completeDelayedOperationsWhenNotPartitionLeader > --

Re: [VOTE] KIP-1043: Administration of groups

This concludes the vote for KIP-1043. The KIP is now ACCEPTED. +1 (binding): David Jacot, Lianet Magrans, Lucas Brutschy, David Arthur +1 (non-binding): Apoorv Mittal I aim to get it implemented in Apache Kafka 4.0. Thanks, Andrew From: David Jacot Sent