Re: [PR] KAFKA-15045: (KIP-924 pt. 26) Only assign changelogged standbys by default [kafka]

2024-06-14 Thread via GitHub
ableegoldman merged PR #16331: URL: https://github.com/apache/kafka/pull/16331 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.ap

Re: [PR] KAFKA-16637: AsyncKafkaConsumer removes offset fetch responses from cache too aggressively [kafka]

2024-06-14 Thread via GitHub
jlprat commented on PR #16310: URL: https://github.com/apache/kafka/pull/16310#issuecomment-2167378623 Hi @kirktrue. Let's check again when the PR is approved :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] KAFKA-16713: Define initial set of RPCs for KIP-932 [kafka]

2024-06-14 Thread via GitHub
chia7712 commented on code in PR #16022: URL: https://github.com/apache/kafka/pull/16022#discussion_r1639374094 ## clients/src/main/java/org/apache/kafka/common/requests/ShareFetchResponse.java: ## @@ -0,0 +1,212 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[jira] [Created] (KAFKA-16956) Broker-side ability to subscribe to record delete events

2024-06-14 Thread Luke Chen (Jira)
Luke Chen created KAFKA-16956: - Summary: Broker-side ability to subscribe to record delete events Key: KAFKA-16956 URL: https://issues.apache.org/jira/browse/KAFKA-16956 Project: Kafka Issue Type

[jira] [Updated] (KAFKA-16956) Broker-side ability to subscribe to record delete events

2024-06-14 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen updated KAFKA-16956: -- Labels: need-kip (was: ) > Broker-side ability to subscribe to record delete events > ---

Re: [PR] KAFKA-15838: ExtractField and InsertField NULL Values are replaced by default value even in NULLABLE fields [kafka]

2024-06-14 Thread via GitHub
mfvitale commented on PR #15756: URL: https://github.com/apache/kafka/pull/15756#issuecomment-2167438478 > @mfvitale Merge-able, I don't know yet, but we can start reviewing it :) ;-) > This is not a candidate for 3.8 as we're now past code freeze. Also the KIP only got 3 bindi

Re: [PR] MINOR: migrate DescribeConsumerGroupTest to use ClusterTestExtensions [kafka]

2024-06-14 Thread via GitHub
FrankYang0529 commented on code in PR #15908: URL: https://github.com/apache/kafka/pull/15908#discussion_r1639415070 ## tools/src/test/java/org/apache/kafka/tools/consumer/group/DescribeConsumerGroupTest.java: ## @@ -16,834 +16,986 @@ */ package org.apache.kafka.tools.consume

Re: [PR] MINOR: migrate DescribeConsumerGroupTest to use ClusterTestExtensions [kafka]

2024-06-14 Thread via GitHub
FrankYang0529 commented on code in PR #15908: URL: https://github.com/apache/kafka/pull/15908#discussion_r1639418996 ## tools/src/test/java/org/apache/kafka/tools/consumer/group/DescribeConsumerGroupTest.java: ## @@ -16,834 +16,986 @@ */ package org.apache.kafka.tools.consume

Re: [PR] KAFKA-15045: (KIP-924 pt. 26) Only assign changelogged standbys by default [kafka]

2024-06-14 Thread via GitHub
ableegoldman commented on PR #16331: URL: https://github.com/apache/kafka/pull/16331#issuecomment-2167453864 Test failures are unrelated Merged to trunk and cherrypicked to 3.8 cc @jlprat -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [PR] MINOR: Add integration tag to AdminFenceProducersIntegrationTest [kafka]

2024-06-14 Thread via GitHub
edoardocomar commented on PR #16326: URL: https://github.com/apache/kafka/pull/16326#issuecomment-2167486809 @C0urante it was only not to make noise on the release(s). Quite happy to cherry-pick -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [PR] MINOR: Add integration tag to AdminFenceProducersIntegrationTest [kafka]

2024-06-14 Thread via GitHub
edoardocomar commented on PR #16326: URL: https://github.com/apache/kafka/pull/16326#issuecomment-2167489841 I just thought we're past the deadline and making noise for such a small change was not worth it. Of course I'd prefer to have consistent code for this test class -- This is an au

Re: [PR] KAFKA-10190: Set dynamic broker configs for entity default [kafka]

2024-06-14 Thread via GitHub
chia7712 commented on code in PR #16280: URL: https://github.com/apache/kafka/pull/16280#discussion_r1639460364 ## core/src/main/scala/kafka/server/ConfigHandler.scala: ## @@ -239,19 +239,24 @@ class BrokerConfigHandler(private val brokerConfig: KafkaConfig, def processCon

Re: [PR] KAFKA-16942 Use ConcurrentHashMap in RecordAccumulator#nodeStats [kafka]

2024-06-14 Thread via GitHub
chia7712 commented on PR #16305: URL: https://github.com/apache/kafka/pull/16305#issuecomment-2167528614 > Test with writePercentage 0.01 (100 times of computeIfAbsent) and 0.0001 (10 times of computeIfAbsent), though there is not much difference under 0.0001, ConcurrentHashMap still perfor

Re: [PR] KAFKA-16942 Use ConcurrentHashMap in RecordAccumulator#nodeStats [kafka]

2024-06-14 Thread via GitHub
brandboat closed pull request #16305: KAFKA-16942 Use ConcurrentHashMap in RecordAccumulator#nodeStats URL: https://github.com/apache/kafka/pull/16305 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] KAFKA-16942 Use ConcurrentHashMap in RecordAccumulator#nodeStats [kafka]

2024-06-14 Thread via GitHub
brandboat commented on PR #16305: URL: https://github.com/apache/kafka/pull/16305#issuecomment-2167536819 > If there is no much benefit to use ConcurrentHashMap, maybe we should keep using CopyOnWriteMap for consistency I'm fine with this one, indeed it is a bit weird to keep both Cop

[jira] [Resolved] (KAFKA-16942) Use ConcurrentHashMap in RecordAccumulator#nodeStats

2024-06-14 Thread Kuan Po Tseng (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuan Po Tseng resolved KAFKA-16942. --- Resolution: Won't Do The performance in get method is not obvious between ConcurrentHashMap

Re: [PR] KAFKA-12708 Rewrite org.apache.kafka.test.Microbenchmarks by JMH [kafka]

2024-06-14 Thread via GitHub
chia7712 merged PR #16231: URL: https://github.com/apache/kafka/pull/16231 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

[jira] [Resolved] (KAFKA-12708) Rewrite org.apache.kafka.test.Microbenchmarks by JMH

2024-06-14 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-12708. Fix Version/s: 3.9.0 Resolution: Fixed > Rewrite org.apache.kafka.test.Microbenchma

Re: [PR] MINOR: Simplify `GroupMetadataManager#toTopicPartitions` by using `ConsumerProtocolSubscription` instead of `ConsumerPartitionAssignor.Subscription` [kafka]

2024-06-14 Thread via GitHub
dajac commented on code in PR #16309: URL: https://github.com/apache/kafka/pull/16309#discussion_r1639492866 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/GroupMetadataManager.java: ## @@ -1648,9 +1650,11 @@ private CoordinatorResult classicGroupJoinToCo

[jira] [Resolved] (KAFKA-16673) Optimize toTopicPartitions with ConsumerProtocolSubscription

2024-06-14 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16673. - Fix Version/s: 3.8.0 Resolution: Duplicate This was done as part of https://github.com/ap

[jira] [Reopened] (KAFKA-16673) Optimize toTopicPartitions with ConsumerProtocolSubscription

2024-06-14 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot reopened KAFKA-16673: - > Optimize toTopicPartitions with ConsumerProtocolSubscription > ---

[jira] [Updated] (KAFKA-16673) Optimize toTopicPartitions with ConsumerProtocolSubscription

2024-06-14 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-16673: Fix Version/s: (was: 3.8.0) > Optimize toTopicPartitions with ConsumerProtocolSubscription > -

[jira] (KAFKA-16673) Optimize toTopicPartitions with ConsumerProtocolSubscription

2024-06-14 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16673 ] David Jacot deleted comment on KAFKA-16673: - was (Author: dajac): This was done as part of https://github.com/apache/kafka/pull/15785. > Optimize toTopicPartitions with ConsumerProtocolSubsc

[jira] [Resolved] (KAFKA-16674) Adjust classicGroupJoinToConsumerGroup to add subscription model

2024-06-14 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16674. - Resolution: Fixed This was done in https://github.com/apache/kafka/pull/15785. > Adjust classic

[jira] [Resolved] (KAFKA-16317) Add event rate in GroupCoordinatorRuntimeMetrics

2024-06-14 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16317. - Resolution: Won't Do > Add event rate in GroupCoordinatorRuntimeMetrics > --

Re: [PR] KAFKA-16673: Simplify `GroupMetadataManager#toTopicPartitions` by using `ConsumerProtocolSubscription` instead of `ConsumerPartitionAssignor.Subscription` [kafka]

2024-06-14 Thread via GitHub
chia7712 commented on PR #16309: URL: https://github.com/apache/kafka/pull/16309#issuecomment-2167576802 It seems we can apply this simplification to following code, since the protocol data can offer all required info https://github.com/apache/kafka/blob/888a17760347223614da9243dc375

Re: [PR] KAFKA-12670: KRaft support for unclean.leader.election.enable [kafka]

2024-06-14 Thread via GitHub
showuon commented on code in PR #16284: URL: https://github.com/apache/kafka/pull/16284#discussion_r1636434931 ## metadata/src/main/java/org/apache/kafka/controller/ConfigurationControlManager.java: ## @@ -495,8 +496,19 @@ void deleteTopicConfigs(String name) { configDa

Re: [PR] KAFKA-12670: KRaft support for unclean.leader.election.enable [kafka]

2024-06-14 Thread via GitHub
showuon commented on code in PR #16284: URL: https://github.com/apache/kafka/pull/16284#discussion_r1636432727 ## metadata/src/main/java/org/apache/kafka/controller/ReplicationControlManager.java: ## @@ -2093,6 +2116,50 @@ Optional changePartitionReassignment(TopicIdPartition t

Re: [PR] KAFKA-16192: Introduce transaction.version and usage of flexible records to coordinators [kafka]

2024-06-14 Thread via GitHub
dajac commented on code in PR #16183: URL: https://github.com/apache/kafka/pull/16183#discussion_r1639511150 ## core/src/main/scala/kafka/coordinator/transaction/TransactionStateManager.scala: ## @@ -618,7 +624,7 @@ class TransactionStateManager(brokerId: Int, // generate

Re: [PR] KAFKA-16570 FenceProducers API returns "unexpected error" when succes… [kafka]

2024-06-14 Thread via GitHub
showuon commented on PR #16229: URL: https://github.com/apache/kafka/pull/16229#issuecomment-2167585352 @edoardocomar , this PR causes compilation error in 3.7 CI. Could you help take a look? https://ci-builds.apache.org/blue/organizations/jenkins/Kafka%2Fkafka/detail/3.7/177/pipeline

Re: [PR] KAFKA-16673: Simplify `GroupMetadataManager#toTopicPartitions` by using `ConsumerProtocolSubscription` instead of `ConsumerPartitionAssignor.Subscription` [kafka]

2024-06-14 Thread via GitHub
dajac commented on PR #16309: URL: https://github.com/apache/kafka/pull/16309#issuecomment-2167587707 > It seems we can apply this simplification to following code, since the protocol data can offer all required info > > https://github.com/apache/kafka/blob/888a17760347223614da9243dc

[jira] [Created] (KAFKA-16957) Enable KafkaConsumerTest#configurableObjectsShouldSeeGeneratedClientId to work with CLASSIC and CONSUMER

2024-06-14 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-16957: -- Summary: Enable KafkaConsumerTest#configurableObjectsShouldSeeGeneratedClientId to work with CLASSIC and CONSUMER Key: KAFKA-16957 URL: https://issues.apache.org/jira/browse

[jira] [Commented] (KAFKA-16957) Enable KafkaConsumerTest#configurableObjectsShouldSeeGeneratedClientId to work with CLASSIC and CONSUMER

2024-06-14 Thread Chia Chuan Yu (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17855001#comment-17855001 ] Chia Chuan Yu commented on KAFKA-16957: --- Hi, [~chia7712]  Can I have this? thanks

[jira] [Assigned] (KAFKA-16957) Enable KafkaConsumerTest#configurableObjectsShouldSeeGeneratedClientId to work with CLASSIC and CONSUMER

2024-06-14 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai reassigned KAFKA-16957: -- Assignee: Chia Chuan Yu (was: Chia-Ping Tsai) > Enable KafkaConsumerTest#configurabl

Re: [PR] KAFKA-16637: AsyncKafkaConsumer removes offset fetch responses from cache too aggressively [kafka]

2024-06-14 Thread via GitHub
cadonna commented on code in PR #16310: URL: https://github.com/apache/kafka/pull/16310#discussion_r1639493007 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AsyncKafkaConsumer.java: ## @@ -1666,23 +1668,68 @@ private boolean initWithCommittedOffsetsIfNeede

Re: [PR] KAFKA-16933: New consumer unsubscribe close commit fixes [kafka]

2024-06-14 Thread via GitHub
philipnee commented on code in PR #16272: URL: https://github.com/apache/kafka/pull/16272#discussion_r1639205859 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AsyncKafkaConsumer.java: ## @@ -1512,7 +1513,9 @@ public void unsubscribe() { }

Re: [PR] KAFKA-16669: Remove extra collection copy when generating DescribeAclsResource [kafka]

2024-06-14 Thread via GitHub
chia7712 commented on PR #15924: URL: https://github.com/apache/kafka/pull/15924#issuecomment-2167621969 @chiacyu any update? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] KAFKA-16936 : Upgrade slf4j, sys property for provider [kafka]

2024-06-14 Thread via GitHub
muralibasani commented on code in PR #16324: URL: https://github.com/apache/kafka/pull/16324#discussion_r1639541717 ## gradle/dependencies.gradle: ## @@ -237,14 +237,14 @@ libs += [ pcollections: "org.pcollections:pcollections:$versions.pcollections", opentelemetryProto:

[jira] [Commented] (KAFKA-16550) add integration test for LogDirsCommand

2024-06-14 Thread PoAn Yang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17855004#comment-17855004 ] PoAn Yang commented on KAFKA-16550: --- Hi [~targetoee], are you working on this? If not,

Re: [PR] KAFKA-16936 : Upgrade slf4j, sys property for provider [kafka]

2024-06-14 Thread via GitHub
muralibasani commented on code in PR #16324: URL: https://github.com/apache/kafka/pull/16324#discussion_r1639543009 ## bin/kafka-run-class.sh: ## @@ -243,6 +243,14 @@ fi (( WINDOWS_OS_FORMAT )) && LOG_DIR=$(cygpath --path --mixed "${LOG_DIR}") KAFKA_LOG4J_CMD_OPTS="-Dkafka.log

[jira] [Assigned] (KAFKA-16550) add integration test for LogDirsCommand

2024-06-14 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai reassigned KAFKA-16550: -- Assignee: PoAn Yang (was: JiaChi Wang) > add integration test for LogDirsCommand > -

Re: [PR] KAFKA-16638 Align the naming convention for config and default variables in *Config classes [kafka]

2024-06-14 Thread via GitHub
chia7712 commented on PR #16289: URL: https://github.com/apache/kafka/pull/16289#issuecomment-2167630992 @EricLuGHub could you please fix the conflicts? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Created] (KAFKA-16958) add `STRICT_STUBS` to `EndToEndLatencyTest`, `OffsetCommitCallbackInvokerTest`, `ProducerPerformanceTest`, and `TopologyTest`

2024-06-14 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-16958: -- Summary: add `STRICT_STUBS` to `EndToEndLatencyTest`, `OffsetCommitCallbackInvokerTest`, `ProducerPerformanceTest`, and `TopologyTest` Key: KAFKA-16958 URL: https://issues.apa

[jira] [Updated] (KAFKA-16958) add `STRICT_STUBS` to `EndToEndLatencyTest`, `OffsetCommitCallbackInvokerTest`, `ProducerPerformanceTest`, and `TopologyTest`

2024-06-14 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai updated KAFKA-16958: --- Description: They all need `@MockitoSettings(strictness = Strictness.STRICT_STUBS)` (was: a

[jira] [Commented] (KAFKA-16958) add `STRICT_STUBS` to `EndToEndLatencyTest`, `OffsetCommitCallbackInvokerTest`, `ProducerPerformanceTest`, and `TopologyTest`

2024-06-14 Thread dujian0068 (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17855012#comment-17855012 ] dujian0068 commented on KAFKA-16958: Hello: Can you assign this task to me? > add

Re: [PR] KAFKA-15853: Move configDef out of core [kafka]

2024-06-14 Thread via GitHub
OmniaGM commented on code in PR #16116: URL: https://github.com/apache/kafka/pull/16116#discussion_r1639569549 ## transaction-coordinator/src/main/java/org/apache/kafka/coordinator/transaction/TransactionLogConfigs.java: ## @@ -51,4 +60,16 @@ public final class TransactionLogCon

Re: [PR] KAFKA-15853: Move configDef out of core [kafka]

2024-06-14 Thread via GitHub
OmniaGM commented on code in PR #16116: URL: https://github.com/apache/kafka/pull/16116#discussion_r1639570221 ## transaction-coordinator/src/main/java/org/apache/kafka/coordinator/transaction/TransactionLogConfigs.java: ## @@ -51,4 +60,16 @@ public final class TransactionLogCon

Re: [PR] KAFKA-15259: Processing must continue with flush + commitTnx [kafka]

2024-06-14 Thread via GitHub
aliehsaeedii commented on code in PR #16332: URL: https://github.com/apache/kafka/pull/16332#discussion_r1639578562 ## clients/src/main/java/org/apache/kafka/clients/producer/KafkaProducer.java: ## @@ -1220,6 +1223,7 @@ private void ensureValidRecordSize(int size) { * of f

Re: [PR] KAFKA-15259: Processing must continue with flush + commitTnx [kafka]

2024-06-14 Thread via GitHub
aliehsaeedii commented on PR #16332: URL: https://github.com/apache/kafka/pull/16332#issuecomment-2167688944 @C0urante It would be nice if you took a look. Instead of implementing a custom handler for Producer (as suggested in KIP-1038), we came up with the idea of allowing the user to st

Re: [PR] KAFKA-15259: Processing must continue with flush + commitTnx [kafka]

2024-06-14 Thread via GitHub
aliehsaeedii commented on code in PR #16332: URL: https://github.com/apache/kafka/pull/16332#discussion_r1639578562 ## clients/src/main/java/org/apache/kafka/clients/producer/KafkaProducer.java: ## @@ -1220,6 +1223,7 @@ private void ensureValidRecordSize(int size) { * of f

[jira] [Assigned] (KAFKA-16958) add `STRICT_STUBS` to `EndToEndLatencyTest`, `OffsetCommitCallbackInvokerTest`, `ProducerPerformanceTest`, and `TopologyTest`

2024-06-14 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai reassigned KAFKA-16958: -- Assignee: dujian0068 (was: Chia-Ping Tsai) > add `STRICT_STUBS` to `EndToEndLatencyT

[jira] [Commented] (KAFKA-16958) add `STRICT_STUBS` to `EndToEndLatencyTest`, `OffsetCommitCallbackInvokerTest`, `ProducerPerformanceTest`, and `TopologyTest`

2024-06-14 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17855017#comment-17855017 ] Chia-Ping Tsai commented on KAFKA-16958: sure > add `STRICT_STUBS` to `EndToEn

Re: [PR] MINOR: Add integration tag to AdminFenceProducersIntegrationTest [kafka]

2024-06-14 Thread via GitHub
C0urante commented on PR #16326: URL: https://github.com/apache/kafka/pull/16326#issuecomment-2167702484 👍 I think it makes sense to cherry-pick -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

Re: [PR] MINOR: Add integration tag to AdminFenceProducersIntegrationTest [kafka]

2024-06-14 Thread via GitHub
jlprat commented on PR #16326: URL: https://github.com/apache/kafka/pull/16326#issuecomment-2167708048 It makes sense to cherry pick this one to 3.8 for sure. Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] KAFKA-16948: Reset tier lag metrics on becoming follower [kafka]

2024-06-14 Thread via GitHub
jlprat commented on PR #16321: URL: https://github.com/apache/kafka/pull/16321#issuecomment-2167758040 Yes it is fine to add to the 3.8 branch. Can you cherry pick this one? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [PR] Unit Test for stripDotPathComponents method in shell [kafka]

2024-06-14 Thread via GitHub
chia7712 commented on PR #16259: URL: https://github.com/apache/kafka/pull/16259#issuecomment-2167760107 @ardada2468 As you have filed a jira, please add jira number to the title. for example: `KAFKA-16923 New Unit Test for stripDotPathComponents method` -- This is an automated message fr

Re: [PR] MINOR: migrate DescribeConsumerGroupTest to use ClusterTestExtensions [kafka]

2024-06-14 Thread via GitHub
FrankYang0529 commented on PR #15908: URL: https://github.com/apache/kafka/pull/15908#issuecomment-2167763518 Hi @chia7712 and @TaiJuWu, I addressed all comments. May you take a look again? Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, ple

[jira] [Commented] (KAFKA-16900) kafka-producer-perf-test reports error when using transaction.

2024-06-14 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17855032#comment-17855032 ] Chia-Ping Tsai commented on KAFKA-16900: Maybe we should enable transaction if e

Re: [PR] KAFKA-16948: Reset tier lag metrics on becoming follower [kafka]

2024-06-14 Thread via GitHub
satishd commented on PR #16321: URL: https://github.com/apache/kafka/pull/16321#issuecomment-2167776223 Merged to 3.8 branch. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] KAFKA-16921: migrate connect module to junit 5 [kafka]

2024-06-14 Thread via GitHub
FrankYang0529 commented on PR #16328: URL: https://github.com/apache/kafka/pull/16328#issuecomment-216113 Hi @chia7712, thanks for your review. I addressed all comments. May you take a look? Thank you. -- This is an automated message from the Apache Git Service. To respond to the mess

Re: [PR] KAFKA-16713: Define initial set of RPCs for KIP-932 [kafka]

2024-06-14 Thread via GitHub
apoorvmittal10 commented on code in PR #16022: URL: https://github.com/apache/kafka/pull/16022#discussion_r1639658963 ## clients/src/main/java/org/apache/kafka/common/requests/ShareFetchResponse.java: ## @@ -0,0 +1,212 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

Re: [PR] KAFKA-16933: New consumer unsubscribe close commit fixes [kafka]

2024-06-14 Thread via GitHub
lucasbru merged PR #16272: URL: https://github.com/apache/kafka/pull/16272 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

Re: [PR] KAFKA-16713: Define initial set of RPCs for KIP-932 [kafka]

2024-06-14 Thread via GitHub
AndrewJSchofield commented on code in PR #16022: URL: https://github.com/apache/kafka/pull/16022#discussion_r1639666418 ## clients/src/main/java/org/apache/kafka/common/requests/ShareFetchResponse.java: ## @@ -0,0 +1,212 @@ +/* + * Licensed to the Apache Software Foundation (ASF

Re: [PR] KAFKA-16933: New consumer unsubscribe close commit fixes [kafka]

2024-06-14 Thread via GitHub
lucasbru commented on PR #16272: URL: https://github.com/apache/kafka/pull/16272#issuecomment-2167800843 Test failures are unrelated Merged to trunk and cherrypicked to 3.8 cc @jlprat -- This is an automated message from the Apache Git Service. To respond to the message, please log

Re: [PR] KAFKA-10190: Set dynamic broker configs for entity default [kafka]

2024-06-14 Thread via GitHub
harryfallows commented on code in PR #16280: URL: https://github.com/apache/kafka/pull/16280#discussion_r1639672823 ## core/src/main/scala/kafka/server/ConfigHandler.scala: ## @@ -239,19 +239,24 @@ class BrokerConfigHandler(private val brokerConfig: KafkaConfig, def proces

Re: [PR] KAFKA-10190: Set dynamic broker configs for entity default [kafka]

2024-06-14 Thread via GitHub
harryfallows commented on code in PR #16280: URL: https://github.com/apache/kafka/pull/16280#discussion_r1639672823 ## core/src/main/scala/kafka/server/ConfigHandler.scala: ## @@ -239,19 +239,24 @@ class BrokerConfigHandler(private val brokerConfig: KafkaConfig, def proces

Re: [PR] KAFKA-10190: Set dynamic broker configs for entity default [kafka]

2024-06-14 Thread via GitHub
harryfallows commented on code in PR #16280: URL: https://github.com/apache/kafka/pull/16280#discussion_r1639672823 ## core/src/main/scala/kafka/server/ConfigHandler.scala: ## @@ -239,19 +239,24 @@ class BrokerConfigHandler(private val brokerConfig: KafkaConfig, def proces

Re: [PR] KAFKA-10190: Set dynamic broker configs for entity default [kafka]

2024-06-14 Thread via GitHub
harryfallows commented on code in PR #16280: URL: https://github.com/apache/kafka/pull/16280#discussion_r1639672823 ## core/src/main/scala/kafka/server/ConfigHandler.scala: ## @@ -239,19 +239,24 @@ class BrokerConfigHandler(private val brokerConfig: KafkaConfig, def proces

Re: [PR] MINOR: Update 3.8 documentation for Kafka Streams [kafka]

2024-06-14 Thread via GitHub
lucasbru commented on code in PR #16265: URL: https://github.com/apache/kafka/pull/16265#discussion_r1639679771 ## docs/streams/upgrade-guide.html: ## @@ -134,11 +134,38 @@ < Streams API changes in 3.8.0 + + +Kafka Streams now supports customizable task

Re: [PR] KAFKA-16747: Implemented share sessions and contexts for share fetch requests [kafka]

2024-06-14 Thread via GitHub
omkreddy merged PR #16263: URL: https://github.com/apache/kafka/pull/16263 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

[jira] [Created] (KAFKA-16959) ConfigCommand should not allow to define both `entity-default` and `entity-name`

2024-06-14 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-16959: -- Summary: ConfigCommand should not allow to define both `entity-default` and `entity-name` Key: KAFKA-16959 URL: https://issues.apache.org/jira/browse/KAFKA-16959

[jira] [Resolved] (KAFKA-16747) Implement share sessions and context

2024-06-14 Thread Abhinav Dixit (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhinav Dixit resolved KAFKA-16747. --- Resolution: Fixed > Implement share sessions and context > -

[jira] [Assigned] (KAFKA-16954) Move consumer leave operations on close to background thread

2024-06-14 Thread Lianet Magrans (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianet Magrans reassigned KAFKA-16954: -- Assignee: Lianet Magrans > Move consumer leave operations on close to background thre

[jira] [Updated] (KAFKA-16954) Move consumer leave operations on close to background thread

2024-06-14 Thread Lianet Magrans (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianet Magrans updated KAFKA-16954: --- Priority: Blocker (was: Major) > Move consumer leave operations on close to background thre

[jira] [Updated] (KAFKA-16954) Move consumer leave operations on close to background thread

2024-06-14 Thread Lianet Magrans (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianet Magrans updated KAFKA-16954: --- Fix Version/s: 3.8.0 > Move consumer leave operations on close to background thread > --

Re: [PR] KAFKA-16933: New consumer unsubscribe close commit fixes [kafka]

2024-06-14 Thread via GitHub
lianetm commented on PR #16272: URL: https://github.com/apache/kafka/pull/16272#issuecomment-2167847254 Hey @philipnee, agreed there is still an issue with the Interrupt discovered with the stress tests, it's just that as discussed offline that will come in a separate PR (just to not keep s

[PR] KAFKA-16753: Implement share acknowledge API in partition (KIP-932) [kafka]

2024-06-14 Thread via GitHub
apoorvmittal10 opened a new pull request, #16339: URL: https://github.com/apache/kafka/pull/16339 The share-partition leader keeps track of the state and delivery attempts for in-flight records. However, delivery attempts tracking follows atleast-once semantics. The consumer process

Re: [PR] KAFKA-16753: Implement share acknowledge API in partition (KIP-932) [kafka]

2024-06-14 Thread via GitHub
apoorvmittal10 commented on PR #16339: URL: https://github.com/apache/kafka/pull/16339#issuecomment-2167881836 @AndrewJSchofield The PR build will fail untill we have APIs defined for Persister interface, I ll update the code once dependent PR is merged. -- This is an automated messag

[jira] [Commented] (KAFKA-16959) ConfigCommand should not allow to define both `entity-default` and `entity-name`

2024-06-14 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17855040#comment-17855040 ] 黃竣陽 commented on KAFKA-16959: - Im interesting in this issue, I want handle it. > ConfigComm

[jira] [Assigned] (KAFKA-16959) ConfigCommand should not allow to define both `entity-default` and `entity-name`

2024-06-14 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai reassigned KAFKA-16959: -- Assignee: 黃竣陽 (was: Chia-Ping Tsai) > ConfigCommand should not allow to define both

Re: [PR] KAFKA-16713: Define initial set of RPCs for KIP-932 [kafka]

2024-06-14 Thread via GitHub
chia7712 commented on code in PR #16022: URL: https://github.com/apache/kafka/pull/16022#discussion_r1639747343 ## clients/src/main/java/org/apache/kafka/common/requests/ShareFetchResponse.java: ## @@ -0,0 +1,212 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

Re: [PR] KAFKA-10190: Set dynamic broker configs for entity default [kafka]

2024-06-14 Thread via GitHub
chia7712 commented on code in PR #16280: URL: https://github.com/apache/kafka/pull/16280#discussion_r1639750736 ## core/src/main/scala/kafka/server/ConfigHandler.scala: ## @@ -239,19 +239,24 @@ class BrokerConfigHandler(private val brokerConfig: KafkaConfig, def processCon

Re: [PR] KAFKA-16921: migrate connect module to junit 5 (Part 2) [kafka]

2024-06-14 Thread via GitHub
chia7712 commented on PR #16330: URL: https://github.com/apache/kafka/pull/16330#issuecomment-2167934579 @m1a2st could you please take a look at failed tests? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

Re: [PR] KAFKA-16950: Define Persister interfaces and RPCs [kafka]

2024-06-14 Thread via GitHub
apoorvmittal10 commented on code in PR #16335: URL: https://github.com/apache/kafka/pull/16335#discussion_r1639739009 ## server-common/src/main/java/org/apache/kafka/server/group/share/GroupTopicPartitionData.java: ## @@ -0,0 +1,87 @@ +/* + * Licensed to the Apache Software Foun

[jira] [Resolved] (KAFKA-16752) Implement acquire functionality in SharePartition

2024-06-14 Thread Apoorv Mittal (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apoorv Mittal resolved KAFKA-16752. --- Resolution: Done > Implement acquire functionality in SharePartition > -

[jira] [Created] (KAFKA-16960) StreamsUpgradeTest system tests fail in v3.7.1 RC1

2024-06-14 Thread Luke Chen (Jira)
Luke Chen created KAFKA-16960: - Summary: StreamsUpgradeTest system tests fail in v3.7.1 RC1 Key: KAFKA-16960 URL: https://issues.apache.org/jira/browse/KAFKA-16960 Project: Kafka Issue Type: Impr

[jira] [Created] (KAFKA-16961) TestKRaftUpgrade system tests fail in v3.7.1 RC1

2024-06-14 Thread Luke Chen (Jira)
Luke Chen created KAFKA-16961: - Summary: TestKRaftUpgrade system tests fail in v3.7.1 RC1 Key: KAFKA-16961 URL: https://issues.apache.org/jira/browse/KAFKA-16961 Project: Kafka Issue Type: Test

[jira] [Created] (KAFKA-16962) kafkatest.tests.core.upgrade_test system tests failed in v3.7.1 RC1

2024-06-14 Thread Luke Chen (Jira)
Luke Chen created KAFKA-16962: - Summary: kafkatest.tests.core.upgrade_test system tests failed in v3.7.1 RC1 Key: KAFKA-16962 URL: https://issues.apache.org/jira/browse/KAFKA-16962 Project: Kafka

Re: [PR] KAFKA-16950: Define Persister interfaces and RPCs [kafka]

2024-06-14 Thread via GitHub
AndrewJSchofield commented on code in PR #16335: URL: https://github.com/apache/kafka/pull/16335#discussion_r1639795031 ## server-common/src/main/java/org/apache/kafka/server/group/share/PartitionAllData.java: ## @@ -0,0 +1,36 @@ +/* + * Licensed to the Apache Software Foundatio

Re: [PR] KAFKA-16950: Define Persister interfaces and RPCs [kafka]

2024-06-14 Thread via GitHub
AndrewJSchofield commented on code in PR #16335: URL: https://github.com/apache/kafka/pull/16335#discussion_r1639797544 ## server-common/src/main/java/org/apache/kafka/server/group/share/ReadShareGroupStateParameters.java: ## @@ -0,0 +1,76 @@ +/* + * Licensed to the Apache Softw

Re: [PR] KAFKA-16950: Define Persister interfaces and RPCs [kafka]

2024-06-14 Thread via GitHub
AndrewJSchofield commented on code in PR #16335: URL: https://github.com/apache/kafka/pull/16335#discussion_r1639801028 ## server-common/src/main/java/org/apache/kafka/server/group/share/Persister.java: ## @@ -0,0 +1,76 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

Re: [PR] KAFKA-12670: KRaft support for unclean.leader.election.enable [kafka]

2024-06-14 Thread via GitHub
showuon commented on code in PR #16284: URL: https://github.com/apache/kafka/pull/16284#discussion_r1636432727 ## metadata/src/main/java/org/apache/kafka/controller/ReplicationControlManager.java: ## @@ -2093,6 +2116,50 @@ Optional changePartitionReassignment(TopicIdPartition t

Re: [PR] KAFKA-16950: Define Persister interfaces and RPCs [kafka]

2024-06-14 Thread via GitHub
AndrewJSchofield commented on PR #16335: URL: https://github.com/apache/kafka/pull/16335#issuecomment-2168022748 @apoorvmittal10 Thanks for the review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

Re: [PR] KAFKA-12670: KRaft support for unclean.leader.election.enable [kafka]

2024-06-14 Thread via GitHub
showuon commented on code in PR #16284: URL: https://github.com/apache/kafka/pull/16284#discussion_r1636434931 ## metadata/src/main/java/org/apache/kafka/controller/ConfigurationControlManager.java: ## @@ -495,8 +496,19 @@ void deleteTopicConfigs(String name) { configDa

Re: [PR] MINOR: Replace range by prefixScan to have exclusive-end range (table-table fk join) [kafka]

2024-06-14 Thread via GitHub
AyoubOm commented on code in PR #16218: URL: https://github.com/apache/kafka/pull/16218#discussion_r1639815011 ## streams/src/main/java/org/apache/kafka/streams/kstream/internals/foreignkeyjoin/CombinedKeySchema.java: ## @@ -94,7 +94,7 @@ public CombinedKey fromBytes(final Bytes

Re: [PR] KAFKA-10190: Set dynamic broker configs for entity default [kafka]

2024-06-14 Thread via GitHub
harryfallows commented on code in PR #16280: URL: https://github.com/apache/kafka/pull/16280#discussion_r1639845590 ## core/src/main/scala/kafka/server/ConfigHandler.scala: ## @@ -239,19 +239,24 @@ class BrokerConfigHandler(private val brokerConfig: KafkaConfig, def proces

Re: [PR] improve log description of QuorumController [kafka]

2024-06-14 Thread via GitHub
chickenchickenlove commented on PR #15926: URL: https://github.com/apache/kafka/pull/15926#issuecomment-2168090694 > I started a new build here https://ci-builds.apache.org/job/Kafka/job/kafka-pr/job/PR-15926/6/ Thanks for your comments. If there is something to be fixed, please le

[PR] KAFKA-16740: Added additional APIs for Share Partition [kafka]

2024-06-14 Thread via GitHub
apoorvmittal10 opened a new pull request, #16340: URL: https://github.com/apache/kafka/pull/16340 Added additional APIs for SharePartition which shall be used by SharePartitionManager. The lock API on SharePartition helps not issuing concurrent fetch request on replica manager for sa

Re: [PR] KAFKA-16254: Allow MM2 to fully disable offset sync feature [kafka]

2024-06-14 Thread via GitHub
mimaison commented on code in PR #15999: URL: https://github.com/apache/kafka/pull/15999#discussion_r1639833636 ## connect/mirror/src/main/java/org/apache/kafka/connect/mirror/MirrorCheckpointConfig.java: ## @@ -166,6 +169,34 @@ Duration consumerPollTimeout() { return D

[PR] KAFKA-16898: move TimeIndexTest and TransactionIndexTest to storage module [kafka]

2024-06-14 Thread via GitHub
FrankYang0529 opened a new pull request, #16341: URL: https://github.com/apache/kafka/pull/16341 ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI build status - [ ] Verify documentation (including

  1   2   3   >