Re: [PR] KAFKA-16894: Define feature to enable share groups [kafka]

2025-04-11 Thread via GitHub
AndrewJSchofield commented on code in PR #19293: URL: https://github.com/apache/kafka/pull/19293#discussion_r2039016521 ## server-common/src/main/java/org/apache/kafka/server/common/ShareVersion.java: ## @@ -0,0 +1,82 @@ +/* + * Licensed to the Apache Software Foundation (ASF) u

[PR] KAFKA-18170: Add scheduled job to snapshot cold share partitions. [kafka]

2025-04-11 Thread via GitHub
smjn opened a new pull request, #19443: URL: https://github.com/apache/kafka/pull/19443 * There could be scenarios where share partition records in `__share_group_state` internal topic have not been updated for a while implying these partitions are basically cold. * In this situation, th

Re: [PR] KAFKA-19113: Migrate DelegationTokenManager to server module [kafka]

2025-04-11 Thread via GitHub
mimaison commented on code in PR #19424: URL: https://github.com/apache/kafka/pull/19424#discussion_r2039048773 ## core/src/test/scala/unit/kafka/server/KafkaConfigTest.scala: ## @@ -1173,14 +1173,15 @@ class KafkaConfigTest { assertEquals(123L, config.logFlushIntervalMs)

Re: [PR] KAFKA-18286: Implement support for streams groups in kafka-groups.sh [kafka]

2025-04-11 Thread via GitHub
aliehsaeedii commented on PR #19423: URL: https://github.com/apache/kafka/pull/19423#issuecomment-2796239979 Thanks, @lucasbru. Essential support that was unintentionally overlooked. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

Re: [PR] MINOR: Consolidated message formatter for share group records [kafka]

2025-04-11 Thread via GitHub
apoorvmittal10 merged PR #19435: URL: https://github.com/apache/kafka/pull/19435 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.

Re: [PR] KAFKA-19015: Remove share session from cache on share consumer connection drop [kafka]

2025-04-11 Thread via GitHub
chirag-wadhwa5 commented on code in PR #19329: URL: https://github.com/apache/kafka/pull/19329#discussion_r2039100729 ## server/src/main/java/org/apache/kafka/server/share/session/ShareSessionCache.java: ## @@ -169,21 +176,69 @@ public synchronized boolean tryEvict(long now) {

Re: [PR] KAFKA-18286: Implement support for streams groups in kafka-groups.sh [kafka]

2025-04-11 Thread via GitHub
lucasbru merged PR #19423: URL: https://github.com/apache/kafka/pull/19423 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

Re: [PR] KAFKA-19118: Enable KIP-1071 in StandbyTaskCreationIntegrationTest [kafka]

2025-04-11 Thread via GitHub
lucasbru commented on code in PR #19438: URL: https://github.com/apache/kafka/pull/19438#discussion_r2039158740 ## group-coordinator/src/test/java/org/apache/kafka/coordinator/group/streams/topics/ChangelogTopicsTest.java: ## @@ -149,14 +149,14 @@ public void shouldContainNonSou

Re: [PR] KAFKA-19118: Enable KIP-1071 in StandbyTaskCreationIntegrationTest [kafka]

2025-04-11 Thread via GitHub
lucasbru merged PR #19438: URL: https://github.com/apache/kafka/pull/19438 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

Re: [PR] MINOR: Modify KafkaEventQueue VoidEvent to as singleton and use more proper function interface [kafka]

2025-04-11 Thread via GitHub
gongxuanzhang commented on PR #19356: URL: https://github.com/apache/kafka/pull/19356#issuecomment-2796352614 @chia7712 PTAL -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[PR] feat: Added external schema support for connector [kafka]

2025-04-11 Thread via GitHub
priyankaku opened a new pull request, #19444: URL: https://github.com/apache/kafka/pull/19444 When using a connector that requires a schema, such as JDBC connectors, with JSON messages, the current JSONConverter necessitates including the schema within every message. To address this, we are

Re: [PR] KAFKA-18900: Implement share.acknowledgment.mode to choose acknowledgement mode [kafka]

2025-04-11 Thread via GitHub
AndrewJSchofield commented on code in PR #19417: URL: https://github.com/apache/kafka/pull/19417#discussion_r2039155579 ## clients/src/main/java/org/apache/kafka/clients/consumer/ConsumerConfig.java: ## @@ -381,18 +381,17 @@ public class ConsumerConfig extends AbstractConfig {

Re: [PR] KAFKA-19080 The constraint on segment.ms is not enforced at topic level [kafka]

2025-04-11 Thread via GitHub
m1a2st commented on PR #19371: URL: https://github.com/apache/kafka/pull/19371#issuecomment-2796373720 Thanks for @junrao, @chia7712 comments, This PR is already for review, PTAL. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[jira] [Commented] (KAFKA-16913) Support external schemas in JSONConverter

2025-04-11 Thread Priyanka K U (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17943498#comment-17943498 ] Priyanka K U commented on KAFKA-16913: -- Raised a New PR for this  KIP [https://cwi

Re: [PR] KAFKA-19103: Remove OffsetConfig [kafka]

2025-04-11 Thread via GitHub
chia7712 merged PR #19441: URL: https://github.com/apache/kafka/pull/19441 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

[jira] [Assigned] (KAFKA-16869) Rewrite HighAvailabilityTaskAssignor to implement the new TaskAssignor interface

2025-04-11 Thread Lorcan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lorcan reassigned KAFKA-16869: -- Assignee: Lorcan > Rewrite HighAvailabilityTaskAssignor to implement the new TaskAssignor > interfac

[PR] MINOR: Small cleanups in streams tests [kafka]

2025-04-11 Thread via GitHub
wernerdv opened a new pull request, #19446: URL: https://github.com/apache/kafka/pull/19446 - Fixed typos - Fixed IDEA code inspection warnings - Removed unused fields and methods -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] MINOR: Small cleanups in streams tests [kafka]

2025-04-11 Thread via GitHub
wernerdv commented on PR #19446: URL: https://github.com/apache/kafka/pull/19446#issuecomment-2796479700 @mjsax @cadonna Hello, please take a look at this when you get a chance. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [PR] KAFKA-18170: Add scheduled job to snapshot cold share partitions. [kafka]

2025-04-11 Thread via GitHub
smjn commented on PR #19443: URL: https://github.com/apache/kafka/pull/19443#issuecomment-2796503058 ### Sample run ``` {"key":{"type":0,"data":{"groupId":"gs1","topicId":"usMKwc_eQ5214UuoShlXIg","partition":0}},"value":{"version":0,"data":{"snapshotEpoch":0,"stateEpoch":1,"leaderE

[PR] MINOR: Update kafka-console-share-consumer to pass in delivery count. [kafka]

2025-04-11 Thread via GitHub
ShivsundarR opened a new pull request, #19447: URL: https://github.com/apache/kafka/pull/19447 *What* - There was a bug in `ConsoleShareConsumer` where the delivery count received in the `ShareFetchResponse` was not sent to the formatter to be shown to the user. PR fixes the bug by p

Re: [PR] MINOR: Fix kraft ver broken test [kafka]

2025-04-11 Thread via GitHub
showuon commented on PR #19448: URL: https://github.com/apache/kafka/pull/19448#issuecomment-2796545810 @frankvicky , call for review. Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[PR] MINOR: Fix kraft ver broken test [kafka]

2025-04-11 Thread via GitHub
showuon opened a new pull request, #19448: URL: https://github.com/apache/kafka/pull/19448 Fix failed `kafka.server.KRaftClusterTest."testDescribeKRaftVersion(boolean)` test. It is failing in [3.9 branch](https://ci-builds.apache.org/job/Kafka/job/kafka/job/3.9/186/#showFailuresLink).

Re: [PR] KAFKA-19127: Integration test for altering and describing streams group configs [kafka]

2025-04-11 Thread via GitHub
lucasbru merged PR #19436: URL: https://github.com/apache/kafka/pull/19436 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

Re: [PR] KAFKA-16894: Define feature to enable share groups [kafka]

2025-04-11 Thread via GitHub
AndrewJSchofield commented on PR #19293: URL: https://github.com/apache/kafka/pull/19293#issuecomment-2796604695 There is a final piece to this change. When `MetadataVersion.LATEST_PRODUCTION` is moved to `IBP_4_1_IV1` or later (as it will before AK 4.1 releases), we must change `ShareVersi

Re: [PR] KAFKA-16894: Define feature to enable share groups [kafka]

2025-04-11 Thread via GitHub
AndrewJSchofield merged PR #19293: URL: https://github.com/apache/kafka/pull/19293 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafk

Re: [PR] KAFKA-18288: Add support kafka-streams-groups.sh --describe [kafka]

2025-04-11 Thread via GitHub
FrankYang0529 commented on code in PR #19433: URL: https://github.com/apache/kafka/pull/19433#discussion_r2039384250 ## tools/src/main/java/org/apache/kafka/tools/streams/StreamsGroupCommand.java: ## @@ -154,6 +166,173 @@ private void printGroupInfo(List groups) { }

Re: [PR] KAFKA-16913 - Support external schemas in JSONConverter [kafka]

2025-04-11 Thread via GitHub
priyankaku commented on PR #19444: URL: https://github.com/apache/kafka/pull/19444#issuecomment-2796713800 Will be raising a new PR -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Re: [PR] KAFKA-16913 - Support external schemas in JSONConverter [kafka]

2025-04-11 Thread via GitHub
priyankaku closed pull request #19444: KAFKA-16913 - Support external schemas in JSONConverter URL: https://github.com/apache/kafka/pull/19444 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

[jira] [Comment Edited] (KAFKA-16913) Support external schemas in JSONConverter

2025-04-11 Thread Priyanka K U (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17943498#comment-17943498 ] Priyanka K U edited comment on KAFKA-16913 at 4/11/25 12:23 PM: --

[PR] KAFKA-16913 - Support external schemas in JSONConverter [kafka]

2025-04-11 Thread via GitHub
priyankaku opened a new pull request, #19449: URL: https://github.com/apache/kafka/pull/19449 When using a connector that requires a schema, such as JDBC connectors, with JSON messages, the current JSONConverter necessitates including the schema within every message. To address this, we are

[jira] [Updated] (KAFKA-19128) Kafka Streams should not get offsets when close dirty

2025-04-11 Thread Alieh Saeedi (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alieh Saeedi updated KAFKA-19128: - Description: Kafka Streams calls `prepareCommit()` in `Taskmanager#closeTaskDirty()`. The initi

[jira] [Updated] (KAFKA-19128) Kafka Streams should not get offsets when close dirty

2025-04-11 Thread Alieh Saeedi (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alieh Saeedi updated KAFKA-19128: - Description: Kafka Streams calls `prepareCommit()` in `Taskmanager#closeTaskDirty()`. The initi

[jira] [Created] (KAFKA-19128) Kafka Streams should not get offsets when close dirty

2025-04-11 Thread Alieh Saeedi (Jira)
Alieh Saeedi created KAFKA-19128: Summary: Kafka Streams should not get offsets when close dirty Key: KAFKA-19128 URL: https://issues.apache.org/jira/browse/KAFKA-19128 Project: Kafka Issue T

[PR] KAFKA-19128: Kafka Streams should not get offsets when close dirty [kafka]

2025-04-11 Thread via GitHub
aliehsaeedii opened a new pull request, #19450: URL: https://github.com/apache/kafka/pull/19450 Kafka Streams calls `prepareCommit()` in `Taskmanager#closeTaskDirty()`. However, the dirty task must not get committed and therefore, prepare-commit tasks such as getting offsets should not be n

Re: [PR] KAFKA-17541:[1/2] Improve handling of delivery count [kafka]

2025-04-11 Thread via GitHub
apoorvmittal10 commented on code in PR #19430: URL: https://github.com/apache/kafka/pull/19430#discussion_r2039566989 ## core/src/main/java/kafka/server/share/SharePartition.java: ## @@ -1011,6 +1011,8 @@ private Optional releaseAcquiredRecordsForPerOffsetBatch(String membe

Re: [PR] MINOR: Fix kraft ver broken test [kafka]

2025-04-11 Thread via GitHub
frankvicky commented on code in PR #19448: URL: https://github.com/apache/kafka/pull/19448#discussion_r2039583366 ## metadata/src/main/java/org/apache/kafka/metadata/bootstrap/BootstrapMetadata.java: ## @@ -149,6 +149,32 @@ public BootstrapMetadata copyWithOnlyVersion() {

Re: [PR] MINOR: Fix kraft ver broken test [kafka]

2025-04-11 Thread via GitHub
frankvicky commented on code in PR #19448: URL: https://github.com/apache/kafka/pull/19448#discussion_r2039603484 ## metadata/src/main/java/org/apache/kafka/metadata/bootstrap/BootstrapMetadata.java: ## @@ -149,6 +149,32 @@ public BootstrapMetadata copyWithOnlyVersion() {

Re: [PR] KAFKA-19115: Utilize initialized topics info to verify delete share group offsets [kafka]

2025-04-11 Thread via GitHub
AndrewJSchofield commented on code in PR #19431: URL: https://github.com/apache/kafka/pull/19431#discussion_r2039571274 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/GroupCoordinatorService.java: ## @@ -1580,83 +1574,51 @@ public CompletableFuture delete

Re: [PR] KAFKA-19119: Move ApiVersionManager/SimpleApiVersionManager to server [kafka]

2025-04-11 Thread via GitHub
mimaison commented on code in PR #19426: URL: https://github.com/apache/kafka/pull/19426#discussion_r2039648616 ## core/src/main/scala/kafka/server/BrokerServer.scala: ## @@ -252,7 +252,7 @@ class BrokerServer( forwardingManager = new ForwardingManagerImpl(clientToContro

Re: [PR] KAFKA-18288: Add support kafka-streams-groups.sh --describe [kafka]

2025-04-11 Thread via GitHub
cadonna commented on code in PR #19433: URL: https://github.com/apache/kafka/pull/19433#discussion_r2037630380 ## tools/src/main/java/org/apache/kafka/tools/streams/StreamsGroupCommand.java: ## @@ -154,6 +166,173 @@ private void printGroupInfo(List groups) { }

Re: [PR] MINOR: Update kafka-console-share-consumer to pass in delivery count. [kafka]

2025-04-11 Thread via GitHub
AndrewJSchofield merged PR #19447: URL: https://github.com/apache/kafka/pull/19447 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafk

Re: [PR] KAFKA-18913: Removing _state.updater.enabled_ flag through the Stream… [kafka]

2025-04-11 Thread via GitHub
cadonna commented on code in PR #19275: URL: https://github.com/apache/kafka/pull/19275#discussion_r2039703906 ## streams/integration-tests/src/test/java/org/apache/kafka/streams/integration/SmokeTestDriverIntegrationTest.java: ## @@ -99,8 +99,8 @@ SmokeTestDriver.VerificationRe

Re: [PR] MINOR: Fix kraft ver broken test [kafka]

2025-04-11 Thread via GitHub
chia7712 commented on code in PR #19448: URL: https://github.com/apache/kafka/pull/19448#discussion_r2039707245 ## metadata/src/main/java/org/apache/kafka/metadata/bootstrap/BootstrapMetadata.java: ## @@ -149,6 +149,32 @@ public BootstrapMetadata copyWithOnlyVersion() {

Re: [PR] MINOR: Fix kraft ver broken test [kafka]

2025-04-11 Thread via GitHub
frankvicky commented on code in PR #19448: URL: https://github.com/apache/kafka/pull/19448#discussion_r2039735443 ## metadata/src/main/java/org/apache/kafka/metadata/bootstrap/BootstrapMetadata.java: ## @@ -149,6 +149,32 @@ public BootstrapMetadata copyWithOnlyVersion() {

[jira] [Created] (KAFKA-19129) Add a comment to BootstrapMetadata#copyWithFeatureRecord

2025-04-11 Thread TengYao Chi (Jira)
TengYao Chi created KAFKA-19129: --- Summary: Add a comment to BootstrapMetadata#copyWithFeatureRecord Key: KAFKA-19129 URL: https://issues.apache.org/jira/browse/KAFKA-19129 Project: Kafka Issue

Re: [PR] MINOR VerifableProducer ducktape can set idempotency and retries [kafka]

2025-04-11 Thread via GitHub
omkreddy merged PR #19362: URL: https://github.com/apache/kafka/pull/19362 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

[PR] KAFKA-19124: Follow up on code improvements [kafka]

2025-04-11 Thread via GitHub
cadonna opened a new pull request, #19453: URL: https://github.com/apache/kafka/pull/19453 Improves a variable name and handling of an Optional. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

Re: [PR] KAFKA-18913: Removing _state.updater.enabled_ flag through the Stream… [kafka]

2025-04-11 Thread via GitHub
cadonna commented on code in PR #19275: URL: https://github.com/apache/kafka/pull/19275#discussion_r2039706952 ## streams/integration-tests/src/test/java/org/apache/kafka/streams/integration/KafkaStreamsTelemetryIntegrationTest.java: ## @@ -432,19 +428,8 @@ private List getTaskI

Re: [PR] KAFKA-19113: Migrate DelegationTokenManager to server module [kafka]

2025-04-11 Thread via GitHub
FrankYang0529 commented on code in PR #19424: URL: https://github.com/apache/kafka/pull/19424#discussion_r2039838645 ## core/src/main/java/kafka/server/builders/KafkaApisBuilder.java: ## @@ -166,11 +164,6 @@ public KafkaApisBuilder setTime(Time time) { return this;

Re: [PR] MINOR: Cleanup Core Module- Scala Modules (1/n) [kafka]

2025-04-11 Thread via GitHub
m1a2st commented on code in PR #19380: URL: https://github.com/apache/kafka/pull/19380#discussion_r2039815019 ## core/src/test/scala/integration/kafka/api/SaslSslAdminIntegrationTest.scala: ## @@ -564,14 +563,14 @@ class SaslSslAdminIntegrationTest extends BaseAdminIntegrationT

Re: [PR] KAFKA-18913: Removing _state.updater.enabled_ flag through the Stream… [kafka]

2025-04-11 Thread via GitHub
cadonna commented on PR #19275: URL: https://github.com/apache/kafka/pull/19275#issuecomment-2797218102 FYI: I will not be online for the next 1.5 weeks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] KAFKA-19113: Migrate DelegationTokenManager to server module [kafka]

2025-04-11 Thread via GitHub
mimaison commented on code in PR #19424: URL: https://github.com/apache/kafka/pull/19424#discussion_r2039850332 ## core/src/main/java/kafka/server/builders/KafkaApisBuilder.java: ## @@ -166,11 +164,6 @@ public KafkaApisBuilder setTime(Time time) { return this; }

Re: [PR] KAFKA-18888: Add KIP-877 support to Authorizer [kafka]

2025-04-11 Thread via GitHub
mimaison commented on PR #19050: URL: https://github.com/apache/kafka/pull/19050#issuecomment-2797321585 > Overall LGTM. Will you be addressing [#19068 (comment)](https://github.com/apache/kafka/pull/19068#discussion_r2033623742) in this PR? I pushed a commit to address it. -- Th

Re: [PR] KAFKA-19113: Migrate DelegationTokenManager to server module [kafka]

2025-04-11 Thread via GitHub
FrankYang0529 commented on code in PR #19424: URL: https://github.com/apache/kafka/pull/19424#discussion_r2039838966 ## core/src/test/scala/unit/kafka/server/KafkaConfigTest.scala: ## @@ -1173,14 +1173,15 @@ class KafkaConfigTest { assertEquals(123L, config.logFlushInterval

[jira] [Assigned] (KAFKA-19123) the buffer of forwarded request should be released after receiving the reponse from controller

2025-04-11 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-19123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 黃竣陽 reassigned KAFKA-19123: --- Assignee: 黃竣陽 (was: Chia-Ping Tsai) > the buffer of forwarded request should be released after receiving t

Re: [PR] KAFKA-19119: Move ApiVersionManager/SimpleApiVersionManager to server [kafka]

2025-04-11 Thread via GitHub
FrankYang0529 commented on code in PR #19426: URL: https://github.com/apache/kafka/pull/19426#discussion_r2039487932 ## core/src/main/scala/kafka/server/BrokerServer.scala: ## @@ -252,7 +252,7 @@ class BrokerServer( forwardingManager = new ForwardingManagerImpl(clientToC

Re: [PR] KAFKA-14485: Move LogCleaner to storage module [kafka]

2025-04-11 Thread via GitHub
junrao merged PR #19387: URL: https://github.com/apache/kafka/pull/19387 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.o

Re: [PR] KAFKA-18288: Add support kafka-streams-groups.sh --describe [kafka]

2025-04-11 Thread via GitHub
aliehsaeedii commented on PR #19433: URL: https://github.com/apache/kafka/pull/19433#issuecomment-2796990486 > Leave comments about format. Will we have integration test for `kafka-streams-groups.sh` like `DescribeConsumerGroupTest`? Yes. In the follow-up PRs. -- This is an automat

[jira] [Updated] (KAFKA-19128) Kafka Streams should not get offsets when close dirty

2025-04-11 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-19128: Component/s: streams > Kafka Streams should not get offsets when close dirty > ---

Re: [PR] KAFKA-14485: Move LogCleaner to storage module [kafka]

2025-04-11 Thread via GitHub
wernerdv commented on PR #19387: URL: https://github.com/apache/kafka/pull/19387#issuecomment-2797455575 @mimaison @junrao Thanks for the review! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

Re: [PR] MINOR: Cleanup Core Module- Scala Modules (1/n) [kafka]

2025-04-11 Thread via GitHub
sjhajharia commented on code in PR #19380: URL: https://github.com/apache/kafka/pull/19380#discussion_r2039918241 ## core/src/test/scala/integration/kafka/api/ProducerSendWhileDeletionTest.scala: ## @@ -60,8 +60,8 @@ class ProducerSendWhileDeletionTest extends IntegrationTestHa

Re: [PR] MINOR: Cleanup Core Module- Scala Modules (1/n) [kafka]

2025-04-11 Thread via GitHub
sjhajharia commented on PR #19380: URL: https://github.com/apache/kafka/pull/19380#issuecomment-2797462875 Thanks @m1a2st for your comments. I have updated the PR accordingly. Requesting a re-review. -- This is an automated message from the Apache Git Service. To respond to the message

[jira] [Assigned] (KAFKA-19103) Remove OffsetConfig

2025-04-11 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai reassigned KAFKA-19103: -- Assignee: Yunchi Pang (was: Bolin Lin) > Remove OffsetConfig > --- >

Re: [PR] KAFKA-10551: Add topic id support to produce request and response [kafka]

2025-04-11 Thread via GitHub
junrao commented on code in PR #15968: URL: https://github.com/apache/kafka/pull/15968#discussion_r2039924782 ## clients/src/test/java/org/apache/kafka/common/message/MessageTest.java: ## @@ -886,7 +888,6 @@ public void testProduceResponseVersions() throws Exception { t

Re: [PR] KAFKA-10551: Add topic id support to produce request and response [kafka]

2025-04-11 Thread via GitHub
junrao commented on code in PR #15968: URL: https://github.com/apache/kafka/pull/15968#discussion_r2039952003 ## core/src/main/scala/kafka/server/KafkaApis.scala: ## @@ -2468,7 +2483,7 @@ class KafkaApis(val requestChannel: RequestChannel, } else { // Oth

[jira] [Commented] (KAFKA-16640) Replace TestUtils#resource by scala.util.Using

2025-04-11 Thread Vladimir Bukhtoyarov (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17943638#comment-17943638 ] Vladimir Bukhtoyarov commented on KAFKA-16640: -- [~frankvicky]  *Using* does

Re: [PR] KAFKA-10551: Add topic id support to produce request and response [kafka]

2025-04-11 Thread via GitHub
junrao commented on code in PR #15968: URL: https://github.com/apache/kafka/pull/15968#discussion_r2039963445 ## core/src/main/scala/kafka/server/ReplicaManager.scala: ## @@ -1361,10 +1366,10 @@ class ReplicaManager(val config: KafkaConfig, */ private def appendToLocalLog

[jira] [Comment Edited] (KAFKA-16640) Replace TestUtils#resource by scala.util.Using

2025-04-11 Thread Vladimir Bukhtoyarov (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17943638#comment-17943638 ] Vladimir Bukhtoyarov edited comment on KAFKA-16640 at 4/11/25 5:18 PM: ---

[jira] [Comment Edited] (KAFKA-16640) Replace TestUtils#resource by scala.util.Using

2025-04-11 Thread Vladimir Bukhtoyarov (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17943638#comment-17943638 ] Vladimir Bukhtoyarov edited comment on KAFKA-16640 at 4/11/25 5:19 PM: ---

[jira] [Commented] (KAFKA-16640) Replace TestUtils#resource by scala.util.Using

2025-04-11 Thread Vladimir Bukhtoyarov (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17943643#comment-17943643 ] Vladimir Bukhtoyarov commented on KAFKA-16640: --  I see that fix has been al

[jira] [Updated] (KAFKA-17078) Add SecurityManager reflective shim

2025-04-11 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-17078: Fix Version/s: 3.9.1 > Add SecurityManager reflective shim > -

Re: [PR] KAFKA-17662: config.providers configuration missing from the docs [kafka]

2025-04-11 Thread via GitHub
mjsax commented on PR #18930: URL: https://github.com/apache/kafka/pull/18930#issuecomment-2798074476 Thanks @mimaison -- that's fair. I am totally ok to add it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] KAFKA-10789: Streamlining Tests in ChangeLoggingKeyValueBytesStoreTest [kafka]

2025-04-11 Thread via GitHub
mjsax commented on code in PR #18816: URL: https://github.com/apache/kafka/pull/18816#discussion_r2040343759 ## streams/src/test/java/org/apache/kafka/streams/state/internals/ChangeLoggingKeyValueBytesStoreTest.java: ## @@ -62,18 +63,23 @@ import static org.hamcrest.CoreMatcher

Re: [PR] KAFKA-10789: Streamlining Tests in ChangeLoggingKeyValueBytesStoreTest [kafka]

2025-04-11 Thread via GitHub
mjsax commented on code in PR #18816: URL: https://github.com/apache/kafka/pull/18816#discussion_r2040344194 ## streams/src/test/java/org/apache/kafka/streams/state/internals/ChangeLoggingKeyValueBytesStoreTest.java: ## @@ -89,8 +95,81 @@ public class ChangeLoggingKeyValueBytesS

Re: [PR] MINOR: Fix an incorrect assignment in StreamsUncaughtExceptionHandlerIntegrationTest [kafka]

2025-04-11 Thread via GitHub
mjsax commented on PR #18837: URL: https://github.com/apache/kafka/pull/18837#issuecomment-2798089312 @cushon -- Do you still have interest to complete this PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

Re: [PR] KAFKA-18572: Update Kafka Streams metric documenation [kafka]

2025-04-11 Thread via GitHub
mjsax commented on PR #18673: URL: https://github.com/apache/kafka/pull/18673#issuecomment-2798090506 @ukpagrace -- What the status on this PR? Would be great to complete it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [PR] KAFKA-19128: Kafka Streams should not get offsets when close dirty [kafka]

2025-04-11 Thread via GitHub
bbejeck commented on code in PR #19450: URL: https://github.com/apache/kafka/pull/19450#discussion_r2040351769 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/TaskManager.java: ## @@ -1479,7 +1479,7 @@ private void closeTaskDirty(final Task task, final boo

Re: [PR] MINOR: Fix an incorrect assignment in StreamsUncaughtExceptionHandlerIntegrationTest [kafka]

2025-04-11 Thread via GitHub
cushon commented on code in PR #18837: URL: https://github.com/apache/kafka/pull/18837#discussion_r2040354567 ## streams/integration-tests/src/test/java/org/apache/kafka/streams/integration/StreamsUncaughtExceptionHandlerIntegrationTest.java: ## @@ -192,7 +192,7 @@ private stati

Re: [PR] MINOR: Fix an incorrect assignment in StreamsUncaughtExceptionHandlerIntegrationTest [kafka]

2025-04-11 Thread via GitHub
cushon commented on PR #18837: URL: https://github.com/apache/kafka/pull/18837#issuecomment-2798094752 > @cushon -- Do you still have interest to complete this PR? Sure thanks, I addressed the review comment, please take another look -- This is an automated message from the Apache G

[jira] [Created] (KAFKA-19130) Do not add fenced brokers to BrokerRegistrationTracker on startup

2025-04-11 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-19130: Summary: Do not add fenced brokers to BrokerRegistrationTracker on startup Key: KAFKA-19130 URL: https://issues.apache.org/jira/browse/KAFKA-19130 Project: Kafka

[PR] KAFKA-19130: Do not add fenced brokers to BrokerRegistrationTracker on startup [kafka]

2025-04-11 Thread via GitHub
cmccabe opened a new pull request, #19454: URL: https://github.com/apache/kafka/pull/19454 When the controller starts up (or becomes active after being inactive), we add all of the registered brokers to BrokerRegistrationTracker so that they will not be accidentally fenced the next time we

[jira] [Updated] (KAFKA-19130) Do not add fenced brokers to BrokerRegistrationTracker on startup

2025-04-11 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe updated KAFKA-19130: - Description: When the controller starts up (or becomes active after being inactive), we add all

Re: [PR] [draft] KAFKA-19047: Allow quickly re-registering brokers that were shutdown [kafka]

2025-04-11 Thread via GitHub
cmccabe commented on PR #19428: URL: https://github.com/apache/kafka/pull/19428#issuecomment-2798145256 I think this PR should be a better fix https://github.com/apache/kafka/pull/19454 -- This is an automated message from the Apache Git Service. To respond to the message, please log on t

Re: [PR] KAFKA-19047: Allow quickly re-registering brokers that are in controlled shutdown [kafka]

2025-04-11 Thread via GitHub
cmccabe commented on PR #19296: URL: https://github.com/apache/kafka/pull/19296#issuecomment-2798145663 Thank you for spotting the flaw here, @splett2 . @ahuang98 @splett2 @jsancio I think this PR should be a better fix https://github.com/apache/kafka/pull/19454 -- This is an autom

Re: [PR] KAFKA-19130: Do not add fenced brokers to BrokerRegistrationTracker on startup [kafka]

2025-04-11 Thread via GitHub
ahuang98 commented on code in PR #19454: URL: https://github.com/apache/kafka/pull/19454#discussion_r2040390910 ## metadata/src/main/java/org/apache/kafka/controller/ClusterControlManager.java: ## @@ -309,8 +309,10 @@ public void activate() { long nowNs = time.nanosecon

Re: [PR] KAFKA-19130: Do not add fenced brokers to BrokerRegistrationTracker on startup [kafka]

2025-04-11 Thread via GitHub
ahuang98 commented on code in PR #19454: URL: https://github.com/apache/kafka/pull/19454#discussion_r2040393861 ## metadata/src/main/java/org/apache/kafka/controller/ClusterControlManager.java: ## @@ -309,8 +309,10 @@ public void activate() { long nowNs = time.nanosecon

Re: [PR] KAFKA-19130: Do not add fenced brokers to BrokerRegistrationTracker on startup [kafka]

2025-04-11 Thread via GitHub
ahuang98 commented on code in PR #19454: URL: https://github.com/apache/kafka/pull/19454#discussion_r2040393861 ## metadata/src/main/java/org/apache/kafka/controller/ClusterControlManager.java: ## @@ -309,8 +309,10 @@ public void activate() { long nowNs = time.nanosecon

Re: [PR] KAFKA-19130: Do not add fenced brokers to BrokerRegistrationTracker on startup [kafka]

2025-04-11 Thread via GitHub
ahuang98 commented on code in PR #19454: URL: https://github.com/apache/kafka/pull/19454#discussion_r2040390910 ## metadata/src/main/java/org/apache/kafka/controller/ClusterControlManager.java: ## @@ -309,8 +309,10 @@ public void activate() { long nowNs = time.nanosecon

Re: [PR] KAFKA-19130: Do not add fenced brokers to BrokerRegistrationTracker on startup [kafka]

2025-04-11 Thread via GitHub
cmccabe commented on code in PR #19454: URL: https://github.com/apache/kafka/pull/19454#discussion_r2040427593 ## metadata/src/main/java/org/apache/kafka/controller/ClusterControlManager.java: ## @@ -309,8 +309,10 @@ public void activate() { long nowNs = time.nanosecond

Re: [PR] KAFKA-19130: Do not add fenced brokers to BrokerRegistrationTracker on startup [kafka]

2025-04-11 Thread via GitHub
wozhuzaisi commented on code in PR #19454: URL: https://github.com/apache/kafka/pull/19454#discussion_r2040410979 ## metadata/src/main/java/org/apache/kafka/controller/ClusterControlManager.java: ## @@ -309,8 +309,10 @@ public void activate() { long nowNs = time.nanosec

Re: [PR] KAFKA-15767: Refactor TransactionManager to avoid use of ThreadLocal [kafka]

2025-04-11 Thread via GitHub
kirktrue commented on PR #19440: URL: https://github.com/apache/kafka/pull/19440#issuecomment-2798230694 Thanks @m1a2st! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] MINOR: Fix kraft ver broken test [kafka]

2025-04-11 Thread via GitHub
showuon merged PR #19448: URL: https://github.com/apache/kafka/pull/19448 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.

[PR] MINOR: Simplify PartitionStates update logic by removing unnecessary grouping [kafka]

2025-04-11 Thread via GitHub
zt52875287 opened a new pull request, #19442: URL: https://github.com/apache/kafka/pull/19442 This patch simplifies the implementation of PartitionStates#update by removing the unnecessary grouping of TopicPartitions by topic. The original logic constructed an intermediate map by topic name

[jira] [Assigned] (KAFKA-19112) cleanup.policy shouldn't be empty

2025-04-11 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-19112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 黃竣陽 reassigned KAFKA-19112: --- Assignee: 黃竣陽 > cleanup.policy shouldn't be empty > - > > K

Re: [PR] KAFKA-18572: Update Kafka Streams metric documenation [kafka]

2025-04-11 Thread via GitHub
ukpagrace commented on PR #18673: URL: https://github.com/apache/kafka/pull/18673#issuecomment-2798439485 Done @mjsax and @bbejeck. Sorry it took this long. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

Re: [PR] KAFKA-19113: Migrate DelegationTokenManager to server module [kafka]

2025-04-11 Thread via GitHub
FrankYang0529 commented on code in PR #19424: URL: https://github.com/apache/kafka/pull/19424#discussion_r2040518849 ## core/src/main/java/kafka/server/builders/KafkaApisBuilder.java: ## @@ -166,11 +164,6 @@ public KafkaApisBuilder setTime(Time time) { return this;

Re: [PR] KAFKA-19071: Fix doc for remote.storage.enable [kafka]

2025-04-11 Thread via GitHub
FrankYang0529 commented on code in PR #19345: URL: https://github.com/apache/kafka/pull/19345#discussion_r2040587319 ## core/src/test/scala/integration/kafka/admin/RemoteTopicCrudTest.scala: ## @@ -441,7 +441,36 @@ class RemoteTopicCrudTest extends IntegrationTestHarness {

[jira] [Commented] (KAFKA-16640) Replace TestUtils#resource by scala.util.Using

2025-04-11 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17943724#comment-17943724 ] Chia-Ping Tsai commented on KAFKA-16640: [~vladimir.bukhtoyarov]  thanks for rep

Re: [PR] KAFKA-19030: Remove metricNamePrefix from RequestChannel [kafka]

2025-04-11 Thread via GitHub
chia7712 commented on code in PR #19374: URL: https://github.com/apache/kafka/pull/19374#discussion_r2040508190 ## core/src/main/scala/kafka/server/BrokerServer.scala: ## @@ -21,7 +21,7 @@ import kafka.coordinator.group.{CoordinatorLoaderImpl, CoordinatorPartitionWrite import

Re: [PR] MINOR: Simplify PartitionStates update logic by removing unnecessary grouping [kafka]

2025-04-11 Thread via GitHub
FrankYang0529 commented on code in PR #19442: URL: https://github.com/apache/kafka/pull/19442#discussion_r2040530970 ## clients/src/main/java/org/apache/kafka/common/internals/PartitionStates.java: ## @@ -138,17 +138,7 @@ private void updateSize() { } private void up

  1   2   >