[GitHub] [kafka] hudeqi commented on a diff in pull request #13697: MINOR:code optimization in QuorumController

2023-05-11 Thread via GitHub
hudeqi commented on code in PR #13697: URL: https://github.com/apache/kafka/pull/13697#discussion_r1191942365 ## metadata/src/main/java/org/apache/kafka/controller/QuorumController.java: ## @@ -1586,11 +1578,6 @@ private void resetToEmptyState() { */ private final Fau

[GitHub] [kafka] dengziming merged pull request #13697: MINOR:code optimization in QuorumController

2023-05-11 Thread via GitHub
dengziming merged PR #13697: URL: https://github.com/apache/kafka/pull/13697 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apac

[GitHub] [kafka] dengziming commented on a diff in pull request #13697: MINOR:code optimization in QuorumController

2023-05-11 Thread via GitHub
dengziming commented on code in PR #13697: URL: https://github.com/apache/kafka/pull/13697#discussion_r1191937851 ## metadata/src/main/java/org/apache/kafka/controller/QuorumController.java: ## @@ -1586,11 +1578,6 @@ private void resetToEmptyState() { */ private final

[GitHub] [kafka] atu-sharm commented on pull request #13633: KAFKA-14839: Exclude protected variable from JavaDocs

2023-05-11 Thread via GitHub
atu-sharm commented on PR #13633: URL: https://github.com/apache/kafka/pull/13633#issuecomment-1545201789 Thanks, @vvcephei @mjsax @machi1990 for your valuable suggestions, i think it's better to apply this property to the whole project, made changes according to that -- This is an autom

[GitHub] [kafka] dengziming merged pull request #13679: KAFKA-14291: KRaft controller should return right finalized features in ApiVersionResponse

2023-05-11 Thread via GitHub
dengziming merged PR #13679: URL: https://github.com/apache/kafka/pull/13679 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apac

[GitHub] [kafka] dengziming commented on pull request #13679: KAFKA-14291: KRaft controller should return right finalized features in ApiVersionResponse

2023-05-11 Thread via GitHub
dengziming commented on PR #13679: URL: https://github.com/apache/kafka/pull/13679#issuecomment-1545197689 The failed tests are flaky and also failed recently in other PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and us

[GitHub] [kafka] dajac commented on a diff in pull request #13678: KAFKA-10337: await async commits in commitSync even if no offsets given

2023-05-11 Thread via GitHub
dajac commented on code in PR #13678: URL: https://github.com/apache/kafka/pull/13678#discussion_r1191927989 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/ConsumerCoordinator.java: ## @@ -186,6 +187,7 @@ public ConsumerCoordinator(GroupRebalanceConfig reb

[jira] [Assigned] (KAFKA-13349) Allow Iterator.remove on KeyValueIterator

2023-05-11 Thread Mahesh Madushan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahesh Madushan reassigned KAFKA-13349: --- Assignee: Mahesh Madushan > Allow Iterator.remove on KeyValueIterator > ---

[jira] [Commented] (KAFKA-13349) Allow Iterator.remove on KeyValueIterator

2023-05-11 Thread Mahesh Madushan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722007#comment-17722007 ] Mahesh Madushan commented on KAFKA-13349: - [~mjsax] Thank you for the response.

[jira] [Commented] (KAFKA-13349) Allow Iterator.remove on KeyValueIterator

2023-05-11 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722005#comment-17722005 ] Matthias J. Sax commented on KAFKA-13349: - Yes, we want to add `remove()` to int

[GitHub] [kafka] aaron-ai opened a new pull request, #13710: MINOR: Fix the outdated comments of ConfigDef

2023-05-11 Thread via GitHub
aaron-ai opened a new pull request, #13710: URL: https://github.com/apache/kafka/pull/13710 Fix the outdated comments of `ConfigDef` since the signature of the corresponding method has been updated. ### Committer Checklist (excluded from commit message) - [ ] Verify design and impl

[jira] [Commented] (KAFKA-14911) Add system tests for rolling upgrade path of KIP-904

2023-05-11 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722004#comment-17722004 ] Matthias J. Sax commented on KAFKA-14911: - No worries. And thanks for helping on

[jira] [Commented] (KAFKA-14981) Set `group.instance.id` in streams consumer so that rebalance will not happen if a instance is restarted

2023-05-11 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722003#comment-17722003 ] Matthias J. Sax commented on KAFKA-14981: - I was not aware that there was (or ma

[GitHub] [kafka] showuon merged pull request #13517: KAFKA-14752: Kafka examples improvements - demo changes

2023-05-11 Thread via GitHub
showuon merged PR #13517: URL: https://github.com/apache/kafka/pull/13517 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.

[GitHub] [kafka] showuon commented on pull request #13517: KAFKA-14752: Kafka examples improvements - demo changes

2023-05-11 Thread via GitHub
showuon commented on PR #13517: URL: https://github.com/apache/kafka/pull/13517#issuecomment-1545024000 Failed tests are unrelated: ``` Build / JDK 8 and Scala 2.12 / org.apache.kafka.connect.integration.ExactlyOnceSourceIntegrationTest.testConnectorBoundary Build / JDK 8 an

[jira] [Commented] (KAFKA-8154) Buffer Overflow exceptions between brokers and with clients

2023-05-11 Thread tony mancill (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17721959#comment-17721959 ] tony mancill commented on KAFKA-8154: - Thank you for that observation [~keith.paulson

[GitHub] [kafka] mehbey opened a new pull request, #13709: Added log timestamp validation to prevent records with timestamps tha…

2023-05-11 Thread via GitHub
mehbey opened a new pull request, #13709: URL: https://github.com/apache/kafka/pull/13709 ### What changed Added a validation to check if the record timestamp is in the future compared to the broker's timestamp and throw an exception to reject the record. The current validation for

[GitHub] [kafka] mehbey commented on pull request #13681: KAFKA-14133: Migrate ActiveTaskCreator mock in TaskManagerTest to Mockito

2023-05-11 Thread via GitHub
mehbey commented on PR #13681: URL: https://github.com/apache/kafka/pull/13681#issuecomment-1544909428 > Thank you for the review @clolov - I will address the comments shortly -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G

[jira] [Created] (KAFKA-14992) Add partition limit or improve error msg for adminzkclient

2023-05-11 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-14992: Summary: Add partition limit or improve error msg for adminzkclient Key: KAFKA-14992 URL: https://issues.apache.org/jira/browse/KAFKA-14992 Project: Kafka Is

[jira] [Commented] (KAFKA-14941) Document which configuration options are applicable only to processes with broker role or controller role

2023-05-11 Thread Bikash Adhikari (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17721935#comment-17721935 ] Bikash Adhikari commented on KAFKA-14941: - I will work on this documentation. 

[GitHub] [kafka] splett2 commented on a diff in pull request #13707: KAFKA-14990: Dynamic producer ID expiration should be applied on a broker restart

2023-05-11 Thread via GitHub
splett2 commented on code in PR #13707: URL: https://github.com/apache/kafka/pull/13707#discussion_r1191702662 ## core/src/main/scala/kafka/server/KafkaConfig.scala: ## @@ -1956,10 +1956,10 @@ class KafkaConfig private(doLog: Boolean, val props: java.util.Map[_, _], dynami v

[GitHub] [kafka] rreddy-22 commented on a diff in pull request #13663: KAFKA-14500; [2/N] Rewrite GroupMetadata in Java

2023-05-11 Thread via GitHub
rreddy-22 commented on code in PR #13663: URL: https://github.com/apache/kafka/pull/13663#discussion_r1191678769 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/generic/GenericGroup.java: ## @@ -0,0 +1,958 @@ +/* + * Licensed to the Apache Software Foundati

[GitHub] [kafka] jeffkbkim commented on pull request #13704: KAFKA-14500; [3/N] add GroupMetadataKey/Value record helpers

2023-05-11 Thread via GitHub
jeffkbkim commented on PR #13704: URL: https://github.com/apache/kafka/pull/13704#issuecomment-1544658481 i'm seeing ``` Class Data Abstraction Coupling is 31 (max allowed is 25) classes [ApiMessageAndVersion, ClientAssignor, ConsumerGroupCurrentMemberAssignmentKey, ConsumerGroupCurr

[GitHub] [kafka] philipnee commented on a diff in pull request #13678: KAFKA-10337: await async commits in commitSync even if no offsets given

2023-05-11 Thread via GitHub
philipnee commented on code in PR #13678: URL: https://github.com/apache/kafka/pull/13678#discussion_r1191665112 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/ConsumerCoordinator.java: ## @@ -1223,6 +1233,26 @@ public void maybeAutoCommitOffsetsAsync(long

[GitHub] [kafka] jeffkbkim opened a new pull request, #13708: KAFKA-14500; [4/N] Add purgatory interface

2023-05-11 Thread via GitHub
jeffkbkim opened a new pull request, #13708: URL: https://github.com/apache/kafka/pull/13708 Adds the purgatory interface that will be used by the new group coordinator. * PurgatoryScheduler: used by GroupMetadataManager (introduced in https://github.com/apache/kafka/pull/13639) to add a

[jira] [Created] (KAFKA-14991) Improving Producer's record timestamp validation

2023-05-11 Thread Mehari Beyene (Jira)
Mehari Beyene created KAFKA-14991: - Summary: Improving Producer's record timestamp validation Key: KAFKA-14991 URL: https://issues.apache.org/jira/browse/KAFKA-14991 Project: Kafka Issue Type

[GitHub] [kafka] jolshan commented on pull request #13608: KAFKA-14884: Include check transaction is still ongoing right before append

2023-05-11 Thread via GitHub
jolshan commented on PR #13608: URL: https://github.com/apache/kafka/pull/13608#issuecomment-1544627294 I forgot this also covers the race for end txn marker being written before the produce completes. (We reset verification status to empty on the marker, so a produce request will fail)

[GitHub] [kafka] dajac commented on a diff in pull request #13704: KAFKA-14500; [3/N] add GroupMetadataKey/Value record helpers

2023-05-11 Thread via GitHub
dajac commented on code in PR #13704: URL: https://github.com/apache/kafka/pull/13704#discussion_r1191653253 ## group-coordinator/src/test/java/org/apache/kafka/coordinator/group/RecordHelpersTest.java: ## @@ -399,8 +403,12 @@ public void testNewCurrentAssignmentTombstoneRecord(

[GitHub] [kafka] splett2 commented on a diff in pull request #13707: KAFKA-14990: Dynamic producer ID expiration should be applied on a broker restart

2023-05-11 Thread via GitHub
splett2 commented on code in PR #13707: URL: https://github.com/apache/kafka/pull/13707#discussion_r1191611324 ## core/src/test/scala/integration/kafka/api/ProducerIdExpirationTest.scala: ## @@ -183,7 +183,11 @@ class ProducerIdExpirationTest extends KafkaServerTestHarness {

[GitHub] [kafka] jeffkbkim commented on a diff in pull request #13704: KAFKA-14500; [3/N] add GroupMetadataKey/Value record helpers

2023-05-11 Thread via GitHub
jeffkbkim commented on code in PR #13704: URL: https://github.com/apache/kafka/pull/13704#discussion_r1191604696 ## group-coordinator/src/test/java/org/apache/kafka/coordinator/group/RecordHelpersTest.java: ## @@ -399,8 +403,12 @@ public void testNewCurrentAssignmentTombstoneRec

[GitHub] [kafka] jeffkbkim commented on a diff in pull request #13663: KAFKA-14500; [2/N] Rewrite GroupMetadata in Java

2023-05-11 Thread via GitHub
jeffkbkim commented on code in PR #13663: URL: https://github.com/apache/kafka/pull/13663#discussion_r1191602652 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/generic/GenericGroup.java: ## @@ -0,0 +1,1012 @@ +/* + * Licensed to the Apache Software Foundat

[GitHub] [kafka] jeffkbkim commented on a diff in pull request #13663: KAFKA-14500; [2/N] Rewrite GroupMetadata in Java

2023-05-11 Thread via GitHub
jeffkbkim commented on code in PR #13663: URL: https://github.com/apache/kafka/pull/13663#discussion_r1191602126 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/generic/GenericGroup.java: ## @@ -0,0 +1,998 @@ +/* + * Licensed to the Apache Software Foundati

[GitHub] [kafka] Hangleton commented on a diff in pull request #13584: MINOR: Add log segment unit tests, If the maximum offset beyond index, appen…

2023-05-11 Thread via GitHub
Hangleton commented on code in PR #13584: URL: https://github.com/apache/kafka/pull/13584#discussion_r1191598672 ## core/src/test/scala/unit/kafka/log/LogSegmentTest.scala: ## @@ -65,6 +68,32 @@ class LogSegmentTest { Utils.delete(logDir) } + /** + * LogSegmentOffse

[GitHub] [kafka] Hangleton commented on a diff in pull request #13584: MINOR: Add log segment unit tests, If the maximum offset beyond index, appen…

2023-05-11 Thread via GitHub
Hangleton commented on code in PR #13584: URL: https://github.com/apache/kafka/pull/13584#discussion_r1191598230 ## core/src/test/scala/unit/kafka/log/LogSegmentTest.scala: ## @@ -65,6 +68,32 @@ class LogSegmentTest { Utils.delete(logDir) } + /** + * LogSegmentOffse

[GitHub] [kafka] splett2 commented on a diff in pull request #13707: KAFKA-14990: Dynamic producer ID expiration should be applied on a broker restart

2023-05-11 Thread via GitHub
splett2 commented on code in PR #13707: URL: https://github.com/apache/kafka/pull/13707#discussion_r1191586683 ## core/src/main/scala/kafka/server/KafkaConfig.scala: ## @@ -1956,10 +1956,10 @@ class KafkaConfig private(doLog: Boolean, val props: java.util.Map[_, _], dynami v

[GitHub] [kafka] jolshan commented on a diff in pull request #13707: KAFKA-14990: Dynamic producer ID expiration should be applied on a broker restart

2023-05-11 Thread via GitHub
jolshan commented on code in PR #13707: URL: https://github.com/apache/kafka/pull/13707#discussion_r1191577885 ## core/src/test/scala/integration/kafka/api/ProducerIdExpirationTest.scala: ## @@ -183,7 +183,11 @@ class ProducerIdExpirationTest extends KafkaServerTestHarness {

[GitHub] [kafka] jolshan commented on a diff in pull request #13707: KAFKA-14990: Dynamic producer ID expiration should be applied on a broker restart

2023-05-11 Thread via GitHub
jolshan commented on code in PR #13707: URL: https://github.com/apache/kafka/pull/13707#discussion_r1191576738 ## core/src/main/scala/kafka/server/KafkaConfig.scala: ## @@ -1956,10 +1956,10 @@ class KafkaConfig private(doLog: Boolean, val props: java.util.Map[_, _], dynami v

[GitHub] [kafka] splett2 opened a new pull request, #13707: KAFKA-14990: Dynamic producer ID expiration should be applied on a broker restart

2023-05-11 Thread via GitHub
splett2 opened a new pull request, #13707: URL: https://github.com/apache/kafka/pull/13707 Dynamic overrides for the producer ID expiration config are not picked up on broker restart in Zookeeper mode. Based on the integration test, this does not apply to KRaft mode. Adds a broker re

[jira] [Created] (KAFKA-14990) Dynamic producer ID expiration is not applied on broker restart

2023-05-11 Thread David Mao (Jira)
David Mao created KAFKA-14990: - Summary: Dynamic producer ID expiration is not applied on broker restart Key: KAFKA-14990 URL: https://issues.apache.org/jira/browse/KAFKA-14990 Project: Kafka Is

[GitHub] [kafka] hoangphuocbk commented on pull request #12371: KAFKA-14035: Fix NPE caused by missing null check in SnapshottableHashTable::mergeFrom()

2023-05-11 Thread via GitHub
hoangphuocbk commented on PR #12371: URL: https://github.com/apache/kafka/pull/12371#issuecomment-1544342962 @iblislin, I had same problem. Did your solution work? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[GitHub] [kafka] dajac commented on a diff in pull request #13704: KAFKA-14500; [3/N] add GroupMetadataKey/Value record helpers

2023-05-11 Thread via GitHub
dajac commented on code in PR #13704: URL: https://github.com/apache/kafka/pull/13704#discussion_r1191453623 ## server-common/src/main/java/org/apache/kafka/server/common/MetadataVersion.java: ## @@ -365,6 +365,20 @@ public short listOffsetRequestVersion() { } }

[GitHub] [kafka] dajac commented on a diff in pull request #13704: KAFKA-14500; [3/N] add GroupMetadataKey/Value record helpers

2023-05-11 Thread via GitHub
dajac commented on code in PR #13704: URL: https://github.com/apache/kafka/pull/13704#discussion_r1191452753 ## group-coordinator/src/test/java/org/apache/kafka/coordinator/group/RecordHelpersTest.java: ## @@ -399,8 +403,12 @@ public void testNewCurrentAssignmentTombstoneRecord(

[GitHub] [kafka] jeffkbkim commented on a diff in pull request #13704: KAFKA-14500; [3/N] add GroupMetadataKey/Value record helpers

2023-05-11 Thread via GitHub
jeffkbkim commented on code in PR #13704: URL: https://github.com/apache/kafka/pull/13704#discussion_r1191438825 ## group-coordinator/src/test/java/org/apache/kafka/coordinator/group/RecordHelpersTest.java: ## @@ -383,4 +398,84 @@ public void testNewCurrentAssignmentTombstoneRec

[GitHub] [kafka] fvaleri commented on pull request #13517: KAFKA-14752: Kafka examples improvements - demo changes

2023-05-11 Thread via GitHub
fvaleri commented on PR #13517: URL: https://github.com/apache/kafka/pull/13517#issuecomment-1544315826 @showuon thanks for keeping the time to review all these PRs. We should be good now. -- This is an automated message from the Apache Git Service. To respond to the message, please log o

[GitHub] [kafka] fvaleri commented on a diff in pull request #13517: KAFKA-14752: Kafka examples improvements - demo changes

2023-05-11 Thread via GitHub
fvaleri commented on code in PR #13517: URL: https://github.com/apache/kafka/pull/13517#discussion_r1191435518 ## examples/src/main/java/kafka/examples/KafkaConsumerProducerDemo.java: ## @@ -16,29 +16,59 @@ */ package kafka.examples; -import org.apache.kafka.common.errors.T

[GitHub] [kafka] clolov commented on a diff in pull request #13663: KAFKA-14500; [2/N] Rewrite GroupMetadata in Java

2023-05-11 Thread via GitHub
clolov commented on code in PR #13663: URL: https://github.com/apache/kafka/pull/13663#discussion_r1191430711 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/generic/GenericGroup.java: ## @@ -0,0 +1,998 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] clolov commented on a diff in pull request #13663: KAFKA-14500; [2/N] Rewrite GroupMetadata in Java

2023-05-11 Thread via GitHub
clolov commented on code in PR #13663: URL: https://github.com/apache/kafka/pull/13663#discussion_r1191430711 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/generic/GenericGroup.java: ## @@ -0,0 +1,998 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] satishd merged pull request #13060: KAFKA-14559: Fix JMX tool to handle the object names with wild cards and optional attributes

2023-05-11 Thread via GitHub
satishd merged PR #13060: URL: https://github.com/apache/kafka/pull/13060 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.

[GitHub] [kafka] satishd commented on pull request #13060: KAFKA-14559: Fix JMX tool to handle the object names with wild cards and optional attributes

2023-05-11 Thread via GitHub
satishd commented on PR #13060: URL: https://github.com/apache/kafka/pull/13060#issuecomment-1544287256 There were a couple of test failures that are unrelated to this PR, will merge to trunk. -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [kafka] philipnee commented on a diff in pull request #13678: KAFKA-10337: await async commits in commitSync even if no offsets given

2023-05-11 Thread via GitHub
philipnee commented on code in PR #13678: URL: https://github.com/apache/kafka/pull/13678#discussion_r1191400253 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/ConsumerCoordinator.java: ## @@ -186,6 +187,7 @@ public ConsumerCoordinator(GroupRebalanceConfig

[GitHub] [kafka] philipnee commented on a diff in pull request #13678: KAFKA-10337: await async commits in commitSync even if no offsets given

2023-05-11 Thread via GitHub
philipnee commented on code in PR #13678: URL: https://github.com/apache/kafka/pull/13678#discussion_r1191400253 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/ConsumerCoordinator.java: ## @@ -186,6 +187,7 @@ public ConsumerCoordinator(GroupRebalanceConfig

[GitHub] [kafka] philipnee commented on a diff in pull request #13678: KAFKA-10337: await async commits in commitSync even if no offsets given

2023-05-11 Thread via GitHub
philipnee commented on code in PR #13678: URL: https://github.com/apache/kafka/pull/13678#discussion_r1191400253 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/ConsumerCoordinator.java: ## @@ -186,6 +187,7 @@ public ConsumerCoordinator(GroupRebalanceConfig

[GitHub] [kafka] dajac commented on a diff in pull request #13704: KAFKA-14500; [3/N] add GroupMetadataKey/Value record helpers

2023-05-11 Thread via GitHub
dajac commented on code in PR #13704: URL: https://github.com/apache/kafka/pull/13704#discussion_r1191395592 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/RecordHelpers.java: ## @@ -357,6 +366,94 @@ public static Record newCurrentAssignmentTombstoneRecord

[GitHub] [kafka] jlprat merged pull request #13706: MINOR: clean up unused methods in core utils

2023-05-11 Thread via GitHub
jlprat merged PR #13706: URL: https://github.com/apache/kafka/pull/13706 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.o

[GitHub] [kafka] jeffkbkim commented on a diff in pull request #13704: KAFKA-14500; [3/N] add GroupMetadataKey/Value record helpers

2023-05-11 Thread via GitHub
jeffkbkim commented on code in PR #13704: URL: https://github.com/apache/kafka/pull/13704#discussion_r1191390607 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/RecordHelpers.java: ## @@ -357,6 +366,94 @@ public static Record newCurrentAssignmentTombstoneRe

[GitHub] [kafka] philipnee commented on a diff in pull request #13678: KAFKA-10337: await async commits in commitSync even if no offsets given

2023-05-11 Thread via GitHub
philipnee commented on code in PR #13678: URL: https://github.com/apache/kafka/pull/13678#discussion_r1191387973 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/ConsumerCoordinator.java: ## @@ -1223,6 +1233,26 @@ public void maybeAutoCommitOffsetsAsync(long

[GitHub] [kafka] jlprat commented on pull request #13706: MINOR: clean up unused methods in core utils

2023-05-11 Thread via GitHub
jlprat commented on PR #13706: URL: https://github.com/apache/kafka/pull/13706#issuecomment-1544246745 All test failures seem to be unrelated to the change. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [kafka] dajac commented on a diff in pull request #13663: KAFKA-14500; [2/N] Rewrite GroupMetadata in Java

2023-05-11 Thread via GitHub
dajac commented on code in PR #13663: URL: https://github.com/apache/kafka/pull/13663#discussion_r1191381128 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/generic/GenericGroup.java: ## @@ -0,0 +1,1012 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] jeffkbkim commented on a diff in pull request #13663: KAFKA-14500; [2/N] Rewrite GroupMetadata in Java

2023-05-11 Thread via GitHub
jeffkbkim commented on code in PR #13663: URL: https://github.com/apache/kafka/pull/13663#discussion_r1191374954 ## group-coordinator/src/test/java/org/apache/kafka/coordinator/group/generic/GenericGroupTest.java: ## @@ -0,0 +1,935 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] [kafka] jeffkbkim commented on a diff in pull request #13663: KAFKA-14500; [2/N] Rewrite GroupMetadata in Java

2023-05-11 Thread via GitHub
jeffkbkim commented on code in PR #13663: URL: https://github.com/apache/kafka/pull/13663#discussion_r1191359030 ## group-coordinator/src/test/java/org/apache/kafka/coordinator/group/generic/GenericGroupTest.java: ## @@ -0,0 +1,935 @@ +/* + * Licensed to the Apache Software Foun

[jira] [Updated] (KAFKA-14978) ExactlyOnceWorkerSourceTask does not remove parent metrics

2023-05-11 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton updated KAFKA-14978: -- Fix Version/s: 3.4.1 > ExactlyOnceWorkerSourceTask does not remove parent metrics > --

[GitHub] [kafka] jeffkbkim commented on a diff in pull request #13663: KAFKA-14500; [2/N] Rewrite GroupMetadata in Java

2023-05-11 Thread via GitHub
jeffkbkim commented on code in PR #13663: URL: https://github.com/apache/kafka/pull/13663#discussion_r1191340188 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/generic/GenericGroup.java: ## @@ -0,0 +1,998 @@ +/* + * Licensed to the Apache Software Foundati

[GitHub] [kafka] kirktrue commented on a diff in pull request #12685: KAFKA-14945: Add Serializer#serializeToByteBuffer() to reduce memory copying

2023-05-11 Thread via GitHub
kirktrue commented on code in PR #12685: URL: https://github.com/apache/kafka/pull/12685#discussion_r1191281659 ## clients/src/main/java/org/apache/kafka/clients/producer/KafkaProducer.java: ## @@ -1383,9 +1386,13 @@ private ClusterResourceListeners configureClusterResourceList

[GitHub] [kafka] jeffkbkim commented on a diff in pull request #13663: KAFKA-14500; [2/N] Rewrite GroupMetadata in Java

2023-05-11 Thread via GitHub
jeffkbkim commented on code in PR #13663: URL: https://github.com/apache/kafka/pull/13663#discussion_r1191303709 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/generic/GenericGroup.java: ## @@ -0,0 +1,998 @@ +/* + * Licensed to the Apache Software Foundati

[GitHub] [kafka] lanshiqin commented on a diff in pull request #13584: MINOR: Add log segment unit tests, If the maximum offset beyond index, appen…

2023-05-11 Thread via GitHub
lanshiqin commented on code in PR #13584: URL: https://github.com/apache/kafka/pull/13584#discussion_r1191256878 ## core/src/test/scala/unit/kafka/log/LogSegmentTest.scala: ## @@ -65,6 +68,32 @@ class LogSegmentTest { Utils.delete(logDir) } + /** + * LogSegmentOffse

[GitHub] [kafka] lanshiqin commented on a diff in pull request #13584: MINOR: Add log segment unit tests, If the maximum offset beyond index, appen…

2023-05-11 Thread via GitHub
lanshiqin commented on code in PR #13584: URL: https://github.com/apache/kafka/pull/13584#discussion_r1191252780 ## core/src/test/scala/unit/kafka/log/LogSegmentTest.scala: ## @@ -65,6 +68,32 @@ class LogSegmentTest { Utils.delete(logDir) } + /** + * LogSegmentOffse

[GitHub] [kafka] lanshiqin commented on a diff in pull request #13584: MINOR: Add log segment unit tests, If the maximum offset beyond index, appen…

2023-05-11 Thread via GitHub
lanshiqin commented on code in PR #13584: URL: https://github.com/apache/kafka/pull/13584#discussion_r1191248219 ## core/src/test/scala/unit/kafka/log/LogSegmentTest.scala: ## @@ -65,6 +68,32 @@ class LogSegmentTest { Utils.delete(logDir) } + /** + * LogSegmentOffse

[GitHub] [kafka] dajac commented on a diff in pull request #13704: KAFKA-14500; [3/N] add GroupMetadataKey/Value record helpers

2023-05-11 Thread via GitHub
dajac commented on code in PR #13704: URL: https://github.com/apache/kafka/pull/13704#discussion_r1191225920 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/RecordHelpers.java: ## @@ -357,6 +366,94 @@ public static Record newCurrentAssignmentTombstoneRecord

[GitHub] [kafka] clolov commented on a diff in pull request #13681: KAFKA-14133: Migrate ActiveTaskCreator mock in TaskManagerTest to Mockito

2023-05-11 Thread via GitHub
clolov commented on code in PR #13681: URL: https://github.com/apache/kafka/pull/13681#discussion_r1191109013 ## streams/src/test/java/org/apache/kafka/streams/processor/internals/TaskManagerTest.java: ## @@ -845,17 +847,16 @@ public void shouldRecycleTasksRemovedFromStateUpdate

[GitHub] [kafka] dajac commented on a diff in pull request #13663: KAFKA-14500; [2/N] Rewrite GroupMetadata in Java

2023-05-11 Thread via GitHub
dajac commented on code in PR #13663: URL: https://github.com/apache/kafka/pull/13663#discussion_r1191160971 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/generic/GenericGroup.java: ## @@ -0,0 +1,967 @@ +/* + * Licensed to the Apache Software Foundation (

[GitHub] [kafka] dengziming commented on pull request #13679: KAFKA-14291: KRaft controller should return right finalized features in ApiVersionResponse

2023-05-11 Thread via GitHub
dengziming commented on PR #13679: URL: https://github.com/apache/kafka/pull/13679#issuecomment-1543964126 I rerun the failed tests locally and they work correctly, I create a JIRA to track this problem. https://issues.apache.org/jira/browse/KAFKA-14989 -- This is an automated message

[jira] [Commented] (KAFKA-14989) Flaky test TransactionsTest.testFailureToFenceEpoch

2023-05-11 Thread Deng Ziming (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17721762#comment-17721762 ] Deng Ziming commented on KAFKA-14989: - https://ci-builds.apache.org/job/Kafka/job/ka

[jira] [Created] (KAFKA-14989) Flaky test TransactionsTest.testFailureToFenceEpoch

2023-05-11 Thread Deng Ziming (Jira)
Deng Ziming created KAFKA-14989: --- Summary: Flaky test TransactionsTest.testFailureToFenceEpoch Key: KAFKA-14989 URL: https://issues.apache.org/jira/browse/KAFKA-14989 Project: Kafka Issue Type:

[GitHub] [kafka] jlprat commented on pull request #13706: MINOR: clean up unused methods in core utils

2023-05-11 Thread via GitHub
jlprat commented on PR #13706: URL: https://github.com/apache/kafka/pull/13706#issuecomment-1543873607 Thanks @machi1990 I fixed the typo as well -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [kafka] dajac merged pull request #13694: MINOR: add test tag for testDeadToDeadIllegalTransition

2023-05-11 Thread via GitHub
dajac merged PR #13694: URL: https://github.com/apache/kafka/pull/13694 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.or

[GitHub] [kafka] machi1990 commented on pull request #12045: KAFKA-12319: Change calculation of window size used to calculate `Rate`

2023-05-11 Thread via GitHub
machi1990 commented on PR #12045: URL: https://github.com/apache/kafka/pull/12045#issuecomment-1543816986 > @machi1990 since you opened a PR to fix this flaky test, you might be familiar with this part of code. May I request you to review this PR please. Hey @divijvaidya I am new to K

[GitHub] [kafka] viktorsomogyi commented on pull request #13701: KAFKA-14978 ExactlyOnceWorkerSourceTask should remove parent metrics …

2023-05-11 Thread via GitHub
viktorsomogyi commented on PR #13701: URL: https://github.com/apache/kafka/pull/13701#issuecomment-1543791889 @vamossagar12 yes, trunk and backports to 3.5 and 3.4 have been merged already. -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [kafka] viktorsomogyi merged pull request #13699: KAFKA-14978 ExactlyOnceWorkerSourceTask should remove parent metrics …

2023-05-11 Thread via GitHub
viktorsomogyi merged PR #13699: URL: https://github.com/apache/kafka/pull/13699 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.a

[GitHub] [kafka] viktorsomogyi merged pull request #13698: KAFKA-14978 ExactlyOnceWorkerSourceTask should remove parent metrics …

2023-05-11 Thread via GitHub
viktorsomogyi merged PR #13698: URL: https://github.com/apache/kafka/pull/13698 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.a

[GitHub] [kafka] Hangleton commented on a diff in pull request #13535: KAFKA-9579 Fetch implementation for records in the remote storage through a specific purgatory.

2023-05-11 Thread via GitHub
Hangleton commented on code in PR #13535: URL: https://github.com/apache/kafka/pull/13535#discussion_r1190991070 ## core/src/test/java/kafka/log/remote/RemoteLogReaderTest.java: ## @@ -0,0 +1,82 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + * co

[jira] [Updated] (KAFKA-14975) Make TopicBasedRemoteLogMetadataManager methods wait for initialize to complete

2023-05-11 Thread Matthew de Detrich (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthew de Detrich updated KAFKA-14975: --- Parent: KAFKA-7739 Issue Type: Sub-task (was: Task) > Make TopicBasedRemote

[GitHub] [kafka] showuon commented on a diff in pull request #13517: KAFKA-14752: Kafka examples improvements - demo changes

2023-05-11 Thread via GitHub
showuon commented on code in PR #13517: URL: https://github.com/apache/kafka/pull/13517#discussion_r1190888533 ## examples/src/main/java/kafka/examples/KafkaConsumerProducerDemo.java: ## @@ -16,29 +16,59 @@ */ package kafka.examples; -import org.apache.kafka.common.errors.T

[GitHub] [kafka] akatona84 commented on pull request #11565: KAFKA-13504: Retry connect internal topics' creation in case of InvalidReplicationFactorException

2023-05-11 Thread via GitHub
akatona84 commented on PR #11565: URL: https://github.com/apache/kafka/pull/11565#issuecomment-1543645307 thx. rebased again and did som adjustments. (this time I built it and ran my modified unit tests as well :) ) -- This is an automated message from the Apache Git Service. To respond t

[GitHub] [kafka] showuon merged pull request #13516: KAFKA-14752: Kafka examples improvements - processor changes

2023-05-11 Thread via GitHub
showuon merged PR #13516: URL: https://github.com/apache/kafka/pull/13516 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.

[GitHub] [kafka] showuon commented on pull request #13516: KAFKA-14752: Kafka examples improvements - processor changes

2023-05-11 Thread via GitHub
showuon commented on PR #13516: URL: https://github.com/apache/kafka/pull/13516#issuecomment-1543640638 Failed tests are unrelated: ``` Build / JDK 17 and Scala 2.13 / org.apache.kafka.common.security.authenticator.SaslAuthenticatorTest.testMultipleServerMechanisms() Build /

[GitHub] [kafka] showuon commented on a diff in pull request #13516: KAFKA-14752: Kafka examples improvements - processor changes

2023-05-11 Thread via GitHub
showuon commented on code in PR #13516: URL: https://github.com/apache/kafka/pull/13516#discussion_r1190880657 ## examples/src/main/java/kafka/examples/ExactlyOnceMessageProcessor.java: ## @@ -79,111 +86,114 @@ public ExactlyOnceMessageProcessor(final String inputTopic,

[GitHub] [kafka] mimaison merged pull request #13170: MINOR: Remove unused methods in CoreUtils

2023-05-11 Thread via GitHub
mimaison merged PR #13170: URL: https://github.com/apache/kafka/pull/13170 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

[GitHub] [kafka] AB027PS commented on pull request #12331: KAFKA-1194: changes needed to run on Windows

2023-05-11 Thread via GitHub
AB027PS commented on PR #12331: URL: https://github.com/apache/kafka/pull/12331#issuecomment-1543611485 I work with Martin Pelak and he suggested that I add my change to this PR, but my change is unrelated to the rest of this PR. So this doesn't address the errors mentioned in the first com

[jira] [Commented] (KAFKA-13349) Allow Iterator.remove on KeyValueIterator

2023-05-11 Thread Mahesh Madushan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17721696#comment-17721696 ] Mahesh Madushan commented on KAFKA-13349: - Hello [~guozhang] . While I'm looking

[GitHub] [kafka] jlprat commented on pull request #13706: MINOR: clean up unused methods in core utils

2023-05-11 Thread via GitHub
jlprat commented on PR #13706: URL: https://github.com/apache/kafka/pull/13706#issuecomment-1543608786 @mimaison I took inspiration from your PR to clean up some more unused methods -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

[GitHub] [kafka] jlprat commented on a diff in pull request #13170: MINOR: Remove unused methods in CoreUtils

2023-05-11 Thread via GitHub
jlprat commented on code in PR #13170: URL: https://github.com/apache/kafka/pull/13170#discussion_r1190857226 ## core/src/test/scala/unit/kafka/utils/CoreUtilsTest.scala: ## @@ -223,7 +204,7 @@ class CoreUtilsTest extends Logging { val map = new ConcurrentHashMap[Int, Atomi

[GitHub] [kafka] jlprat opened a new pull request, #13706: MINOR: clean up unused methods in core utils

2023-05-11 Thread via GitHub
jlprat opened a new pull request, #13706: URL: https://github.com/apache/kafka/pull/13706 Inspired by https://github.com/apache/kafka/pull/13170 I decided to check some other core utils classes and remove some unused methods. ### Committer Checklist (excluded from commit message) -

[GitHub] [kafka] mimaison commented on a diff in pull request #13170: MINOR: Remove unused methods in CoreUtils

2023-05-11 Thread via GitHub
mimaison commented on code in PR #13170: URL: https://github.com/apache/kafka/pull/13170#discussion_r1190855504 ## core/src/test/scala/unit/kafka/utils/CoreUtilsTest.scala: ## @@ -223,7 +204,7 @@ class CoreUtilsTest extends Logging { val map = new ConcurrentHashMap[Int, Ato

[jira] [Updated] (KAFKA-14988) Upgrade scalaCollectionCompact to v2.9 for CVE-2022-36944

2023-05-11 Thread Divij Vaidya (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Divij Vaidya updated KAFKA-14988: - Fix Version/s: 3.6.0 > Upgrade scalaCollectionCompact to v2.9 for CVE-2022-36944 > -

[jira] [Updated] (KAFKA-14988) Upgrade scalaCollectionCompact to v2.9 for CVE-2022-36944

2023-05-11 Thread Divij Vaidya (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Divij Vaidya updated KAFKA-14988: - Description: Current version of ScalaCollectionCompact library in trunk 2.6.0 suffers from a cr

[jira] [Comment Edited] (KAFKA-14988) Upgrade scalaCollectionCompact to v2.9 for CVE-2022-36944

2023-05-11 Thread Divij Vaidya (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17721691#comment-17721691 ] Divij Vaidya edited comment on KAFKA-14988 at 5/11/23 8:46 AM: ---

[jira] [Commented] (KAFKA-14988) Upgrade scalaCollectionCompact to v2.9 for CVE-2022-36944

2023-05-11 Thread Divij Vaidya (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17721691#comment-17721691 ] Divij Vaidya commented on KAFKA-14988: -- Fixed by [https://github.com/apache/kafka/p

[GitHub] [kafka] Hangleton commented on pull request #12331: KAFKA-1194: changes needed to run on Windows

2023-05-11 Thread via GitHub
Hangleton commented on PR #12331: URL: https://github.com/apache/kafka/pull/12331#issuecomment-1543590907 Hi Julius (@AB027PS) - just to clarify, this isn't the same as the `AccessDeniedException` addressed by this CR right? -- This is an automated message from the Apache Git Service. To

[GitHub] [kafka] divijvaidya commented on pull request #12045: KAFKA-12319: Change calculation of window size used to calculate `Rate`

2023-05-11 Thread via GitHub
divijvaidya commented on PR #12045: URL: https://github.com/apache/kafka/pull/12045#issuecomment-1543589903 @machi1990 since you opened a PR to fix this flaky test, you might be familiar with this part of code. May I request you to review this PR please. -- This is an automated message fr

[jira] [Created] (KAFKA-14988) Upgrade scalaCollectionCompact to v2.9 for CVE-2022-36944

2023-05-11 Thread Divij Vaidya (Jira)
Divij Vaidya created KAFKA-14988: Summary: Upgrade scalaCollectionCompact to v2.9 for CVE-2022-36944 Key: KAFKA-14988 URL: https://issues.apache.org/jira/browse/KAFKA-14988 Project: Kafka Iss

  1   2   >