[GitHub] [kafka] showuon commented on a diff in pull request #12783: KAFKA-14334: complete delayed purgatory after replication

2022-11-04 Thread GitBox
showuon commented on code in PR #12783: URL: https://github.com/apache/kafka/pull/12783#discussion_r1013697955 ## core/src/test/scala/unit/kafka/server/ReplicaFetcherThreadTest.scala: ## @@ -1100,6 +1102,66 @@ class ReplicaFetcherThreadTest { assertEquals(Collections.single

[GitHub] [kafka] dajac commented on pull request #12794: Revert "KAFKA-13891: reset generation when syncgroup failed with REBA…

2022-11-04 Thread GitBox
dajac commented on PR #12794: URL: https://github.com/apache/kafka/pull/12794#issuecomment-1303070785 @showuon What's the plan with this one? I tend to agree that reverting it makes sense. Is there are reason why you did not merge it yet? -- This is an automated message from the Apache Gi

[GitHub] [kafka] showuon commented on pull request #12794: Revert "KAFKA-13891: reset generation when syncgroup failed with REBA…

2022-11-04 Thread GitBox
showuon commented on PR #12794: URL: https://github.com/apache/kafka/pull/12794#issuecomment-1303078559 Ah, sorry, was waiting for jenkins build results, and ... forgot it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [kafka] showuon commented on pull request #12794: Revert "KAFKA-13891: reset generation when syncgroup failed with REBA…

2022-11-04 Thread GitBox
showuon commented on PR #12794: URL: https://github.com/apache/kafka/pull/12794#issuecomment-1303080802 Build results: ``` Build / JDK 8 and Scala 2.12 / kafka.admin.TopicCommandIntegrationTest.testDeleteInternalTopic(String).quorum=kraft Build / JDK 8 and Scala 2.12 / kafk

[GitHub] [kafka] dajac commented on a diff in pull request #12783: KAFKA-14334: complete delayed purgatory after replication

2022-11-04 Thread GitBox
dajac commented on code in PR #12783: URL: https://github.com/apache/kafka/pull/12783#discussion_r1013705694 ## core/src/main/scala/kafka/log/UnifiedLog.scala: ## @@ -433,6 +432,27 @@ class UnifiedLog(@volatile var logStartOffset: Long, } } + /** + * Update high wat

[GitHub] [kafka] dajac merged pull request #12811: MINOR: Move timeline data structures from metadata to server-common

2022-11-04 Thread GitBox
dajac merged PR #12811: URL: https://github.com/apache/kafka/pull/12811 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.or

[GitHub] [kafka] dajac commented on a diff in pull request #12748: KAFKA-13715: add generationId field in subscription

2022-11-04 Thread GitBox
dajac commented on code in PR #12748: URL: https://github.com/apache/kafka/pull/12748#discussion_r1013722215 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AbstractStickyAssignor.java: ## @@ -117,30 +117,41 @@ private boolean allSubscriptionsEqual(Set allT

[GitHub] [kafka] showuon commented on pull request #12756: Kafka 12960: Follow up Commit to filter expired records from Windowed/Session Stores

2022-11-04 Thread GitBox
showuon commented on PR #12756: URL: https://github.com/apache/kafka/pull/12756#issuecomment-1303186809 @vamossagar12 , sorry, could you help point to me where this PR is different from https://github.com/apache/kafka/pull/11211. That would help me have quicker review. Thanks. -- This is

[GitHub] [kafka] clolov opened a new pull request, #12821: Replace PowerMock and EasyMock with Mockito in streams tests

2022-11-04 Thread GitBox
clolov opened a new pull request, #12821: URL: https://github.com/apache/kafka/pull/12821 Batch 1 of the tests detailed in https://issues.apache.org/jira/browse/KAFKA-14132 which use PowerMock/EasyMock and need to be moved to Mockito. -- This is an automated message from the Apache Git S

[GitHub] [kafka] vamossagar12 commented on pull request #12756: Kafka 12960: Follow up Commit to filter expired records from Windowed/Session Stores

2022-11-04 Thread GitBox
vamossagar12 commented on PR #12756: URL: https://github.com/apache/kafka/pull/12756#issuecomment-1303348490 > @vamossagar12 , sorry, could you help point to me where this PR is different from #11211. That would help me have quicker review. Thanks. @showuon , it is mainly around => s

[jira] [Updated] (KAFKA-14132) Remaining PowerMock to Mockito tests

2022-11-04 Thread Christo Lolov (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christo Lolov updated KAFKA-14132: -- Description: {color:#de350b}Some of the tests below use EasyMock as well. For those migrate b

[jira] [Updated] (KAFKA-14132) Remaining PowerMock to Mockito tests

2022-11-04 Thread Christo Lolov (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christo Lolov updated KAFKA-14132: -- Description: {color:#de350b}Some of the tests below use EasyMock as well. For those migrate b

[jira] [Created] (KAFKA-14355) Integer overflow occurs in kafka-producer-perf-test.sh (class ProducerProfrmance ).

2022-11-04 Thread Minoru Tomioka (Jira)
Minoru Tomioka created KAFKA-14355: -- Summary: Integer overflow occurs in kafka-producer-perf-test.sh (class ProducerProfrmance ). Key: KAFKA-14355 URL: https://issues.apache.org/jira/browse/KAFKA-14355

[jira] [Updated] (KAFKA-14355) Integer overflow occurs in kafka-producer-perf-test.sh (class ProducerProfrmance ).

2022-11-04 Thread Minoru Tomioka (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Minoru Tomioka updated KAFKA-14355: --- Priority: Minor (was: Major) > Integer overflow occurs in kafka-producer-perf-test.sh (clas

[jira] [Updated] (KAFKA-14355) Integer overflow occurs in kafka-producer-perf-test.sh (class ProducerProfrmance ).

2022-11-04 Thread Minoru Tomioka (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Minoru Tomioka updated KAFKA-14355: --- Description:   An integer overflow occurs if a fairly large value is passed to {{{}--num-r

[GitHub] [kafka] showuon commented on a diff in pull request #12729: KAFKA-14285: Delete quota node in zookeeper when configs are empty

2022-11-04 Thread GitBox
showuon commented on code in PR #12729: URL: https://github.com/apache/kafka/pull/12729#discussion_r1013994799 ## core/src/main/scala/kafka/zk/AdminZkClient.scala: ## @@ -355,18 +355,43 @@ class AdminZkClient(zkClient: KafkaZkClient) extends Logging { * @param entityName Th

[GitHub] [kafka] runom opened a new pull request, #12822: KAFKA-14355: Fix integer overflow in ProducerPerformance

2022-11-04 Thread GitBox
runom opened a new pull request, #12822: URL: https://github.com/apache/kafka/pull/12822 In `kafka-producer-perf-test.sh`, an integer overflow occurs if a fairly large value is passed to `--num-records`. It causes a NegativeArraySizeException error. This PR fixed this problem by changing ty

[jira] [Created] (KAFKA-14356) Make it possible to detect changes to SCRAM-SHA credentials using the Admin API

2022-11-04 Thread Jakub Scholz (Jira)
Jakub Scholz created KAFKA-14356: Summary: Make it possible to detect changes to SCRAM-SHA credentials using the Admin API Key: KAFKA-14356 URL: https://issues.apache.org/jira/browse/KAFKA-14356 Proje

[GitHub] [kafka] C0urante commented on a diff in pull request #12817: KAFKA-14346: Remove difficult to mock Plugins.compareAndSwapLoader usages

2022-11-04 Thread GitBox
C0urante commented on code in PR #12817: URL: https://github.com/apache/kafka/pull/12817#discussion_r1014046291 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/WorkerConnector.java: ## @@ -116,14 +115,12 @@ public void run() { LoggingContext.clear();

[GitHub] [kafka] C0urante commented on a diff in pull request #12817: KAFKA-14346: Remove difficult to mock Plugins.compareAndSwapLoader usages

2022-11-04 Thread GitBox
C0urante commented on code in PR #12817: URL: https://github.com/apache/kafka/pull/12817#discussion_r1014046291 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/WorkerConnector.java: ## @@ -116,14 +115,12 @@ public void run() { LoggingContext.clear();

[jira] [Created] (KAFKA-14357) Make it possible to batch describe requests in the Kafka Admin API

2022-11-04 Thread Jakub Scholz (Jira)
Jakub Scholz created KAFKA-14357: Summary: Make it possible to batch describe requests in the Kafka Admin API Key: KAFKA-14357 URL: https://issues.apache.org/jira/browse/KAFKA-14357 Project: Kafka

[GitHub] [kafka] C0urante commented on a diff in pull request #12817: KAFKA-14346: Remove difficult to mock Plugins.compareAndSwapLoader usages

2022-11-04 Thread GitBox
C0urante commented on code in PR #12817: URL: https://github.com/apache/kafka/pull/12817#discussion_r1014047751 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/isolation/Plugins.java: ## @@ -155,10 +143,22 @@ public LoaderSwap withClassLoader(ClassLoader loader

[GitHub] [kafka] C0urante commented on a diff in pull request #12817: KAFKA-14346: Remove difficult to mock Plugins.compareAndSwapLoader usages

2022-11-04 Thread GitBox
C0urante commented on code in PR #12817: URL: https://github.com/apache/kafka/pull/12817#discussion_r1014063487 ## connect/runtime/src/test/java/org/apache/kafka/connect/runtime/WorkerTest.java: ## @@ -1957,6 +1789,61 @@ private void verifyTaskHeaderConverter() { verify

[GitHub] [kafka] C0urante commented on a diff in pull request #12817: KAFKA-14346: Remove difficult to mock Plugins.compareAndSwapLoader usages

2022-11-04 Thread GitBox
C0urante commented on code in PR #12817: URL: https://github.com/apache/kafka/pull/12817#discussion_r1014063487 ## connect/runtime/src/test/java/org/apache/kafka/connect/runtime/WorkerTest.java: ## @@ -1957,6 +1789,61 @@ private void verifyTaskHeaderConverter() { verify

[GitHub] [kafka] clolov opened a new pull request, #12823: KAFKA-14132: Replace PowerMock and EasyMock with Mockito in streams tests

2022-11-04 Thread GitBox
clolov opened a new pull request, #12823: URL: https://github.com/apache/kafka/pull/12823 Batch 2 of the tests detailed in https://issues.apache.org/jira/browse/KAFKA-14132 which use PowerMock/EasyMock and need to be moved to Mockito. -- This is an automated message from the Apache Git S

[jira] [Updated] (KAFKA-14132) Remaining PowerMock to Mockito tests

2022-11-04 Thread Christo Lolov (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christo Lolov updated KAFKA-14132: -- Description: {color:#de350b}Some of the tests below use EasyMock as well. For those migrate b

[GitHub] [kafka] clolov commented on a diff in pull request #12823: KAFKA-14132: Replace PowerMock and EasyMock with Mockito in streams tests

2022-11-04 Thread GitBox
clolov commented on code in PR #12823: URL: https://github.com/apache/kafka/pull/12823#discussion_r1014077019 ## connect/runtime/src/test/java/org/apache/kafka/connect/runtime/SourceTaskOffsetCommitterTest.java: ## @@ -71,122 +74,74 @@ public void setup() { Long

[GitHub] [kafka] clolov commented on pull request #12823: KAFKA-14132: Replace PowerMock and EasyMock with Mockito in streams tests

2022-11-04 Thread GitBox
clolov commented on PR #12823: URL: https://github.com/apache/kafka/pull/12823#issuecomment-1303625752 Hey @C0urante! Tagging you for visibility as this is a Connect-related test. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [kafka] clolov commented on a diff in pull request #12821: KAFKA-14132: Replace PowerMock and EasyMock with Mockito in streams tests

2022-11-04 Thread GitBox
clolov commented on code in PR #12821: URL: https://github.com/apache/kafka/pull/12821#discussion_r1014079123 ## streams/src/test/java/org/apache/kafka/streams/processor/internals/RepartitionTopicsTest.java: ## @@ -47,22 +47,18 @@ import static org.apache.kafka.streams.process

[GitHub] [kafka] clolov commented on a diff in pull request #12821: KAFKA-14132: Replace PowerMock and EasyMock with Mockito in streams tests

2022-11-04 Thread GitBox
clolov commented on code in PR #12821: URL: https://github.com/apache/kafka/pull/12821#discussion_r1014080005 ## streams/src/test/java/org/apache/kafka/streams/processor/internals/RepartitionTopicsTest.java: ## @@ -151,22 +147,17 @@ public void shouldSetupRepartitionTopics() {

[GitHub] [kafka] clolov commented on a diff in pull request #12821: KAFKA-14132: Replace PowerMock and EasyMock with Mockito in streams tests

2022-11-04 Thread GitBox
clolov commented on code in PR #12821: URL: https://github.com/apache/kafka/pull/12821#discussion_r1014081545 ## streams/src/test/java/org/apache/kafka/streams/processor/internals/RepartitionTopicsTest.java: ## @@ -447,13 +414,9 @@ private void setupClusterWithMissingTopicsAndM

[GitHub] [kafka] clolov commented on a diff in pull request #12821: KAFKA-14132: Replace PowerMock and EasyMock with Mockito in streams tests

2022-11-04 Thread GitBox
clolov commented on code in PR #12821: URL: https://github.com/apache/kafka/pull/12821#discussion_r1014082612 ## streams/src/test/java/org/apache/kafka/streams/processor/internals/StateManagerUtilTest.java: ## @@ -42,77 +39,54 @@ import static java.util.Collections.emptyList;

[GitHub] [kafka] clolov commented on a diff in pull request #12821: KAFKA-14132: Replace PowerMock and EasyMock with Mockito in streams tests

2022-11-04 Thread GitBox
clolov commented on code in PR #12821: URL: https://github.com/apache/kafka/pull/12821#discussion_r1014084531 ## streams/src/test/java/org/apache/kafka/streams/processor/internals/StateManagerUtilTest.java: ## @@ -187,151 +139,92 @@ public void testCloseStateManagerThrowsExcept

[GitHub] [kafka] clolov commented on pull request #12821: KAFKA-14132: Replace PowerMock and EasyMock with Mockito in streams tests

2022-11-04 Thread GitBox
clolov commented on PR #12821: URL: https://github.com/apache/kafka/pull/12821#issuecomment-1303633189 Hey @cadonna 👋! Adding you for visibility as these are Streams-related tests. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

[GitHub] [kafka] dajac commented on pull request #12794: Revert "KAFKA-13891: reset generation when syncgroup failed with REBA…

2022-11-04 Thread GitBox
dajac commented on PR #12794: URL: https://github.com/apache/kafka/pull/12794#issuecomment-1303633764 Last build had two failures: ``` Build / JDK 11 and Scala 2.13 / testLargeAssignmentAndGroupWithNonEqualSubscription() – org.apache.kafka.clients.consumer.CooperativeStickyAssignorTes

[GitHub] [kafka] C0urante commented on pull request #12823: KAFKA-14132: Replace PowerMock and EasyMock with Mockito in streams tests

2022-11-04 Thread GitBox
C0urante commented on PR #12823: URL: https://github.com/apache/kafka/pull/12823#issuecomment-1303685374 Hi @clolov - thanks for the PR! The title mentions streams tests; should that be updated? I plan to take a look sometime within the next week. -- This is an automated message fr

[GitHub] [kafka] C0urante commented on a diff in pull request #12823: KAFKA-14132: Replace PowerMock and EasyMock with Mockito in streams tests

2022-11-04 Thread GitBox
C0urante commented on code in PR #12823: URL: https://github.com/apache/kafka/pull/12823#discussion_r1014154097 ## connect/runtime/src/test/java/org/apache/kafka/connect/runtime/SourceTaskOffsetCommitterTest.java: ## @@ -71,122 +74,74 @@ public void setup() { Lo

[GitHub] [kafka] gharris1727 commented on a diff in pull request #12817: KAFKA-14346: Remove difficult to mock Plugins.compareAndSwapLoader usages

2022-11-04 Thread GitBox
gharris1727 commented on code in PR #12817: URL: https://github.com/apache/kafka/pull/12817#discussion_r1014264009 ## connect/runtime/src/test/java/org/apache/kafka/connect/runtime/WorkerTest.java: ## @@ -1957,6 +1789,61 @@ private void verifyTaskHeaderConverter() { ver

[GitHub] [kafka] gharris1727 commented on a diff in pull request #12817: KAFKA-14346: Remove difficult to mock Plugins.compareAndSwapLoader usages

2022-11-04 Thread GitBox
gharris1727 commented on code in PR #12817: URL: https://github.com/apache/kafka/pull/12817#discussion_r1014266416 ## connect/runtime/src/test/java/org/apache/kafka/connect/runtime/WorkerTest.java: ## @@ -1957,6 +1789,61 @@ private void verifyTaskHeaderConverter() { ver

[GitHub] [kafka] niket-goel closed pull request #11208: MINOR: Refactored BrokerHeartbeatManager::findOneStaleBroker to not use iterator

2022-11-04 Thread GitBox
niket-goel closed pull request #11208: MINOR: Refactored BrokerHeartbeatManager::findOneStaleBroker to not use iterator URL: https://github.com/apache/kafka/pull/11208 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

[GitHub] [kafka] ekeric13 commented on pull request #8575: KAFKA-8713 KIP-581 Add accept.optional.null to solve optional null

2022-11-04 Thread GitBox
ekeric13 commented on PR #8575: URL: https://github.com/apache/kafka/pull/8575#issuecomment-1304001620 I think it would be great to get this in -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] gharris1727 commented on pull request #12806: KAFKA-14345: Fix flakiness with more accurate bound in DynamicConnectionQuotaTest

2022-11-04 Thread GitBox
gharris1727 commented on PR #12806: URL: https://github.com/apache/kafka/pull/12806#issuecomment-1304036956 My worst-case bounds test had a typo that made the results invalid. I've fixed that and this is the current behavior: ``` PASS numSamples = 1 PASS numSamples = 10 PASS numS

[GitHub] [kafka] jolshan opened a new pull request, #12824: MINOR: modified ProducerIdExpirationTest to hopefully be less flaky

2022-11-04 Thread GitBox
jolshan opened a new pull request, #12824: URL: https://github.com/apache/kafka/pull/12824 This test has failed on a few PR runs. Using a waitUntil instead. ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test cov

[jira] [Created] (KAFKA-14358) Users should not be able to create a regular topic name __cluster_metadata

2022-11-04 Thread Jira
José Armando García Sancio created KAFKA-14358: -- Summary: Users should not be able to create a regular topic name __cluster_metadata Key: KAFKA-14358 URL: https://issues.apache.org/jira/browse/KAFKA-1

[jira] [Updated] (KAFKA-14358) Users should not be able to create a regular topic name __cluster_metadata

2022-11-04 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-14358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] José Armando García Sancio updated KAFKA-14358: --- Description: The following test passes and it should not: {code:java

[GitHub] [kafka] gharris1727 commented on pull request #12806: KAFKA-14345: Fix flakiness with more accurate bound in DynamicConnectionQuotaTest

2022-11-04 Thread GitBox
gharris1727 commented on PR #12806: URL: https://github.com/apache/kafka/pull/12806#issuecomment-1304289836 Okay, I've just loosened the bound to compensate for the variable-length windows. This means that the flakey tests should now be resolved, while not changing the behavior of the windo

[GitHub] [kafka] hgeraldino opened a new pull request, #12825: KAFKA-14354: Add deleted() callback method to Connector

2022-11-04 Thread GitBox
hgeraldino opened a new pull request, #12825: URL: https://github.com/apache/kafka/pull/12825 This PR contains a small change to the Connector public API, and a few tweaks on the Worker/WorkerConnector and Herder classes - all this in context of [KIP-893](https://cwiki.apache.org/confluenc

[GitHub] [kafka] soarez commented on a diff in pull request #12822: KAFKA-14355: Fix integer overflow in ProducerPerformance

2022-11-04 Thread GitBox
soarez commented on code in PR #12822: URL: https://github.com/apache/kafka/pull/12822#discussion_r1014501624 ## tools/src/main/java/org/apache/kafka/tools/ProducerPerformance.java: ## @@ -350,7 +351,7 @@ public Stats(long numRecords, int reportingInterval) { this.s

[jira] [Commented] (KAFKA-13813) left/outer joins can wait indefinitely for emitted record with spurious record fix

2022-11-04 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17629223#comment-17629223 ] Matthias J. Sax commented on KAFKA-13813: - Sorry for late reply – I was on leave

[jira] [Created] (KAFKA-14359) Idempotent Producer continues to retry on OutOfOrderSequence error when first batch fails

2022-11-04 Thread Justine Olshan (Jira)
Justine Olshan created KAFKA-14359: -- Summary: Idempotent Producer continues to retry on OutOfOrderSequence error when first batch fails Key: KAFKA-14359 URL: https://issues.apache.org/jira/browse/KAFKA-14359

[jira] [Commented] (KAFKA-14359) Idempotent Producer continues to retry on OutOfOrderSequence error when first batch fails

2022-11-04 Thread Justine Olshan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17629231#comment-17629231 ] Justine Olshan commented on KAFKA-14359: might be the same as https://issues.apa

[GitHub] [kafka] showuon merged pull request #12824: MINOR: modified ProducerIdExpirationTest to hopefully be less flaky

2022-11-04 Thread GitBox
showuon merged PR #12824: URL: https://github.com/apache/kafka/pull/12824 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.

[GitHub] [kafka] showuon merged pull request #12794: Revert "KAFKA-13891: reset generation when syncgroup failed with REBA…

2022-11-04 Thread GitBox
showuon merged PR #12794: URL: https://github.com/apache/kafka/pull/12794 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.

[GitHub] [kafka] showuon commented on a diff in pull request #12729: KAFKA-14285: Delete quota node in zookeeper when configs are empty

2022-11-04 Thread GitBox
showuon commented on code in PR #12729: URL: https://github.com/apache/kafka/pull/12729#discussion_r1014593992 ## core/src/main/scala/kafka/zk/AdminZkClient.scala: ## @@ -355,18 +355,43 @@ class AdminZkClient(zkClient: KafkaZkClient) extends Logging { * @param entityName Th