Re: [PR] KAFKA-15305: The background thread should try to process the remaining task until the shutdown timer is expired. [kafka]

2024-06-01 Thread via GitHub
frankvicky commented on code in PR #16156: URL: https://github.com/apache/kafka/pull/16156#discussion_r1623166279 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/NetworkClientDelegateTest.java: ## @@ -140,6 +141,25 @@ public void testEnsureTimerSetOnAdd() {

Re: [PR] KAFKA-16223: Replace EasyMock/PowerMock with Mockito for KafkaConfigBackingStoreTest [kafka]

2024-06-01 Thread via GitHub
chiacyu commented on code in PR #15989: URL: https://github.com/apache/kafka/pull/15989#discussion_r1623166390 ## connect/runtime/src/test/java/org/apache/kafka/connect/storage/KafkaConfigBackingStoreMockitoTest.java: ## @@ -1315,4 +1451,22 @@ private Map structToMap(Struct stru

Re: [PR] KAFKA-16223: Replace EasyMock/PowerMock with Mockito for KafkaConfigBackingStoreTest [kafka]

2024-06-01 Thread via GitHub
chiacyu closed pull request #15989: KAFKA-16223: Replace EasyMock/PowerMock with Mockito for KafkaConfigBackingStoreTest URL: https://github.com/apache/kafka/pull/15989 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[PR] KAFKA-16814 KRaft broker cannot startup when `partition.metadata` is missing [kafka]

2024-06-01 Thread via GitHub
brandboat opened a new pull request, #16165: URL: https://github.com/apache/kafka/pull/16165 related to https://issues.apache.org/jira/browse/KAFKA-16814 ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and

Re: [PR] KAFKA-16652: add unit test for ClusterTemplate offering zero ClusterConfig [kafka]

2024-06-01 Thread via GitHub
TaiJuWu commented on code in PR #15862: URL: https://github.com/apache/kafka/pull/15862#discussion_r1623180599 ## core/src/test/java/kafka/test/junit/ClusterTestExtensionsUnitTest.java: ## @@ -17,29 +17,64 @@ package kafka.test.junit; +import kafka.test.ClusterConfig; impo

Re: [PR] MINOR: Optimize heartbeat to broker in test [kafka]

2024-06-01 Thread via GitHub
TaiJuWu commented on PR #16013: URL: https://github.com/apache/kafka/pull/16013#issuecomment-2143370139 Pin @chia7712 , Please take a look. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

Re: [PR] KAFKA-16606 Gate JBOD configuration on 3.7-IV2 [kafka]

2024-06-01 Thread via GitHub
soarez commented on code in PR #15834: URL: https://github.com/apache/kafka/pull/15834#discussion_r1623198189 ## core/src/main/scala/kafka/server/KafkaConfig.scala: ## @@ -1457,6 +1465,18 @@ class KafkaConfig private(doLog: Boolean, val props: java.util.Map[_, _], dynami }

[PR] Minor: Add URL to log for Connect RestClient [kafka]

2024-06-01 Thread via GitHub
farbodahm opened a new pull request, #16166: URL: https://github.com/apache/kafka/pull/16166 I was using Kafka Connect ([Confluent Image](https://hub.docker.com/r/confluentinc/cp-kafka-connect)) to run an Iceberg Sink connector on 2 different AWS environments (running on ECS) and same Kafk

Re: [PR] KAFKA-15303: Avoid unnecessary re-serialization in FK-join [kafka]

2024-06-01 Thread via GitHub
Chuckame commented on PR #14157: URL: https://github.com/apache/kafka/pull/14157#issuecomment-2143420186 Hello @mjsax, I'm working on it (or trying to 😄). What do you think about adding `getRaw` to the `KeyValueStore` interface ? It would generalize an efficient access from anywhere.

Re: [PR] KAFKA-16223: Replace EasyMock/PowerMock with Mockito for KafkaConfigBackingStoreTest [kafka]

2024-06-01 Thread via GitHub
chia7712 commented on code in PR #16164: URL: https://github.com/apache/kafka/pull/16164#discussion_r1623211768 ## connect/runtime/src/test/java/org/apache/kafka/connect/storage/KafkaConfigBackingStoreMockitoTest.java: ## @@ -1184,6 +1185,148 @@ public void testRestoreRestartRe

Re: [PR] MINOR: Optimize heartbeat to broker in test [kafka]

2024-06-01 Thread via GitHub
chia7712 commented on code in PR #16013: URL: https://github.com/apache/kafka/pull/16013#discussion_r1623212627 ## metadata/src/test/java/org/apache/kafka/controller/QuorumControllerIntegrationTestUtils.java: ## @@ -139,15 +140,19 @@ static void sendBrokerHeartbeatToUnfenceBroke

Re: [PR] KAFKA-16223: Replace EasyMock/PowerMock with Mockito for KafkaConfigBackingStoreTest [kafka]

2024-06-01 Thread via GitHub
chiacyu commented on code in PR #16164: URL: https://github.com/apache/kafka/pull/16164#discussion_r1623216072 ## connect/runtime/src/test/java/org/apache/kafka/connect/storage/KafkaConfigBackingStoreMockitoTest.java: ## @@ -1184,6 +1185,148 @@ public void testRestoreRestartReq

[jira] [Commented] (KAFKA-16871) Clean up internal AssignmentConfigs class in Streams

2024-06-01 Thread MOHD KAIF KHAN (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17851287#comment-17851287 ] MOHD KAIF KHAN commented on KAFKA-16871: Hey [~ableegoldman], I would like to wo

Re: [PR] KAFKA-16574: The metrics of LogCleaner disappear after reconfiguration [kafka]

2024-06-01 Thread via GitHub
chiacyu commented on code in PR #15863: URL: https://github.com/apache/kafka/pull/15863#discussion_r1623229305 ## core/src/main/scala/kafka/log/LogCleaner.scala: ## @@ -223,8 +230,8 @@ class LogCleaner(initialConfig: CleanerConfig, info(s"Updating logCleanerIoMaxBytesPerS

Re: [PR] KAFKA-10787: Add import ordering checkstyle rule and configure an automatic formatter [kafka]

2024-06-01 Thread via GitHub
gongxuanzhang commented on PR #16097: URL: https://github.com/apache/kafka/pull/16097#issuecomment-2143483983 I update this PR,plz review it -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

Re: [PR] Minor: Add URL to log for Connect RestClient [kafka]

2024-06-01 Thread via GitHub
C0urante commented on code in PR #16166: URL: https://github.com/apache/kafka/pull/16166#discussion_r1623243320 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/rest/RestClient.java: ## @@ -190,15 +190,15 @@ private HttpResponse httpRequest(HttpClient client,

[jira] [Commented] (KAFKA-16838) Kafka Connect loads old tasks from removed connectors

2024-06-01 Thread Sergey Ivanov (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17851304#comment-17851304 ] Sergey Ivanov commented on KAFKA-16838: --- Hi [~ChrisEgerton], thanks for the answer

Re: [PR] KAFKA-16223: Replace EasyMock/PowerMock with Mockito for KafkaConfigBackingStoreTest [kafka]

2024-06-01 Thread via GitHub
chia7712 commented on code in PR #16164: URL: https://github.com/apache/kafka/pull/16164#discussion_r1623248311 ## connect/runtime/src/test/java/org/apache/kafka/connect/storage/KafkaConfigBackingStoreMockitoTest.java: ## @@ -1184,6 +1185,148 @@ public void testRestoreRestartRe

Re: [PR] KAFKA-10787: Add import ordering checkstyle rule and configure an automatic formatter [kafka]

2024-06-01 Thread via GitHub
chia7712 commented on code in PR #16097: URL: https://github.com/apache/kafka/pull/16097#discussion_r1623249229 ## checkstyle/checkstyle.xml: ## @@ -82,6 +82,10 @@ +

Re: [PR] KAFKA-16652: add unit test for ClusterTemplate offering zero ClusterConfig [kafka]

2024-06-01 Thread via GitHub
chia7712 merged PR #15862: URL: https://github.com/apache/kafka/pull/15862 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

[jira] [Resolved] (KAFKA-16652) add unit test for ClusterTemplate offering zero ClusterConfig

2024-06-01 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-16652. Fix Version/s: 3.9.0 Resolution: Fixed > add unit test for ClusterTemplate offering

Re: [PR] KAFKA-15713: KRaft support in AclCommandTest [kafka]

2024-06-01 Thread via GitHub
pasharik commented on code in PR #15830: URL: https://github.com/apache/kafka/pull/15830#discussion_r1623251171 ## core/src/test/java/kafka/admin/AclCommandIntegrationTest.java: ## @@ -0,0 +1,453 @@ +package kafka.admin; + +import kafka.test.ClusterInstance; +import kafka.test.a

Re: [PR] KAFKA-16574: The metrics of LogCleaner disappear after reconfiguration [kafka]

2024-06-01 Thread via GitHub
chia7712 merged PR #15863: URL: https://github.com/apache/kafka/pull/15863 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

[jira] [Resolved] (KAFKA-16574) The metrics of LogCleaner disappear after reconfiguration

2024-06-01 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-16574. Fix Version/s: 3.9.0 Resolution: Fixed > The metrics of LogCleaner disappear after

Re: [PR] MINOR: speed up reset consumer group offset test [kafka]

2024-06-01 Thread via GitHub
chia7712 merged PR #16155: URL: https://github.com/apache/kafka/pull/16155 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

Re: [PR] Minor: Add URL to log for Connect RestClient [kafka]

2024-06-01 Thread via GitHub
farbodahm commented on code in PR #16166: URL: https://github.com/apache/kafka/pull/16166#discussion_r1623260629 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/rest/RestClient.java: ## @@ -190,15 +190,15 @@ private HttpResponse httpRequest(HttpClient client,

[jira] [Commented] (KAFKA-16803) Upgrade to a version of ShadowJavaPlugin which doesn't use ConfigureUtil

2024-06-01 Thread Eric Lu (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17851318#comment-17851318 ] Eric Lu commented on KAFKA-16803: - Hi, I've been looking into it for a little while now

[jira] [Assigned] (KAFKA-16803) Upgrade to a version of ShadowJavaPlugin which doesn't use ConfigureUtil

2024-06-01 Thread Eric Lu (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Lu reassigned KAFKA-16803: --- Assignee: (was: Eric Lu) > Upgrade to a version of ShadowJavaPlugin which doesn't use Configure

[PR] [Draft] KAFKA-16689: Move LogValidatorTest to storage module [kafka]

2024-06-01 Thread via GitHub
TaiJuWu opened a new pull request, #16167: URL: https://github.com/apache/kafka/pull/16167 *More detailed description of your change, if necessary. The PR title and PR message become the squashed commit message, so use a separate comment to ping reviewers.* *Summary of testing

Re: [PR] bumping shadowJar 8.1.0->8.1.1 [kafka]

2024-06-01 Thread via GitHub
EricLuGHub closed pull request #16096: bumping shadowJar 8.1.0->8.1.1 URL: https://github.com/apache/kafka/pull/16096 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubsc

[jira] [Commented] (KAFKA-15156) Update cipherInformation correctly in DefaultChannelMetadataRegistry

2024-06-01 Thread Ganesh Sadanala (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17851327#comment-17851327 ] Ganesh Sadanala commented on KAFKA-15156: - is this still open issue?  > Update

[jira] [Assigned] (KAFKA-15156) Update cipherInformation correctly in DefaultChannelMetadataRegistry

2024-06-01 Thread Ganesh Sadanala (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ganesh Sadanala reassigned KAFKA-15156: --- Assignee: Ganesh Sadanala > Update cipherInformation correctly in DefaultChannelMet

Re: [PR] KAFKA-16861: Don't convert to group to classic if the size is larger than group max size. [kafka]

2024-06-01 Thread via GitHub
chia7712 commented on PR #16163: URL: https://github.com/apache/kafka/pull/16163#issuecomment-2143558213 I noticed that we don't have IT for downgrading to classic group. Maybe we can add IT in this PR? -- This is an automated message from the Apache Git Service. To respond to the message

[jira] [Comment Edited] (KAFKA-16811) Punctuate Ratio metric almost impossible to track

2024-06-01 Thread Ganesh Sadanala (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17851160#comment-17851160 ] Ganesh Sadanala edited comment on KAFKA-16811 at 6/1/24 7:26 PM: -

Re: [PR] KAFKA-16807: DescribeLogDirsResponseData#results#topics have unexpected topics having empty partitions [kafka]

2024-06-01 Thread via GitHub
chia7712 commented on PR #16042: URL: https://github.com/apache/kafka/pull/16042#issuecomment-2143563321 @m1a2st Could you please rebase code again? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

Re: [PR] Minor: Add URL to log for Connect RestClient [kafka]

2024-06-01 Thread via GitHub
C0urante commented on PR #16166: URL: https://github.com/apache/kafka/pull/16166#issuecomment-2143575258 Thanks @farbodahm! LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

Re: [PR] Minor: Add URL to log for Connect RestClient [kafka]

2024-06-01 Thread via GitHub
C0urante merged PR #16166: URL: https://github.com/apache/kafka/pull/16166 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

[jira] [Commented] (KAFKA-16869) Rewrite HighAvailabilityTaskAssignor to implement the new TaskAssignor interface

2024-06-01 Thread Muralidhar Basani (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17851341#comment-17851341 ] Muralidhar Basani commented on KAFKA-16869: --- Is it ok if I pick up this ?  Wi

[jira] [Commented] (KAFKA-16874) Remove old TaskAssignor interface

2024-06-01 Thread Muralidhar Basani (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17851342#comment-17851342 ] Muralidhar Basani commented on KAFKA-16874: --- I see there are a few other imple

[PR] Add timeout to alterClientQuotas kafka-16698 [kafka]

2024-06-01 Thread via GitHub
muralibasani opened a new pull request, #16168: URL: https://github.com/apache/kafka/pull/16168 Resolves https://issues.apache.org/jira/browse/KAFKA-16698 My hunch is that adding a timeout to alterClientQuotas, could fix the timeout issue happening here in next step connectionRateForI

[jira] [Assigned] (KAFKA-16698) Fix flaky kafka.network.DynamicConnectionQuotaTest#testDynamicIpConnectionRateQuota

2024-06-01 Thread Muralidhar Basani (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Muralidhar Basani reassigned KAFKA-16698: - Assignee: Muralidhar Basani > Fix flaky > kafka.network.DynamicConnectionQuota

[jira] [Commented] (KAFKA-16698) Fix flaky kafka.network.DynamicConnectionQuotaTest#testDynamicIpConnectionRateQuota

2024-06-01 Thread Muralidhar Basani (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17851343#comment-17851343 ] Muralidhar Basani commented on KAFKA-16698: --- Thanks, I have a PR opened. > Fi

[jira] [Comment Edited] (KAFKA-16698) Fix flaky kafka.network.DynamicConnectionQuotaTest#testDynamicIpConnectionRateQuota

2024-06-01 Thread Muralidhar Basani (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17851343#comment-17851343 ] Muralidhar Basani edited comment on KAFKA-16698 at 6/1/24 9:36 PM: ---

Re: [PR] KAFKA-16757: Fix broker re-registration issues around MV 3.7-IV2 [kafka]

2024-06-01 Thread via GitHub
soarez merged PR #15945: URL: https://github.com/apache/kafka/pull/15945 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.o

[jira] [Resolved] (KAFKA-16757) Fix broker re-registration issues around MV 3.7-IV2

2024-06-01 Thread Igor Soarez (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Soarez resolved KAFKA-16757. - Resolution: Fixed > Fix broker re-registration issues around MV 3.7-IV2 > --

[PR] KAFKA-15156 Update cipherInformation correctly in DefaultChannelMetadataRegistry [kafka]

2024-06-01 Thread via GitHub
ganesh-sadanala opened a new pull request, #16169: URL: https://github.com/apache/kafka/pull/16169 Assing the new value of `cipherInformation` to a member variable if the assigning variable value is not null. The previous implementation has a bug preventing it from getting updated with the

[jira] [Commented] (KAFKA-15156) Update cipherInformation correctly in DefaultChannelMetadataRegistry

2024-06-01 Thread Ganesh Sadanala (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17851345#comment-17851345 ] Ganesh Sadanala commented on KAFKA-15156: - [GitHub Pull Request #16169|https://g

Re: [PR] KAFKA-10787: Add import ordering checkstyle rule and configure an automatic formatter [kafka]

2024-06-01 Thread via GitHub
gongxuanzhang commented on code in PR #16097: URL: https://github.com/apache/kafka/pull/16097#discussion_r1623310676 ## build.gradle: ## @@ -47,7 +47,8 @@ plugins { // Updating the shadow plugin version to 8.1.1 causes issue with signing and publishing the shadowed // art

Re: [PR] KAFKA-10787: Add import ordering checkstyle rule and configure an automatic formatter [kafka]

2024-06-01 Thread via GitHub
gongxuanzhang commented on code in PR #16097: URL: https://github.com/apache/kafka/pull/16097#discussion_r1623310868 ## checkstyle/checkstyle.xml: ## @@ -82,6 +82,10 @@ +

Re: [PR] KAFKA-16861: Don't convert to group to classic if the size is larger than group max size. [kafka]

2024-06-01 Thread via GitHub
frankvicky commented on PR #16163: URL: https://github.com/apache/kafka/pull/16163#issuecomment-2143675270 Sounds good, I will write an integration test for downgrading to classic group -- This is an automated message from the Apache Git Service. To respond to the message, please log on t

Re: [PR] KAFKA-16042: Add byte-rate metrics for topic and partition [kafka]

2024-06-01 Thread via GitHub
github-actions[bot] commented on PR #15085: URL: https://github.com/apache/kafka/pull/15085#issuecomment-2143682945 This PR is being marked as stale since it has not had any activity in 90 days. If you would like to keep this PR alive, please ask a committer for review. If the PR has merge

Re: [PR] KAFKA-15894: Fix KafkaApis.updateRecordConversionStats to ensure MessageConversionsTimeMs and TemporaryMemoryBytes are recorded correctly [kafka]

2024-06-01 Thread via GitHub
github-actions[bot] commented on PR #14841: URL: https://github.com/apache/kafka/pull/14841#issuecomment-2143682954 This PR is being marked as stale since it has not had any activity in 90 days. If you would like to keep this PR alive, please ask a committer for review. If the PR has merge

[jira] [Assigned] (KAFKA-16876) TaskManager.handleRevocation doesn't handle errors thrown from task.prepareCommit

2024-06-01 Thread Ganesh Sadanala (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ganesh Sadanala reassigned KAFKA-16876: --- Assignee: Ganesh Sadanala > TaskManager.handleRevocation doesn't handle errors thro

Re: [PR] KAFKA-16811 Sliding window approach to calculate non-zero punctuate-ratio metric [kafka]

2024-06-01 Thread via GitHub
ganesh-sadanala commented on PR #16162: URL: https://github.com/apache/kafka/pull/16162#issuecomment-2143705807 I have completed the implementation using the SlidingWindow approach with x=30 seconds for testing. Here are the changes: https://github.com/apache/kafka/pull/16162

Re: [PR] KAFKA-16861: Don't convert to group to classic if the size is larger than group max size. [kafka]

2024-06-01 Thread via GitHub
dajac commented on PR #16163: URL: https://github.com/apache/kafka/pull/16163#issuecomment-2143718116 @dongnuo123 is working in adding integration tests for all this work stream. We should wait. @chia7712 We do already have unit tests but we missed one for this particular case. --

Re: [PR] KAFKA-16861: Don't convert to group to classic if the size is larger than group max size. [kafka]

2024-06-01 Thread via GitHub
dajac commented on PR #16163: URL: https://github.com/apache/kafka/pull/16163#issuecomment-2143718243 @dongnuo123 Could you please review this PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to