Re: [PR] KAFKA-15633: Fix overwrite of meta.properties at startup to handle JBOD. [WIP] [kafka]

2023-10-23 Thread via GitHub
pprovenzano commented on code in PR #14578: URL: https://github.com/apache/kafka/pull/14578#discussion_r1369677542 ## core/src/main/scala/kafka/server/BrokerMetadataCheckpoint.scala: ## @@ -184,6 +185,8 @@ object BrokerMetadataCheckpoint extends Logging { try { b

Re: [PR] KAFKA-15632: Drop the invalid remote log metadata events [kafka]

2023-10-23 Thread via GitHub
showuon commented on code in PR #14576: URL: https://github.com/apache/kafka/pull/14576#discussion_r1369627969 ## storage/src/main/java/org/apache/kafka/server/log/remote/metadata/storage/RemoteLogMetadataCache.java: ## @@ -157,13 +157,20 @@ public void updateRemoteLogSegmentMe

Re: [PR] KAFKA-15602: revert KAFKA-4852 [kafka]

2023-10-23 Thread via GitHub
philipnee commented on code in PR #14617: URL: https://github.com/apache/kafka/pull/14617#discussion_r1369600869 ## clients/src/main/java/org/apache/kafka/common/serialization/ByteBufferSerializer.java: ## @@ -16,38 +16,34 @@ */ package org.apache.kafka.common.serialization;

[jira] [Commented] (KAFKA-15602) Breaking change in 3.4.0 ByteBufferSerializer

2023-10-23 Thread Philip Nee (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17778913#comment-17778913 ] Philip Nee commented on KAFKA-15602: Thanks, [~luke.kirby] - Can you create a Jira t

Re: [PR] [MINOR] Deduplicating ConsumerGroupCommand print formating [kafka]

2023-10-23 Thread via GitHub
hudeqi commented on PR #14610: URL: https://github.com/apache/kafka/pull/14610#issuecomment-1776463505 > @hudeqi Are you OK with merging this? I'm ok, but need other commiters to merge. @showuon -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [PR] [MINOR] Deduplicating ConsumerGroupCommand print formating [kafka]

2023-10-23 Thread via GitHub
nizhikov commented on PR #14610: URL: https://github.com/apache/kafka/pull/14610#issuecomment-1776460338 @hudeqi Are you OK with merging this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] KAFKA-15481: Fix concurrency bug in RemoteIndexCache [kafka]

2023-10-23 Thread via GitHub
hudeqi commented on PR #14483: URL: https://github.com/apache/kafka/pull/14483#issuecomment-1776392320 > > @jeel2420 https://ci-builds.apache.org/job/Kafka/job/kafka-pr/job/PR-14483/16/testReport/junit/kafka.log.remote/RemoteIndexCacheTest/Build___JDK_8_and_Scala_2_12___testClearCacheAndInde

[jira] [Updated] (KAFKA-15675) Fix flaky ConnectorRestartApiIntegrationTest.testMultiWorkerRestartOnlyConnector() test

2023-10-23 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-15675: -- Labels: flaky-test (was: ) > Fix flaky > ConnectorRestartApiIntegrationTest.testMultiWorkerRestartOn

Re: [PR] KAFKA-14274 [6, 7]: Introduction of fetch request manager [kafka]

2023-10-23 Thread via GitHub
kirktrue closed pull request #14406: KAFKA-14274 [6, 7]: Introduction of fetch request manager URL: https://github.com/apache/kafka/pull/14406 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

Re: [PR] KAFKA-14274 [6, 7]: Introduction of fetch request manager [kafka]

2023-10-23 Thread via GitHub
kirktrue commented on PR #14406: URL: https://github.com/apache/kafka/pull/14406#issuecomment-1776378053 Closing and reopening to restart test. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] KAFKA-14274 [6, 7]: Introduction of fetch request manager [kafka]

2023-10-23 Thread via GitHub
kirktrue commented on PR #14406: URL: https://github.com/apache/kafka/pull/14406#issuecomment-1776377391 Ugh. One of the builds failed with: ``` ERROR: Error fetching remote repo 'origin' hudson.plugins.git.GitException: Failed to fetch from https://github.com/apache/kafka.git

[jira] [Commented] (KAFKA-15388) Handle topics that were having compaction as retention earlier are changed to delete only retention policy and onboarded to tiered storage.

2023-10-23 Thread Arpit Goyal (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17778884#comment-17778884 ] Arpit Goyal commented on KAFKA-15388: - [~divijvaidya] Sure I am picking it up. > Ha

[jira] [Assigned] (KAFKA-15388) Handle topics that were having compaction as retention earlier are changed to delete only retention policy and onboarded to tiered storage.

2023-10-23 Thread Arpit Goyal (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Goyal reassigned KAFKA-15388: --- Assignee: Arpit Goyal > Handle topics that were having compaction as retention earlier are

Re: [PR] KAFKA-14133: Replace Easymock with Mockito in StreamsProducerTest, TopologyMetadataTest & GlobalStateStoreProviderTest [kafka]

2023-10-23 Thread via GitHub
bachmanity1 commented on code in PR #14410: URL: https://github.com/apache/kafka/pull/14410#discussion_r1368465903 ## streams/src/test/java/org/apache/kafka/streams/state/internals/GlobalStateStoreProviderTest.java: ## @@ -105,28 +105,19 @@ public void before() {

Re: [PR] KAFKA-15673: Adding client metrics resource types (KIP-714) [kafka]

2023-10-23 Thread via GitHub
apoorvmittal10 commented on code in PR #14621: URL: https://github.com/apache/kafka/pull/14621#discussion_r1369416326 ## core/src/main/scala/kafka/metrics/clientmetrics/ClientMetricsConfig.scala: ## @@ -0,0 +1,137 @@ +/** + * Licensed to the Apache Software Foundation (ASF) unde

Re: [PR] KAFKA-15673: Adding client metrics resource types (KIP-714) [kafka]

2023-10-23 Thread via GitHub
apoorvmittal10 commented on code in PR #14621: URL: https://github.com/apache/kafka/pull/14621#discussion_r1369415500 ## core/src/main/scala/kafka/server/ClientMetricsManager.scala: ## @@ -0,0 +1,38 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under one or more +

Re: [PR] KAFKA-15673: Adding client metrics resource types (KIP-714) [kafka]

2023-10-23 Thread via GitHub
apoorvmittal10 commented on code in PR #14621: URL: https://github.com/apache/kafka/pull/14621#discussion_r1369413838 ## core/src/main/scala/kafka/server/ClientMetricsManager.scala: ## @@ -0,0 +1,38 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under one or more +

[PR] KAFKA-15673: Adding client metrics resource types (KIP-714) [kafka]

2023-10-23 Thread via GitHub
apoorvmittal10 opened a new pull request, #14621: URL: https://github.com/apache/kafka/pull/14621 This PR add resources to store and handle client metrics needed for KIP-714 as defined [here](https://cwiki.apache.org/confluence/display/KAFKA/KIP-714%3A+Client+metrics+and+observability#KIP71

[jira] [Updated] (KAFKA-15673) Define new client_metrics resource type configuration to store metric config.

2023-10-23 Thread Apoorv Mittal (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apoorv Mittal updated KAFKA-15673: -- Description: The KIP-714 introduces new resource type named CLIENT_METRICS - [details|#KIP714

Re: [PR] KAFKA-15605: Fix topic deletion handling during ZK migration [kafka]

2023-10-23 Thread via GitHub
cmccabe commented on code in PR #14545: URL: https://github.com/apache/kafka/pull/14545#discussion_r1369368851 ## core/src/main/scala/kafka/zk/migration/ZkTopicMigrationClient.scala: ## @@ -47,8 +47,14 @@ class ZkTopicMigrationClient(zkClient: KafkaZkClient) extends TopicMigrat

Re: [PR] KAFKA-15605: Fix topic deletion handling during ZK migration [kafka]

2023-10-23 Thread via GitHub
cmccabe commented on PR #14545: URL: https://github.com/apache/kafka/pull/14545#issuecomment-1776180980 oh, and please remove the thing where we log all deleting topic names … if it’s too much effort, just log the # . We don't want to blow up our log4j files -- This is an automated messag

Re: [PR] KAFKA-15605: Fix topic deletion handling during ZK migration [kafka]

2023-10-23 Thread via GitHub
cmccabe commented on code in PR #14545: URL: https://github.com/apache/kafka/pull/14545#discussion_r1369366766 ## clients/src/main/java/org/apache/kafka/common/requests/LeaderAndIsrRequest.java: ## @@ -42,26 +42,52 @@ public class LeaderAndIsrRequest extends AbstractControlRe

Re: [PR] KAFKA-15605: Fix topic deletion handling during ZK migration [kafka]

2023-10-23 Thread via GitHub
cmccabe commented on code in PR #14545: URL: https://github.com/apache/kafka/pull/14545#discussion_r1369366766 ## clients/src/main/java/org/apache/kafka/common/requests/LeaderAndIsrRequest.java: ## @@ -42,26 +42,52 @@ public class LeaderAndIsrRequest extends AbstractControlRe

Re: [PR] KAFKA-14808: fix leaderless partition issue when controller removes u… [kafka]

2023-10-23 Thread via GitHub
junrao commented on code in PR #13451: URL: https://github.com/apache/kafka/pull/13451#discussion_r1369359298 ## core/src/main/scala/kafka/controller/KafkaController.scala: ## @@ -1894,10 +1894,16 @@ class KafkaController(val config: KafkaConfig, val currentAssignment =

Re: [PR] KAFKA-14808: fix leaderless partition issue when controller removes u… [kafka]

2023-10-23 Thread via GitHub
junrao commented on code in PR #13451: URL: https://github.com/apache/kafka/pull/13451#discussion_r1369359298 ## core/src/main/scala/kafka/controller/KafkaController.scala: ## @@ -1894,10 +1894,16 @@ class KafkaController(val config: KafkaConfig, val currentAssignment =

Re: [PR] KAFKA-14808: fix leaderless partition issue when controller removes u… [kafka]

2023-10-23 Thread via GitHub
junrao commented on code in PR #13451: URL: https://github.com/apache/kafka/pull/13451#discussion_r1369359298 ## core/src/main/scala/kafka/controller/KafkaController.scala: ## @@ -1894,10 +1894,16 @@ class KafkaController(val config: KafkaConfig, val currentAssignment =

Re: [PR] KAFKA-15633: Fix overwrite of meta.properties at startup to handle JBOD. [WIP] [kafka]

2023-10-23 Thread via GitHub
pprovenzano commented on code in PR #14578: URL: https://github.com/apache/kafka/pull/14578#discussion_r1369329881 ## core/src/main/scala/kafka/server/KafkaServer.scala: ## @@ -1025,9 +1026,13 @@ class KafkaServer( */ private def checkpointBrokerMetadata(brokerMetadata: Z

[jira] [Assigned] (KAFKA-15643) Improve unloading logging

2023-10-23 Thread Ritika Muduganti (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ritika Muduganti reassigned KAFKA-15643: Assignee: Ritika Muduganti > Improve unloading logging >

Re: [PR] KAFKA-15633: Fix overwrite of meta.properties at startup to handle JBOD. [WIP] [kafka]

2023-10-23 Thread via GitHub
pprovenzano commented on code in PR #14578: URL: https://github.com/apache/kafka/pull/14578#discussion_r1369328666 ## core/src/main/scala/kafka/server/BrokerMetadataCheckpoint.scala: ## @@ -166,6 +166,7 @@ case class MetaProperties( } } +// Return only the RawMetaPropertie

[PR] KAFKA-14274 [6, 7]: Introduction of fetch request manager [kafka]

2023-10-23 Thread via GitHub
kirktrue opened a new pull request, #14406: URL: https://github.com/apache/kafka/pull/14406 Changes: 1. Introduces `FetchRequestManager` that implements the `RequestManager` API for fetching messages from brokers. Unlike `Fetcher`, record decompression and deserialization is performe

Re: [PR] KAFKA-14274 [6, 7]: Introduction of fetch request manager [kafka]

2023-10-23 Thread via GitHub
kirktrue commented on PR #14406: URL: https://github.com/apache/kafka/pull/14406#issuecomment-1776110492 Closing and reopening to trigger another Jenkins test run. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

Re: [PR] KAFKA-14274 [6, 7]: Introduction of fetch request manager [kafka]

2023-10-23 Thread via GitHub
kirktrue closed pull request #14406: KAFKA-14274 [6, 7]: Introduction of fetch request manager URL: https://github.com/apache/kafka/pull/14406 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

Re: [PR] KAFKA-14274 [6, 7]: Introduction of fetch request manager [kafka]

2023-10-23 Thread via GitHub
kirktrue commented on PR #14406: URL: https://github.com/apache/kafka/pull/14406#issuecomment-1776108652 > Are the 30 test failures related? No, I do not believe they are. There are 8 failures, of which two are the same test with different parameters. Here are the tests and any

[jira] [Created] (KAFKA-15675) Fix flaky ConnectorRestartApiIntegrationTest.testMultiWorkerRestartOnlyConnector() test

2023-10-23 Thread Kirk True (Jira)
Kirk True created KAFKA-15675: - Summary: Fix flaky ConnectorRestartApiIntegrationTest.testMultiWorkerRestartOnlyConnector() test Key: KAFKA-15675 URL: https://issues.apache.org/jira/browse/KAFKA-15675 Pro

[jira] [Commented] (KAFKA-15674) Consider making RequestLocal thread safe

2023-10-23 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17778835#comment-17778835 ] Jun Rao commented on KAFKA-15674: - For context, [https://github.com/apache/kafka/pull/92

[jira] [Commented] (KAFKA-15653) NPE in ChunkedByteStream

2023-10-23 Thread Justine Olshan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17778831#comment-17778831 ] Justine Olshan commented on KAFKA-15653: I will definitely work on this [~divijv

[jira] [Created] (KAFKA-15674) Consider making RequestLocal thread safe

2023-10-23 Thread Justine Olshan (Jira)
Justine Olshan created KAFKA-15674: -- Summary: Consider making RequestLocal thread safe Key: KAFKA-15674 URL: https://issues.apache.org/jira/browse/KAFKA-15674 Project: Kafka Issue Type: Impr

[jira] [Assigned] (KAFKA-15653) NPE in ChunkedByteStream

2023-10-23 Thread Justine Olshan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Justine Olshan reassigned KAFKA-15653: -- Assignee: Justine Olshan > NPE in ChunkedByteStream > > >

Re: [PR] KAFKA-15355: Message schema changes [kafka]

2023-10-23 Thread via GitHub
rondagostino commented on code in PR #14290: URL: https://github.com/apache/kafka/pull/14290#discussion_r1368928056 ## metadata/src/main/resources/common/metadata/BrokerRegistrationChangeRecord.json: ## @@ -13,11 +13,12 @@ // See the License for the specific language governing

[jira] [Resolved] (KAFKA-15656) Frequent INVALID_RECORD on Kafka 3.6

2023-10-23 Thread Travis Bischel (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Travis Bischel resolved KAFKA-15656. Resolution: Duplicate Closing this as a different manifestation of (and thus, duplicate of

[jira] [Resolved] (KAFKA-15657) Unexpected errors when producing transactionally in 3.6

2023-10-23 Thread Travis Bischel (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Travis Bischel resolved KAFKA-15657. Resolution: Duplicate Closing this as a different manifestation (and thus, duplicate of) K

[jira] [Commented] (KAFKA-15653) NPE in ChunkedByteStream

2023-10-23 Thread Travis Bischel (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17778827#comment-17778827 ] Travis Bischel commented on KAFKA-15653: I've loop tested this a few times at th

[jira] [Created] (KAFKA-15673) Define new client_metrics resource type configuration to store metric config.

2023-10-23 Thread Apoorv Mittal (Jira)
Apoorv Mittal created KAFKA-15673: - Summary: Define new client_metrics resource type configuration to store metric config. Key: KAFKA-15673 URL: https://issues.apache.org/jira/browse/KAFKA-15673 Proj

Re: [PR] KAFKA-15669: Implement telemetry metric naming strategy (KIP-714) [kafka]

2023-10-23 Thread via GitHub
apoorvmittal10 commented on code in PR #14619: URL: https://github.com/apache/kafka/pull/14619#discussion_r1369241432 ## clients/src/test/java/org/apache/kafka/common/telemetry/internals/MetricNamingConventionTest.java: ## @@ -0,0 +1,196 @@ +/* + * Licensed to the Apache Softwar

Re: [PR] KAFKA-15628: Refactor ConsumerRebalanceListener invocation for reuse [kafka]

2023-10-23 Thread via GitHub
kirktrue commented on PR #14565: URL: https://github.com/apache/kafka/pull/14565#issuecomment-1775972229 @dajac This is ready for another review. Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] KAFKA-15669: Implement telemetry metric naming strategy (KIP-714) [kafka]

2023-10-23 Thread via GitHub
AndrewJSchofield commented on code in PR #14619: URL: https://github.com/apache/kafka/pull/14619#discussion_r1369227989 ## clients/src/test/java/org/apache/kafka/common/telemetry/internals/MetricNamingConventionTest.java: ## @@ -0,0 +1,196 @@ +/* + * Licensed to the Apache Softw

[jira] [Commented] (KAFKA-15401) Segment with corrupted index should not be uploaded to remote storage

2023-10-23 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17778807#comment-17778807 ] Jun Rao commented on KAFKA-15401: - [~nickstery] : Thanks for reporting this issue. I am

Re: [PR] KAFKA-15050: format the prompts in the quickstart [kafka]

2023-10-23 Thread via GitHub
tombentley commented on PR #13862: URL: https://github.com/apache/kafka/pull/13862#issuecomment-1775906514 @joobisb when I said > It works fine for me with ``, using both FF and a chrome-based browser. I meant that I still don't think we need the changes which add the `class="

[jira] [Updated] (KAFKA-15093) Add 3.5.0 to broker/client and streams upgrade/compatibility tests

2023-10-23 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison updated KAFKA-15093: --- Fix Version/s: (was: 3.5.2) > Add 3.5.0 to broker/client and streams upgrade/compatibili

Re: [PR] KAFKA-15093: Add 3.5 Streams upgrade system tests [kafka]

2023-10-23 Thread via GitHub
mimaison commented on PR #14602: URL: https://github.com/apache/kafka/pull/14602#issuecomment-1775903085 Done -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe

Re: [PR] KAFKA-15093: Add 3.5 Streams upgrade system tests [kafka]

2023-10-23 Thread via GitHub
mimaison commented on PR #14602: URL: https://github.com/apache/kafka/pull/14602#issuecomment-1775898581 Ok, I'll revert d769f1dd87 in the 3.5 branch. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [PR] KAFKA-14132; Replace EasyMock with Mockito in StandaloneHerderTest [kafka]

2023-10-23 Thread via GitHub
mdedetrich commented on PR #12728: URL: https://github.com/apache/kafka/pull/12728#issuecomment-1775892079 @mimaison I started rebasing across `trunk` and under-estimated the amount of changes that have since landed so this may take a day or two longer -- This is an automated message from

[jira] [Commented] (KAFKA-15602) Breaking change in 3.4.0 ByteBufferSerializer

2023-10-23 Thread Luke Kirby (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17778797#comment-17778797 ] Luke Kirby commented on KAFKA-15602: Hi [~pnee] , [~mjsax] – I largely agree with wh

[jira] [Assigned] (KAFKA-15671) Flaky test RemoteIndexCacheTest.testClearCacheAndIndexFilesWhenResizeCache

2023-10-23 Thread Brian (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian reassigned KAFKA-15671: - Assignee: Brian > Flaky test RemoteIndexCacheTest.testClearCacheAndIndexFilesWhenResizeCache >

[jira] [Commented] (KAFKA-15671) Flaky test RemoteIndexCacheTest.testClearCacheAndIndexFilesWhenResizeCache

2023-10-23 Thread Divij Vaidya (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17778782#comment-17778782 ] Divij Vaidya commented on KAFKA-15671: -- Sure [~brian030128] , please go ahead and a

[jira] [Assigned] (KAFKA-15542) Release member assignments on errors

2023-10-23 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True reassigned KAFKA-15542: - Assignee: Kirk True > Release member assignments on errors > --

Re: [PR] KAFKA-15632: Drop the invalid remote log metadata events [kafka]

2023-10-23 Thread via GitHub
kamalcph commented on code in PR #14576: URL: https://github.com/apache/kafka/pull/14576#discussion_r1369070287 ## storage/src/main/java/org/apache/kafka/server/log/remote/metadata/storage/RemoteLogMetadataCache.java: ## @@ -157,13 +157,20 @@ public void updateRemoteLogSegmentM

[jira] [Assigned] (KAFKA-15574) Integrate partition assignment reconciliation with heartbeat request manager

2023-10-23 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True reassigned KAFKA-15574: - Assignee: Kirk True > Integrate partition assignment reconciliation with heartbeat request mana

Re: [PR] KAFKA-15632: Drop the invalid remote log metadata events [kafka]

2023-10-23 Thread via GitHub
kamalcph commented on code in PR #14576: URL: https://github.com/apache/kafka/pull/14576#discussion_r1369070287 ## storage/src/main/java/org/apache/kafka/server/log/remote/metadata/storage/RemoteLogMetadataCache.java: ## @@ -157,13 +157,20 @@ public void updateRemoteLogSegmentM

Re: [PR] KAFKA-15632: Drop the invalid remote log metadata events [kafka]

2023-10-23 Thread via GitHub
kamalcph commented on code in PR #14576: URL: https://github.com/apache/kafka/pull/14576#discussion_r1369070287 ## storage/src/main/java/org/apache/kafka/server/log/remote/metadata/storage/RemoteLogMetadataCache.java: ## @@ -157,13 +157,20 @@ public void updateRemoteLogSegmentM

Re: [PR] KAFKA-15632: Drop the invalid remote log metadata events [kafka]

2023-10-23 Thread via GitHub
kamalcph commented on code in PR #14576: URL: https://github.com/apache/kafka/pull/14576#discussion_r1367695583 ## storage/src/test/java/org/apache/kafka/server/log/remote/metadata/storage/RemoteLogMetadataCacheTest.java: ## @@ -26,83 +26,136 @@ import org.apache.kafka.server.

Re: [PR] KAFKA-15584: Leader election with ELR [kafka]

2023-10-23 Thread via GitHub
CalvinConfluent commented on code in PR #14593: URL: https://github.com/apache/kafka/pull/14593#discussion_r1369069244 ## metadata/src/main/java/org/apache/kafka/controller/PartitionChangeBuilder.java: ## @@ -253,17 +269,30 @@ private ElectionResult electAnyLeader() { r

Re: [PR] KAFKA-15584: Leader election with ELR [kafka]

2023-10-23 Thread via GitHub
CalvinConfluent commented on code in PR #14593: URL: https://github.com/apache/kafka/pull/14593#discussion_r1369067852 ## metadata/src/main/java/org/apache/kafka/controller/PartitionChangeBuilder.java: ## @@ -253,17 +269,30 @@ private ElectionResult electAnyLeader() { r

[jira] [Commented] (KAFKA-15671) Flaky test RemoteIndexCacheTest.testClearCacheAndIndexFilesWhenResizeCache

2023-10-23 Thread Brian (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17778777#comment-17778777 ] Brian commented on KAFKA-15671: --- [~divijvaidya] Hello I'm new to this project, can I give

[jira] (KAFKA-15672) Add 3.6 to streams system tests

2023-10-23 Thread Brian (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15672 ] Brian deleted comment on KAFKA-15672: --- was (Author: JIRAUSER302723): I could work on this, can you assign it to me?   > Add 3.6 to streams system tests > --- > >

[jira] [Commented] (KAFKA-15672) Add 3.6 to streams system tests

2023-10-23 Thread Brian (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17778771#comment-17778771 ] Brian commented on KAFKA-15672: --- I could work on this, can you assign it to me?   > Add

[jira] [Assigned] (KAFKA-15653) NPE in ChunkedByteStream

2023-10-23 Thread Divij Vaidya (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Divij Vaidya reassigned KAFKA-15653: Assignee: (was: Divij Vaidya) > NPE in ChunkedByteStream > >

Re: [PR] KAFKA-15584: Leader election with ELR [kafka]

2023-10-23 Thread via GitHub
CalvinConfluent commented on code in PR #14593: URL: https://github.com/apache/kafka/pull/14593#discussion_r1369023859 ## metadata/src/main/java/org/apache/kafka/controller/PartitionChangeBuilder.java: ## @@ -253,17 +269,30 @@ private ElectionResult electAnyLeader() { r

Re: [PR] KAFKA-15582: Move the clean shutdown file to the storage package [kafka]

2023-10-23 Thread via GitHub
ijuma commented on code in PR #14603: URL: https://github.com/apache/kafka/pull/14603#discussion_r1369015980 ## storage/src/main/java/org/apache/kafka/storage/internals/util/CleanShutdownFileHandler.java: ## @@ -85,6 +85,7 @@ void write(long brokerEpoch, int version) throws Exce

Re: [PR] KAFKA-15582: Move the clean shutdown file to the storage package [kafka]

2023-10-23 Thread via GitHub
ijuma commented on code in PR #14603: URL: https://github.com/apache/kafka/pull/14603#discussion_r1369013666 ## storage/src/main/java/org/apache/kafka/storage/internals/util/CleanShutdownFileHandler.java: ## @@ -15,7 +15,7 @@ * limitations under the License. */ -package ka

Re: [PR] KAFKA-15584: Leader election with ELR [kafka]

2023-10-23 Thread via GitHub
CalvinConfluent commented on code in PR #14593: URL: https://github.com/apache/kafka/pull/14593#discussion_r1369012157 ## metadata/src/main/java/org/apache/kafka/controller/PartitionChangeBuilder.java: ## @@ -93,6 +93,9 @@ public enum Election { private boolean eligibleLead

Re: [PR] KAFKA-15582: Move the clean shutdown file to the storage package [kafka]

2023-10-23 Thread via GitHub
CalvinConfluent commented on code in PR #14603: URL: https://github.com/apache/kafka/pull/14603#discussion_r1369010124 ## storage/src/main/java/org/apache/kafka/storage/internals/util/CleanShutdownFileHandler.java: ## @@ -15,7 +15,7 @@ * limitations under the License. */ -

[PR] KAFKA-15618: Kafka metrics collector and supporting classes (KIP-714) [kafka]

2023-10-23 Thread via GitHub
apoorvmittal10 opened a new pull request, #14620: URL: https://github.com/apache/kafka/pull/14620 The PR ([jira](https://issues.apache.org/jira/browse/KAFKA-15618)) outlines classes to collect metrics for client by KafkaMetricsCollector implementation. The MetricsCollector defines mechanism

Re: [PR] KAFKA-15582: Move the clean shutdown file to the storage package [kafka]

2023-10-23 Thread via GitHub
ijuma commented on code in PR #14603: URL: https://github.com/apache/kafka/pull/14603#discussion_r1369008762 ## storage/src/main/java/org/apache/kafka/storage/internals/util/CleanShutdownFileHandler.java: ## @@ -15,7 +15,7 @@ * limitations under the License. */ -package ka

Re: [PR] KAFKA-15628: Refactor ConsumerRebalanceListener invocation for reuse [kafka]

2023-10-23 Thread via GitHub
kirktrue commented on code in PR #14565: URL: https://github.com/apache/kafka/pull/14565#discussion_r1369002478 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/ConsumerCoordinatorMetrics.java: ## @@ -0,0 +1,80 @@ +/* + * Licensed to the Apache Software Found

Re: [PR] KAFKA-15628: Refactor ConsumerRebalanceListener invocation for reuse [kafka]

2023-10-23 Thread via GitHub
kirktrue commented on code in PR #14565: URL: https://github.com/apache/kafka/pull/14565#discussion_r1368991272 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/ConsumerRebalanceListenerInvoker.java: ## @@ -0,0 +1,128 @@ +/* + * Licensed to the Apache Softwar

Re: [PR] KAFKA-15093: Add 3.5 Streams upgrade system tests [kafka]

2023-10-23 Thread via GitHub
mjsax commented on PR #14602: URL: https://github.com/apache/kafka/pull/14602#issuecomment-1775630277 I think it would be good to revert? System test run already very long, and if we can cut down a few minutes by not re-running the same test twice, it might be good? -- This is an automat

Re: [PR] KAFKA-15628: Refactor ConsumerRebalanceListener invocation for reuse [kafka]

2023-10-23 Thread via GitHub
kirktrue commented on code in PR #14565: URL: https://github.com/apache/kafka/pull/14565#discussion_r1368990080 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/ConsumerCoordinator.java: ## @@ -227,6 +224,12 @@ public ConsumerCoordinator(GroupRebalanceConfig

Re: [PR] KAFKA-15628: Refactor ConsumerRebalanceListener invocation for reuse [kafka]

2023-10-23 Thread via GitHub
kirktrue commented on code in PR #14565: URL: https://github.com/apache/kafka/pull/14565#discussion_r1368989675 ## clients/src/main/java/org/apache/kafka/clients/consumer/KafkaConsumer.java: ## @@ -961,7 +960,7 @@ public void subscribe(Collection topics, ConsumerRebalanceListen

[PR] KAFKA-15669: Implement telemetry metric naming strategy (KIP-714) [kafka]

2023-10-23 Thread via GitHub
apoorvmittal10 opened a new pull request, #14619: URL: https://github.com/apache/kafka/pull/14619 The PR defined the naming convention for telemetry metric names for KIP-714. Telemetry metric name should be dot separated and tags should be snake case. PR adds the interface which will

[PR] KAFKA-15668: Adding Opentelmetry shadowed library (KIP-714) [kafka]

2023-10-23 Thread via GitHub
apoorvmittal10 opened a new pull request, #14618: URL: https://github.com/apache/kafka/pull/14618 The PR comprises of changes to include opentlemetry library as defined in KIP-714. The libraries are shadowed to prevent conflicts. ``` jar -tf kafka-clients-3.7.0-SNAPSHOT.jar | grep

Re: [PR] KAFKA-15582: Move the clean shutdown file to the storage package [kafka]

2023-10-23 Thread via GitHub
CalvinConfluent commented on PR #14603: URL: https://github.com/apache/kafka/pull/14603#issuecomment-1775608992 @junrao @ijuma Now the build success with irrelevant test failures. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[jira] [Updated] (KAFKA-14767) Gradle build fails with missing commitId after git gc

2023-10-23 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris updated KAFKA-14767: Fix Version/s: 3.4.2 3.5.2 3.6.1 > Gradle build fails with m

Re: [PR] KAFKA-15602: revert KAFKA-4852 [kafka]

2023-10-23 Thread via GitHub
philipnee commented on code in PR #14617: URL: https://github.com/apache/kafka/pull/14617#discussion_r1368954689 ## clients/src/main/java/org/apache/kafka/common/serialization/ByteBufferSerializer.java: ## @@ -16,38 +16,32 @@ */ package org.apache.kafka.common.serialization;

Re: [PR] MINOR: KAFKA-15526 followup [kafka]

2023-10-23 Thread via GitHub
splett2 commented on code in PR #14485: URL: https://github.com/apache/kafka/pull/14485#discussion_r1368951497 ## storage/src/main/java/org/apache/kafka/storage/internals/log/LogAppendInfo.java: ## @@ -204,6 +204,10 @@ public LeaderHwChange leaderHwChange() { return lea

[jira] [Comment Edited] (KAFKA-15602) Breaking change in 3.4.0 ByteBufferSerializer

2023-10-23 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17778731#comment-17778731 ] Matthias J. Sax edited comment on KAFKA-15602 at 10/23/23 4:20 PM: ---

[jira] [Commented] (KAFKA-15602) Breaking change in 3.4.0 ByteBufferSerializer

2023-10-23 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17778731#comment-17778731 ] Matthias J. Sax commented on KAFKA-15602: - Btw: also left a comment on K4852: h

[jira] [Commented] (KAFKA-4852) ByteBufferSerializer not compatible with offsets

2023-10-23 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17778727#comment-17778727 ] Matthias J. Sax commented on KAFKA-4852: As reported on https://issues.apache.org

[jira] [Commented] (KAFKA-15602) Breaking change in 3.4.0 ByteBufferSerializer

2023-10-23 Thread Philip Nee (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17778726#comment-17778726 ] Philip Nee commented on KAFKA-15602: Great I think so. [~luke.kirby] - Do you agree?

[PR] KAFKA-15602: revert KAFKA-4852 [kafka]

2023-10-23 Thread via GitHub
mjsax opened a new pull request, #14617: URL: https://github.com/apache/kafka/pull/14617 This PR reverts - https://github.com/apache/kafka/commit/51dbd175b08e78aeca03d6752847aa5f23c98659 - https://github.com/apache/kafka/commit/496ae054c2d43c0905167745bfb2f4a0725e9fc2 Also ad

[jira] [Commented] (KAFKA-15653) NPE in ChunkedByteStream

2023-10-23 Thread Divij Vaidya (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17778721#comment-17778721 ] Divij Vaidya commented on KAFKA-15653: -- > However, there was some other way to acce

[jira] [Commented] (KAFKA-15602) Breaking change in 3.4.0 ByteBufferSerializer

2023-10-23 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17778719#comment-17778719 ] Matthias J. Sax commented on KAFKA-15602: - Sounds fair. – Let me revert K4852 in

Re: [PR] KAFKA-15629: Proposal to introduce IQv2 Query Types: TimestampedKeyQuery and TimestampedRangeQuery [kafka]

2023-10-23 Thread via GitHub
hanyuzheng7 commented on code in PR #14570: URL: https://github.com/apache/kafka/pull/14570#discussion_r1368883149 ## streams/src/main/java/org/apache/kafka/streams/state/internals/MeteredKeyValueStore.java: ## @@ -99,9 +101,17 @@ public class MeteredKeyValueStore

[jira] [Resolved] (KAFKA-15666) Добавить функцию поиска по почте

2023-10-23 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-15666. - Resolution: Invalid [~noraverba] – We can only take tickets in English. – Also piped the

Re: [PR] KAFKA-15093: Add 3.5 Streams upgrade system tests [kafka]

2023-10-23 Thread via GitHub
mimaison commented on PR #14602: URL: https://github.com/apache/kafka/pull/14602#issuecomment-1775452320 Are we ok keeping the commit or should we revert it? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[jira] [Created] (KAFKA-15672) Add 3.6 to streams system tests

2023-10-23 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-15672: --- Summary: Add 3.6 to streams system tests Key: KAFKA-15672 URL: https://issues.apache.org/jira/browse/KAFKA-15672 Project: Kafka Issue Type: Test

Re: [PR] KAFKA-15664: Add 3.4 Streams upgrade system tests [kafka]

2023-10-23 Thread via GitHub
mimaison commented on PR #14601: URL: https://github.com/apache/kafka/pull/14601#issuecomment-1775449629 Ah ok, thanks for clarifying. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Commented] (KAFKA-15653) NPE in ChunkedByteStream

2023-10-23 Thread Justine Olshan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17778709#comment-17778709 ] Justine Olshan commented on KAFKA-15653: Thanks [~divijvaidya] and [~ijuma] for

Re: [PR] KAFKA-15093: Add 3.5 Streams upgrade system tests [kafka]

2023-10-23 Thread via GitHub
mjsax commented on PR #14602: URL: https://github.com/apache/kafka/pull/14602#issuecomment-1775443078 Why backport to `3.5` ? That's not necessary -- we test upgrade to `DEV_VERSION` what is `3.5.x-SNAPSHOT` -- no need to double test. -- This is an automated message from the Apache Git Se

Re: [PR] KAFKA-15664: Add 3.4 Streams upgrade system tests [kafka]

2023-10-23 Thread via GitHub
mjsax commented on PR #14601: URL: https://github.com/apache/kafka/pull/14601#issuecomment-1775440767 We don't need to backported to `3.4` branch -- In `3.4` branch we test this implicitly by upgrading to `DEV_VERSION`. -- This is an automated message from the Apache Git Service. To respo

  1   2   >