[jira] [Updated] (KAFKA-14849) Kafka consumers receive INCONSISTENT_GROUP_PROTOCOL error even the configuration of all consumers is same

2023-03-27 Thread zou shengfu (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zou shengfu updated KAFKA-14849: Description: # At first, we modify the group.instance.id for consumers wrongly, so different cons

[GitHub] [kafka] viktorsomogyi merged pull request #13441: KAFKA-14836: Fix log DateTime format unit test

2023-03-27 Thread via GitHub
viktorsomogyi merged PR #13441: URL: https://github.com/apache/kafka/pull/13441 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.a

[GitHub] [kafka] cadonna commented on a diff in pull request #13127: KAFKA-14586: Moving StreamResetter to tools

2023-03-27 Thread via GitHub
cadonna commented on code in PR #13127: URL: https://github.com/apache/kafka/pull/13127#discussion_r1149019632 ## streams/src/test/java/org/apache/kafka/streams/tools/StreamsResetterTest.java: ## @@ -16,7 +16,7 @@ */ package org.apache.kafka.streams.tools; -import kafka.too

[jira] [Created] (KAFKA-14850) Introduce InMemoryLeaderEpochCheckpoint to allow quick write/read

2023-03-27 Thread Luke Chen (Jira)
Luke Chen created KAFKA-14850: - Summary: Introduce InMemoryLeaderEpochCheckpoint to allow quick write/read Key: KAFKA-14850 URL: https://issues.apache.org/jira/browse/KAFKA-14850 Project: Kafka

[GitHub] [kafka] showuon opened a new pull request, #13456: KAFKA-14850: introduce InMemoryLeaderEpochCheckpoint

2023-03-27 Thread via GitHub
showuon opened a new pull request, #13456: URL: https://github.com/apache/kafka/pull/13456 Introduce `InMemoryLeaderEpochCheckpoint` to allow quick read/write ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage

[GitHub] [kafka] cadonna commented on pull request #13127: KAFKA-14586: Moving StreamResetter to tools

2023-03-27 Thread via GitHub
cadonna commented on PR #13127: URL: https://github.com/apache/kafka/pull/13127#issuecomment-1484819384 I restarted the build. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [kafka] rajinisivaram commented on a diff in pull request #13350: KAFKA-14452: Make sticky assignors rack-aware if client rack is configured (KIP-881)

2023-03-27 Thread via GitHub
rajinisivaram commented on code in PR #13350: URL: https://github.com/apache/kafka/pull/13350#discussion_r1149063073 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AbstractStickyAssignor.java: ## @@ -519,13 +641,14 @@ Map> build() { return assi

[GitHub] [kafka] rajinisivaram commented on a diff in pull request #13350: KAFKA-14452: Make sticky assignors rack-aware if client rack is configured (KIP-881)

2023-03-27 Thread via GitHub
rajinisivaram commented on code in PR #13350: URL: https://github.com/apache/kafka/pull/13350#discussion_r1149064166 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AbstractStickyAssignor.java: ## @@ -574,6 +697,42 @@ private void assignOwnedPartitions() {

[GitHub] [kafka] rajinisivaram commented on pull request #13350: KAFKA-14452: Make sticky assignors rack-aware if client rack is configured (KIP-881)

2023-03-27 Thread via GitHub
rajinisivaram commented on PR #13350: URL: https://github.com/apache/kafka/pull/13350#issuecomment-1484836832 @dajac Thanks for the initial review, have addressed your comments. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [kafka] showuon opened a new pull request, #13457: MINOR: remove remoteStorageManager parameter in UnifiedLog

2023-03-27 Thread via GitHub
showuon opened a new pull request, #13457: URL: https://github.com/apache/kafka/pull/13457 1. remote `remoteStorageManager` parameter in UnifiedLog because remoteStorageManager needs wait for logManager got started before it can be initialized. And the `UnifiedLog` is created/initialized in

[GitHub] [kafka] chia7712 commented on pull request #13326: KAFKA-14774 the removed listeners should not be reconfigurable

2023-03-27 Thread via GitHub
chia7712 commented on PR #13326: URL: https://github.com/apache/kafka/pull/13326#issuecomment-1484917669 failed test is traced by #13452 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

[GitHub] [kafka] chia7712 merged pull request #13326: KAFKA-14774 the removed listeners should not be reconfigurable

2023-03-27 Thread via GitHub
chia7712 merged PR #13326: URL: https://github.com/apache/kafka/pull/13326 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

[jira] [Resolved] (KAFKA-14774) the removed listeners should not be reconfigurable

2023-03-27 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-14774. Fix Version/s: 3.5.0 Resolution: Fixed > the removed listeners should not be reconf

[GitHub] [kafka] yashmayya commented on a diff in pull request #13453: KAFKA-12525: Ignoring Stale status statuses when reading from Status …

2023-03-27 Thread via GitHub
yashmayya commented on code in PR #13453: URL: https://github.com/apache/kafka/pull/13453#discussion_r1149108767 ## connect/runtime/src/main/java/org/apache/kafka/connect/storage/KafkaStatusBackingStore.java: ## @@ -596,7 +596,11 @@ private void readTaskStatus(String key, byte[]

[GitHub] [kafka] chia7712 commented on a diff in pull request #13452: KAFKA-14848: KafkaConsumer incorrectly passes locally-scoped deserializers to FetchConfig

2023-03-27 Thread via GitHub
chia7712 commented on code in PR #13452: URL: https://github.com/apache/kafka/pull/13452#discussion_r1149136794 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/FetchConfig.java: ## @@ -101,8 +103,8 @@ public FetchConfig(ConsumerConfig config, this.m

[jira] [Updated] (KAFKA-14851) Move StreamResetterTest to tools module

2023-03-27 Thread Sagar Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Rao updated KAFKA-14851: -- Priority: Minor (was: Major) > Move StreamResetterTest to tools module >

[jira] [Updated] (KAFKA-14851) Move StreamResetterTest to tools module

2023-03-27 Thread Sagar Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Rao updated KAFKA-14851: -- Description: This came up as a suggestion here: https://github.com/apache/kafka/pull/13127#discussion_

[jira] [Created] (KAFKA-14851) Move StreamResetterTest to tools module

2023-03-27 Thread Sagar Rao (Jira)
Sagar Rao created KAFKA-14851: - Summary: Move StreamResetterTest to tools module Key: KAFKA-14851 URL: https://issues.apache.org/jira/browse/KAFKA-14851 Project: Kafka Issue Type: Sub-task

[GitHub] [kafka] vamossagar12 commented on a diff in pull request #13127: KAFKA-14586: Moving StreamResetter to tools

2023-03-27 Thread via GitHub
vamossagar12 commented on code in PR #13127: URL: https://github.com/apache/kafka/pull/13127#discussion_r1149149145 ## streams/src/test/java/org/apache/kafka/streams/tools/StreamsResetterTest.java: ## @@ -16,7 +16,7 @@ */ package org.apache.kafka.streams.tools; -import kafk

[GitHub] [kafka] yashmayya commented on a diff in pull request #13453: KAFKA-12525: Ignoring Stale status statuses when reading from Status …

2023-03-27 Thread via GitHub
yashmayya commented on code in PR #13453: URL: https://github.com/apache/kafka/pull/13453#discussion_r1149123939 ## connect/runtime/src/main/java/org/apache/kafka/connect/storage/KafkaStatusBackingStore.java: ## @@ -596,7 +596,11 @@ private void readTaskStatus(String key, byte[]

[GitHub] [kafka] cadonna commented on a diff in pull request #13269: KAFKA-12634 enforce checkpoint after restoration

2023-03-27 Thread via GitHub
cadonna commented on code in PR #13269: URL: https://github.com/apache/kafka/pull/13269#discussion_r1149189233 ## streams/src/test/java/org/apache/kafka/streams/processor/internals/StreamTaskTest.java: ## @@ -1699,7 +1705,8 @@ public void shouldReturnOffsetsForRepartitionTopics

[GitHub] [kafka] pierDipi commented on a diff in pull request #13325: KAFKA-14771: Include threads info in ConcurrentModificationException message

2023-03-27 Thread via GitHub
pierDipi commented on code in PR #13325: URL: https://github.com/apache/kafka/pull/13325#discussion_r1149221534 ## clients/src/main/java/org/apache/kafka/clients/consumer/KafkaConsumer.java: ## @@ -2547,9 +2547,10 @@ private void acquireAndEnsureOpen() { * @throws Concurre

[GitHub] [kafka] Hangleton commented on pull request #13240: KAFKA-14690: Add topic IDs to the OffsetCommit API version 9

2023-03-27 Thread via GitHub
Hangleton commented on PR #13240: URL: https://github.com/apache/kafka/pull/13240#issuecomment-1485037330 Hello David, this PR has been updated and is ready for review. Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

[jira] [Updated] (KAFKA-14838) MM2 Worker/Connector/Task clients should specify client ID based on flow and role

2023-03-27 Thread Daniel Urban (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Urban updated KAFKA-14838: - Summary: MM2 Worker/Connector/Task clients should specify client ID based on flow and role (was

[jira] [Updated] (KAFKA-14838) MM2 Worker/Connector/Task clients should specify client ID based on flow and role

2023-03-27 Thread Daniel Urban (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Urban updated KAFKA-14838: - Description: MM2 code creates a lot of Kafka clients internally. These clients generate a lot o

[jira] [Created] (KAFKA-14852) Propagate Topic Ids to the Group Coordinator for Offset Fetch

2023-03-27 Thread Alexandre Dupriez (Jira)
Alexandre Dupriez created KAFKA-14852: - Summary: Propagate Topic Ids to the Group Coordinator for Offset Fetch Key: KAFKA-14852 URL: https://issues.apache.org/jira/browse/KAFKA-14852 Project: Kafk

[jira] [Updated] (KAFKA-14690) OffsetCommit API Version 9

2023-03-27 Thread Alexandre Dupriez (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexandre Dupriez updated KAFKA-14690: -- Fix Version/s: 3.5.0 > OffsetCommit API Version 9 > -- > >

[GitHub] [kafka] emissionnebula commented on pull request #13437: KAFKA-14828: Remove R/W locks using persistent data structures

2023-03-27 Thread via GitHub
emissionnebula commented on PR #13437: URL: https://github.com/apache/kafka/pull/13437#issuecomment-1485100563 Oops. Thanks @rondagostino for pointing this out. I have updated the description with the correct details. -- This is an automated message from the Apache Git Service. To respond

[GitHub] [kafka] C0urante commented on a diff in pull request #12637: KAFKA-14226: [connect:transform] Introduce support for nested structures

2023-03-27 Thread via GitHub
C0urante commented on code in PR #12637: URL: https://github.com/apache/kafka/pull/12637#discussion_r1148760142 ## connect/transforms/src/main/java/org/apache/kafka/connect/transforms/field/SingleFieldPath.java: ## @@ -0,0 +1,585 @@ +/* + * Licensed to the Apache Software Founda

[jira] [Assigned] (KAFKA-14852) Propagate Topic Ids to the Group Coordinator for Offset Fetch

2023-03-27 Thread Alexandre Dupriez (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexandre Dupriez reassigned KAFKA-14852: - Assignee: Alexandre Dupriez > Propagate Topic Ids to the Group Coordinator for

[jira] [Updated] (KAFKA-14852) Propagate Topic Ids to the Group Coordinator for Offset Fetch

2023-03-27 Thread Alexandre Dupriez (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexandre Dupriez updated KAFKA-14852: -- Description: This task is the sibling of KAFKA-14793 which propagates topic ids in the

[GitHub] [kafka] urbandan opened a new pull request, #13458: KAFKA-14838: Add flow/connector/task/role information to MM2 Kafka cl…

2023-03-27 Thread via GitHub
urbandan opened a new pull request, #13458: URL: https://github.com/apache/kafka/pull/13458 …ient.id configs *More detailed description of your change, if necessary. The PR title and PR message become the squashed commit message, so use a separate comment to ping reviewers.*

[GitHub] [kafka] urbandan commented on pull request #13458: KAFKA-14838: Add flow/connector/task/role information to MM2 Kafka cl…

2023-03-27 Thread via GitHub
urbandan commented on PR #13458: URL: https://github.com/apache/kafka/pull/13458#issuecomment-1485136651 @viktorsomogyi @C0urante @mimaison You had some changes/review in this part of the code lately, could you please review? -- This is an automated message from the Apache Git Service. To

[jira] [Updated] (KAFKA-14652) Improve MM2 logging by adding the flow information to the context

2023-03-27 Thread Daniel Urban (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Urban updated KAFKA-14652: - Description: MirrorMaker2 runs multiple Connect worker instances in a single process. In Connec

[GitHub] [kafka] philipnee commented on a diff in pull request #13269: KAFKA-12634 enforce checkpoint after restoration

2023-03-27 Thread via GitHub
philipnee commented on code in PR #13269: URL: https://github.com/apache/kafka/pull/13269#discussion_r1149285314 ## streams/src/test/java/org/apache/kafka/streams/processor/internals/StreamTaskTest.java: ## @@ -1699,7 +1705,8 @@ public void shouldReturnOffsetsForRepartitionTopi

[GitHub] [kafka] pprovenzano commented on pull request #13374: KAFKA-14765 and KAFKA-14776: Support for SCRAM at bootstrap with integration tests

2023-03-27 Thread via GitHub
pprovenzano commented on PR #13374: URL: https://github.com/apache/kafka/pull/13374#issuecomment-1485244811 > This seems to have broken `FeatureCommandUnitTest.testHandleDowngrade` because of changes to storage tool. > This seems to have broken `FeatureCommandUnitTest.testHand

[GitHub] [kafka] C0urante commented on pull request #12637: KAFKA-14226: [connect:transform] Introduce support for nested structures

2023-03-27 Thread via GitHub
C0urante commented on PR #12637: URL: https://github.com/apache/kafka/pull/12637#issuecomment-1485251519 I'm also wondering about the spec for V2 field syntax. The KIP states that "if the backticks are in a wrapping position (opening or closing a field name), then need to be escaped with ba

[GitHub] [kafka] C0urante commented on pull request #12637: KAFKA-14226: [connect:transform] Introduce support for nested structures

2023-03-27 Thread via GitHub
C0urante commented on PR #12637: URL: https://github.com/apache/kafka/pull/12637#issuecomment-1485252002 I'm also wondering about the spec for V2 field syntax. The KIP states that "if the backticks are in a wrapping position (opening or closing a field name), then need to be escaped with ba

[GitHub] [kafka] C0urante commented on a diff in pull request #12637: KAFKA-14226: [connect:transform] Introduce support for nested structures

2023-03-27 Thread via GitHub
C0urante commented on code in PR #12637: URL: https://github.com/apache/kafka/pull/12637#discussion_r1149375240 ## connect/transforms/src/main/java/org/apache/kafka/connect/transforms/field/SingleFieldPath.java: ## @@ -0,0 +1,585 @@ +/* + * Licensed to the Apache Software Founda

[GitHub] [kafka] C0urante commented on pull request #13458: KAFKA-14838: Add flow/connector/task/role information to MM2 Kafka cl…

2023-03-27 Thread via GitHub
C0urante commented on PR #13458: URL: https://github.com/apache/kafka/pull/13458#issuecomment-1485288081 Hey @urbandan, it's looking like this week is going to be pretty busy for me so I may not be able to take a look immediately. I can try to take a look next week if this still hasn't rece

[GitHub] [kafka] urbandan commented on pull request #10566: KAFKA-12694 Avoid schema mismatch DataException when validating default values

2023-03-27 Thread via GitHub
urbandan commented on PR #10566: URL: https://github.com/apache/kafka/pull/10566#issuecomment-1485386852 Thanks a lot @C0urante, will review that one! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [kafka] urbandan commented on a diff in pull request #13433: KAFKA-12694, KAFKA-3910: Add cyclic schema support, fix default struct values

2023-03-27 Thread via GitHub
urbandan commented on code in PR #13433: URL: https://github.com/apache/kafka/pull/13433#discussion_r1149465857 ## connect/api/src/main/java/org/apache/kafka/connect/data/ConnectSchema.java: ## @@ -289,29 +291,202 @@ public ConnectSchema schema() { @Override public boo

[GitHub] [kafka] urbandan commented on a diff in pull request #13433: KAFKA-12694, KAFKA-3910: Add cyclic schema support, fix default struct values

2023-03-27 Thread via GitHub
urbandan commented on code in PR #13433: URL: https://github.com/apache/kafka/pull/13433#discussion_r1149488176 ## connect/api/src/main/java/org/apache/kafka/connect/data/ConnectSchema.java: ## @@ -289,29 +291,202 @@ public ConnectSchema schema() { @Override public boo

[GitHub] [kafka] C0urante commented on a diff in pull request #13433: KAFKA-12694, KAFKA-3910: Add cyclic schema support, fix default struct values

2023-03-27 Thread via GitHub
C0urante commented on code in PR #13433: URL: https://github.com/apache/kafka/pull/13433#discussion_r1149494051 ## connect/api/src/main/java/org/apache/kafka/connect/data/ConnectSchema.java: ## @@ -289,29 +291,202 @@ public ConnectSchema schema() { @Override public boo

[GitHub] [kafka] junrao commented on a diff in pull request #13408: KAFKA-14617: Update AlterPartitionRequest and enable Kraft controller to reject stale request.

2023-03-27 Thread via GitHub
junrao commented on code in PR #13408: URL: https://github.com/apache/kafka/pull/13408#discussion_r1149498020 ## metadata/src/main/java/org/apache/kafka/controller/ReplicationControlManager.java: ## @@ -1159,16 +1171,20 @@ private Errors validateAlterPartitionData( retu

[GitHub] [kafka] tinaselenge opened a new pull request, #13459: KAFKA-14592: Move FeatureCommand to tools

2023-03-27 Thread via GitHub
tinaselenge opened a new pull request, #13459: URL: https://github.com/apache/kafka/pull/13459 ``` === tests $./bin/kafka-features.sh --bootstrap-server localhost:9092 --command-config test describe Feature: metadata.version SupportedMinVersion: 3.0-IV1 SupportedMaxVersio

[GitHub] [kafka] guozhangwang commented on pull request #13452: KAFKA-14848: KafkaConsumer incorrectly passes locally-scoped deserializers to FetchConfig

2023-03-27 Thread via GitHub
guozhangwang commented on PR #13452: URL: https://github.com/apache/kafka/pull/13452#issuecomment-1485490464 LGTM. Merging to trunk to unblock @rayokota and SR, please feel free to address @chia7712 's comments in a follow-up PR. -- This is an automated message from the Apache Git Service

[GitHub] [kafka] guozhangwang merged pull request #13452: KAFKA-14848: KafkaConsumer incorrectly passes locally-scoped deserializers to FetchConfig

2023-03-27 Thread via GitHub
guozhangwang merged PR #13452: URL: https://github.com/apache/kafka/pull/13452 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.ap

[GitHub] [kafka] CalvinConfluent commented on a diff in pull request #13408: KAFKA-14617: Update AlterPartitionRequest and enable Kraft controller to reject stale request.

2023-03-27 Thread via GitHub
CalvinConfluent commented on code in PR #13408: URL: https://github.com/apache/kafka/pull/13408#discussion_r1149550057 ## metadata/src/main/java/org/apache/kafka/controller/ReplicationControlManager.java: ## @@ -1159,16 +1171,20 @@ private Errors validateAlterPartitionData(

[jira] [Created] (KAFKA-14853) the serializer/deserialize which extends ClusterResourceListener is never called

2023-03-27 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-14853: -- Summary: the serializer/deserialize which extends ClusterResourceListener is never called Key: KAFKA-14853 URL: https://issues.apache.org/jira/browse/KAFKA-14853

[jira] [Updated] (KAFKA-14853) the serializer/deserialize which extends ClusterResourceListener is not added to Metadata

2023-03-27 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai updated KAFKA-14853: --- Summary: the serializer/deserialize which extends ClusterResourceListener is not added to Me

[GitHub] [kafka] chia7712 opened a new pull request, #13460: KAFKA-14853 the serializer/deserialize which extends ClusterResourceL…

2023-03-27 Thread via GitHub
chia7712 opened a new pull request, #13460: URL: https://github.com/apache/kafka/pull/13460 https://issues.apache.org/jira/browse/KAFKA-14853 I noticed this issue when reviewing #13452. We use the incorrect reference of serializer/deserializer ### Committer Checklist (exclu

[jira] [Created] (KAFKA-14854) Refactor inter broker send thread to handle all interbroker requests on one thread

2023-03-27 Thread Justine Olshan (Jira)
Justine Olshan created KAFKA-14854: -- Summary: Refactor inter broker send thread to handle all interbroker requests on one thread Key: KAFKA-14854 URL: https://issues.apache.org/jira/browse/KAFKA-14854

[GitHub] [kafka] jolshan commented on a diff in pull request #13391: KAFKA-14561: Improve transactions experience for older clients by ensuring ongoing transaction

2023-03-27 Thread via GitHub
jolshan commented on code in PR #13391: URL: https://github.com/apache/kafka/pull/13391#discussion_r1149586417 ## core/src/main/scala/kafka/server/AddPartitionsToTxnManager.scala: ## @@ -0,0 +1,173 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under one or more +

[GitHub] [kafka] rreddy-22 commented on a diff in pull request #13443: KAFKA-14514: Add Server Side Sticky Range Assignor (KIP-848)

2023-03-27 Thread via GitHub
rreddy-22 commented on code in PR #13443: URL: https://github.com/apache/kafka/pull/13443#discussion_r1149630814 ## checkstyle/suppressions.xml: ## @@ -320,6 +320,14 @@ + + +

[GitHub] [kafka] rreddy-22 commented on a diff in pull request #13443: KAFKA-14514: Add Server Side Sticky Range Assignor (KIP-848)

2023-03-27 Thread via GitHub
rreddy-22 commented on code in PR #13443: URL: https://github.com/apache/kafka/pull/13443#discussion_r1149644261 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/assignor/AssignmentMemberSpec.java: ## @@ -37,29 +39,28 @@ public class AssignmentMemberSpec {

[GitHub] [kafka] rreddy-22 commented on a diff in pull request #13443: KAFKA-14514: Add Server Side Sticky Range Assignor (KIP-848)

2023-03-27 Thread via GitHub
rreddy-22 commented on code in PR #13443: URL: https://github.com/apache/kafka/pull/13443#discussion_r1149647453 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/assignor/ServerSideStickyRangeAssignor.java: ## @@ -0,0 +1,268 @@ +/* + * Licensed to the Apache

[GitHub] [kafka] gharris1727 commented on a diff in pull request #13445: [KAFKA-14843] fix(connect): include base connector config to return

2023-03-27 Thread via GitHub
gharris1727 commented on code in PR #13445: URL: https://github.com/apache/kafka/pull/13445#discussion_r1149638851 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/AbstractHerder.java: ## @@ -836,10 +836,19 @@ public List connectorPluginConfig(String pluginName

[GitHub] [kafka] rreddy-22 commented on a diff in pull request #13443: KAFKA-14514: Add Server Side Sticky Range Assignor (KIP-848)

2023-03-27 Thread via GitHub
rreddy-22 commented on code in PR #13443: URL: https://github.com/apache/kafka/pull/13443#discussion_r1149648624 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/assignor/ServerSideStickyRangeAssignor.java: ## @@ -0,0 +1,268 @@ +/* + * Licensed to the Apache

[GitHub] [kafka] rreddy-22 commented on a diff in pull request #13443: KAFKA-14514: Add Server Side Sticky Range Assignor (KIP-848)

2023-03-27 Thread via GitHub
rreddy-22 commented on code in PR #13443: URL: https://github.com/apache/kafka/pull/13443#discussion_r1149650468 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/assignor/ServerSideStickyRangeAssignor.java: ## @@ -0,0 +1,268 @@ +/* + * Licensed to the Apache

[GitHub] [kafka] rreddy-22 commented on a diff in pull request #13443: KAFKA-14514: Add Server Side Sticky Range Assignor (KIP-848)

2023-03-27 Thread via GitHub
rreddy-22 commented on code in PR #13443: URL: https://github.com/apache/kafka/pull/13443#discussion_r1149655641 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/assignor/ServerSideStickyRangeAssignor.java: ## @@ -0,0 +1,268 @@ +/* + * Licensed to the Apache

[GitHub] [kafka] gharris1727 commented on a diff in pull request #13433: KAFKA-12694, KAFKA-3910: Add cyclic schema support, fix default struct values

2023-03-27 Thread via GitHub
gharris1727 commented on code in PR #13433: URL: https://github.com/apache/kafka/pull/13433#discussion_r1149656291 ## connect/api/src/main/java/org/apache/kafka/connect/data/ConnectSchema.java: ## @@ -289,29 +291,202 @@ public ConnectSchema schema() { @Override public

[GitHub] [kafka] rreddy-22 commented on a diff in pull request #13443: KAFKA-14514: Add Server Side Sticky Range Assignor (KIP-848)

2023-03-27 Thread via GitHub
rreddy-22 commented on code in PR #13443: URL: https://github.com/apache/kafka/pull/13443#discussion_r1149658306 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/assignor/ServerSideStickyRangeAssignor.java: ## @@ -0,0 +1,268 @@ +/* + * Licensed to the Apache

[GitHub] [kafka] rreddy-22 commented on a diff in pull request #13443: KAFKA-14514: Add Server Side Sticky Range Assignor (KIP-848)

2023-03-27 Thread via GitHub
rreddy-22 commented on code in PR #13443: URL: https://github.com/apache/kafka/pull/13443#discussion_r1149659044 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/assignor/ServerSideStickyRangeAssignor.java: ## @@ -0,0 +1,268 @@ +/* + * Licensed to the Apache

[GitHub] [kafka] rreddy-22 commented on a diff in pull request #13443: KAFKA-14514: Add Server Side Sticky Range Assignor (KIP-848)

2023-03-27 Thread via GitHub
rreddy-22 commented on code in PR #13443: URL: https://github.com/apache/kafka/pull/13443#discussion_r1149659044 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/assignor/ServerSideStickyRangeAssignor.java: ## @@ -0,0 +1,268 @@ +/* + * Licensed to the Apache

[GitHub] [kafka] rreddy-22 commented on a diff in pull request #13443: KAFKA-14514: Add Server Side Sticky Range Assignor (KIP-848)

2023-03-27 Thread via GitHub
rreddy-22 commented on code in PR #13443: URL: https://github.com/apache/kafka/pull/13443#discussion_r1149666320 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/assignor/ServerSideStickyRangeAssignor.java: ## @@ -0,0 +1,268 @@ +/* + * Licensed to the Apache

[GitHub] [kafka] jeqo commented on pull request #13445: [KAFKA-14843] fix(connect): include base connector config to return

2023-03-27 Thread via GitHub
jeqo commented on PR #13445: URL: https://github.com/apache/kafka/pull/13445#issuecomment-1485705474 Sure, thanks @gharris1727! let me know how it looks now. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[GitHub] [kafka] jeqo commented on a diff in pull request #13445: [KAFKA-14843] fix(connect): include base connector config to return

2023-03-27 Thread via GitHub
jeqo commented on code in PR #13445: URL: https://github.com/apache/kafka/pull/13445#discussion_r1149677176 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/AbstractHerder.java: ## @@ -856,11 +867,8 @@ public List connectorPluginConfig(String pluginName) {

[GitHub] [kafka] rreddy-22 commented on a diff in pull request #13443: KAFKA-14514: Add Server Side Sticky Range Assignor (KIP-848)

2023-03-27 Thread via GitHub
rreddy-22 commented on code in PR #13443: URL: https://github.com/apache/kafka/pull/13443#discussion_r1149655641 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/assignor/ServerSideStickyRangeAssignor.java: ## @@ -0,0 +1,268 @@ +/* + * Licensed to the Apache

[jira] [Assigned] (KAFKA-14746) Throwing in Connector.taskConfigs generates a lot of logs

2023-03-27 Thread Spacrocket (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Spacrocket reassigned KAFKA-14746: -- Assignee: Spacrocket > Throwing in Connector.taskConfigs generates a lot of logs > --

[GitHub] [kafka] gharris1727 commented on a diff in pull request #13445: [KAFKA-14843] fix(connect): include base connector config to return

2023-03-27 Thread via GitHub
gharris1727 commented on code in PR #13445: URL: https://github.com/apache/kafka/pull/13445#discussion_r1149755190 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/AbstractHerder.java: ## @@ -856,11 +867,8 @@ public List connectorPluginConfig(String pluginName)

[GitHub] [kafka] C0urante commented on a diff in pull request #13429: KAFKA-14666: Add MM2 in-memory offset translation index for offsets behind replication

2023-03-27 Thread via GitHub
C0urante commented on code in PR #13429: URL: https://github.com/apache/kafka/pull/13429#discussion_r1149500829 ## connect/mirror/src/main/java/org/apache/kafka/connect/mirror/OffsetSyncStore.java: ## @@ -25,17 +25,37 @@ import org.apache.kafka.common.utils.Utils; import org.a

[jira] [Created] (KAFKA-14855) Harden integration testing logic for asserting that a connector is deleted

2023-03-27 Thread Chris Egerton (Jira)
Chris Egerton created KAFKA-14855: - Summary: Harden integration testing logic for asserting that a connector is deleted Key: KAFKA-14855 URL: https://issues.apache.org/jira/browse/KAFKA-14855 Project:

[GitHub] [kafka] C0urante commented on a diff in pull request #13424: KAFKA-14783 (KIP-875): New STOPPED state for connectors

2023-03-27 Thread via GitHub
C0urante commented on code in PR #13424: URL: https://github.com/apache/kafka/pull/13424#discussion_r1149773408 ## connect/runtime/src/test/java/org/apache/kafka/connect/integration/ConnectWorkerIntegrationTest.java: ## @@ -325,6 +325,181 @@ public void testSourceTaskNotBlocked

[GitHub] [kafka] C0urante commented on a diff in pull request #13424: KAFKA-14783 (KIP-875): New STOPPED state for connectors

2023-03-27 Thread via GitHub
C0urante commented on code in PR #13424: URL: https://github.com/apache/kafka/pull/13424#discussion_r1149776904 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/standalone/StandaloneHerder.java: ## @@ -237,6 +237,17 @@ private synchronized void putConnectorConfi

[GitHub] [kafka] C0urante commented on a diff in pull request #13424: KAFKA-14783 (KIP-875): New STOPPED state for connectors

2023-03-27 Thread via GitHub
C0urante commented on code in PR #13424: URL: https://github.com/apache/kafka/pull/13424#discussion_r1149778430 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/distributed/DistributedHerder.java: ## @@ -1090,6 +1090,40 @@ public void putConnectorConfig(final St

[GitHub] [kafka] anatasiavela commented on pull request #13078: KAFKA-13999: Add ProducerCount metrics (KIP-847)

2023-03-27 Thread via GitHub
anatasiavela commented on PR #13078: URL: https://github.com/apache/kafka/pull/13078#issuecomment-1485869027 @mimaison I've marked the JIRA as resolved -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[jira] [Created] (KAFKA-14856) Next gen group coordinator dynamic configs should be forward compatible

2023-03-27 Thread Jeff Kim (Jira)
Jeff Kim created KAFKA-14856: Summary: Next gen group coordinator dynamic configs should be forward compatible Key: KAFKA-14856 URL: https://issues.apache.org/jira/browse/KAFKA-14856 Project: Kafka

[GitHub] [kafka] C0urante commented on a diff in pull request #13434: KAFKA-14785: Connect offset read REST API

2023-03-27 Thread via GitHub
C0urante commented on code in PR #13434: URL: https://github.com/apache/kafka/pull/13434#discussion_r1149813420 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/AbstractHerder.java: ## @@ -866,4 +867,19 @@ public List connectorPluginConfig(String pluginName) {

[jira] [Commented] (KAFKA-14757) Kafka Cooperative Sticky Assignor results in significant duplicate consumption

2023-03-27 Thread Philip Nee (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17705687#comment-17705687 ] Philip Nee commented on KAFKA-14757: Hey [~sanand] - I'm unfamiliar with ConsumerAwa

[jira] (KAFKA-14757) Kafka Cooperative Sticky Assignor results in significant duplicate consumption

2023-03-27 Thread Philip Nee (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14757 ] Philip Nee deleted comment on KAFKA-14757: was (Author: JIRAUSER283568): Hey [~sanand] - I'm unfamiliar with ConsumerAwareRebalanceListener, but do you know if it revokes the partitions upon

[jira] [Commented] (KAFKA-14757) Kafka Cooperative Sticky Assignor results in significant duplicate consumption

2023-03-27 Thread Philip Nee (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17705689#comment-17705689 ] Philip Nee commented on KAFKA-14757: Hi [~sanand] - I'm not sure what's behavior of

[GitHub] [kafka] C0urante commented on a diff in pull request #13434: KAFKA-14785: Connect offset read REST API

2023-03-27 Thread via GitHub
C0urante commented on code in PR #13434: URL: https://github.com/apache/kafka/pull/13434#discussion_r1149828648 ## connect/runtime/src/main/java/org/apache/kafka/connect/storage/KafkaOffsetBackingStore.java: ## @@ -343,12 +336,38 @@ public Future set(final Map values, final Cal

[GitHub] [kafka] artemlivshits commented on a diff in pull request #13391: KAFKA-14561: Improve transactions experience for older clients by ensuring ongoing transaction

2023-03-27 Thread via GitHub
artemlivshits commented on code in PR #13391: URL: https://github.com/apache/kafka/pull/13391#discussion_r1149838206 ## core/src/main/scala/kafka/server/AddPartitionsToTxnManager.scala: ## @@ -0,0 +1,173 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under one or m

[GitHub] [kafka] C0urante commented on a diff in pull request #13373: Kafka-14420 Use incrementalAlterConfigs API for syncing topic configurations (KIP-894)

2023-03-27 Thread via GitHub
C0urante commented on code in PR #13373: URL: https://github.com/apache/kafka/pull/13373#discussion_r1149838213 ## connect/mirror/src/main/java/org/apache/kafka/connect/mirror/MirrorSourceConnector.java: ## @@ -540,10 +601,13 @@ Map describeTopicConfigs(Set topics) Confi

[GitHub] [kafka] gharris1727 commented on a diff in pull request #13433: KAFKA-12694, KAFKA-3910: Add cyclic schema support, fix default struct values

2023-03-27 Thread via GitHub
gharris1727 commented on code in PR #13433: URL: https://github.com/apache/kafka/pull/13433#discussion_r1149838302 ## connect/api/src/main/java/org/apache/kafka/connect/data/ConnectSchema.java: ## @@ -289,29 +291,202 @@ public ConnectSchema schema() { @Override public

[GitHub] [kafka] C0urante commented on a diff in pull request #13373: Kafka-14420 Use incrementalAlterConfigs API for syncing topic configurations (KIP-894)

2023-03-27 Thread via GitHub
C0urante commented on code in PR #13373: URL: https://github.com/apache/kafka/pull/13373#discussion_r1149841456 ## connect/mirror/src/main/java/org/apache/kafka/connect/mirror/ConfigPropertyFilter.java: ## @@ -25,8 +25,19 @@ @InterfaceStability.Evolving public interface Config

[GitHub] [kafka] C0urante commented on a diff in pull request #13373: Kafka-14420 Use incrementalAlterConfigs API for syncing topic configurations (KIP-894)

2023-03-27 Thread via GitHub
C0urante commented on code in PR #13373: URL: https://github.com/apache/kafka/pull/13373#discussion_r1149842964 ## connect/mirror/src/main/java/org/apache/kafka/connect/mirror/DefaultConfigPropertyFilter.java: ## @@ -30,6 +30,9 @@ public class DefaultConfigPropertyFilter impleme

[GitHub] [kafka] C0urante commented on a diff in pull request #13373: Kafka-14420 Use incrementalAlterConfigs API for syncing topic configurations (KIP-894)

2023-03-27 Thread via GitHub
C0urante commented on code in PR #13373: URL: https://github.com/apache/kafka/pull/13373#discussion_r1149843748 ## connect/mirror/src/main/java/org/apache/kafka/connect/mirror/MirrorSourceConnector.java: ## @@ -96,6 +99,7 @@ public class MirrorSourceConnector extends SourceConne

[jira] [Created] (KAFKA-14857) Fix some MetadataLoader bugs

2023-03-27 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-14857: Summary: Fix some MetadataLoader bugs Key: KAFKA-14857 URL: https://issues.apache.org/jira/browse/KAFKA-14857 Project: Kafka Issue Type: Bug Repo

[GitHub] [kafka] C0urante commented on a diff in pull request #13373: Kafka-14420 Use incrementalAlterConfigs API for syncing topic configurations (KIP-894)

2023-03-27 Thread via GitHub
C0urante commented on code in PR #13373: URL: https://github.com/apache/kafka/pull/13373#discussion_r1149844200 ## connect/mirror/src/test/java/org/apache/kafka/connect/mirror/integration/IdentityReplicationIntegrationTest.java: ## @@ -41,12 +41,12 @@ import org.junit.jupiter.a

[GitHub] [kafka] cmccabe opened a new pull request, #13462: KAFKA-14857: Fix some MetadataLoader bugs

2023-03-27 Thread via GitHub
cmccabe opened a new pull request, #13462: URL: https://github.com/apache/kafka/pull/13462 The MetadataLoader is not supposed to publish metadata updates until we have loaded up to the high water mark. Previously, this logic was broken, and we published updates immediately. This PR fixes th

[GitHub] [kafka] jolshan commented on a diff in pull request #13391: KAFKA-14561: Improve transactions experience for older clients by ensuring ongoing transaction

2023-03-27 Thread via GitHub
jolshan commented on code in PR #13391: URL: https://github.com/apache/kafka/pull/13391#discussion_r1149847782 ## core/src/main/scala/kafka/server/AddPartitionsToTxnManager.scala: ## @@ -0,0 +1,173 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under one or more +

[GitHub] [kafka] C0urante commented on a diff in pull request #13373: Kafka-14420 Use incrementalAlterConfigs API for syncing topic configurations (KIP-894)

2023-03-27 Thread via GitHub
C0urante commented on code in PR #13373: URL: https://github.com/apache/kafka/pull/13373#discussion_r1149844764 ## connect/mirror/src/test/java/org/apache/kafka/connect/mirror/integration/IdentityReplicationIntegrationTest.java: ## @@ -41,12 +41,12 @@ import org.junit.jupiter.a

[GitHub] [kafka] C0urante commented on a diff in pull request #13373: Kafka-14420 Use incrementalAlterConfigs API for syncing topic configurations (KIP-894)

2023-03-27 Thread via GitHub
C0urante commented on code in PR #13373: URL: https://github.com/apache/kafka/pull/13373#discussion_r1149857584 ## connect/mirror/src/main/java/org/apache/kafka/connect/mirror/MirrorSourceConnector.java: ## @@ -514,6 +543,41 @@ private void updateTopicConfigs(Map topicConfigs)

[GitHub] [kafka] cmccabe merged pull request #13368: KAFKA-14796 Migrate ACLs from AclAuthorizor to KRaft

2023-03-27 Thread via GitHub
cmccabe merged PR #13368: URL: https://github.com/apache/kafka/pull/13368 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.

[GitHub] [kafka] cmccabe commented on a diff in pull request #13374: KAFKA-14765 and KAFKA-14776: Support for SCRAM at bootstrap with integration tests

2023-03-27 Thread via GitHub
cmccabe commented on code in PR #13374: URL: https://github.com/apache/kafka/pull/13374#discussion_r1149874897 ## core/src/main/scala/kafka/tools/StorageTool.scala: ## @@ -22,19 +22,37 @@ import java.nio.file.{Files, Paths} import kafka.server.{BrokerMetadataCheckpoint, KafkaCo

[GitHub] [kafka] artemlivshits commented on a diff in pull request #13391: KAFKA-14561: Improve transactions experience for older clients by ensuring ongoing transaction

2023-03-27 Thread via GitHub
artemlivshits commented on code in PR #13391: URL: https://github.com/apache/kafka/pull/13391#discussion_r1149873099 ## core/src/main/scala/kafka/server/AddPartitionsToTxnManager.scala: ## @@ -0,0 +1,173 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under one or m

[GitHub] [kafka] cmccabe commented on a diff in pull request #13374: KAFKA-14765 and KAFKA-14776: Support for SCRAM at bootstrap with integration tests

2023-03-27 Thread via GitHub
cmccabe commented on code in PR #13374: URL: https://github.com/apache/kafka/pull/13374#discussion_r1149876669 ## core/src/main/scala/kafka/tools/StorageTool.scala: ## @@ -128,6 +152,108 @@ object StorageTool extends Logging { .getOrElse(defaultValue) } + def getUse

[GitHub] [kafka] cmccabe commented on a diff in pull request #13374: KAFKA-14765 and KAFKA-14776: Support for SCRAM at bootstrap with integration tests

2023-03-27 Thread via GitHub
cmccabe commented on code in PR #13374: URL: https://github.com/apache/kafka/pull/13374#discussion_r1149874897 ## core/src/main/scala/kafka/tools/StorageTool.scala: ## @@ -22,19 +22,37 @@ import java.nio.file.{Files, Paths} import kafka.server.{BrokerMetadataCheckpoint, KafkaCo

  1   2   >