[GitHub] [kafka] dajac merged pull request #13023: KAFKA-14532: Correctly handle failed fetch when partitions unassigned

2022-12-21 Thread GitBox
dajac merged PR #13023: URL: https://github.com/apache/kafka/pull/13023 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.or

[GitHub] [kafka] dajac commented on pull request #13023: KAFKA-14532: Correctly handle failed fetch when partitions unassigned

2022-12-21 Thread GitBox
dajac commented on PR #13023: URL: https://github.com/apache/kafka/pull/13023#issuecomment-1361005539 Merged to trunk, 3.4 and 3.3. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[GitHub] [kafka] dajac commented on a diff in pull request #13023: KAFKA-14532: Correctly handle failed fetch when partitions unassigned

2022-12-21 Thread GitBox
dajac commented on code in PR #13023: URL: https://github.com/apache/kafka/pull/13023#discussion_r1054106713 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/SubscriptionState.java: ## @@ -620,7 +620,12 @@ public synchronized Optional preferredReadReplica(To

[jira] [Resolved] (KAFKA-14532) Correctly handle failed fetch when partitions unassigned

2022-12-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-14532. - Resolution: Fixed > Correctly handle failed fetch when partitions unassigned > -

[jira] [Updated] (KAFKA-14532) Correctly handle failed fetch when partitions unassigned

2022-12-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-14532: Summary: Correctly handle failed fetch when partitions unassigned (was: IllegalStateException whe

[GitHub] [kafka] dajac merged pull request #12982: MINOR: Fix testPreferredReplicaAsLeaderWhenSameRackFollowerIsOutOfIsr

2022-12-21 Thread GitBox
dajac merged PR #12982: URL: https://github.com/apache/kafka/pull/12982 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.or

[GitHub] [kafka] lhotari commented on a diff in pull request #13032: KAFKA-14540: Fix DataOutputStreamWritable#writeByteBuffer

2022-12-21 Thread GitBox
lhotari commented on code in PR #13032: URL: https://github.com/apache/kafka/pull/13032#discussion_r1054114528 ## clients/src/main/java/org/apache/kafka/common/protocol/DataOutputStreamWritable.java: ## @@ -99,7 +99,7 @@ public void writeUnsignedVarint(int i) { public void

[GitHub] [kafka] dajac commented on pull request #12982: MINOR: Fix testPreferredReplicaAsLeaderWhenSameRackFollowerIsOutOfIsr

2022-12-21 Thread GitBox
dajac commented on PR #12982: URL: https://github.com/apache/kafka/pull/12982#issuecomment-1361022525 Merged to trunk, 3.4 and 3.3. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[jira] [Commented] (KAFKA-13107) KafkaServer.startup leaves server socket open if zk error is throws (ex. NodeExists)

2022-12-21 Thread Nikolay Izhikov (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17650437#comment-17650437 ] Nikolay Izhikov commented on KAFKA-13107: - Hello, [~Fuud]    Do you have logs?

[GitHub] [kafka] lucasbru commented on a diff in pull request #13017: KAFKA-14530: Check state updater more often

2022-12-21 Thread GitBox
lucasbru commented on code in PR #13017: URL: https://github.com/apache/kafka/pull/13017#discussion_r1054215201 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamThread.java: ## @@ -880,9 +885,7 @@ void runOnce() { private void initializeAndRestore

[GitHub] [kafka] cadonna commented on a diff in pull request #12739: Replace EasyMock and PowerMock with Mockito | TimeOrderedCachingPersistentWindowStoreTest

2022-12-21 Thread GitBox
cadonna commented on code in PR #12739: URL: https://github.com/apache/kafka/pull/12739#discussion_r1054286982 ## streams/src/test/java/org/apache/kafka/streams/state/internals/TimeOrderedCachingPersistentWindowStoreTest.java: ## @@ -104,11 +108,10 @@ public class TimeOrderedCac

[GitHub] [kafka] cadonna commented on pull request #13014: KAFKA-14461: Move StoreQueryIntegrationTest to junit5 and fixing logic in a couple of tests for finding active streams

2022-12-21 Thread GitBox
cadonna commented on PR #13014: URL: https://github.com/apache/kafka/pull/13014#issuecomment-1361257639 Build failures are not related: ``` Build / JDK 11 and Scala 2.13 / org.apache.kafka.connect.mirror.integration.IdentityReplicationIntegrationTest.testReplication() Build / JDK 11

[GitHub] [kafka] cadonna merged pull request #13014: KAFKA-14461: Move StoreQueryIntegrationTest to junit5 and fixing logic in a couple of tests for finding active streams

2022-12-21 Thread GitBox
cadonna merged PR #13014: URL: https://github.com/apache/kafka/pull/13014 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.

[jira] [Resolved] (KAFKA-14461) StoreQueryIntegrationTest#shouldQuerySpecificActivePartitionStores logic to check for active partitions seems brittle.

2022-12-21 Thread Bruno Cadonna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruno Cadonna resolved KAFKA-14461. --- Resolution: Fixed > StoreQueryIntegrationTest#shouldQuerySpecificActivePartitionStores logic

[GitHub] [kafka] cadonna commented on pull request #12959: MINOR: Fix various memory leaks in tests

2022-12-21 Thread GitBox
cadonna commented on PR #12959: URL: https://github.com/apache/kafka/pull/12959#issuecomment-1361260371 Build failures are not related: ``` Build / JDK 11 and Scala 2.13 / org.apache.kafka.clients.consumer.StickyAssignorTest.testLargeAssignmentAndGroupWithNonEqualSubscription() Buil

[GitHub] [kafka] cadonna merged pull request #12959: MINOR: Fix various memory leaks in tests

2022-12-21 Thread GitBox
cadonna merged PR #12959: URL: https://github.com/apache/kafka/pull/12959 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.

[GitHub] [kafka] ijuma commented on pull request #13012: KAFKA-14477: Move LogValidator and related to storage module

2022-12-21 Thread GitBox
ijuma commented on PR #13012: URL: https://github.com/apache/kafka/pull/13012#issuecomment-1361291206 JDK 17 build passed, the other failures are flaky. Re-running the test suite just in case. -- This is an automated message from the Apache Git Service. To respond to the message, please l

[GitHub] [kafka] ijuma commented on a diff in pull request #13032: KAFKA-14540: Fix DataOutputStreamWritable#writeByteBuffer

2022-12-21 Thread GitBox
ijuma commented on code in PR #13032: URL: https://github.com/apache/kafka/pull/13032#discussion_r1054369362 ## clients/src/main/java/org/apache/kafka/common/protocol/DataOutputStreamWritable.java: ## @@ -99,7 +99,7 @@ public void writeUnsignedVarint(int i) { public void wr

[GitHub] [kafka] ijuma merged pull request #13024: MINOR: Avoid unnecessary allocations in index binary search

2022-12-21 Thread GitBox
ijuma merged PR #13024: URL: https://github.com/apache/kafka/pull/13024 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.or

[GitHub] [kafka] ijuma commented on pull request #13024: MINOR: Avoid unnecessary allocations in index binary search

2022-12-21 Thread GitBox
ijuma commented on PR #13024: URL: https://github.com/apache/kafka/pull/13024#issuecomment-1361298288 Annoyingly, the commit was somehow pushed prematurely while I was still editing the commit message - not quite sure how that happened. Apologies for the bad commit message and the missing r

[jira] [Resolved] (KAFKA-14479) Move CleanerConfig to storage module

2022-12-21 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-14479. - Resolution: Duplicate Doing it as part of KAFKA-14478 instead. > Move CleanerConfig to storage

[jira] [Updated] (KAFKA-14478) Move LogConfig/CleanerConfig to storage module

2022-12-21 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-14478: Summary: Move LogConfig/CleanerConfig to storage module (was: Move LogConfig to storage module)

[jira] [Commented] (KAFKA-14128) Kafka Streams terminates on topic check

2022-12-21 Thread Lucia Cerchie (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17650896#comment-17650896 ] Lucia Cerchie commented on KAFKA-14128: --- working on this > Kafka Streams terminat

[jira] [Created] (KAFKA-14541) Profile produce workload for Apache Kafka

2022-12-21 Thread Divij Vaidya (Jira)
Divij Vaidya created KAFKA-14541: Summary: Profile produce workload for Apache Kafka Key: KAFKA-14541 URL: https://issues.apache.org/jira/browse/KAFKA-14541 Project: Kafka Issue Type: Improve

[jira] [Updated] (KAFKA-14392) KRaft broker heartbeat timeout should not exceed broker.session.timeout.ms

2022-12-21 Thread Ron Dagostino (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ron Dagostino updated KAFKA-14392: -- Affects Version/s: (was: 3.4.0) > KRaft broker heartbeat timeout should not exceed broker.

[jira] [Updated] (KAFKA-14392) KRaft broker heartbeat timeout should not exceed broker.session.timeout.ms

2022-12-21 Thread Ron Dagostino (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ron Dagostino updated KAFKA-14392: -- Fix Version/s: 3.4.0 (was: 3.5.0) > KRaft broker heartbeat timeout shou

[jira] [Updated] (KAFKA-14541) Profile produce workload for Apache Kafka

2022-12-21 Thread Divij Vaidya (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Divij Vaidya updated KAFKA-14541: - Description: I have been profiling Kafka (3.4.0 / trunk right now) for a produce only workload

[jira] [Updated] (KAFKA-14541) Profile produce workload for Apache Kafka

2022-12-21 Thread Divij Vaidya (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Divij Vaidya updated KAFKA-14541: - Description: I have been profiling Kafka (3.4.0 / trunk right now) for a produce only workload

[jira] [Updated] (KAFKA-14541) Profile produce workload for Apache Kafka

2022-12-21 Thread Divij Vaidya (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Divij Vaidya updated KAFKA-14541: - Description: I have been profiling Kafka (3.4.0 / trunk right now) for a produce only workload

[GitHub] [kafka] mumrah commented on a diff in pull request #13033: KAFKA-14538: Implement KRaft metadata transactions

2022-12-21 Thread GitBox
mumrah commented on code in PR #13033: URL: https://github.com/apache/kafka/pull/13033#discussion_r1054455358 ## core/src/main/scala/kafka/server/metadata/BrokerMetadataListener.scala: ## @@ -289,6 +316,59 @@ class BrokerMetadataListener( BatchLoadResults(numBatches, numRec

[GitHub] [kafka] mumrah commented on a diff in pull request #13033: KAFKA-14538: Implement KRaft metadata transactions

2022-12-21 Thread GitBox
mumrah commented on code in PR #13033: URL: https://github.com/apache/kafka/pull/13033#discussion_r1054483117 ## core/src/main/scala/kafka/server/metadata/BrokerMetadataListener.scala: ## @@ -76,6 +77,21 @@ class BrokerMetadataListener( */ private var _highestTimestamp =

[GitHub] [kafka] mumrah commented on a diff in pull request #13033: KAFKA-14538: Implement KRaft metadata transactions

2022-12-21 Thread GitBox
mumrah commented on code in PR #13033: URL: https://github.com/apache/kafka/pull/13033#discussion_r1054455358 ## core/src/main/scala/kafka/server/metadata/BrokerMetadataListener.scala: ## @@ -289,6 +316,59 @@ class BrokerMetadataListener( BatchLoadResults(numBatches, numRec

[GitHub] [kafka] mumrah commented on a diff in pull request #13033: KAFKA-14538: Implement KRaft metadata transactions

2022-12-21 Thread GitBox
mumrah commented on code in PR #13033: URL: https://github.com/apache/kafka/pull/13033#discussion_r1054485418 ## metadata/src/main/java/org/apache/kafka/controller/QuorumController.java: ## @@ -1071,7 +1136,11 @@ public ControllerResult generateRecordsAndResult() throws Excepti

[GitHub] [kafka] dajac commented on a diff in pull request #12870: KAFKA-14367; Add `OffsetFetch` to the new `GroupCoordinator` interface

2022-12-21 Thread GitBox
dajac commented on code in PR #12870: URL: https://github.com/apache/kafka/pull/12870#discussion_r1054490432 ## core/src/main/scala/kafka/server/KafkaApis.scala: ## @@ -1395,79 +1389,123 @@ class KafkaApis(val requestChannel: RequestChannel, offsetFetchResponse }

[GitHub] [kafka] dajac commented on a diff in pull request #12870: KAFKA-14367; Add `OffsetFetch` to the new `GroupCoordinator` interface

2022-12-21 Thread GitBox
dajac commented on code in PR #12870: URL: https://github.com/apache/kafka/pull/12870#discussion_r1054490900 ## core/src/test/scala/unit/kafka/server/KafkaApisTest.scala: ## @@ -3405,6 +3405,341 @@ class KafkaApisTest { assertEquals(Errors.GROUP_AUTHORIZATION_FAILED, respon

[GitHub] [kafka] dajac commented on a diff in pull request #12870: KAFKA-14367; Add `OffsetFetch` to the new `GroupCoordinator` interface

2022-12-21 Thread GitBox
dajac commented on code in PR #12870: URL: https://github.com/apache/kafka/pull/12870#discussion_r1054492204 ## clients/src/main/java/org/apache/kafka/common/requests/OffsetFetchResponse.java: ## @@ -19,6 +19,7 @@ import java.util.Map.Entry; Review Comment: As I follow-up,

[GitHub] [kafka] dajac commented on a diff in pull request #12870: KAFKA-14367; Add `OffsetFetch` to the new `GroupCoordinator` interface

2022-12-21 Thread GitBox
dajac commented on code in PR #12870: URL: https://github.com/apache/kafka/pull/12870#discussion_r1054493387 ## core/src/test/scala/unit/kafka/server/OffsetFetchRequestTest.scala: ## @@ -150,42 +149,6 @@ class OffsetFetchRequestTest extends BaseRequestTest { } } - @Te

[GitHub] [kafka] dajac commented on a diff in pull request #12870: KAFKA-14367; Add `OffsetFetch` to the new `GroupCoordinator` interface

2022-12-21 Thread GitBox
dajac commented on code in PR #12870: URL: https://github.com/apache/kafka/pull/12870#discussion_r1054494189 ## core/src/main/scala/kafka/server/KafkaApis.scala: ## @@ -1338,11 +1337,12 @@ class KafkaApis(val requestChannel: RequestChannel, /** * Handle an offset fetch re

[GitHub] [kafka] dajac commented on a diff in pull request #12870: KAFKA-14367; Add `OffsetFetch` to the new `GroupCoordinator` interface

2022-12-21 Thread GitBox
dajac commented on code in PR #12870: URL: https://github.com/apache/kafka/pull/12870#discussion_r1054494916 ## core/src/main/scala/kafka/server/KafkaApis.scala: ## @@ -1397,77 +1397,172 @@ class KafkaApis(val requestChannel: RequestChannel, requestHelper.sendResponseMaybeT

[jira] [Updated] (KAFKA-14541) Profile produce workload for Apache Kafka

2022-12-21 Thread Divij Vaidya (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Divij Vaidya updated KAFKA-14541: - Description: I have been profiling Kafka (3.4.0 / trunk right now) for a produce only workload

[GitHub] [kafka] dajac commented on a diff in pull request #12870: KAFKA-14367; Add `OffsetFetch` to the new `GroupCoordinator` interface

2022-12-21 Thread GitBox
dajac commented on code in PR #12870: URL: https://github.com/apache/kafka/pull/12870#discussion_r1054496553 ## core/src/test/scala/unit/kafka/server/OffsetFetchRequestTest.scala: ## @@ -150,42 +149,6 @@ class OffsetFetchRequestTest extends BaseRequestTest { } } - @Te

[jira] [Created] (KAFKA-14542) Deprecate OffsetFetch/Commit version 0 and remove them in 4.0

2022-12-21 Thread David Jacot (Jira)
David Jacot created KAFKA-14542: --- Summary: Deprecate OffsetFetch/Commit version 0 and remove them in 4.0 Key: KAFKA-14542 URL: https://issues.apache.org/jira/browse/KAFKA-14542 Project: Kafka

[jira] [Commented] (KAFKA-14470) Move log layer to storage module

2022-12-21 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17650927#comment-17650927 ] Mickael Maison commented on KAFKA-14470: Should we also move classes like LogOff

[GitHub] [kafka] michaeljmarshall commented on a diff in pull request #13032: KAFKA-14540: Fix DataOutputStreamWritable#writeByteBuffer

2022-12-21 Thread GitBox
michaeljmarshall commented on code in PR #13032: URL: https://github.com/apache/kafka/pull/13032#discussion_r1054547725 ## clients/src/main/java/org/apache/kafka/common/protocol/DataOutputStreamWritable.java: ## @@ -99,7 +99,7 @@ public void writeUnsignedVarint(int i) { pub

[GitHub] [kafka] dajac commented on a diff in pull request #12886: KAFKA-14367; Add `OffsetCommit` to the new `GroupCoordinator` interface

2022-12-21 Thread GitBox
dajac commented on code in PR #12886: URL: https://github.com/apache/kafka/pull/12886#discussion_r1054582822 ## core/src/main/java/kafka/server/builders/KafkaApisBuilder.java: ## @@ -178,6 +179,7 @@ public KafkaApis build() { metadataSupport,

[GitHub] [kafka] dajac commented on a diff in pull request #12886: KAFKA-14367; Add `OffsetCommit` to the new `GroupCoordinator` interface

2022-12-21 Thread GitBox
dajac commented on code in PR #12886: URL: https://github.com/apache/kafka/pull/12886#discussion_r1054592382 ## core/src/main/scala/kafka/server/KafkaApis.scala: ## @@ -407,136 +416,200 @@ class KafkaApis(val requestChannel: RequestChannel, * Handle an offset commit request

[GitHub] [kafka] michaeljmarshall commented on a diff in pull request #13032: KAFKA-14540: Fix DataOutputStreamWritable#writeByteBuffer

2022-12-21 Thread GitBox
michaeljmarshall commented on code in PR #13032: URL: https://github.com/apache/kafka/pull/13032#discussion_r1054597086 ## clients/src/test/java/org/apache/kafka/common/protocol/DataOutputStreamWritableTest.java: ## @@ -0,0 +1,47 @@ +/* + * Licensed to the Apache Software Founda

[GitHub] [kafka] C0urante commented on pull request #12735: KAFKA-14132: Replace EasyMock and PowerMock with Mockito in connect/runtime/ErrorHandlingTaskTest

2022-12-21 Thread GitBox
C0urante commented on PR #12735: URL: https://github.com/apache/kafka/pull/12735#issuecomment-1361648543 FYI, I've changed the Jira ticket in the title from KAFKA-14059 (which refers to a different test class) to KAFKA-14132, which is the umbrella issue for migration from EasyMock/PowerMock

[GitHub] [kafka] C0urante merged pull request #12735: KAFKA-14132: Replace EasyMock and PowerMock with Mockito in connect/runtime/ErrorHandlingTaskTest

2022-12-21 Thread GitBox
C0urante merged PR #12735: URL: https://github.com/apache/kafka/pull/12735 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

[jira] [Updated] (KAFKA-14132) Remaining PowerMock to Mockito tests

2022-12-21 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton updated KAFKA-14132: -- Description: {color:#de350b}Some of the tests below use EasyMock as well. For those migrate b

[GitHub] [kafka] michaeljmarshall commented on a diff in pull request #13032: KAFKA-14540: Fix DataOutputStreamWritable#writeByteBuffer

2022-12-21 Thread GitBox
michaeljmarshall commented on code in PR #13032: URL: https://github.com/apache/kafka/pull/13032#discussion_r1054618672 ## clients/src/test/java/org/apache/kafka/common/protocol/DataOutputStreamWritableTest.java: ## @@ -0,0 +1,47 @@ +/* + * Licensed to the Apache Software Founda

[jira] [Updated] (KAFKA-13933) Stuck SSL/TLS unit tests in case of authentication failure

2022-12-21 Thread Federico Valeri (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Federico Valeri updated KAFKA-13933: Description: When there is an authentication error after the initial TCP connection, the

[GitHub] [kafka] jolshan commented on a diff in pull request #12870: KAFKA-14367; Add `OffsetFetch` to the new `GroupCoordinator` interface

2022-12-21 Thread GitBox
jolshan commented on code in PR #12870: URL: https://github.com/apache/kafka/pull/12870#discussion_r1054632844 ## clients/src/main/java/org/apache/kafka/common/requests/OffsetFetchResponse.java: ## @@ -19,6 +19,7 @@ import java.util.Map.Entry; Review Comment: sounds like a

[GitHub] [kafka] jolshan commented on a diff in pull request #12870: KAFKA-14367; Add `OffsetFetch` to the new `GroupCoordinator` interface

2022-12-21 Thread GitBox
jolshan commented on code in PR #12870: URL: https://github.com/apache/kafka/pull/12870#discussion_r1054636234 ## core/src/main/scala/kafka/server/KafkaApis.scala: ## @@ -1395,79 +1389,123 @@ class KafkaApis(val requestChannel: RequestChannel, offsetFetchResponse }

[jira] [Commented] (KAFKA-14470) Move log layer to storage module

2022-12-21 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17650947#comment-17650947 ] Ismael Juma commented on KAFKA-14470: - [~mimaison] Dependencies of the log layer cla

[GitHub] [kafka] jolshan commented on a diff in pull request #12870: KAFKA-14367; Add `OffsetFetch` to the new `GroupCoordinator` interface

2022-12-21 Thread GitBox
jolshan commented on code in PR #12870: URL: https://github.com/apache/kafka/pull/12870#discussion_r1054638304 ## core/src/test/scala/unit/kafka/server/KafkaApisTest.scala: ## @@ -3405,6 +3405,341 @@ class KafkaApisTest { assertEquals(Errors.GROUP_AUTHORIZATION_FAILED, resp

[GitHub] [kafka] jolshan commented on a diff in pull request #12870: KAFKA-14367; Add `OffsetFetch` to the new `GroupCoordinator` interface

2022-12-21 Thread GitBox
jolshan commented on code in PR #12870: URL: https://github.com/apache/kafka/pull/12870#discussion_r1054640668 ## core/src/test/scala/unit/kafka/server/OffsetFetchRequestTest.scala: ## @@ -150,42 +149,6 @@ class OffsetFetchRequestTest extends BaseRequestTest { } } - @

[GitHub] [kafka] cmccabe commented on a diff in pull request #13029: MINOR: Add zk migration field to the ApiVersionsResponse

2022-12-21 Thread GitBox
cmccabe commented on code in PR #13029: URL: https://github.com/apache/kafka/pull/13029#discussion_r1054647289 ## clients/src/main/resources/common/message/ApiVersionsResponse.json: ## @@ -25,9 +25,12 @@ // not in the header. The length of the header must not change in order

[GitHub] [kafka] jolshan commented on a diff in pull request #12886: KAFKA-14367; Add `OffsetCommit` to the new `GroupCoordinator` interface

2022-12-21 Thread GitBox
jolshan commented on code in PR #12886: URL: https://github.com/apache/kafka/pull/12886#discussion_r1054648954 ## core/src/main/scala/kafka/server/KafkaApis.scala: ## @@ -407,136 +416,200 @@ class KafkaApis(val requestChannel: RequestChannel, * Handle an offset commit reques

[jira] [Created] (KAFKA-14543) Move LogOffsetMetadata to storage module

2022-12-21 Thread Mickael Maison (Jira)
Mickael Maison created KAFKA-14543: -- Summary: Move LogOffsetMetadata to storage module Key: KAFKA-14543 URL: https://issues.apache.org/jira/browse/KAFKA-14543 Project: Kafka Issue Type: Sub-

[GitHub] [kafka] C0urante merged pull request #12947: KAFKA-6586: Refactor ConnectDistributed and ConnectStandalone to re-use shared logic

2022-12-21 Thread GitBox
C0urante merged PR #12947: URL: https://github.com/apache/kafka/pull/12947 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

[jira] [Commented] (KAFKA-13467) Clients never refresh cached bootstrap IPs

2022-12-21 Thread Ivan Yurchenko (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17650964#comment-17650964 ] Ivan Yurchenko commented on KAFKA-13467: Probably related https://issues.apache.

[GitHub] [kafka] lihaosky opened a new pull request, #13034: MINOR: remove onChange call in stream assignor assign method

2022-12-21 Thread GitBox
lihaosky opened a new pull request, #13034: URL: https://github.com/apache/kafka/pull/13034 ## Description Remove unnecessary calls in assign method ## Test Existing tests ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation

[jira] [Commented] (KAFKA-13881) Add package.java for public package javadoc

2022-12-21 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17650968#comment-17650968 ] Mickael Maison commented on KAFKA-13881: [~gharris1727] Are you planning to open

[GitHub] [kafka] mimaison commented on pull request #12936: KAFKA-13881: Add Streams package infos

2022-12-21 Thread GitBox
mimaison commented on PR #12936: URL: https://github.com/apache/kafka/pull/12936#issuecomment-1361845545 @mjsax @ableegoldman Can you take a look? Thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Created] (KAFKA-14544) The "is-future" should be removed from metrics tags after future log becomes current log

2022-12-21 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-14544: -- Summary: The "is-future" should be removed from metrics tags after future log becomes current log Key: KAFKA-14544 URL: https://issues.apache.org/jira/browse/KAFKA-14544

[GitHub] [kafka] chia7712 commented on pull request #12979: KAFKA-14544 The "is-future" should be removed from metrics tags after future log becomes current log

2022-12-21 Thread GitBox
chia7712 commented on PR #12979: URL: https://github.com/apache/kafka/pull/12979#issuecomment-1361909104 file a jira as this is related to true bug -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [kafka] junrao commented on a diff in pull request #13012: KAFKA-14477: Move LogValidator and related to storage module

2022-12-21 Thread GitBox
junrao commented on code in PR #13012: URL: https://github.com/apache/kafka/pull/13012#discussion_r1054705599 ## core/src/main/scala/kafka/log/UnifiedLog.scala: ## @@ -2185,6 +2188,27 @@ object UnifiedLog extends Logging { private[log] def createNewCleanedSegment(dir: File, l

[GitHub] [kafka] C0urante commented on a diff in pull request #12802: KAFKA-14311: Connect Worker clean shutdown does not cleanly stop connectors/tasks

2022-12-21 Thread GitBox
C0urante commented on code in PR #12802: URL: https://github.com/apache/kafka/pull/12802#discussion_r1054700417 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/distributed/DistributedHerder.java: ## @@ -1658,11 +1659,20 @@ private void backoff(long ms) {

[jira] [Commented] (KAFKA-9087) ReplicaAlterLogDirs stuck and restart fails with java.lang.IllegalStateException: Offset mismatch for the future replica

2022-12-21 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17650979#comment-17650979 ] Chia-Ping Tsai commented on KAFKA-9087: --- We encountered this error also. The root c

[GitHub] [kafka] cmccabe merged pull request #13001: KAFKA-14446: code style improvements for broker-to-controller forwarding

2022-12-21 Thread GitBox
cmccabe merged PR #13001: URL: https://github.com/apache/kafka/pull/13001 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.

[GitHub] [kafka] cmccabe commented on a diff in pull request #13029: MINOR: Add zk migration field to the ApiVersionsResponse

2022-12-21 Thread GitBox
cmccabe commented on code in PR #13029: URL: https://github.com/apache/kafka/pull/13029#discussion_r1054764792 ## clients/src/main/resources/common/message/ApiVersionsResponse.json: ## @@ -69,6 +69,9 @@ {"name": "MinVersionLevel", "type": "int16", "versions": "3+",

[GitHub] [kafka] cmccabe commented on a diff in pull request #13033: KAFKA-14538: Implement KRaft metadata transactions

2022-12-21 Thread GitBox
cmccabe commented on code in PR #13033: URL: https://github.com/apache/kafka/pull/13033#discussion_r1054775292 ## core/src/main/scala/kafka/server/metadata/BrokerMetadataListener.scala: ## @@ -289,6 +316,59 @@ class BrokerMetadataListener( BatchLoadResults(numBatches, numRe

[GitHub] [kafka] cmccabe commented on a diff in pull request #13033: KAFKA-14538: Implement KRaft metadata transactions

2022-12-21 Thread GitBox
cmccabe commented on code in PR #13033: URL: https://github.com/apache/kafka/pull/13033#discussion_r1054776436 ## metadata/src/main/java/org/apache/kafka/controller/QuorumController.java: ## @@ -860,7 +886,7 @@ public void handleCommit(BatchReader reader) {

[GitHub] [kafka] cmccabe commented on a diff in pull request #13033: KAFKA-14538: Implement KRaft metadata transactions

2022-12-21 Thread GitBox
cmccabe commented on code in PR #13033: URL: https://github.com/apache/kafka/pull/13033#discussion_r1054777011 ## core/src/main/scala/kafka/server/metadata/BrokerMetadataListener.scala: ## @@ -76,6 +77,21 @@ class BrokerMetadataListener( */ private var _highestTimestamp =

[GitHub] [kafka] cmccabe commented on a diff in pull request #13033: KAFKA-14538: Implement KRaft metadata transactions

2022-12-21 Thread GitBox
cmccabe commented on code in PR #13033: URL: https://github.com/apache/kafka/pull/13033#discussion_r1054777972 ## metadata/src/main/java/org/apache/kafka/controller/QuorumController.java: ## @@ -1071,7 +1136,11 @@ public ControllerResult generateRecordsAndResult() throws Except

[GitHub] [kafka] dajac commented on a diff in pull request #12870: KAFKA-14367; Add `OffsetFetch` to the new `GroupCoordinator` interface

2022-12-21 Thread GitBox
dajac commented on code in PR #12870: URL: https://github.com/apache/kafka/pull/12870#discussion_r1054778185 ## core/src/test/scala/unit/kafka/server/KafkaApisTest.scala: ## @@ -3405,6 +3405,341 @@ class KafkaApisTest { assertEquals(Errors.GROUP_AUTHORIZATION_FAILED, respon

[GitHub] [kafka] dajac commented on a diff in pull request #12886: KAFKA-14367; Add `OffsetCommit` to the new `GroupCoordinator` interface

2022-12-21 Thread GitBox
dajac commented on code in PR #12886: URL: https://github.com/apache/kafka/pull/12886#discussion_r1054778967 ## core/src/main/scala/kafka/server/KafkaApis.scala: ## @@ -407,136 +416,200 @@ class KafkaApis(val requestChannel: RequestChannel, * Handle an offset commit request

[GitHub] [kafka] dajac commented on pull request #12886: KAFKA-14367; Add `OffsetCommit` to the new `GroupCoordinator` interface

2022-12-21 Thread GitBox
dajac commented on PR #12886: URL: https://github.com/apache/kafka/pull/12886#issuecomment-1362010257 @jolshan @OmniaGM Thanks for your comments. I just updated the PR. I have tried to simplify the code in KafkaApis as much as possible. Let me know what you think. -- This is an automated

[GitHub] [kafka] cmccabe commented on pull request #13033: KAFKA-14538: Implement KRaft metadata transactions

2022-12-21 Thread GitBox
cmccabe commented on PR #13033: URL: https://github.com/apache/kafka/pull/13033#issuecomment-1362010708 @mumrah : you're right that we need to be checking MV before generating these records. On second thought, I also think we should be using abort transation rather than checking reco

[GitHub] [kafka] dajac commented on a diff in pull request #12870: KAFKA-14367; Add `OffsetFetch` to the new `GroupCoordinator` interface

2022-12-21 Thread GitBox
dajac commented on code in PR #12870: URL: https://github.com/apache/kafka/pull/12870#discussion_r1054782481 ## core/src/test/scala/unit/kafka/server/KafkaApisTest.scala: ## @@ -3405,6 +3405,341 @@ class KafkaApisTest { assertEquals(Errors.GROUP_AUTHORIZATION_FAILED, respon

[GitHub] [kafka] chia7712 opened a new pull request, #13035: KAFKA-9087 The changed future log causes that ReplicaAlterLogDirsThre…

2022-12-21 Thread GitBox
chia7712 opened a new pull request, #13035: URL: https://github.com/apache/kafka/pull/13035 We encountered this error also. The root cause is about race condition. 1. ReplicaAlterLogDirsThread has fetched the data for topic partition 1. ReplicaManager#alterReplicaLogDirs changes the fut

[GitHub] [kafka] dajac commented on a diff in pull request #12870: KAFKA-14367; Add `OffsetFetch` to the new `GroupCoordinator` interface

2022-12-21 Thread GitBox
dajac commented on code in PR #12870: URL: https://github.com/apache/kafka/pull/12870#discussion_r1054793572 ## core/src/test/scala/unit/kafka/server/OffsetFetchRequestTest.scala: ## @@ -150,42 +149,6 @@ class OffsetFetchRequestTest extends BaseRequestTest { } } - @Te

[GitHub] [kafka] jolshan commented on a diff in pull request #12886: KAFKA-14367; Add `OffsetCommit` to the new `GroupCoordinator` interface

2022-12-21 Thread GitBox
jolshan commented on code in PR #12886: URL: https://github.com/apache/kafka/pull/12886#discussion_r1054814682 ## core/src/main/scala/kafka/coordinator/group/GroupCoordinatorAdapter.scala: ## @@ -234,4 +240,78 @@ class GroupCoordinatorAdapter( } CompletableFuture.compl

[GitHub] [kafka] jolshan commented on a diff in pull request #12886: KAFKA-14367; Add `OffsetCommit` to the new `GroupCoordinator` interface

2022-12-21 Thread GitBox
jolshan commented on code in PR #12886: URL: https://github.com/apache/kafka/pull/12886#discussion_r1054814682 ## core/src/main/scala/kafka/coordinator/group/GroupCoordinatorAdapter.scala: ## @@ -234,4 +240,78 @@ class GroupCoordinatorAdapter( } CompletableFuture.compl

[GitHub] [kafka] jolshan commented on a diff in pull request #12886: KAFKA-14367; Add `OffsetCommit` to the new `GroupCoordinator` interface

2022-12-21 Thread GitBox
jolshan commented on code in PR #12886: URL: https://github.com/apache/kafka/pull/12886#discussion_r1054819922 ## core/src/main/scala/kafka/server/KafkaApis.scala: ## @@ -411,137 +411,144 @@ class KafkaApis(val requestChannel: RequestChannel, /** * Handle an offset commit

[GitHub] [kafka] ijuma commented on a diff in pull request #13012: KAFKA-14477: Move LogValidator and related to storage module

2022-12-21 Thread GitBox
ijuma commented on code in PR #13012: URL: https://github.com/apache/kafka/pull/13012#discussion_r1054822187 ## core/src/main/scala/kafka/log/UnifiedLog.scala: ## @@ -2185,6 +2188,27 @@ object UnifiedLog extends Logging { private[log] def createNewCleanedSegment(dir: File, lo

[GitHub] [kafka] ijuma commented on a diff in pull request #13012: KAFKA-14477: Move LogValidator and related to storage module

2022-12-21 Thread GitBox
ijuma commented on code in PR #13012: URL: https://github.com/apache/kafka/pull/13012#discussion_r1054822697 ## clients/src/test/java/org/apache/kafka/common/utils/PrimitiveRefTest.java: ## @@ -14,15 +14,19 @@ * See the License for the specific language governing permissions a

[GitHub] [kafka] dajac commented on a diff in pull request #12886: KAFKA-14367; Add `OffsetCommit` to the new `GroupCoordinator` interface

2022-12-21 Thread GitBox
dajac commented on code in PR #12886: URL: https://github.com/apache/kafka/pull/12886#discussion_r1054822770 ## core/src/main/scala/kafka/server/KafkaApis.scala: ## @@ -411,137 +411,144 @@ class KafkaApis(val requestChannel: RequestChannel, /** * Handle an offset commit r

[GitHub] [kafka] ijuma commented on pull request #13012: KAFKA-14477: Move LogValidator and related to storage module

2022-12-21 Thread GitBox
ijuma commented on PR #13012: URL: https://github.com/apache/kafka/pull/13012#issuecomment-1362078506 @junrao Pushed a change that addresses two of the review comments. I left a comment for the other review comment. -- This is an automated message from the Apache Git Service. To respond t

[GitHub] [kafka] jolshan commented on a diff in pull request #12886: KAFKA-14367; Add `OffsetCommit` to the new `GroupCoordinator` interface

2022-12-21 Thread GitBox
jolshan commented on code in PR #12886: URL: https://github.com/apache/kafka/pull/12886#discussion_r1054830892 ## core/src/main/scala/kafka/coordinator/group/GroupCoordinatorAdapter.scala: ## @@ -234,4 +240,78 @@ class GroupCoordinatorAdapter( } CompletableFuture.compl

[GitHub] [kafka] jolshan commented on a diff in pull request #12886: KAFKA-14367; Add `OffsetCommit` to the new `GroupCoordinator` interface

2022-12-21 Thread GitBox
jolshan commented on code in PR #12886: URL: https://github.com/apache/kafka/pull/12886#discussion_r1054833397 ## core/src/main/scala/kafka/server/KafkaApis.scala: ## @@ -411,137 +411,144 @@ class KafkaApis(val requestChannel: RequestChannel, /** * Handle an offset commit

[GitHub] [kafka] jolshan commented on a diff in pull request #12886: KAFKA-14367; Add `OffsetCommit` to the new `GroupCoordinator` interface

2022-12-21 Thread GitBox
jolshan commented on code in PR #12886: URL: https://github.com/apache/kafka/pull/12886#discussion_r1054834094 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/GroupCoordinator.java: ## @@ -52,6 +54,7 @@ CompletableFuture joinGroup( ); /** +<

[GitHub] [kafka] jolshan commented on a diff in pull request #12870: KAFKA-14367; Add `OffsetFetch` to the new `GroupCoordinator` interface

2022-12-21 Thread GitBox
jolshan commented on code in PR #12870: URL: https://github.com/apache/kafka/pull/12870#discussion_r1054835003 ## core/src/test/scala/unit/kafka/server/KafkaApisTest.scala: ## @@ -3405,6 +3405,341 @@ class KafkaApisTest { assertEquals(Errors.GROUP_AUTHORIZATION_FAILED, resp

[jira] [Updated] (KAFKA-14271) Topic recreation fails in KRaft mode when topic contains collidable characters

2022-12-21 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton updated KAFKA-14271: -- Fix Version/s: (was: 3.4.0) (was: 3.3.2) > Topic recreation fails i

[GitHub] [kafka] junrao commented on a diff in pull request #13012: KAFKA-14477: Move LogValidator and related to storage module

2022-12-21 Thread GitBox
junrao commented on code in PR #13012: URL: https://github.com/apache/kafka/pull/13012#discussion_r1054846959 ## core/src/main/scala/kafka/log/UnifiedLog.scala: ## @@ -2185,6 +2188,27 @@ object UnifiedLog extends Logging { private[log] def createNewCleanedSegment(dir: File, l

[GitHub] [kafka] philipnee commented on a diff in pull request #12590: KAFKA-7109: Close fetch sessions on close of consumer

2022-12-21 Thread GitBox
philipnee commented on code in PR #12590: URL: https://github.com/apache/kafka/pull/12590#discussion_r1054670620 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/Fetcher.java: ## @@ -1933,11 +1943,79 @@ private Map topicPartitionTags(TopicPartition tp) {

[GitHub] [kafka] philipnee commented on a diff in pull request #12870: KAFKA-14367; Add `OffsetFetch` to the new `GroupCoordinator` interface

2022-12-21 Thread GitBox
philipnee commented on code in PR #12870: URL: https://github.com/apache/kafka/pull/12870#discussion_r1054847935 ## clients/src/main/java/org/apache/kafka/common/requests/OffsetFetchRequest.java: ## @@ -227,6 +227,24 @@ public boolean requireStable() { return data.requi

[GitHub] [kafka] gharris1727 opened a new pull request, #13036: KAFKA-14534: Reduce flakiness in TransactionsExpirationTest

2022-12-21 Thread GitBox
gharris1727 opened a new pull request, #13036: URL: https://github.com/apache/kafka/pull/13036 This test asserts that after a producerId expires and before a transactionId expires, the producerId is reused in a subsequent epoch. The transactionId expiration time used in this test was too

[GitHub] [kafka] gharris1727 commented on pull request #13036: KAFKA-14534: Reduce flakiness in TransactionsExpirationTest

2022-12-21 Thread GitBox
gharris1727 commented on PR #13036: URL: https://github.com/apache/kafka/pull/13036#issuecomment-1362127508 @jolshan Could you take a look at this test stabilization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

  1   2   >