Re: [PR] KAFKA-17125: Streams Sticky Task Assignor [kafka]

2025-01-31 Thread via GitHub
aliehsaeedii commented on code in PR #18652: URL: https://github.com/apache/kafka/pull/18652#discussion_r1936905316 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/streams/assignor/ProcessState.java: ## @@ -0,0 +1,144 @@ +/* + * Licensed to the Apache Softw

Re: [PR] KAFKA-18677: Update ConsoleConsumerTest system test [kafka]

2025-01-31 Thread via GitHub
frankvicky commented on code in PR #18763: URL: https://github.com/apache/kafka/pull/18763#discussion_r1936975308 ## tests/kafkatest/sanity_checks/test_console_consumer.py: ## @@ -44,8 +44,7 @@ def setUp(self): @cluster(num_nodes=3) @matrix(security_protocol=['PLAINTEX

Re: [PR] KAFKA-16505: Fix source raw key and value in store caches [kafka]

2025-01-31 Thread via GitHub
loicgreffier commented on code in PR #18739: URL: https://github.com/apache/kafka/pull/18739#discussion_r1936976194 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/RecordCollectorImpl.java: ## @@ -259,6 +259,10 @@ public void send(final String topic,

[jira] [Commented] (KAFKA-18679) KafkaRaftMetrics metrics are exposing doubles instead of integers

2025-01-31 Thread TaiJuWu (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17922646#comment-17922646 ] TaiJuWu commented on KAFKA-18679: - Hi [~kevinwu2412] , may I pick this up? > KafkaRaftM

Re: [PR] KAFKA-16505: Fix source raw key and value in store caches [kafka]

2025-01-31 Thread via GitHub
loicgreffier commented on code in PR #18739: URL: https://github.com/apache/kafka/pull/18739#discussion_r1936995608 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/StampedRecord.java: ## @@ -55,8 +69,26 @@ public Headers headers() { return value.he

[PR] KAFKA-18146; tests/kafkatest/tests/core/upgrade_test.py needs to be re-added as KRaft [kafka]

2025-01-31 Thread via GitHub
dajac opened a new pull request, #18766: URL: https://github.com/apache/kafka/pull/18766 This patch renames kraft_upgrade_test.py to upgrade_test.py. This is enough to cover the old upgrade/downgrade tests. ### Committer Checklist (excluded from commit message) - [ ] Verify design

Re: [PR] MINOR: clean up for sasl endpoints [kafka]

2025-01-31 Thread via GitHub
mimaison merged PR #18519: URL: https://github.com/apache/kafka/pull/18519 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

Re: [PR] KAFKA-18494-3: solution for the bug relating to gaps in the share partition cachedStates post initialization [kafka]

2025-01-31 Thread via GitHub
chirag-wadhwa5 commented on code in PR #18696: URL: https://github.com/apache/kafka/pull/18696#discussion_r1937022015 ## core/src/main/java/kafka/server/share/SharePartition.java: ## @@ -2160,6 +2234,43 @@ private long startOffsetDuringInitialization(long partitionDataStartOffs

[jira] [Created] (KAFKA-18685) Refactor DynamicLogConfig constructor

2025-01-31 Thread Jira
黃竣陽 created KAFKA-18685: --- Summary: Refactor DynamicLogConfig constructor Key: KAFKA-18685 URL: https://issues.apache.org/jira/browse/KAFKA-18685 Project: Kafka Issue Type: Improvement Repo

Re: [PR] KAFKA-17379: Fix inexpected state transition from ERROR to PENDING_SHUTDOWN [kafka]

2025-01-31 Thread via GitHub
lucasbru commented on code in PR #18765: URL: https://github.com/apache/kafka/pull/18765#discussion_r1936939161 ## streams/src/main/java/org/apache/kafka/streams/KafkaStreams.java: ## @@ -1543,26 +1544,28 @@ private boolean close(final Optional timeout, final boolean leaveGroup

Re: [PR] KAFKA-18677: Update ConsoleConsumerTest system test [kafka]

2025-01-31 Thread via GitHub
dajac merged PR #18763: URL: https://github.com/apache/kafka/pull/18763 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.or

[jira] [Resolved] (KAFKA-18677) Update ConsoleConsumerTest system test

2025-01-31 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-18677. - Resolution: Fixed > Update ConsoleConsumerTest system test > ---

Re: [PR] KAFKA-18677: Update ConsoleConsumerTest system test [kafka]

2025-01-31 Thread via GitHub
dajac commented on PR #18763: URL: https://github.com/apache/kafka/pull/18763#issuecomment-2626970633 Merged to trunk and 4.0. Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Updated] (KAFKA-18686) Flaky test StandbyTaskEOSMultiRebalanceIntegrationTest#shouldHonorEOSWhenUsingCachingAndStandbyReplicas

2025-01-31 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-18686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 黃竣陽 updated KAFKA-18686: Description: It seens this test flaky these days [https://github.com/apache/kafka/actions/runs/13061784839/job/36

[jira] [Updated] (KAFKA-18685) Cleanup DynamicLogConfig constructor

2025-01-31 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-18685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 黃竣陽 updated KAFKA-18685: Summary: Cleanup DynamicLogConfig constructor (was: Refactor DynamicLogConfig constructor ) > Cleanup DynamicLo

Re: [PR] KAFKA-18677: Update ConsoleConsumerTest system test [kafka]

2025-01-31 Thread via GitHub
dajac commented on code in PR #18763: URL: https://github.com/apache/kafka/pull/18763#discussion_r1936943993 ## tests/kafkatest/sanity_checks/test_console_consumer.py: ## @@ -44,8 +44,7 @@ def setUp(self): @cluster(num_nodes=3) @matrix(security_protocol=['PLAINTEXT', '

Re: [PR] KAFKA-15995: Initial API + make Producer/Consumer plugins Monitorable [kafka]

2025-01-31 Thread via GitHub
mimaison merged PR #17511: URL: https://github.com/apache/kafka/pull/17511 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

Re: [PR] KAFKA-18677: Update ConsoleConsumerTest system test [kafka]

2025-01-31 Thread via GitHub
frankvicky commented on code in PR #18763: URL: https://github.com/apache/kafka/pull/18763#discussion_r1936955157 ## tests/kafkatest/sanity_checks/test_console_consumer.py: ## @@ -44,8 +44,7 @@ def setUp(self): @cluster(num_nodes=3) @matrix(security_protocol=['PLAINTEX

Re: [PR] KAFKA-17298: Update upgrade notes for 4.0 KIP-848 [kafka]

2025-01-31 Thread via GitHub
dajac commented on code in PR #18756: URL: https://github.com/apache/kafka/pull/18756#discussion_r1936945456 ## docs/upgrade.html: ## @@ -89,6 +89,27 @@ Notable changes in 4 Broker +The new Consumer

Re: [PR] KAFKA-18494-3: solution for the bug relating to gaps in the share partition cachedStates post initialization [kafka]

2025-01-31 Thread via GitHub
apoorvmittal10 commented on code in PR #18696: URL: https://github.com/apache/kafka/pull/18696#discussion_r1936961623 ## core/src/main/java/kafka/server/share/SharePartition.java: ## @@ -1791,10 +1875,24 @@ be removed once all the messages (0-99) are acknowledged (ACCEPT or REJ

[PR] KAFKA-17379: Fix inexpected state transition from ERROR to PENDING_SHUTDOWN [kafka]

2025-01-31 Thread via GitHub
lucasbru opened a new pull request, #18765: URL: https://github.com/apache/kafka/pull/18765 The exception stack trace shown in the ticket can happen when we are concurrently closing the producer because of an error and doing a regular close. This is not a bug in the test, but a real race co

[jira] [Assigned] (KAFKA-16906) Add consistent error handling for Transactions

2025-01-31 Thread Kaushik Raina (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaushik Raina reassigned KAFKA-16906: - Assignee: Kaushik Raina > Add consistent error handling for Transactions >

[jira] [Created] (KAFKA-18686) Flaky test StandbyTaskEOSMultiRebalanceIntegrationTest#shouldHonorEOSWhenUsingCachingAndStandbyReplicas

2025-01-31 Thread Jira
黃竣陽 created KAFKA-18686: --- Summary: Flaky test StandbyTaskEOSMultiRebalanceIntegrationTest#shouldHonorEOSWhenUsingCachingAndStandbyReplicas Key: KAFKA-18686 URL: https://issues.apache.org/jira/browse/KAFKA-18686

Re: [PR] KAFKA-17125: Streams Sticky Task Assignor [kafka]

2025-01-31 Thread via GitHub
aliehsaeedii commented on code in PR #18652: URL: https://github.com/apache/kafka/pull/18652#discussion_r1936919748 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/streams/assignor/StickyTaskAssignor.java: ## @@ -0,0 +1,440 @@ +/* + * Licensed to the Apache

Re: [PR] KAFKA-18494-3: solution for the bug relating to gaps in the share partition cachedStates post initialization [kafka]

2025-01-31 Thread via GitHub
chirag-wadhwa5 commented on code in PR #18696: URL: https://github.com/apache/kafka/pull/18696#discussion_r1936922439 ## core/src/main/java/kafka/server/share/SharePartition.java: ## @@ -1791,10 +1875,23 @@ be removed once all the messages (0-99) are acknowledged (ACCEPT or REJ

Re: [PR] KAFKA-18494-3: solution for the bug relating to gaps in the share partition cachedStates post initialization [kafka]

2025-01-31 Thread via GitHub
chirag-wadhwa5 commented on code in PR #18696: URL: https://github.com/apache/kafka/pull/18696#discussion_r1936922439 ## core/src/main/java/kafka/server/share/SharePartition.java: ## @@ -1791,10 +1875,23 @@ be removed once all the messages (0-99) are acknowledged (ACCEPT or REJ

Re: [PR] KAFKA-18489 - Fix Connector tasks metrics task-startup-attempts, task… [kafka]

2025-01-31 Thread via GitHub
mimaison commented on PR #18762: URL: https://github.com/apache/kafka/pull/18762#issuecomment-2626730476 Thanks for the PR. I've not looked into this issue but if we're fixing some logic then I was expecting some updates in the tests too. Why are the existing tests passing if you say

[jira] [Commented] (KAFKA-16717) Add AdminClient.alterShareGroupOffsets

2025-01-31 Thread Jimmy Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17922688#comment-17922688 ] Jimmy Wang commented on KAFKA-16717: [~schofielaj] Thanks for your reply. I prefer

Re: [PR] KAFKA-18325: Add TargetAssignmentBuilder [kafka]

2025-01-31 Thread via GitHub
cadonna commented on code in PR #18676: URL: https://github.com/apache/kafka/pull/18676#discussion_r1936879253 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/streams/TopologyMetadata.java: ## @@ -0,0 +1,94 @@ +/* + * Licensed to the Apache Software Foundat

Re: [PR] KAFKA-18023: Enforcing Explicit Naming for Kafka Streams Internal Topics [kafka]

2025-01-31 Thread via GitHub
sebastienviale commented on code in PR #18233: URL: https://github.com/apache/kafka/pull/18233#discussion_r1937323264 ## streams/src/main/java/org/apache/kafka/streams/StreamsConfig.java: ## @@ -592,6 +592,10 @@ public class StreamsConfig extends AbstractConfig { public sta

Re: [PR] KAFKA-18023: Enforcing Explicit Naming for Kafka Streams Internal Topics [kafka]

2025-01-31 Thread via GitHub
sebastienviale commented on code in PR #18233: URL: https://github.com/apache/kafka/pull/18233#discussion_r1937323668 ## streams/src/main/java/org/apache/kafka/streams/StreamsConfig.java: ## @@ -592,6 +592,10 @@ public class StreamsConfig extends AbstractConfig { public sta

Re: [PR] KAFKA-18023: Enforcing Explicit Naming for Kafka Streams Internal Topics [kafka]

2025-01-31 Thread via GitHub
sebastienviale commented on code in PR #18233: URL: https://github.com/apache/kafka/pull/18233#discussion_r1937326984 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/InternalTopologyBuilder.java: ## @@ -2333,4 +2341,33 @@ public WrappedProcessorSupplier w

Re: [PR] KAFKA-18023: Enforcing Explicit Naming for Kafka Streams Internal Topics [kafka]

2025-01-31 Thread via GitHub
sebastienviale commented on code in PR #18233: URL: https://github.com/apache/kafka/pull/18233#discussion_r1937324922 ## streams/src/main/java/org/apache/kafka/streams/kstream/internals/CogroupedStreamAggregateBuilder.java: ## @@ -214,8 +215,7 @@ private void processRepartitions

Re: [PR] KAFKA-18023: Enforcing Explicit Naming for Kafka Streams Internal Topics [kafka]

2025-01-31 Thread via GitHub
sebastienviale commented on code in PR #18233: URL: https://github.com/apache/kafka/pull/18233#discussion_r1937325997 ## streams/src/main/java/org/apache/kafka/streams/kstream/internals/InternalStreamsBuilder.java: ## @@ -489,7 +492,8 @@ private void mergeRepartitionTopics() {

Re: [PR] KAFKA-16505: Fix source raw key and value in store caches [kafka]

2025-01-31 Thread via GitHub
cadonna commented on PR #18739: URL: https://github.com/apache/kafka/pull/18739#issuecomment-2627367592 > @cadonna Changes about buffers will be added to this PR. However, despite my tests using `suppress()`, I did not manage to lose the `rawKey` and `rawValue` for now. I'm always receiving

Re: [PR] KAFKA-18538: Add Streams membership manager [kafka]

2025-01-31 Thread via GitHub
cadonna commented on code in PR #18551: URL: https://github.com/apache/kafka/pull/18551#discussion_r1937345936 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/StreamsMembershipManager.java: ## @@ -0,0 +1,1249 @@ +/* + * Licensed to the Apache Software Founda

Re: [PR] KAFKA-18146; tests/kafkatest/tests/core/upgrade_test.py needs to be re-added as KRaft [kafka]

2025-01-31 Thread via GitHub
dajac merged PR #18766: URL: https://github.com/apache/kafka/pull/18766 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.or

Re: [PR] KAFKA-18435: Remove zookeeper dependencies in build.gradle [kafka]

2025-01-31 Thread via GitHub
chia7712 commented on code in PR #18450: URL: https://github.com/apache/kafka/pull/18450#discussion_r1937376383 ## core/src/main/scala/kafka/zookeeper/ZooKeeperClient.scala: ## @@ -59,63 +50,9 @@ class ZooKeeperClient(connectString: String, time: Time,

Re: [PR] KAFKA-17182: Consumer fetch sessions are evicted too quickly with AsyncKafkaConsumer [kafka]

2025-01-31 Thread via GitHub
lianetm commented on PR #17700: URL: https://github.com/apache/kafka/pull/17700#issuecomment-2627458022 Done, manually cherry-picked to 4.0 (clean) https://github.com/apache/kafka/commit/9c02072c4fd8159087b7960872d6ee8271a308ab Thanks @kirktrue ! cc. @junrao -- This is an autom

[jira] [Resolved] (KAFKA-18146) tests/kafkatest/tests/core/upgrade_test.py needs to be re-added as KRaft

2025-01-31 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-18146. - Resolution: Fixed > tests/kafkatest/tests/core/upgrade_test.py needs to be re-added as KRaft > -

Re: [PR] KAFKA-18023: Enforcing Explicit Naming for Kafka Streams Internal Topics [kafka]

2025-01-31 Thread via GitHub
sebastienviale commented on code in PR #18233: URL: https://github.com/apache/kafka/pull/18233#discussion_r1937384414 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/InternalTopologyBuilder.java: ## @@ -192,6 +196,10 @@ public InternalTopologyBuilder(final

[jira] [Commented] (KAFKA-17182) Consumer fetch sessions are evicted too quickly with AsyncKafkaConsumer

2025-01-31 Thread Lianet Magrans (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17922724#comment-17922724 ] Lianet Magrans commented on KAFKA-17182: Cherry-picked to 4.0 [https://github.c

Re: [PR] KAFKA-18538: Add Streams membership manager [kafka]

2025-01-31 Thread via GitHub
cadonna commented on code in PR #18551: URL: https://github.com/apache/kafka/pull/18551#discussion_r1937615237 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/StreamsMembershipManager.java: ## @@ -0,0 +1,1249 @@ +/* + * Licensed to the Apache Software Founda

Re: [PR] KAFKA-18538: Add Streams membership manager [kafka]

2025-01-31 Thread via GitHub
cadonna commented on code in PR #18551: URL: https://github.com/apache/kafka/pull/18551#discussion_r1937614089 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/StreamsMembershipManager.java: ## @@ -0,0 +1,1249 @@ +/* + * Licensed to the Apache Software Founda

Re: [PR] KAFKA-18538: Add Streams membership manager [kafka]

2025-01-31 Thread via GitHub
cadonna commented on code in PR #18551: URL: https://github.com/apache/kafka/pull/18551#discussion_r1937615571 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/StreamsMembershipManager.java: ## @@ -0,0 +1,1249 @@ +/* + * Licensed to the Apache Software Founda

Re: [PR] KAFKA-18538: Add Streams membership manager [kafka]

2025-01-31 Thread via GitHub
cadonna commented on code in PR #18551: URL: https://github.com/apache/kafka/pull/18551#discussion_r1937616145 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/StreamsMembershipManager.java: ## @@ -0,0 +1,1249 @@ +/* + * Licensed to the Apache Software Founda

Re: [PR] KAFKA-18538: Add Streams membership manager [kafka]

2025-01-31 Thread via GitHub
cadonna commented on code in PR #18551: URL: https://github.com/apache/kafka/pull/18551#discussion_r1937616145 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/StreamsMembershipManager.java: ## @@ -0,0 +1,1249 @@ +/* + * Licensed to the Apache Software Founda

Re: [PR] KAFKA-18530 Rename ZooKeeperInternals [kafka]

2025-01-31 Thread via GitHub
chia7712 commented on code in PR #18641: URL: https://github.com/apache/kafka/pull/18641#discussion_r1937287973 ## core/src/main/scala/kafka/server/ClientQuotaManager.scala: ## @@ -451,10 +449,31 @@ class ClientQuotaManager(private val config: ClientQuotaManagerConfig, }

Re: [PR] KAFKA-18672; CoordinatorRecordSerde must validate value version [kafka]

2025-01-31 Thread via GitHub
dajac commented on code in PR #18749: URL: https://github.com/apache/kafka/pull/18749#discussion_r1937293367 ## group-coordinator/src/test/java/org/apache/kafka/coordinator/group/GroupCoordinatorRecordSerdeTest.java: ## @@ -198,6 +198,34 @@ public void testDeserializeWithInvalid

Re: [PR] KAFKA-18146; tests/kafkatest/tests/core/upgrade_test.py needs to be re-added as KRaft [kafka]

2025-01-31 Thread via GitHub
dajac commented on PR #18766: URL: https://github.com/apache/kafka/pull/18766#issuecomment-2627314076 I got a successful run: https://confluent-open-source-kafka-branch-builder-system-test-results.s3-us-west-2.amazonaws.com/trunk/2025-01-31--001.87ec847a-f18e-4d26-b85b-f8c53100a36f--17383290

Re: [PR] KAFKA-18435: Remove zookeeper dependencies in build.gradle [kafka]

2025-01-31 Thread via GitHub
Yunyung commented on code in PR #18450: URL: https://github.com/apache/kafka/pull/18450#discussion_r1937409376 ## core/src/main/scala/kafka/zookeeper/ZooKeeperClient.scala: ## @@ -59,63 +50,9 @@ class ZooKeeperClient(connectString: String, time: Time,

Re: [PR] KAFKA-18325: Add TargetAssignmentBuilder [kafka]

2025-01-31 Thread via GitHub
cadonna commented on code in PR #18676: URL: https://github.com/apache/kafka/pull/18676#discussion_r1937549560 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/streams/TopologyMetadata.java: ## @@ -0,0 +1,115 @@ +/* + * Licensed to the Apache Software Founda

Re: [PR] KAFKA-18320; Ensure that assignors are at the right place [kafka]

2025-01-31 Thread via GitHub
dajac merged PR #18750: URL: https://github.com/apache/kafka/pull/18750 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.or

Re: [PR] KAFKA-18538: Add Streams membership manager [kafka]

2025-01-31 Thread via GitHub
cadonna commented on code in PR #18551: URL: https://github.com/apache/kafka/pull/18551#discussion_r1937554379 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/StreamsMembershipManager.java: ## @@ -0,0 +1,1249 @@ +/* + * Licensed to the Apache Software Founda

[PR] KAFKA-18678: Update TestVerifiableProducer system test [kafka]

2025-01-31 Thread via GitHub
FrankYang0529 opened a new pull request, #18768: URL: https://github.com/apache/kafka/pull/18768 Test result: ``` > TC_PATHS="tests/kafkatest/sanity_checks/test_verifiable_producer.py::TestVerifiableProducer" /bin/bash tests/docker/run_tests.sh

Re: [PR] KAFKA-17503: Fix incorrect calculation of poll-idle-ratio-avg for con… [kafka]

2025-01-31 Thread via GitHub
ahuang98 commented on PR #17139: URL: https://github.com/apache/kafka/pull/17139#issuecomment-2627732715 @srdo what did you think about the KIP? Your point about the multithreading issue is valid, and since fixing TimeRatio would impact the metric reporting for the existing idle ratio metri

Re: [PR] KAFKA-18659: librdkafka compressed produce fails unless api versions returns produce v0 [kafka]

2025-01-31 Thread via GitHub
ijuma commented on code in PR #18727: URL: https://github.com/apache/kafka/pull/18727#discussion_r1937695933 ## clients/src/main/java/org/apache/kafka/common/protocol/ApiKeys.java: ## @@ -264,8 +273,11 @@ public boolean hasValidVersion() { return oldestVersion() <= late

Re: [PR] KAFKA-18659: librdkafka compressed produce fails unless api versions returns produce v0 [kafka]

2025-01-31 Thread via GitHub
ijuma commented on code in PR #18727: URL: https://github.com/apache/kafka/pull/18727#discussion_r1937699394 ## core/src/test/scala/unit/kafka/server/ProduceRequestTest.scala: ## @@ -283,6 +286,48 @@ class ProduceRequestTest extends BaseRequestTest { assertEquals(-1, partit

Re: [PR] KAFKA-18659: librdkafka compressed produce fails unless api versions returns produce v0 [kafka]

2025-01-31 Thread via GitHub
ijuma commented on code in PR #18727: URL: https://github.com/apache/kafka/pull/18727#discussion_r1937699394 ## core/src/test/scala/unit/kafka/server/ProduceRequestTest.scala: ## @@ -283,6 +286,48 @@ class ProduceRequestTest extends BaseRequestTest { assertEquals(-1, partit

[PR] (Draft) Load HEAD of test catalog for PRs [kafka]

2025-01-31 Thread via GitHub
mumrah opened a new pull request, #18770: URL: https://github.com/apache/kafka/pull/18770 WIP -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-u

Re: [PR] KAFKA-18659: librdkafka compressed produce fails unless api versions returns produce v0 [kafka]

2025-01-31 Thread via GitHub
ijuma commented on code in PR #18727: URL: https://github.com/apache/kafka/pull/18727#discussion_r1937734265 ## core/src/test/scala/unit/kafka/server/ProduceRequestTest.scala: ## @@ -283,6 +286,48 @@ class ProduceRequestTest extends BaseRequestTest { assertEquals(-1, partit

[jira] [Commented] (KAFKA-18686) Flaky test StandbyTaskEOSMultiRebalanceIntegrationTest#shouldHonorEOSWhenUsingCachingAndStandbyReplicas

2025-01-31 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17922813#comment-17922813 ] Matthias J. Sax commented on KAFKA-18686: - The test had 100% pass rate until yes

[jira] [Assigned] (KAFKA-18686) Flaky test StandbyTaskEOSMultiRebalanceIntegrationTest#shouldHonorEOSWhenUsingCachingAndStandbyReplicas

2025-01-31 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-18686: --- Assignee: Matthias J. Sax > Flaky test > StandbyTaskEOSMultiRebalanceIntegrationTe

[jira] [Updated] (KAFKA-18686) Flaky test StandbyTaskEOSMultiRebalanceIntegrationTest#shouldHonorEOSWhenUsingCachingAndStandbyReplicas

2025-01-31 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-18686: Component/s: streams unit tests > Flaky test > StandbyTaskEOSMultiRebala

Re: [PR] KAFKA-16505: Fix source raw key and value in store caches [kafka]

2025-01-31 Thread via GitHub
loicgreffier commented on code in PR #18739: URL: https://github.com/apache/kafka/pull/18739#discussion_r1937172436 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/ProcessorRecordContext.java: ## @@ -48,6 +50,24 @@ public ProcessorRecordContext(final long t

[jira] [Updated] (KAFKA-18687) New group coordinator triggers assignment recalculation on consumer group upgrade due to static member replacement

2025-01-31 Thread Sean Quah (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Quah updated KAFKA-18687: -- Description: When a consumer protocol static member replaces an existing member in a classic group, i

[jira] [Assigned] (KAFKA-18688) Uniform homogeneous assignment is not always stable

2025-01-31 Thread Sean Quah (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Quah reassigned KAFKA-18688: - Assignee: Sean Quah > Uniform homogeneous assignment is not always stable > ---

[jira] [Resolved] (KAFKA-18320) Ensure that assignors are at the right place

2025-01-31 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-18320. - Resolution: Fixed > Ensure that assignors are at the right place > -

Re: [PR] KAFKA-18325: Add TargetAssignmentBuilder [kafka]

2025-01-31 Thread via GitHub
lucasbru commented on code in PR #18676: URL: https://github.com/apache/kafka/pull/18676#discussion_r1937040226 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/streams/TopologyMetadata.java: ## @@ -0,0 +1,94 @@ +/* + * Licensed to the Apache Software Founda

[jira] [Created] (KAFKA-18688) Uniform homogeneous assignment is not always stable

2025-01-31 Thread Sean Quah (Jira)
Sean Quah created KAFKA-18688: - Summary: Uniform homogeneous assignment is not always stable Key: KAFKA-18688 URL: https://issues.apache.org/jira/browse/KAFKA-18688 Project: Kafka Issue Type: Bug

Re: [PR] KAFKA-18325: Add TargetAssignmentBuilder [kafka]

2025-01-31 Thread via GitHub
lucasbru commented on PR #18676: URL: https://github.com/apache/kafka/pull/18676#issuecomment-2627695635 @cadonna @bbejeck Thanks for the comments! All comments addressed, ready for re-review. -- This is an automated message from the Apache Git Service. To respond to the message, please l

Re: [PR] KAFKA-16505: Fix source raw key and value in store caches [kafka]

2025-01-31 Thread via GitHub
loicgreffier commented on PR #18739: URL: https://github.com/apache/kafka/pull/18739#issuecomment-2627195210 @cadonna Changes about buffers will be added to this PR. However, despite my tests using `suppress()`, I did not manage to lose the `rawKey` and `rawValue` for now. I'm always receiv

Re: [PR] KAFKA-18530 Rename ZooKeeperInternals [kafka]

2025-01-31 Thread via GitHub
chia7712 commented on code in PR #18641: URL: https://github.com/apache/kafka/pull/18641#discussion_r1937322084 ## core/src/main/scala/kafka/server/ClientQuotaManager.scala: ## @@ -451,10 +449,31 @@ class ClientQuotaManager(private val config: ClientQuotaManagerConfig, }

Re: [PR] KAFKA-18678: Update TestVerifiableProducer system test [kafka]

2025-01-31 Thread via GitHub
dajac commented on code in PR #18768: URL: https://github.com/apache/kafka/pull/18768#discussion_r1937598836 ## tests/kafkatest/sanity_checks/test_verifiable_producer.py: ## @@ -32,25 +31,21 @@ def __init__(self, test_context): super(TestVerifiableProducer, self).__init

Re: [PR] KAFKA-18499 Clean up zookeeper from LogConfig [kafka]

2025-01-31 Thread via GitHub
chia7712 commented on code in PR #18583: URL: https://github.com/apache/kafka/pull/18583#discussion_r1937352489 ## core/src/test/scala/unit/kafka/log/LogConfigTest.scala: ## @@ -447,21 +447,6 @@ class LogConfigTest { LogConfig.validate(logProps) } - @ParameterizedTest

Re: [PR] KAFKA-18023: Enforcing Explicit Naming for Kafka Streams Internal Topics [kafka]

2025-01-31 Thread via GitHub
sebastienviale commented on code in PR #18233: URL: https://github.com/apache/kafka/pull/18233#discussion_r1937350055 ## streams/src/main/java/org/apache/kafka/streams/StreamsBuilder.java: ## @@ -384,7 +384,7 @@ public synchronized GlobalKTable globalTable(final String topic,

[PR] KAFKA-18675: Add testValidBrokerList to ClientUtilsTest [kafka]

2025-01-31 Thread via GitHub
mingyen066 opened a new pull request, #18767: URL: https://github.com/apache/kafka/pull/18767 Based on the discussion https://github.com/apache/kafka/pull/18741#issuecomment-2623740585 Add unit test to ensure user can provide space-separated broker list This change need to be backp

Re: [PR] KAFKA-18023: Enforcing Explicit Naming for Kafka Streams Internal Topics [kafka]

2025-01-31 Thread via GitHub
sebastienviale commented on code in PR #18233: URL: https://github.com/apache/kafka/pull/18233#discussion_r1937351094 ## streams/src/main/java/org/apache/kafka/streams/StreamsBuilder.java: ## @@ -457,7 +457,7 @@ public synchronized GlobalKTable globalTable(final String topic,

Re: [PR] KAFKA-18023: Enforcing Explicit Naming for Kafka Streams Internal Topics [kafka]

2025-01-31 Thread via GitHub
sebastienviale commented on code in PR #18233: URL: https://github.com/apache/kafka/pull/18233#discussion_r1937350055 ## streams/src/main/java/org/apache/kafka/streams/StreamsBuilder.java: ## @@ -384,7 +384,7 @@ public synchronized GlobalKTable globalTable(final String topic,

Re: [PR] KAFKA-16907: Fix RaftUtil's type complexity [kafka]

2025-01-31 Thread via GitHub
ahuang98 commented on code in PR #16831: URL: https://github.com/apache/kafka/pull/16831#discussion_r1937578663 ## raft/src/main/java/org/apache/kafka/raft/utils/DescribeQuorumRpc.java: ## @@ -0,0 +1,135 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or mo

Re: [PR] KAFKA-16907: Fix RaftUtil's type complexity [kafka]

2025-01-31 Thread via GitHub
ahuang98 commented on code in PR #16831: URL: https://github.com/apache/kafka/pull/16831#discussion_r1937578663 ## raft/src/main/java/org/apache/kafka/raft/utils/DescribeQuorumRpc.java: ## @@ -0,0 +1,135 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or mo

Re: [PR] KAFKA-18561: Remove withKip853Rpc and replace it with withRaftProtocol [kafka]

2025-01-31 Thread via GitHub
ahuang98 commented on PR #18600: URL: https://github.com/apache/kafka/pull/18600#issuecomment-2627768820 @ijuma I believe @jsancio is okay with this change. I'll review first -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [PR] KAFKA-18230: handle not controller or not leader error in admin client [kafka]

2025-01-31 Thread via GitHub
chia7712 commented on code in PR #18165: URL: https://github.com/apache/kafka/pull/18165#discussion_r1937733425 ## clients/src/main/java/org/apache/kafka/clients/admin/KafkaAdminClient.java: ## @@ -4081,7 +4084,9 @@ void handleFailure(Throwable throwable) { } private

Re: [PR] KAFKA-18659: librdkafka compressed produce fails unless api versions returns produce v0 [kafka]

2025-01-31 Thread via GitHub
ijuma commented on code in PR #18727: URL: https://github.com/apache/kafka/pull/18727#discussion_r1937734265 ## core/src/test/scala/unit/kafka/server/ProduceRequestTest.scala: ## @@ -283,6 +286,48 @@ class ProduceRequestTest extends BaseRequestTest { assertEquals(-1, partit

Re: [PR] KAFKA-18659: librdkafka compressed produce fails unless api versions returns produce v0 [kafka]

2025-01-31 Thread via GitHub
chia7712 commented on code in PR #18727: URL: https://github.com/apache/kafka/pull/18727#discussion_r1937752816 ## core/src/test/scala/unit/kafka/server/ProduceRequestTest.scala: ## @@ -283,6 +286,48 @@ class ProduceRequestTest extends BaseRequestTest { assertEquals(-1, par

Re: [PR] KAFKA-18659: librdkafka compressed produce fails unless api versions returns produce v0 [kafka]

2025-01-31 Thread via GitHub
junrao commented on code in PR #18727: URL: https://github.com/apache/kafka/pull/18727#discussion_r1937678804 ## core/src/test/scala/unit/kafka/server/ProduceRequestTest.scala: ## @@ -283,6 +286,48 @@ class ProduceRequestTest extends BaseRequestTest { assertEquals(-1, parti

Re: [PR] KAFKA-18634: Fix ELR metadata version issues [kafka]

2025-01-31 Thread via GitHub
ahuang98 commented on code in PR #18680: URL: https://github.com/apache/kafka/pull/18680#discussion_r1937681609 ## metadata/src/main/java/org/apache/kafka/image/writer/ImageWriterOptions.java: ## @@ -30,6 +31,7 @@ public final class ImageWriterOptions { public static class

Re: [PR] KAFKA-18659: librdkafka compressed produce fails unless api versions returns produce v0 [kafka]

2025-01-31 Thread via GitHub
chia7712 commented on code in PR #18727: URL: https://github.com/apache/kafka/pull/18727#discussion_r1937725987 ## core/src/test/scala/unit/kafka/server/ProduceRequestTest.scala: ## @@ -283,6 +286,48 @@ class ProduceRequestTest extends BaseRequestTest { assertEquals(-1, par

Re: [PR] KAFKA-18230: handle not controller or not leader error in admin client [kafka]

2025-01-31 Thread via GitHub
jolshan commented on PR #18165: URL: https://github.com/apache/kafka/pull/18165#issuecomment-2628007305 Sorry, for some reason I only get tags when someone approves/merges the PR. Thanks for taking a look @mimaison! -- This is an automated message from the Apache Git Service. To respond t

Re: [PR] KAFKA-18659: librdkafka compressed produce fails unless api versions returns produce v0 [kafka]

2025-01-31 Thread via GitHub
ijuma commented on code in PR #18727: URL: https://github.com/apache/kafka/pull/18727#discussion_r1937803364 ## core/src/test/scala/unit/kafka/server/ProduceRequestTest.scala: ## @@ -283,6 +286,48 @@ class ProduceRequestTest extends BaseRequestTest { assertEquals(-1, partit

[PR] [KAFKA-18689] improve metric calculation to avoid NoSuchElementException [kafka]

2025-01-31 Thread via GitHub
stevenschlansker opened a new pull request, #18771: URL: https://github.com/apache/kafka/pull/18771 I opened KAFKA-18689 because we see in our application: ``` java.util.NoSuchElementException: null at java.base/java.util.concurrent.ConcurrentSkipListMap.firstKey(Concurrent

Re: [PR] [KAFKA-18689] improve metric calculation to avoid NoSuchElementException [kafka]

2025-01-31 Thread via GitHub
stevenschlansker commented on PR #18771: URL: https://github.com/apache/kafka/pull/18771#issuecomment-2628414500 If you do not like this improvement, it's totally OK by me to close the issue and PR as duplicate. -- This is an automated message from the Apache Git Service. To respond to th

Re: [PR] KAFKA-18635: reenable the unclean shutdown detection [kafka]

2025-01-31 Thread via GitHub
CalvinConfluent commented on code in PR #18277: URL: https://github.com/apache/kafka/pull/18277#discussion_r1938125715 ## core/src/test/java/kafka/server/integration/EligibleLeaderReplicasIntegrationTest.java: ## @@ -0,0 +1,450 @@ +/* + * Licensed to the Apache Software Foundati

Re: [PR] MINOR: cleanup KStream JavaDocs (5/N) - stream-globalTable-inner-join [kafka]

2025-01-31 Thread via GitHub
mjsax commented on PR #18747: URL: https://github.com/apache/kafka/pull/18747#issuecomment-2628633913 Looking into test failure history (especially for PRs), `SmokeTestDriverIntegrationTest` has a high failure rate with `processingThreadsEnabled=true` and 100% pass rate w/o processing threa

[PR] MINOR: disable "processing threads" in SmokeTestDriverIntegrationTest [kafka]

2025-01-31 Thread via GitHub
mjsax opened a new pull request, #18773: URL: https://github.com/apache/kafka/pull/18773 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail

Re: [PR] KAFKA-18659: librdkafka compressed produce fails unless api versions returns produce v0 [kafka]

2025-01-31 Thread via GitHub
ijuma commented on code in PR #18727: URL: https://github.com/apache/kafka/pull/18727#discussion_r1938136154 ## clients/src/main/java/org/apache/kafka/common/requests/ProduceRequest.java: ## @@ -66,21 +67,10 @@ public Builder(short minVersion, @Override publi

Re: [PR] KAFKA-18659: librdkafka compressed produce fails unless api versions returns produce v0 [kafka]

2025-01-31 Thread via GitHub
ijuma commented on code in PR #18727: URL: https://github.com/apache/kafka/pull/18727#discussion_r1938136022 ## clients/src/main/java/org/apache/kafka/common/protocol/ApiKeys.java: ## @@ -264,8 +273,11 @@ public boolean hasValidVersion() { return oldestVersion() <= late

Re: [PR] KAFKA-18659: librdkafka compressed produce fails unless api versions returns produce v0 [kafka]

2025-01-31 Thread via GitHub
ijuma commented on code in PR #18727: URL: https://github.com/apache/kafka/pull/18727#discussion_r1938138397 ## core/src/test/scala/unit/kafka/server/ProduceRequestTest.scala: ## @@ -283,6 +286,48 @@ class ProduceRequestTest extends BaseRequestTest { assertEquals(-1, partit

Re: [PR] KAFKA-18659: librdkafka compressed produce fails unless api versions returns produce v0 [kafka]

2025-01-31 Thread via GitHub
ijuma commented on PR #18727: URL: https://github.com/apache/kafka/pull/18727#issuecomment-2628657478 @junrao @chia7712 I realized that the test I wanted already existed in `ProcessorTest` - I made a small adjustment so it tests V0-V2 (and not just V0). I then went ahead and adjusted the pr

[jira] [Comment Edited] (KAFKA-18320) Ensure that assignors are at the right place

2025-01-31 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17922891#comment-17922891 ] Ismael Juma edited comment on KAFKA-18320 at 2/1/25 2:35 AM: -

  1   2   >