Re: [PR] KAFKA-17496: Add heterogeneous case to TargetAssignmentBuilderBenchmark [kafka]

2024-09-25 Thread via GitHub
dajac merged PR #17277: URL: https://github.com/apache/kafka/pull/17277 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.or

Re: [PR] KAFKA-15931: Reopen TransactionIndex if channel is closed [kafka]

2024-09-25 Thread via GitHub
jeqo commented on PR #15241: URL: https://github.com/apache/kafka/pull/15241#issuecomment-2376067147 We have received feedback of this issue persisting on 3.8, so I guess we could have another look at this PR. @showuon I have made the TransactionIndexFile channel access methods synch

Re: [PR] KAFKA-17367: Share coordinator impl. New merge batches algorithm. [3/N] [kafka]

2024-09-25 Thread via GitHub
smjn commented on code in PR #17149: URL: https://github.com/apache/kafka/pull/17149#discussion_r1776430833 ## share-coordinator/src/main/java/org/apache/kafka/coordinator/share/StateBatchUtil.java: ## @@ -0,0 +1,360 @@ +/* + * Licensed to the Apache Software Foundation (ASF) un

Re: [PR] KAFKA-15266: Static configs set for non primary synonyms are ignored for Log configs [kafka]

2024-09-25 Thread via GitHub
showuon commented on PR #14119: URL: https://github.com/apache/kafka/pull/14119#issuecomment-2376058424 @amangandhi94 , thanks for your contribution! For this question: > Just wondering how can I get more attention to bugs or PR i have raised next time onwards? I'm sorry that I did

Re: [PR] KAFKA-15266: Static configs set for non primary synonyms are ignored for Log configs [kafka]

2024-09-25 Thread via GitHub
showuon closed pull request #14119: KAFKA-15266: Static configs set for non primary synonyms are ignored for Log configs URL: https://github.com/apache/kafka/pull/14119 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[PR] KAFKA-17584: Fix incorrect synonym handling for dynamic log configurations [kafka]

2024-09-25 Thread via GitHub
showuon opened a new pull request, #17278: URL: https://github.com/apache/kafka/pull/17278 Backporting https://github.com/apache/kafka/pull/17258 Several Kafka log configurations in have synonyms. For example, log retention can be configured either by log.retention.ms, or by log.rete

Re: [PR] KAFKA-17367: Share coordinator impl. New merge batches algorithm. [3/N] [kafka]

2024-09-25 Thread via GitHub
smjn commented on code in PR #17149: URL: https://github.com/apache/kafka/pull/17149#discussion_r1776452137 ## share-coordinator/src/main/java/org/apache/kafka/coordinator/share/StateBatchUtil.java: ## @@ -0,0 +1,360 @@ +/* + * Licensed to the Apache Software Foundation (ASF) un

Re: [PR] KAFKA-17584: Fix incorrect synonym handling for dynamic log configurations [kafka]

2024-09-25 Thread via GitHub
showuon merged PR #17258: URL: https://github.com/apache/kafka/pull/17258 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.

Re: [PR] KAFKA-17584: Fix incorrect synonym handling for dynamic log configurations [kafka]

2024-09-25 Thread via GitHub
showuon commented on code in PR #17258: URL: https://github.com/apache/kafka/pull/17258#discussion_r1776431850 ## core/src/main/scala/kafka/server/DynamicBrokerConfig.scala: ## @@ -732,17 +732,7 @@ class DynamicLogConfig(logManager: LogManager, server: KafkaBroker) extends Brok

Re: [PR] KAFKA-17584: Fix incorrect synonym handling for dynamic log configurations [kafka]

2024-09-25 Thread via GitHub
showuon commented on PR #17258: URL: https://github.com/apache/kafka/pull/17258#issuecomment-2376012733 All tests passed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] KAFKA-17367: Share coordinator impl. New merge batches algorithm. [3/N] [kafka]

2024-09-25 Thread via GitHub
smjn commented on code in PR #17149: URL: https://github.com/apache/kafka/pull/17149#discussion_r1776423900 ## share-coordinator/src/test/java/org/apache/kafka/coordinator/share/StateBatchUtilTest.java: ## @@ -0,0 +1,472 @@ +/* + * Licensed to the Apache Software Foundation (ASF

Re: [PR] KAFKA-17498: Reduce the number of remote calls when serving LIST_OFFSETS request [kafka]

2024-09-25 Thread via GitHub
showuon commented on code in PR #17132: URL: https://github.com/apache/kafka/pull/17132#discussion_r1776418279 ## core/src/test/java/kafka/log/remote/RemoteLogManagerTest.java: ## @@ -1588,6 +1588,100 @@ private void doTestFindOffsetByTimestamp(long ts, long startOffset, int ta

Re: [PR] KAFKA-15859: Add timeout field to the ListOffsets request [kafka]

2024-09-25 Thread via GitHub
satishd merged PR #17112: URL: https://github.com/apache/kafka/pull/17112 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.

Re: [PR] KAFKA-17525: Convert the UnknownServerException to InvalidRequestException when altering client-metrics config at runtime [kafka]

2024-09-25 Thread via GitHub
TaiJuWu commented on code in PR #17168: URL: https://github.com/apache/kafka/pull/17168#discussion_r1776371598 ## server/src/main/java/org/apache/kafka/server/metrics/ClientMetricsConfigs.java: ## @@ -131,9 +131,11 @@ private static void validateProperties(Properties properties

[jira] [Assigned] (KAFKA-16966) Allow offset commit fetch to reuse previous request if partitions are a subset

2024-09-25 Thread TaiJuWu (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TaiJuWu reassigned KAFKA-16966: --- Assignee: TaiJuWu > Allow offset commit fetch to reuse previous request if partitions are a subset

[jira] [Commented] (KAFKA-17606) Include Rat errors in GitHub workflow summary

2024-09-25 Thread Logan Zhu (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17884851#comment-17884851 ] Logan Zhu commented on KAFKA-17606: --- Hi, [~davidarthur]  Can I have this one? thanks! 

[jira] [Resolved] (KAFKA-17515) Fix flaky RestoreIntegrationTest.shouldInvokeUserDefinedGlobalStateRestoreListener

2024-09-25 Thread Yu-Lin Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu-Lin Chen resolved KAFKA-17515. - Resolution: Fixed Since the Jenkins build on the trunk has been disabled today, close the second

Re: [PR] KAFKA-17515: Fix flaky RestoreIntegrationTest.shouldInvokeUserDefinedGlobalStateRestoreListener by increasing stream client start timeout [kafka]

2024-09-25 Thread via GitHub
chenyulin0719 commented on PR #17272: URL: https://github.com/apache/kafka/pull/17272#issuecomment-2375839932 Close it sinece the Jenkins build has been disable. We shouldn't see the unstable build again. Will keep monitoring this issue. -- This is an automated message from the Apache

Re: [PR] KAFKA-17515: Fix flaky RestoreIntegrationTest.shouldInvokeUserDefinedGlobalStateRestoreListener by increasing stream client start timeout [kafka]

2024-09-25 Thread via GitHub
chenyulin0719 closed pull request #17272: KAFKA-17515: Fix flaky RestoreIntegrationTest.shouldInvokeUserDefinedGlobalStateRestoreListener by increasing stream client start timeout URL: https://github.com/apache/kafka/pull/17272 -- This is an automated message from the Apache Git Service. To

[jira] [Commented] (KAFKA-17615) Remove KafkaServer references in tests

2024-09-25 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-17615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17884837#comment-17884837 ] 黃竣陽 commented on KAFKA-17615: - Hi [~cmccabe], if you're not working on this, may I take this

Re: [PR] KAFKA-16331: remove KafkaClientSupplier from StreamsProducer [kafka]

2024-09-25 Thread via GitHub
mjsax commented on PR #17259: URL: https://github.com/apache/kafka/pull/17259#issuecomment-2375771525 `UnnecessaryStubbingException` -- no idea where this is coming from 🤔 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

Re: [PR] KAFKA-17057: Add RETRY option to ProductionExceptionHanlder [kafka]

2024-09-25 Thread via GitHub
mjsax merged PR #17163: URL: https://github.com/apache/kafka/pull/17163 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.or

[jira] [Assigned] (KAFKA-15588) Purge the unsent offset commits/fetches when the member is fenced/failed

2024-09-25 Thread TengYao Chi (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TengYao Chi reassigned KAFKA-15588: --- Assignee: TengYao Chi > Purge the unsent offset commits/fetches when the member is fenced/f

[jira] [Commented] (KAFKA-17518) AsyncKafkaConsumer cannot reliably leave group when closed with small timeout

2024-09-25 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17884834#comment-17884834 ] Kirk True commented on KAFKA-17518: --- Thanks! :) > AsyncKafkaConsumer cannot reliably

[jira] [Commented] (KAFKA-17518) AsyncKafkaConsumer cannot reliably leave group when closed with small timeout

2024-09-25 Thread TengYao Chi (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17884833#comment-17884833 ] TengYao Chi commented on KAFKA-17518: - Hi [~kirktrue]  Thanks for information. I wi

Re: [PR] KAFKA-16985: Ensure consumer sends leave request on close even if interrupted [kafka]

2024-09-25 Thread via GitHub
kirktrue commented on PR #16686: URL: https://github.com/apache/kafka/pull/16686#issuecomment-2375754964 cc @FrankYang0529 since you're working on KAFKA-17519 👋 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

Re: [PR] KAFKA-16985: Ensure consumer sends leave request on close even if interrupted [kafka]

2024-09-25 Thread via GitHub
kirktrue commented on PR #16686: URL: https://github.com/apache/kafka/pull/16686#issuecomment-2375753117 cc @frankvicky -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[jira] [Commented] (KAFKA-17518) AsyncKafkaConsumer cannot reliably leave group when closed with small timeout

2024-09-25 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17884832#comment-17884832 ] Kirk True commented on KAFKA-17518: --- [~frankvicky]—as [~lianetm] mentioned, this Jira

Re: [PR] MINOR: Code cleanup Kafka Streams [kafka]

2024-09-25 Thread via GitHub
mjsax commented on code in PR #16050: URL: https://github.com/apache/kafka/pull/16050#discussion_r1776270654 ## streams/src/test/java/org/apache/kafka/streams/integration/KTableKTableForeignKeyInnerJoinCustomPartitionerIntegrationTest.java: ## @@ -125,8 +125,8 @@ public static v

[jira] [Commented] (KAFKA-17590) ReplicaFetcher throw CorruptRecordException

2024-09-25 Thread Fake (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17884831#comment-17884831 ] Fake commented on KAFKA-17590: -- CorruptRecordException first [~junrao]  > ReplicaFetcher t

[jira] [Updated] (KAFKA-16778) AsyncKafkaConsumer fetcher might occasionally try to fetch to a revoked partition

2024-09-25 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16778: -- Labels: kip-848-client-support (was: ) > AsyncKafkaConsumer fetcher might occasionally try to fetch t

[jira] [Updated] (KAFKA-16778) AsyncKafkaConsumer fetcher might occasionally try to fetch to a revoked partition

2024-09-25 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16778: -- Component/s: clients consumer > AsyncKafkaConsumer fetcher might occasionally try to

[jira] [Commented] (KAFKA-16966) Allow offset commit fetch to reuse previous request if partitions are a subset

2024-09-25 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17884828#comment-17884828 ] Kirk True commented on KAFKA-16966: --- [~taijuwu]—feel free to take it :) > Allow offse

Re: [PR] KAFKA-12823 Remove Deprecated method KStream#through (KIP-1087) [kafka]

2024-09-25 Thread via GitHub
mjsax commented on PR #16761: URL: https://github.com/apache/kafka/pull/16761#issuecomment-2375693057 Thanks! The PR LGTM, but you should close the VOTE for KIP-1087 before we merge it, by replying to the VOTE thread, calling the vote closed and the KIP as accepted, summarizing the voting r

[jira] [Commented] (KAFKA-15588) Purge the unsent offset commits/fetches when the member is fenced/failed

2024-09-25 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17884827#comment-17884827 ] Kirk True commented on KAFKA-15588: --- [~frankvicky]—I can't say with any certainty, but

Re: [PR] KAFKA-17488: Cleanup (test) code for Kafka Streams "metric version" [kafka]

2024-09-25 Thread via GitHub
mjsax commented on PR #17182: URL: https://github.com/apache/kafka/pull/17182#issuecomment-2375672399 Thanks for the update. Overall LGTM -- one more minor question. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[jira] [Updated] (KAFKA-17581) AsyncKafkaConsumer can't unsubscribe invalid topics

2024-09-25 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-17581: -- Labels: consumer-threading-refactor kip-848-client-support (was: ) > AsyncKafkaConsumer can't unsubsc

Re: [PR] KAFKA-17488: Cleanup (test) code for Kafka Streams "metric version" [kafka]

2024-09-25 Thread via GitHub
mjsax commented on code in PR #17182: URL: https://github.com/apache/kafka/pull/17182#discussion_r1776244084 ## streams/src/test/java/org/apache/kafka/streams/processor/internals/metrics/StreamsMetricsImplTest.java: ## @@ -139,7 +139,7 @@ public class StreamsMetricsImplTest {

Re: [PR] KAFKA-17488: Cleanup (test) code for Kafka Streams "metric version" [kafka]

2024-09-25 Thread via GitHub
mjsax commented on code in PR #17182: URL: https://github.com/apache/kafka/pull/17182#discussion_r1776242300 ## streams/src/test/java/org/apache/kafka/streams/processor/internals/StreamTaskTest.java: ## @@ -3030,7 +3030,7 @@ private StreamTask createSingleSourceStateless(final

[jira] [Commented] (KAFKA-17613) Remove ZK migration code

2024-09-25 Thread TengYao Chi (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17884826#comment-17884826 ] TengYao Chi commented on KAFKA-17613: - Hello [~cmccabe]  If you haven’t started wor

[jira] [Updated] (KAFKA-17582) Unpredictable consumer position after transaction abort

2024-09-25 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-17582: -- Component/s: consumer > Unpredictable consumer position after transaction abort >

Re: [PR] KAFKA-17609: Changes needed to convert system tests to use KRaft and remove ZK [kafka]

2024-09-25 Thread via GitHub
mjsax commented on PR #17275: URL: https://github.com/apache/kafka/pull/17275#issuecomment-2375648848 Thanks Bill. Made a pass. Can you also trigger a system test run and share the link? -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [PR] KAFKA-17609: Changes needed to convert system tests to use KRaft and remove ZK [kafka]

2024-09-25 Thread via GitHub
mjsax commented on code in PR #17275: URL: https://github.com/apache/kafka/pull/17275#discussion_r1776232271 ## tests/kafkatest/tests/streams/streams_broker_bounce_test.py: ## @@ -216,12 +208,7 @@ def collect_results(self, sleep_time_secs): broker_type=["leader"],

Re: [PR] KAFKA-17609: Changes needed to convert system tests to use KRaft and remove ZK [kafka]

2024-09-25 Thread via GitHub
mjsax commented on code in PR #17275: URL: https://github.com/apache/kafka/pull/17275#discussion_r1776232271 ## tests/kafkatest/tests/streams/streams_broker_bounce_test.py: ## @@ -216,12 +208,7 @@ def collect_results(self, sleep_time_secs): broker_type=["leader"],

Re: [PR] KAFKA-17609: Changes needed to convert system tests to use KRaft and remove ZK [kafka]

2024-09-25 Thread via GitHub
mjsax commented on code in PR #17275: URL: https://github.com/apache/kafka/pull/17275#discussion_r1776229140 ## tests/kafkatest/tests/streams/streams_broker_bounce_test.py: ## @@ -152,16 +151,9 @@ def confirm_topics_on_all_brokers(self, expected_topic_set): def s

Re: [PR] KAFKA-17609: Changes needed to convert system tests to use KRaft and remove ZK [kafka]

2024-09-25 Thread via GitHub
mjsax commented on code in PR #17275: URL: https://github.com/apache/kafka/pull/17275#discussion_r1776227488 ## tests/kafkatest/tests/streams/streams_broker_bounce_test.py: ## @@ -152,16 +151,9 @@ def confirm_topics_on_all_brokers(self, expected_topic_set): def s

Re: [PR] KAFKA-17609: Changes needed to convert system tests to use KRaft and remove ZK [kafka]

2024-09-25 Thread via GitHub
mjsax commented on code in PR #17275: URL: https://github.com/apache/kafka/pull/17275#discussion_r1776222580 ## tests/kafkatest/tests/streams/streams_application_upgrade_test.py: ## @@ -56,9 +55,9 @@ def perform_broker_upgrade(self, to_version): node.version = Kafka

Re: [PR] KAFKA-17581: AsyncKafkaConsumer can't unsubscribe invalid topics [kafka]

2024-09-25 Thread via GitHub
kirktrue commented on PR #17244: URL: https://github.com/apache/kafka/pull/17244#issuecomment-2375629455 @FrankYang0529—I just want to say I like the current approach. It's much cleaner 😄 I haven't had a chance to dig into the root cause as I'm curious what can be done at that layer

Re: [PR] KAFKA-17609: Changes needed to convert system tests to use KRaft and remove ZK [kafka]

2024-09-25 Thread via GitHub
mjsax commented on code in PR #17275: URL: https://github.com/apache/kafka/pull/17275#discussion_r1776222580 ## tests/kafkatest/tests/streams/streams_application_upgrade_test.py: ## @@ -56,9 +55,9 @@ def perform_broker_upgrade(self, to_version): node.version = Kafka

Re: [PR] KAFKA-17609: Changes needed to convert system tests to use KRaft and remove ZK [kafka]

2024-09-25 Thread via GitHub
mjsax commented on code in PR #17275: URL: https://github.com/apache/kafka/pull/17275#discussion_r1776221750 ## tests/kafkatest/tests/streams/streams_application_upgrade_test.py: ## @@ -56,9 +55,9 @@ def perform_broker_upgrade(self, to_version): node.version = Kafka

Re: [PR] KAFKA-17609: Changes needed to convert system tests to use KRaft and remove ZK [kafka]

2024-09-25 Thread via GitHub
mjsax commented on code in PR #17275: URL: https://github.com/apache/kafka/pull/17275#discussion_r1776221513 ## tests/kafkatest/services/streams.py: ## @@ -627,11 +627,6 @@ def prop_file(self): def start_cmd(self, node): args = self.args.copy() - -if self

[jira] [Updated] (KAFKA-17439) Make polling for new records an explicit action/event in the new consumer

2024-09-25 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-17439: -- Labels: consumer-threading-refactor kip-848-client-support (was: consumer-threading-refactor) > Make

Re: [PR] KAFKA-17609: Changes needed to convert system tests to use KRaft and remove ZK [kafka]

2024-09-25 Thread via GitHub
mjsax commented on code in PR #17275: URL: https://github.com/apache/kafka/pull/17275#discussion_r1776220211 ## tests/kafkatest/tests/streams/streams_application_upgrade_test.py: ## @@ -18,9 +18,8 @@ from ducktape.mark.resource import cluster from ducktape.tests.test import Te

Re: [PR] KAFKA-17439: Make polling for new records an explicit action/event in the new consumer [kafka]

2024-09-25 Thread via GitHub
kirktrue commented on code in PR #17035: URL: https://github.com/apache/kafka/pull/17035#discussion_r1776206186 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/FetchRequestManager.java: ## @@ -65,16 +69,60 @@ protected void maybeThrowAuthFailure(Node node) {

Re: [PR] KAFKA-17439: Make polling for new records an explicit action/event in the new consumer [kafka]

2024-09-25 Thread via GitHub
kirktrue commented on code in PR #17035: URL: https://github.com/apache/kafka/pull/17035#discussion_r1776205457 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/FetchRequestManagerTest.java: ## @@ -3387,6 +3394,71 @@ public void testWhenFetchResponseReturnsA

Re: [PR] KAFKA-17439: Make polling for new records an explicit action/event in the new consumer [kafka]

2024-09-25 Thread via GitHub
kirktrue commented on code in PR #17035: URL: https://github.com/apache/kafka/pull/17035#discussion_r1776205136 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AsyncKafkaConsumer.java: ## @@ -697,6 +698,8 @@ public ConsumerRecords poll(final Duration timeout

Re: [PR] KAFKA-16985: Ensure consumer sends leave request on close even if interrupted [kafka]

2024-09-25 Thread via GitHub
kirktrue commented on code in PR #16686: URL: https://github.com/apache/kafka/pull/16686#discussion_r1776180315 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/AsyncKafkaConsumerTest.java: ## @@ -1341,6 +1342,79 @@ public void testCloseAwaitPendingAsyncCommi

Re: [PR] KAFKA-16985: Ensure consumer sends leave request on close even if interrupted [kafka]

2024-09-25 Thread via GitHub
kirktrue commented on PR #16686: URL: https://github.com/apache/kafka/pull/16686#issuecomment-2375564338 Hi @chia7712! > Apologies, but I have another question. If the interrupt is swallowed, how can users forcefully close the consumer? The wakeup method doesn't work during close, an

[jira] [Updated] (KAFKA-16955) ConcurrentModification exception thrown by KafkaStream threadState access

2024-09-25 Thread A. Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] A. Sophie Blee-Goldman updated KAFKA-16955: --- Fix Version/s: 3.8.1 > ConcurrentModification exception thrown by KafkaStrea

Re: [PR] KAFKA-16955: fix synchronization of streams threadState [kafka]

2024-09-25 Thread via GitHub
ableegoldman commented on PR #16337: URL: https://github.com/apache/kafka/pull/16337#issuecomment-2375553507 Went ahead and cherrypicked back to 3.8 🤷‍♀️ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[jira] [Created] (KAFKA-17617) New GitHub Actions build builds Java 8 with 2.13 instead of 2.12

2024-09-25 Thread Justine Olshan (Jira)
Justine Olshan created KAFKA-17617: -- Summary: New GitHub Actions build builds Java 8 with 2.13 instead of 2.12 Key: KAFKA-17617 URL: https://issues.apache.org/jira/browse/KAFKA-17617 Project: Kafka

Re: [PR] KAFKA-17277: [2/2] Add feature dependency command to the storage and the feature command tool [kafka]

2024-09-25 Thread via GitHub
jolshan commented on PR #17093: URL: https://github.com/apache/kafka/pull/17093#issuecomment-2375532175 Still seeing an issue with Scala 2.12 :( -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

Re: [PR] KAFKA-14563: add feature version supports in the producers and ApiVersions. (#117) [kafka]

2024-09-25 Thread via GitHub
jolshan merged PR #17265: URL: https://github.com/apache/kafka/pull/17265 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.

Re: [PR] KAFKA-17542: Use actions/labeler for automatic PR labeling - part 2 [kafka]

2024-09-25 Thread via GitHub
TaiJuWu commented on PR #17260: URL: https://github.com/apache/kafka/pull/17260#issuecomment-2375517375 > > test on: [TaiJuWu#10](https://github.com/TaiJuWu/kafka/pull/10) > > I don't find any changes as per this PR on mentioned test PR, am I missing something? Hi @apoorvmittal

Re: [PR] MINOR Disable Jenkins build [kafka]

2024-09-25 Thread via GitHub
jolshan commented on PR #17273: URL: https://github.com/apache/kafka/pull/17273#issuecomment-2375517383 I was looking for the Jenkins build on a few PR and now I understand why it is gone. Nice! -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [PR] KAFKA-17540: Create floating tag on trunk for CI cache [kafka]

2024-09-25 Thread via GitHub
fonsdant commented on PR #17204: URL: https://github.com/apache/kafka/pull/17204#issuecomment-2375500521 > Also, I wonder if we should do a git fetch origin as part of the command. Otherwise, we might pull in a SHA that doesn't exist locally I think it will not work well for all cases

Re: [PR] KAFKA-17540: Create floating tag on trunk for CI cache [kafka]

2024-09-25 Thread via GitHub
mumrah commented on PR #17204: URL: https://github.com/apache/kafka/pull/17204#issuecomment-2375498807 Ok, now we need to take the SHA captured by `cut` and use update-ref to create a local branch. I'd like to see this output: ``` $ git update-cache Local branch 'trunk-c

Re: [PR] KAFKA-16308 [3/N]: Introduce feature dependency validation to UpdateFeatures command [kafka]

2024-09-25 Thread via GitHub
jolshan commented on code in PR #16443: URL: https://github.com/apache/kafka/pull/16443#discussion_r1776137936 ## clients/src/main/java/org/apache/kafka/common/requests/UpdateFeaturesResponse.java: ## @@ -82,17 +84,31 @@ public static UpdateFeaturesResponse parse(ByteBuffer buf

Re: [PR] KAFKA-17540: Create floating tag on trunk for CI cache [kafka]

2024-09-25 Thread via GitHub
mumrah commented on PR #17204: URL: https://github.com/apache/kafka/pull/17204#issuecomment-2375493797 The new `cut` options are working 👍 ``` $ git update-cache 264131cdaaef3f4696942f26534b3f61f3a2a162 ``` -- This is an automated message from the Apache G

Re: [PR] KAFKA-17540: Create floating tag on trunk for CI cache [kafka]

2024-09-25 Thread via GitHub
mumrah commented on PR #17204: URL: https://github.com/apache/kafka/pull/17204#issuecomment-2375491776 Oops, sorry didn't mean to update the branch. `gh update-branch` did the opposite that I expected 😅 -- This is an automated message from the Apache Git Service. To respond to the messag

Re: [PR] KAFKA-16308 [3/N]: Introduce feature dependency validation to UpdateFeatures command [kafka]

2024-09-25 Thread via GitHub
jolshan commented on code in PR #16443: URL: https://github.com/apache/kafka/pull/16443#discussion_r1776131479 ## clients/src/main/java/org/apache/kafka/common/requests/UpdateFeaturesResponse.java: ## @@ -82,17 +84,31 @@ public static UpdateFeaturesResponse parse(ByteBuffer buf

Re: [PR] KAFKA-16308 [3/N]: Introduce feature dependency validation to UpdateFeatures command [kafka]

2024-09-25 Thread via GitHub
jolshan commented on code in PR #16443: URL: https://github.com/apache/kafka/pull/16443#discussion_r1776131479 ## clients/src/main/java/org/apache/kafka/common/requests/UpdateFeaturesResponse.java: ## @@ -82,17 +84,31 @@ public static UpdateFeaturesResponse parse(ByteBuffer buf

Re: [PR] KAFKA-16308 [3/N]: Introduce feature dependency validation to UpdateFeatures command [kafka]

2024-09-25 Thread via GitHub
jolshan commented on code in PR #16443: URL: https://github.com/apache/kafka/pull/16443#discussion_r1776131026 ## clients/src/main/java/org/apache/kafka/common/requests/UpdateFeaturesResponse.java: ## @@ -82,17 +84,31 @@ public static UpdateFeaturesResponse parse(ByteBuffer buf

Re: [PR] KAFKA-16308 [3/N]: Introduce feature dependency validation to UpdateFeatures command [kafka]

2024-09-25 Thread via GitHub
jolshan commented on code in PR #16443: URL: https://github.com/apache/kafka/pull/16443#discussion_r1776130089 ## clients/src/main/java/org/apache/kafka/common/requests/UpdateFeaturesResponse.java: ## @@ -82,17 +84,31 @@ public static UpdateFeaturesResponse parse(ByteBuffer buf

Re: [PR] KAFKA-17540: Create floating tag on trunk for CI cache [kafka]

2024-09-25 Thread via GitHub
mumrah commented on PR #17204: URL: https://github.com/apache/kafka/pull/17204#issuecomment-2375488213 Also, I wonder if we should do a `git fetch origin` as part of the command. Otherwise, we might pull in a SHA that doesn't exist locally -- This is an automated message from the Apac

Re: [PR] KAFKA-17540: Create floating tag on trunk for CI cache [kafka]

2024-09-25 Thread via GitHub
fonsdant commented on PR #17204: URL: https://github.com/apache/kafka/pull/17204#issuecomment-2375488174 Oh! Okay, I will modify the options, thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [PR] KAFKA-17540: Create floating tag on trunk for CI cache [kafka]

2024-09-25 Thread via GitHub
mumrah commented on PR #17204: URL: https://github.com/apache/kafka/pull/17204#issuecomment-2375486383 Thanks @fonsdant! I tried it and got an error from `cut`. I'm on an Apple Silicon Mac ``` $ ./committer-tools/update-cache.sh cut: illegal option -- - usage: cut -b list [-

[jira] [Assigned] (KAFKA-17607) Add CI step to verify LICENSE-binary

2024-09-25 Thread Chia-Chuan Yu (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Chuan Yu reassigned KAFKA-17607: - Assignee: Chia-Chuan Yu > Add CI step to verify LICENSE-binary > -

[jira] [Commented] (KAFKA-17607) Add CI step to verify LICENSE-binary

2024-09-25 Thread David Arthur (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17884813#comment-17884813 ] David Arthur commented on KAFKA-17607: -- Sounds good, [~chiacyu]. Go for it :)  > A

[jira] [Commented] (KAFKA-16339) Remove Deprecated "transformer" methods and classes

2024-09-25 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-16339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17884814#comment-17884814 ] João Pedro Fonseca commented on KAFKA-16339: [~mjsax], should I base the PRs

Re: [PR] KAFKA-17540: Create floating tag on trunk for CI cache [kafka]

2024-09-25 Thread via GitHub
fonsdant commented on PR #17204: URL: https://github.com/apache/kafka/pull/17204#issuecomment-2375473179 @mumrah, @chia7712, I have created an `update-cache.sh` script inside `committer-tools`. It retrieves the latest commit (by `created_at`). Also, it makes the Git alias, if it does not al

[jira] [Commented] (KAFKA-17607) Add CI step to verify LICENSE-binary

2024-09-25 Thread Chia-Chuan Yu (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17884811#comment-17884811 ] Chia-Chuan Yu commented on KAFKA-17607: --- Hi, [~davidarthur] Can I have this one?

Re: [PR] KAFKA-17608: KRaft controller crashes when leader is removed from quorum [kafka]

2024-09-25 Thread via GitHub
cmccabe commented on code in PR #17146: URL: https://github.com/apache/kafka/pull/17146#discussion_r1776104765 ## metadata/src/main/java/org/apache/kafka/controller/QuorumController.java: ## @@ -1065,6 +1065,11 @@ public void handleCommit(BatchReader reader) {

Re: [PR] KAFKA-17608: KRaft controller crashes when leader is removed from quorum [kafka]

2024-09-25 Thread via GitHub
cmccabe commented on code in PR #17146: URL: https://github.com/apache/kafka/pull/17146#discussion_r1776104122 ## metadata/src/main/java/org/apache/kafka/controller/QuorumController.java: ## @@ -1065,6 +1065,11 @@ public void handleCommit(BatchReader reader) {

Re: [PR] KAFKA-17608: KRaft controller crashes when leader is removed from quorum [kafka]

2024-09-25 Thread via GitHub
cmccabe commented on code in PR #17146: URL: https://github.com/apache/kafka/pull/17146#discussion_r1776103853 ## metadata/src/main/java/org/apache/kafka/controller/QuorumController.java: ## @@ -1065,6 +1065,11 @@ public void handleCommit(BatchReader reader) {

[jira] [Commented] (KAFKA-17614) Remove AclAuthorizer

2024-09-25 Thread PoAn Yang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17884810#comment-17884810 ] PoAn Yang commented on KAFKA-17614: --- Hi [~cmccabe], if you're not working on this, may

Re: [PR] KAFKA-17584: Fix incorrect synonym handling for dynamic log configurations [kafka]

2024-09-25 Thread via GitHub
cmccabe commented on code in PR #17258: URL: https://github.com/apache/kafka/pull/17258#discussion_r1776102833 ## core/src/main/scala/kafka/server/DynamicBrokerConfig.scala: ## @@ -732,17 +744,14 @@ class DynamicLogConfig(logManager: LogManager, server: KafkaBroker) extends Bro

Re: [PR] KAFKA-17584: Fix incorrect synonym handling for dynamic log configurations [kafka]

2024-09-25 Thread via GitHub
cmccabe commented on code in PR #17258: URL: https://github.com/apache/kafka/pull/17258#discussion_r1776102102 ## core/src/main/scala/kafka/server/DynamicBrokerConfig.scala: ## @@ -732,17 +744,14 @@ class DynamicLogConfig(logManager: LogManager, server: KafkaBroker) extends Bro

Re: [PR] KAFKA-17584: Fix incorrect synonym handling for dynamic log configurations [kafka]

2024-09-25 Thread via GitHub
cmccabe commented on code in PR #17258: URL: https://github.com/apache/kafka/pull/17258#discussion_r1776101826 ## core/src/main/scala/kafka/server/DynamicBrokerConfig.scala: ## @@ -732,17 +744,14 @@ class DynamicLogConfig(logManager: LogManager, server: KafkaBroker) extends Bro

[PR] KAFKA-17496: Add heterogeneous case to TargetAssignmentBuilderBenchmark [kafka]

2024-09-25 Thread via GitHub
squah-confluent opened a new pull request, #17277: URL: https://github.com/apache/kafka/pull/17277 Bring the homogeneous case from ServerSideAssignorBenchmark to TargetAssignmentBuilderBenchmark. ### Committer Checklist (excluded from commit message) - [ ] Verify design and imple

[jira] [Created] (KAFKA-17611) Remove ZK from Kafka 4.0

2024-09-25 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-17611: Summary: Remove ZK from Kafka 4.0 Key: KAFKA-17611 URL: https://issues.apache.org/jira/browse/KAFKA-17611 Project: Kafka Issue Type: Task Reporte

[PR] KAFKA-17612: Remove some tests that only apply to ZK mode or migration [kafka]

2024-09-25 Thread via GitHub
cmccabe opened a new pull request, #17276: URL: https://github.com/apache/kafka/pull/17276 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-ma

[jira] [Updated] (KAFKA-17612) Remove some tests that only apply to ZK mode or migration

2024-09-25 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe updated KAFKA-17612: - Summary: Remove some tests that only apply to ZK mode or migration (was: Remove some tests that

Re: [PR] KAFKA-16308 [3/N]: Introduce feature dependency validation to UpdateFeatures command [kafka]

2024-09-25 Thread via GitHub
junrao commented on code in PR #16443: URL: https://github.com/apache/kafka/pull/16443#discussion_r1776097413 ## clients/src/main/java/org/apache/kafka/common/requests/UpdateFeaturesResponse.java: ## @@ -82,17 +84,31 @@ public static UpdateFeaturesResponse parse(ByteBuffer buff

Re: [PR] KAFKA-16308 [3/N]: Introduce feature dependency validation to UpdateFeatures command [kafka]

2024-09-25 Thread via GitHub
junrao commented on code in PR #16443: URL: https://github.com/apache/kafka/pull/16443#discussion_r1776097413 ## clients/src/main/java/org/apache/kafka/common/requests/UpdateFeaturesResponse.java: ## @@ -82,17 +84,31 @@ public static UpdateFeaturesResponse parse(ByteBuffer buff

[jira] [Created] (KAFKA-17616) Remove KafkaServer

2024-09-25 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-17616: Summary: Remove KafkaServer Key: KAFKA-17616 URL: https://issues.apache.org/jira/browse/KAFKA-17616 Project: Kafka Issue Type: Sub-task Reporter:

[jira] [Created] (KAFKA-17615) Remove KafkaServer references in tests

2024-09-25 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-17615: Summary: Remove KafkaServer references in tests Key: KAFKA-17615 URL: https://issues.apache.org/jira/browse/KAFKA-17615 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-17613) Remove ZK migration code

2024-09-25 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-17613: Summary: Remove ZK migration code Key: KAFKA-17613 URL: https://issues.apache.org/jira/browse/KAFKA-17613 Project: Kafka Issue Type: Sub-task Rep

Re: [PR] KAFKA-16959: ConfigCommand should allow to define both `entity-default` and `entity-name` [kafka]

2024-09-25 Thread via GitHub
m1a2st commented on PR #16381: URL: https://github.com/apache/kafka/pull/16381#issuecomment-2375431411 @chia7712, @apoorvmittal10, Thanks for your reminder, I will update the Jira Title. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [PR] KAFKA-17584: Fix incorrect synonym handling for dynamic log configurations [kafka]

2024-09-25 Thread via GitHub
junrao commented on code in PR #17258: URL: https://github.com/apache/kafka/pull/17258#discussion_r1776088538 ## core/src/main/scala/kafka/server/DynamicBrokerConfig.scala: ## @@ -732,17 +744,14 @@ class DynamicLogConfig(logManager: LogManager, server: KafkaBroker) extends Brok

  1   2   3   >