[GitHub] [kafka] yashmayya commented on a diff in pull request #13415: KAFKA-14816: Only load SSL properties when issuing cross-worker requests to HTTPS URLs

2023-03-20 Thread via GitHub
yashmayya commented on code in PR #13415: URL: https://github.com/apache/kafka/pull/13415#discussion_r1141704800 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/rest/RestClient.java: ## @@ -97,7 +98,11 @@ public HttpResponse httpRequest(String url, String met

[GitHub] [kafka] dajac commented on a diff in pull request #13350: KAFKA-14452: Make sticky assignors rack-aware if client rack is configured (KIP-881)

2023-03-20 Thread via GitHub
dajac commented on code in PR #13350: URL: https://github.com/apache/kafka/pull/13350#discussion_r1141731445 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AbstractStickyAssignor.java: ## @@ -495,8 +615,8 @@ private class ConstrainedAssignmentBuilder extend

[GitHub] [kafka] akatona84 commented on a diff in pull request #11565: KAFKA-13504: Retry connect internal topics' creation in case of InvalidReplicationFactorException

2023-03-20 Thread via GitHub
akatona84 commented on code in PR #11565: URL: https://github.com/apache/kafka/pull/11565#discussion_r1141771004 ## connect/runtime/src/main/java/org/apache/kafka/connect/storage/KafkaTopicBasedBackingStore.java: ## @@ -0,0 +1,73 @@ +/* + * Licensed to the Apache Software Founda

[GitHub] [kafka] akatona84 commented on a diff in pull request #11565: KAFKA-13504: Retry connect internal topics' creation in case of InvalidReplicationFactorException

2023-03-20 Thread via GitHub
akatona84 commented on code in PR #11565: URL: https://github.com/apache/kafka/pull/11565#discussion_r1141776979 ## connect/runtime/src/main/java/org/apache/kafka/connect/util/TopicAdmin.java: ## @@ -328,6 +335,48 @@ public Set createTopics(NewTopic... topics) { return

[jira] [Created] (KAFKA-14821) Better handle timeouts in ListOffsets API

2023-03-20 Thread Dimitar Dimitrov (Jira)
Dimitar Dimitrov created KAFKA-14821: Summary: Better handle timeouts in ListOffsets API Key: KAFKA-14821 URL: https://issues.apache.org/jira/browse/KAFKA-14821 Project: Kafka Issue Type:

[GitHub] [kafka] mimaison commented on pull request #12992: KAFKA-14376-KIP887: Add ConfigProvider to make use of environment variables

2023-03-20 Thread via GitHub
mimaison commented on PR #12992: URL: https://github.com/apache/kafka/pull/12992#issuecomment-1475905586 Can you reply to the DISCUSS/VOTE threads explaining the changes you made since the KIP was accepted? -- This is an automated message from the Apache Git Service. To respond to the mes

[jira] [Created] (KAFKA-14822) Allow restricting File and Directory ConfigProviders to specific paths

2023-03-20 Thread Mickael Maison (Jira)
Mickael Maison created KAFKA-14822: -- Summary: Allow restricting File and Directory ConfigProviders to specific paths Key: KAFKA-14822 URL: https://issues.apache.org/jira/browse/KAFKA-14822 Project: K

[jira] [Created] (KAFKA-14823) Clean up ConfigProvider API

2023-03-20 Thread Mickael Maison (Jira)
Mickael Maison created KAFKA-14823: -- Summary: Clean up ConfigProvider API Key: KAFKA-14823 URL: https://issues.apache.org/jira/browse/KAFKA-14823 Project: Kafka Issue Type: Improvement

[GitHub] [kafka] Schm1tz1 commented on pull request #12992: KAFKA-14376-KIP887: Add ConfigProvider to make use of environment variables

2023-03-20 Thread via GitHub
Schm1tz1 commented on PR #12992: URL: https://github.com/apache/kafka/pull/12992#issuecomment-1475939063 > Can you reply to the DISCUSS/VOTE threads explaining the changes you made since the KIP was accepted? Sure, just sent an update to the KIP thread: https://lists.apache.org/threa

[jira] [Assigned] (KAFKA-14785) Implement connector offset read REST API

2023-03-20 Thread Yash Mayya (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yash Mayya reassigned KAFKA-14785: -- Assignee: Yash Mayya > Implement connector offset read REST API > ---

[jira] [Assigned] (KAFKA-14784) Implement connector offset reset REST API

2023-03-20 Thread Yash Mayya (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yash Mayya reassigned KAFKA-14784: -- Assignee: Yash Mayya > Implement connector offset reset REST API > --

[GitHub] [kafka] dengziming merged pull request #13403: MINOR:Fix hint about alter in TopicCommand

2023-03-20 Thread via GitHub
dengziming merged PR #13403: URL: https://github.com/apache/kafka/pull/13403 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apac

[GitHub] [kafka] C0urante commented on pull request #13418: MINOR: add equals and hashcode methods to KafkaProducer and ProducerMetadata

2023-03-20 Thread via GitHub
C0urante commented on PR #13418: URL: https://github.com/apache/kafka/pull/13418#issuecomment-1476186302 Thanks for providing more detail. I'm still confused about this part: > The default equals method compares by address. But this is not what we want. Wouldn't comparison by a

[GitHub] [kafka] C0urante commented on a diff in pull request #13415: KAFKA-14816: Only load SSL properties when issuing cross-worker requests to HTTPS URLs

2023-03-20 Thread via GitHub
C0urante commented on code in PR #13415: URL: https://github.com/apache/kafka/pull/13415#discussion_r1142078897 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/rest/RestClient.java: ## @@ -97,7 +98,11 @@ public HttpResponse httpRequest(String url, String meth

[GitHub] [kafka] C0urante commented on a diff in pull request #13415: KAFKA-14816: Only load SSL properties when issuing cross-worker requests to HTTPS URLs

2023-03-20 Thread via GitHub
C0urante commented on code in PR #13415: URL: https://github.com/apache/kafka/pull/13415#discussion_r1142078897 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/rest/RestClient.java: ## @@ -97,7 +98,11 @@ public HttpResponse httpRequest(String url, String meth

[GitHub] [kafka] viktorsomogyi commented on a diff in pull request #11565: KAFKA-13504: Retry connect internal topics' creation in case of InvalidReplicationFactorException

2023-03-20 Thread via GitHub
viktorsomogyi commented on code in PR #11565: URL: https://github.com/apache/kafka/pull/11565#discussion_r114295 ## connect/runtime/src/main/java/org/apache/kafka/connect/util/TopicAdmin.java: ## @@ -328,6 +335,48 @@ public Set createTopics(NewTopic... topics) { ret

[GitHub] [kafka] mimaison opened a new pull request, #13419: KAFKA-8713: Allow using null for field in JsonConverter (KIP-581)

2023-03-20 Thread via GitHub
mimaison opened a new pull request, #13419: URL: https://github.com/apache/kafka/pull/13419 Add a new configuration replace.null.with.default to allow using null instead of the default value. ### Committer Checklist (excluded from commit message) - [ ] Verify design and impleme

[GitHub] [kafka] jolshan merged pull request #13415: KAFKA-14816: Only load SSL properties when issuing cross-worker requests to HTTPS URLs

2023-03-20 Thread via GitHub
jolshan merged PR #13415: URL: https://github.com/apache/kafka/pull/13415 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.

[GitHub] [kafka] C0urante commented on pull request #13415: KAFKA-14816: Only load SSL properties when issuing cross-worker requests to HTTPS URLs

2023-03-20 Thread via GitHub
C0urante commented on PR #13415: URL: https://github.com/apache/kafka/pull/13415#issuecomment-1476461304 Thanks Justine! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [kafka] mimaison opened a new pull request, #13420: KAFKA-14740: Add source tag to MirrorSourceMetrics - KIP-911

2023-03-20 Thread via GitHub
mimaison opened a new pull request, #13420: URL: https://github.com/apache/kafka/pull/13420 New add.source.alias.to.metrics setting to add the source cluster alias to the MirrorSourceConnector metrics ### Committer Checklist (excluded from commit message) - [ ] Verify design an

[jira] [Created] (KAFKA-14824) ReplicaAlterLogDirsThread may cause serious disk usage in case of unknown exception

2023-03-20 Thread hudeqi (Jira)
hudeqi created KAFKA-14824: -- Summary: ReplicaAlterLogDirsThread may cause serious disk usage in case of unknown exception Key: KAFKA-14824 URL: https://issues.apache.org/jira/browse/KAFKA-14824 Project: Kafk

[GitHub] [kafka] hudeqi opened a new pull request, #13421: KAFKA-14824:ReplicaAlterLogDirsThread may cause serious disk usage in…

2023-03-20 Thread via GitHub
hudeqi opened a new pull request, #13421: URL: https://github.com/apache/kafka/pull/13421 For ReplicaAlterLogDirsThread, if the partition is marked as failed due to an unknown exception and the partition fetch is suspended, the paused cleanup logic of the partition needs to be canceled, oth

[jira] [Updated] (KAFKA-14824) ReplicaAlterLogDirsThread may cause serious disk usage in case of unknown exception

2023-03-20 Thread hudeqi (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hudeqi updated KAFKA-14824: --- Reviewer: Chia-Ping Tsai > ReplicaAlterLogDirsThread may cause serious disk usage in case of unknown > exce

[GitHub] [kafka] hudeqi commented on pull request #13421: KAFKA-14824:ReplicaAlterLogDirsThread may cause serious disk usage in…

2023-03-20 Thread via GitHub
hudeqi commented on PR #13421: URL: https://github.com/apache/kafka/pull/13421#issuecomment-1476492254 hello, maybe you are interested in this issue? @chia7712 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[GitHub] [kafka] mimaison opened a new pull request, #13422: MINOR: Cleanups in clients common.config

2023-03-20 Thread via GitHub
mimaison opened a new pull request, #13422: URL: https://github.com/apache/kafka/pull/13422 ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI build status - [ ] Verify documentation (including upgr

[GitHub] [kafka] jolshan commented on pull request #13415: KAFKA-14816: Only load SSL properties when issuing cross-worker requests to HTTPS URLs

2023-03-20 Thread via GitHub
jolshan commented on PR #13415: URL: https://github.com/apache/kafka/pull/13415#issuecomment-1476575571 cherrypicked to 3.4 as well -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[jira] [Resolved] (KAFKA-14816) Connect loading SSL configs when contacting non-HTTPS URLs

2023-03-20 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton resolved KAFKA-14816. --- Reviewer: Justine Olshan Resolution: Fixed > Connect loading SSL configs when contacti

[jira] [Created] (KAFKA-14825) Handle divergence between KRaft's HWM and Log's HWM

2023-03-20 Thread Jira
José Armando García Sancio created KAFKA-14825: -- Summary: Handle divergence between KRaft's HWM and Log's HWM Key: KAFKA-14825 URL: https://issues.apache.org/jira/browse/KAFKA-14825 Proje

[jira] [Created] (KAFKA-14826) Log the completion time for request that resulted in an error.

2023-03-20 Thread Jira
José Armando García Sancio created KAFKA-14826: -- Summary: Log the completion time for request that resulted in an error. Key: KAFKA-14826 URL: https://issues.apache.org/jira/browse/KAFKA-14826

[GitHub] [kafka] lucasbru commented on a diff in pull request #13369: KAFKA-14172: Should clear cache when active recycled from standby

2023-03-20 Thread via GitHub
lucasbru commented on code in PR #13369: URL: https://github.com/apache/kafka/pull/13369#discussion_r1142535965 ## streams/src/test/java/org/apache/kafka/streams/integration/StandbyTaskEOSMultiRebalanceIntegrationTest.java: ## @@ -0,0 +1,304 @@ +/* + * Licensed to the Apache Sof

[jira] [Created] (KAFKA-14827) Support for StandardAuthorizer in Benchmark

2023-03-20 Thread Purshotam Chauhan (Jira)
Purshotam Chauhan created KAFKA-14827: - Summary: Support for StandardAuthorizer in Benchmark Key: KAFKA-14827 URL: https://issues.apache.org/jira/browse/KAFKA-14827 Project: Kafka Issue T

[GitHub] [kafka] emissionnebula opened a new pull request, #13423: KAFKA-14827: Support for StandardAuthorizer benchmark

2023-03-20 Thread via GitHub
emissionnebula opened a new pull request, #13423: URL: https://github.com/apache/kafka/pull/13423 What * Renamed AclAuthorizerBenchmark -> AuthorizerBenchmark * Updated it to run benchmarks for both AclAuthorizer and StandardAuthorizer Current benchmark results: `

[jira] [Updated] (KAFKA-14828) Remove R/W lock from StandardAuthorizer

2023-03-20 Thread Purshotam Chauhan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Purshotam Chauhan updated KAFKA-14828: -- Description: Currently, StandardAuthorizer uses R/W locks to keep the data consistent

[jira] [Created] (KAFKA-14828) Remove R/W lock from StandardAuthorizer

2023-03-20 Thread Purshotam Chauhan (Jira)
Purshotam Chauhan created KAFKA-14828: - Summary: Remove R/W lock from StandardAuthorizer Key: KAFKA-14828 URL: https://issues.apache.org/jira/browse/KAFKA-14828 Project: Kafka Issue Type:

[GitHub] [kafka] jsancio merged pull request #13402: MINOR: Use PartitionAssignment in ReplicationControlManager and PartitionReassignmentReplicas

2023-03-20 Thread via GitHub
jsancio merged PR #13402: URL: https://github.com/apache/kafka/pull/13402 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.

[GitHub] [kafka] guozhangwang commented on pull request #13347: MINOR: Use JUnit-5 extension to enforce strict stubbing

2023-03-20 Thread via GitHub
guozhangwang commented on PR #13347: URL: https://github.com/apache/kafka/pull/13347#issuecomment-1476912355 @lucasbru ack (and sorry for late reply)! Will take a look. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [kafka] guozhangwang merged pull request #13347: MINOR: Use JUnit-5 extension to enforce strict stubbing

2023-03-20 Thread via GitHub
guozhangwang merged PR #13347: URL: https://github.com/apache/kafka/pull/13347 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.ap

[GitHub] [kafka] guozhangwang commented on a diff in pull request #13369: KAFKA-14172: Should clear cache when active recycled from standby

2023-03-20 Thread via GitHub
guozhangwang commented on code in PR #13369: URL: https://github.com/apache/kafka/pull/13369#discussion_r1142669679 ## streams/src/test/java/org/apache/kafka/streams/integration/StandbyTaskEOSMultiRebalanceIntegrationTest.java: ## @@ -0,0 +1,304 @@ +/* + * Licensed to the Apache

[GitHub] [kafka] guozhangwang commented on a diff in pull request #13369: KAFKA-14172: Should clear cache when active recycled from standby

2023-03-20 Thread via GitHub
guozhangwang commented on code in PR #13369: URL: https://github.com/apache/kafka/pull/13369#discussion_r1142674372 ## streams/src/test/java/org/apache/kafka/streams/integration/StandbyTaskEOSMultiRebalanceIntegrationTest.java: ## @@ -0,0 +1,304 @@ +/* + * Licensed to the Apache

[GitHub] [kafka] C0urante opened a new pull request, #13424: KAFKA-14783: New STOPPED state for connectors

2023-03-20 Thread via GitHub
C0urante opened a new pull request, #13424: URL: https://github.com/apache/kafka/pull/13424 [Jira](https://issues.apache.org/jira/browse/KAFKA-14783), [relevant KIP section](https://cwiki.apache.org/confluence/display/KAFKA/KIP-875%3A+First-class+offsets+support+in+Kafka+Connect#KIP875:First

[jira] [Updated] (KAFKA-14365) Extract common logic from Fetcher

2023-03-20 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-14365: -- Summary: Extract common logic from Fetcher (was: Extract common logic from Fetcher into FetcherUtils)

[GitHub] [kafka] C0urante commented on pull request #13424: KAFKA-14783 (KIP-875): New STOPPED state for connectors

2023-03-20 Thread via GitHub
C0urante commented on PR #13424: URL: https://github.com/apache/kafka/pull/13424#issuecomment-1476935983 cc @yashmayya; feel free to review and/or build off of this for KAFKA-14786, KAFKA-14368, and KAFKA-14784. -- This is an automated message from the Apache Git Service. To respond to th

[GitHub] [kafka] C0urante commented on pull request #13424: KAFKA-14783 (KIP-875): New STOPPED state for connectors

2023-03-20 Thread via GitHub
C0urante commented on PR #13424: URL: https://github.com/apache/kafka/pull/13424#issuecomment-1476936722 @mimaison do you think you'll have time to take a look? Hoping to get this in before the 3.5.0 release but we can punt if there's not enough bandwidth for review. -- This is an automa

[jira] [Commented] (KAFKA-14823) Clean up ConfigProvider API

2023-03-20 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17702932#comment-17702932 ] Greg Harris commented on KAFKA-14823: - Connect currently has an issue where secrets

[jira] [Created] (KAFKA-14829) Consolidate reassignment logic in PartitionReassignmentReplicas

2023-03-20 Thread Andrew Grant (Jira)
Andrew Grant created KAFKA-14829: Summary: Consolidate reassignment logic in PartitionReassignmentReplicas Key: KAFKA-14829 URL: https://issues.apache.org/jira/browse/KAFKA-14829 Project: Kafka

[jira] [Assigned] (KAFKA-14829) Consolidate reassignment logic in PartitionReassignmentReplicas

2023-03-20 Thread Andrew Grant (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Grant reassigned KAFKA-14829: Assignee: Andrew Grant > Consolidate reassignment logic in PartitionReassignmentReplicas

[jira] [Updated] (KAFKA-14829) Consolidate reassignment logic in PartitionReassignmentReplicas

2023-03-20 Thread Andrew Grant (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Grant updated KAFKA-14829: - Priority: Minor (was: Major) > Consolidate reassignment logic in PartitionReassignmentReplicas

[GitHub] [kafka] C0urante commented on a diff in pull request #13367: KAFKA-14797: Emit offset sync when offset translation lag would exceed max.offset.lag

2023-03-20 Thread via GitHub
C0urante commented on code in PR #13367: URL: https://github.com/apache/kafka/pull/13367#discussion_r1142683836 ## connect/mirror/src/test/java/org/apache/kafka/connect/mirror/integration/MirrorConnectorsIntegrationBaseTest.java: ## @@ -416,6 +417,15 @@ public void testReplicati

[GitHub] [kafka] C0urante commented on a diff in pull request #11565: KAFKA-13504: Retry connect internal topics' creation in case of InvalidReplicationFactorException

2023-03-20 Thread via GitHub
C0urante commented on code in PR #11565: URL: https://github.com/apache/kafka/pull/11565#discussion_r1142700527 ## connect/runtime/src/main/java/org/apache/kafka/connect/storage/KafkaTopicBasedBackingStore.java: ## @@ -0,0 +1,73 @@ +/* + * Licensed to the Apache Software Foundat

[GitHub] [kafka] artemlivshits commented on a diff in pull request #13391: WIP: KAFKA-14561: Improve transactions experience for older clients by ensuring ongoing transaction

2023-03-20 Thread via GitHub
artemlivshits commented on code in PR #13391: URL: https://github.com/apache/kafka/pull/13391#discussion_r1142707455 ## core/src/main/scala/kafka/server/AddPartitionsToTxnManager.scala: ## @@ -0,0 +1,173 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under one or m

[jira] [Updated] (KAFKA-14829) Consolidate reassignment logic in PartitionReassignmentReplicas

2023-03-20 Thread Andrew Grant (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Grant updated KAFKA-14829: - Description: Currently, we have various bits of reassignment logic spread across different class

[jira] [Updated] (KAFKA-14829) Consolidate reassignment logic in PartitionReassignmentReplicas

2023-03-20 Thread Andrew Grant (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Grant updated KAFKA-14829: - Description: Currently, we have various bits of reassignment logic spread across different class

[GitHub] [kafka] guozhangwang commented on a diff in pull request #13380: KAFKA-14468: Committed API

2023-03-20 Thread via GitHub
guozhangwang commented on code in PR #13380: URL: https://github.com/apache/kafka/pull/13380#discussion_r1142683410 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/CommitRequestManager.java: ## @@ -207,6 +226,232 @@ public NetworkClientDelegate.UnsentRequest

[GitHub] [kafka] kirktrue opened a new pull request, #13425: KAFKA-14365: Extract common logic from Fetcher

2023-03-20 Thread via GitHub
kirktrue opened a new pull request, #13425: URL: https://github.com/apache/kafka/pull/13425 The `Fetcher` class is used internally by the `KafkaConsumer` to fetch records from the brokers. There is ongoing work to create a new consumer implementation with a significantly refactored threadin

[jira] [Updated] (KAFKA-14365) Extract common logic from Fetcher

2023-03-20 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-14365: -- Description: The {{Fetcher}} class is used internally by the {{KafkaConsumer}} to fetch records from

[GitHub] [kafka] artemlivshits commented on a diff in pull request #13391: KAFKA-14561: Improve transactions experience for older clients by ensuring ongoing transaction

2023-03-20 Thread via GitHub
artemlivshits commented on code in PR #13391: URL: https://github.com/apache/kafka/pull/13391#discussion_r1142722842 ## core/src/main/scala/kafka/server/AddPartitionsToTxnManager.scala: ## @@ -0,0 +1,173 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under one or m

[GitHub] [kafka] jolshan commented on a diff in pull request #13391: KAFKA-14561: Improve transactions experience for older clients by ensuring ongoing transaction

2023-03-20 Thread via GitHub
jolshan commented on code in PR #13391: URL: https://github.com/apache/kafka/pull/13391#discussion_r1142786061 ## core/src/main/scala/kafka/server/AddPartitionsToTxnManager.scala: ## @@ -0,0 +1,173 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under one or more +

[GitHub] [kafka] jolshan commented on a diff in pull request #13391: KAFKA-14561: Improve transactions experience for older clients by ensuring ongoing transaction

2023-03-20 Thread via GitHub
jolshan commented on code in PR #13391: URL: https://github.com/apache/kafka/pull/13391#discussion_r1142787086 ## core/src/main/scala/kafka/server/AddPartitionsToTxnManager.scala: ## @@ -0,0 +1,173 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under one or more +

[GitHub] [kafka] jolshan commented on a diff in pull request #13391: KAFKA-14561: Improve transactions experience for older clients by ensuring ongoing transaction

2023-03-20 Thread via GitHub
jolshan commented on code in PR #13391: URL: https://github.com/apache/kafka/pull/13391#discussion_r1142787356 ## core/src/main/scala/kafka/server/AddPartitionsToTxnManager.scala: ## @@ -0,0 +1,173 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under one or more +

[GitHub] [kafka] jolshan commented on a diff in pull request #13391: KAFKA-14561: Improve transactions experience for older clients by ensuring ongoing transaction

2023-03-20 Thread via GitHub
jolshan commented on code in PR #13391: URL: https://github.com/apache/kafka/pull/13391#discussion_r1142788144 ## core/src/main/scala/kafka/server/AddPartitionsToTxnManager.scala: ## @@ -0,0 +1,173 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under one or more +

[GitHub] [kafka] jolshan commented on a diff in pull request #13391: KAFKA-14561: Improve transactions experience for older clients by ensuring ongoing transaction

2023-03-20 Thread via GitHub
jolshan commented on code in PR #13391: URL: https://github.com/apache/kafka/pull/13391#discussion_r1142788313 ## core/src/main/scala/kafka/server/BrokerServer.scala: ## @@ -247,6 +248,10 @@ class BrokerServer( ) alterPartitionManager.start() + val addPartit

[GitHub] [kafka] leeleeian commented on pull request #13418: MINOR: add equals and hashcode methods to KafkaProducer and ProducerMetadata

2023-03-20 Thread via GitHub
leeleeian commented on PR #13418: URL: https://github.com/apache/kafka/pull/13418#issuecomment-1477157623 We're discussing the solution for our use case. Closing this PR for now. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [kafka] leeleeian closed pull request #13418: MINOR: add equals and hashcode methods to KafkaProducer and ProducerMetadata

2023-03-20 Thread via GitHub
leeleeian closed pull request #13418: MINOR: add equals and hashcode methods to KafkaProducer and ProducerMetadata URL: https://github.com/apache/kafka/pull/13418 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

[jira] [Commented] (KAFKA-7224) KIP-328: Add spill-to-disk for Suppression

2023-03-20 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17702980#comment-17702980 ] Matthias J. Sax commented on KAFKA-7224: With [https://cwiki.apache.org/confluen

[GitHub] [kafka] mjsax commented on a diff in pull request #13292: KAFKA-14491: [14/N] Set changelog topic configs for versioned stores

2023-03-20 Thread via GitHub
mjsax commented on code in PR #13292: URL: https://github.com/apache/kafka/pull/13292#discussion_r1142842326 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/InternalTopologyBuilder.java: ## @@ -1293,12 +1306,16 @@ private void setRegexMatchedTopicToStateSto

[GitHub] [kafka] mjsax commented on a diff in pull request #13340: KAFKA-14491: [15/N] Add integration tests for versioned stores

2023-03-20 Thread via GitHub
mjsax commented on code in PR #13340: URL: https://github.com/apache/kafka/pull/13340#discussion_r1142848103 ## streams/src/test/java/org/apache/kafka/streams/integration/VersionedKeyValueStoreIntegrationTest.java: ## @@ -302,7 +319,54 @@ public void shouldAllowCustomIQv2ForCus

[GitHub] [kafka] mjsax commented on a diff in pull request #13340: KAFKA-14491: [15/N] Add integration tests for versioned stores

2023-03-20 Thread via GitHub
mjsax commented on code in PR #13340: URL: https://github.com/apache/kafka/pull/13340#discussion_r1142848310 ## streams/src/test/java/org/apache/kafka/streams/integration/VersionedKeyValueStoreIntegrationTest.java: ## @@ -334,18 +399,65 @@ private final int produceSourceData(fin

[GitHub] [kafka] mjsax commented on pull request #13340: KAFKA-14491: [15/N] Add integration tests for versioned stores

2023-03-20 Thread via GitHub
mjsax commented on PR #13340: URL: https://github.com/apache/kafka/pull/13340#issuecomment-1477214689 Build failed with checkstyle errors: ``` [ant:checkstyle] [ERROR] /home/jenkins/workspace/Kafka_kafka-pr_PR-13340/streams/src/test/java/org/apache/kafka/streams/integration/VersionedKe

[GitHub] [kafka] mjsax commented on a diff in pull request #13365: KAFKA-14491: [17/N] Refactor segments cleanup logic

2023-03-20 Thread via GitHub
mjsax commented on code in PR #13365: URL: https://github.com/apache/kafka/pull/13365#discussion_r1142849436 ## streams/src/main/java/org/apache/kafka/streams/state/internals/LogicalKeyValueSegments.java: ## @@ -57,6 +57,11 @@ public void openExisting(final ProcessorContext cont

[GitHub] [kafka] mjsax merged pull request #13365: KAFKA-14491: [17/N] Refactor segments cleanup logic

2023-03-20 Thread via GitHub
mjsax merged PR #13365: URL: https://github.com/apache/kafka/pull/13365 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.or

[GitHub] [kafka] satishd commented on pull request #13362: KAFKA-14795: Provide message formatter for RemoteLogMetadata

2023-03-20 Thread via GitHub
satishd commented on PR #13362: URL: https://github.com/apache/kafka/pull/13362#issuecomment-1477226052 >LGTM, the only comment is should we make the formatter as a separate file? @satishd , thoughts? @showuon I am fine with formatter inside the serde class. -- This is an automate

[GitHub] [kafka] rohits64 commented on pull request #13361: KAFKA-14401: Resume WorkThread if Connector/Tasks reading offsets get stuck when underneath WorkThread dies [WIP]

2023-03-20 Thread via GitHub
rohits64 commented on PR #13361: URL: https://github.com/apache/kafka/pull/13361#issuecomment-1477318855 Hi @mukkachaitanya, thanks for the inputs. I think it we can go with exponential backoff with some static number of retries. I have made the changes. Currently I have made the number of

[GitHub] [kafka] chia7712 commented on pull request #13421: KAFKA-14824:ReplicaAlterLogDirsThread may cause serious disk usage in…

2023-03-20 Thread via GitHub
chia7712 commented on PR #13421: URL: https://github.com/apache/kafka/pull/13421#issuecomment-1477334683 Why we need this PR if KAFKA-9087 had fixed the bug ( you mentioned in the jira)? Is there another potential bug? Or the bug fixed by KAFKA-9087 is not root cause? -- This is an autom

[GitHub] [kafka] hudeqi commented on pull request #13421: KAFKA-14824:ReplicaAlterLogDirsThread may cause serious disk usage in…

2023-03-20 Thread via GitHub
hudeqi commented on PR #13421: URL: https://github.com/apache/kafka/pull/13421#issuecomment-1477340172 > Why we need this PR if [KAFKA-9087](https://issues.apache.org/jira/browse/KAFKA-9087) had fixed the bug ( you mentioned in the jira)? Is there another potential bug? Or the bug fixed by

[GitHub] [kafka] showuon commented on pull request #13362: KAFKA-14795: Provide message formatter for RemoteLogMetadata

2023-03-20 Thread via GitHub
showuon commented on PR #13362: URL: https://github.com/apache/kafka/pull/13362#issuecomment-1477344434 Failed tests are unrelated ``` Build / JDK 17 and Scala 2.13 / org.apache.kafka.connect.integration.ExactlyOnceSourceIntegrationTest.testConnectorReconfiguration Build / J

[GitHub] [kafka] showuon merged pull request #13362: KAFKA-14795: Provide message formatter for RemoteLogMetadata

2023-03-20 Thread via GitHub
showuon merged PR #13362: URL: https://github.com/apache/kafka/pull/13362 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.