[GitHub] [kafka] satishd commented on a diff in pull request #13304: KAFKA-14726 Move/rewrite of LogReadInfo, LogOffsetSnapshot, LogStartOffsetIncrementReason to storage module

2023-02-27 Thread via GitHub
satishd commented on code in PR #13304: URL: https://github.com/apache/kafka/pull/13304#discussion_r1118411232 ## core/src/main/scala/kafka/log/UnifiedLog.scala: ## @@ -1112,7 +1079,8 @@ class UnifiedLog(@volatile var logStartOffset: Long, new LogAppendInfo(firstOffset, l

[GitHub] [kafka] ijuma merged pull request #13311: MINOR: Enable spotless for streams-scala when Java 11+ is used

2023-02-27 Thread via GitHub
ijuma merged PR #13311: URL: https://github.com/apache/kafka/pull/13311 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.or

[GitHub] [kafka] ijuma commented on pull request #13205: KAFKA-14680: Upgrade gradle version from 7.6 to 8.0.1

2023-02-27 Thread via GitHub
ijuma commented on PR #13205: URL: https://github.com/apache/kafka/pull/13205#issuecomment-1445905740 The `spotlessScala` issue was fixed via #13311. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [kafka] ijuma commented on pull request #13263: KAFKA-14728: Don't run 'spotlessScalaCheck' in CI

2023-02-27 Thread via GitHub
ijuma commented on PR #13263: URL: https://github.com/apache/kafka/pull/13263#issuecomment-1445906790 @guozhangwang Note that we found a way to re-enable this when running with Java 11 or newer, see #13311. -- This is an automated message from the Apache Git Service. To respond to the mes

[jira] [Resolved] (KAFKA-14749) Re-enable 'spotlessScalaCheck' task (in Jenkinsfile)

2023-02-27 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-14749. - Assignee: Ismael Juma Resolution: Fixed We found a way to re-enable this when running with

[jira] [Updated] (KAFKA-14749) Re-enable 'spotlessScalaCheck' task (in Jenkinsfile)

2023-02-27 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-14749: Fix Version/s: 3.5.0 (was: 4.0.0) > Re-enable 'spotlessScalaCheck' task (in

[jira] [Updated] (KAFKA-14749) Re-enable 'spotlessScalaCheck' task (in Jenkinsfile)

2023-02-27 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-14749: Priority: Major (was: Blocker) > Re-enable 'spotlessScalaCheck' task (in Jenkinsfile) > -

[jira] [Resolved] (KAFKA-14680) Gradle version upgrade 7 -->> 8

2023-02-27 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-14680. - Fix Version/s: 3.5.0 Resolution: Fixed > Gradle version upgrade 7 -->> 8 > --

[GitHub] [kafka] satishd commented on pull request #13304: KAFKA-14726 Move/rewrite of LogReadInfo, LogOffsetSnapshot, LogStartOffsetIncrementReason to storage module

2023-02-27 Thread via GitHub
satishd commented on PR #13304: URL: https://github.com/apache/kafka/pull/13304#issuecomment-1445917205 Thanks @showuon for your review. Addressed them with inline replies or the latest commits. -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [kafka] dajac commented on a diff in pull request #13231: KAFKA-14402: Update AddPartitionsToTxn protocol to batch and handle verifyOnly requests

2023-02-27 Thread via GitHub
dajac commented on code in PR #13231: URL: https://github.com/apache/kafka/pull/13231#discussion_r1118380508 ## clients/src/main/java/org/apache/kafka/common/requests/AddPartitionsToTxnRequest.java: ## @@ -34,22 +43,40 @@ public class AddPartitionsToTxnRequest extends AbstractR

[GitHub] [kafka] mimaison merged pull request #13174: MINOR: Various cleanups in common utils

2023-02-27 Thread via GitHub
mimaison merged PR #13174: URL: https://github.com/apache/kafka/pull/13174 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

[jira] [Updated] (KAFKA-14206) Upgrade zookeeper to 3.7.1 to address security vulnerabilities

2023-02-27 Thread Valeriy Kassenbayev (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Valeriy Kassenbayev updated KAFKA-14206: Fix Version/s: 3.4.1 (was: 3.4.0) > Upgrade zookeeper to 3.

[jira] [Reopened] (KAFKA-14206) Upgrade zookeeper to 3.7.1 to address security vulnerabilities

2023-02-27 Thread Valeriy Kassenbayev (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Valeriy Kassenbayev reopened KAFKA-14206: - Still have the same CVEs reported: {code:java}   ✗ Denial of Service (DoS) [High Se

[GitHub] [kafka] mimaison commented on pull request #13145: MINOR: Remove duplicate empty string check

2023-02-27 Thread via GitHub
mimaison commented on PR #13145: URL: https://github.com/apache/kafka/pull/13145#issuecomment-1446008315 @C0urante can you take a look? Thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] mimaison commented on pull request #13170: MINOR: Remove unused methods in CoreUtils

2023-02-27 Thread via GitHub
mimaison commented on PR #13170: URL: https://github.com/apache/kafka/pull/13170#issuecomment-1446015320 @tombentley can you take a look? Thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

[jira] [Created] (KAFKA-14763) Add integration test for DelegationTokenCommand tool

2023-02-27 Thread Gantigmaa Selenge (Jira)
Gantigmaa Selenge created KAFKA-14763: - Summary: Add integration test for DelegationTokenCommand tool Key: KAFKA-14763 URL: https://issues.apache.org/jira/browse/KAFKA-14763 Project: Kafka

[GitHub] [kafka] tinaselenge commented on pull request #13172: KAFKA-14590: Move DelegationTokenCommand to tools

2023-02-27 Thread via GitHub
tinaselenge commented on PR #13172: URL: https://github.com/apache/kafka/pull/13172#issuecomment-1446056568 Created a Jira issue for adding integration test for this tool later on: https://issues.apache.org/jira/browse/KAFKA-14763 -- This is an automated message from the Apache Git Servic

[GitHub] [kafka] edoardocomar commented on a diff in pull request #13291: KAFKA-14742: Throttle connectors in ExactlyOnceSourceIntegrationTest to fix flakey OOMEs

2023-02-27 Thread via GitHub
edoardocomar commented on code in PR #13291: URL: https://github.com/apache/kafka/pull/13291#discussion_r1118563985 ## connect/runtime/src/test/java/org/apache/kafka/connect/integration/ExactlyOnceSourceIntegrationTest.java: ## @@ -81,6 +81,7 @@ import static org.apache.kafka.

[GitHub] [kafka] edoardocomar commented on a diff in pull request #13291: KAFKA-14742: Throttle connectors in ExactlyOnceSourceIntegrationTest to fix flakey OOMEs

2023-02-27 Thread via GitHub
edoardocomar commented on code in PR #13291: URL: https://github.com/apache/kafka/pull/13291#discussion_r1118569732 ## connect/runtime/src/test/java/org/apache/kafka/connect/integration/ExactlyOnceSourceIntegrationTest.java: ## @@ -266,6 +267,7 @@ public void testPollBoundary()

[GitHub] [kafka] edoardocomar commented on a diff in pull request #13291: KAFKA-14742: Throttle connectors in ExactlyOnceSourceIntegrationTest to fix flakey OOMEs

2023-02-27 Thread via GitHub
edoardocomar commented on code in PR #13291: URL: https://github.com/apache/kafka/pull/13291#discussion_r1118563985 ## connect/runtime/src/test/java/org/apache/kafka/connect/integration/ExactlyOnceSourceIntegrationTest.java: ## @@ -81,6 +81,7 @@ import static org.apache.kafka.

[jira] [Commented] (KAFKA-2967) Move Kafka documentation to ReStructuredText

2023-02-27 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-2967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17693955#comment-17693955 ] Mickael Maison commented on KAFKA-2967: --- Thanks [~jeqo] for picking this up, your P

[GitHub] [kafka] mimaison merged pull request #13145: MINOR: Remove duplicate empty string check

2023-02-27 Thread via GitHub
mimaison merged PR #13145: URL: https://github.com/apache/kafka/pull/13145 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

[GitHub] [kafka] edoardocomar commented on a diff in pull request #13291: KAFKA-14742: Throttle connectors in ExactlyOnceSourceIntegrationTest to fix flakey OOMEs

2023-02-27 Thread via GitHub
edoardocomar commented on code in PR #13291: URL: https://github.com/apache/kafka/pull/13291#discussion_r1118569732 ## connect/runtime/src/test/java/org/apache/kafka/connect/integration/ExactlyOnceSourceIntegrationTest.java: ## @@ -266,6 +267,7 @@ public void testPollBoundary()

[GitHub] [kafka] C0urante commented on pull request #13302: KAFKA-14759: Move Mock, Schema, and Verifiable connectors to new test-plugins module

2023-02-27 Thread via GitHub
C0urante commented on PR #13302: URL: https://github.com/apache/kafka/pull/13302#issuecomment-1446393595 Hey @gharris1727, thanks for the PR. While I personally agree with the rationale here and would be happy to merge the changes, I think this may still require a KIP as it removes connecto

[GitHub] [kafka] C0urante merged pull request #13191: KAFKA-14060: Replace EasyMock and PowerMock with Mockito in AbstractWorkerSourceTaskTest

2023-02-27 Thread via GitHub
C0urante merged PR #13191: URL: https://github.com/apache/kafka/pull/13191 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

[jira] [Commented] (KAFKA-14041) Avoid the keyword var for a variable declaration in ConfigTransformer

2023-02-27 Thread Andras Katona (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17694048#comment-17694048 ] Andras Katona commented on KAFKA-14041: --- Java compiler doesn't mind. {{var}} can b

[jira] [Resolved] (KAFKA-14060) Replace EasyMock and PowerMock with Mockito in AbstractWorkerSourceTaskTest

2023-02-27 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton resolved KAFKA-14060. --- Resolution: Done > Replace EasyMock and PowerMock with Mockito in AbstractWorkerSourceTaskTe

[jira] [Resolved] (KAFKA-14738) Topic disappears from kafka_topic.sh --list after modifying it with kafka_acl.sh

2023-02-27 Thread Andras Katona (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Katona resolved KAFKA-14738. --- Resolution: Not A Bug > Topic disappears from kafka_topic.sh --list after modifying it with

[GitHub] [kafka] rondagostino commented on pull request #13280: KAFKA-14735: Improve KRaft metadata image change performance at high …

2023-02-27 Thread via GitHub
rondagostino commented on PR #13280: URL: https://github.com/apache/kafka/pull/13280#issuecomment-1446491240 The `topicIdInfo` benchmark now performs equivalently. I eliminated the `TranslatedValueMapView` class in favor of adding a value mapper to the `VavrMapAsJava` class. -- This is

[jira] [Resolved] (KAFKA-14387) kafka.common.KafkaException | kafka_2.12-3.3.1.jar

2023-02-27 Thread Andras Katona (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Katona resolved KAFKA-14387. --- Resolution: Information Provided > kafka.common.KafkaException | kafka_2.12-3.3.1.jar > ---

[jira] [Commented] (KAFKA-14387) kafka.common.KafkaException | kafka_2.12-3.3.1.jar

2023-02-27 Thread Andras Katona (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17694068#comment-17694068 ] Andras Katona commented on KAFKA-14387: --- it was removed here: https://github.com/a

[jira] [Created] (KAFKA-14764) Metadata API ignores topic names if at least one topic is provided with an id

2023-02-27 Thread David Jacot (Jira)
David Jacot created KAFKA-14764: --- Summary: Metadata API ignores topic names if at least one topic is provided with an id Key: KAFKA-14764 URL: https://issues.apache.org/jira/browse/KAFKA-14764 Project:

[jira] [Assigned] (KAFKA-14765) Support SCRAM for brokers at bootstrap

2023-02-27 Thread Proven Provenzano (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Proven Provenzano reassigned KAFKA-14765: - Assignee: Proven Provenzano > Support SCRAM for brokers at bootstrap >

[jira] [Created] (KAFKA-14765) Support SCRAM for brokers at bootstrap

2023-02-27 Thread Proven Provenzano (Jira)
Proven Provenzano created KAFKA-14765: - Summary: Support SCRAM for brokers at bootstrap Key: KAFKA-14765 URL: https://issues.apache.org/jira/browse/KAFKA-14765 Project: Kafka Issue Type:

[GitHub] [kafka] dajac commented on pull request #13240: KAFKA-14690: Add topic IDs to OffsetCommit API and propagate for request version >= 9

2023-02-27 Thread via GitHub
dajac commented on PR #13240: URL: https://github.com/apache/kafka/pull/13240#issuecomment-1446539881 @Hangleton Thanks for the update. I will take a look shortly. In the meantime, could you already add a few integration test for the OffsetCommitRequest like we have for the OffsetFetchReque

[jira] [Comment Edited] (KAFKA-14750) Sink connector fails if a topic matching its topics.regex gets deleted

2023-02-27 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17693369#comment-17693369 ] Chris Egerton edited comment on KAFKA-14750 at 2/27/23 3:28 PM: --

[jira] [Commented] (KAFKA-14765) Support SCRAM for brokers at bootstrap

2023-02-27 Thread Proven Provenzano (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17694074#comment-17694074 ] Proven Provenzano commented on KAFKA-14765: --- [KIP-900|https://cwiki.apache.org

[jira] [Commented] (KAFKA-14764) Metadata API ignores topic names if at least one topic is provided with an id

2023-02-27 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17694076#comment-17694076 ] David Jacot commented on KAFKA-14764: - [~dengziming] If I remember correctly, you di

[GitHub] [kafka] hgeraldino commented on pull request #13193: KAFKA-14659 source-record-write-[rate|total] metrics include filtered records

2023-02-27 Thread via GitHub
hgeraldino commented on PR #13193: URL: https://github.com/apache/kafka/pull/13193#issuecomment-1446570858 Thanks @clolov, Now that https://github.com/apache/kafka/pull/13191 has been merged, this PR has been rebased and is ready for review. CC @C0urante -- This is an aut

[jira] [Updated] (KAFKA-14764) Metadata API ignores topic names if at least one topic ID is provided

2023-02-27 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-14764: Summary: Metadata API ignores topic names if at least one topic ID is provided (was: Metadata API

[jira] [Updated] (KAFKA-14764) Metadata API ignores topic names if at least one topic id is provided with an id

2023-02-27 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-14764: Summary: Metadata API ignores topic names if at least one topic id is provided with an id (was: M

[jira] [Updated] (KAFKA-14764) Metadata API ignores topic names if at least one topic is provided with an id

2023-02-27 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-14764: Summary: Metadata API ignores topic names if at least one topic is provided with an id (was: Meta

[GitHub] [kafka] jolshan commented on a diff in pull request #13231: KAFKA-14402: Update AddPartitionsToTxn protocol to batch and handle verifyOnly requests

2023-02-27 Thread via GitHub
jolshan commented on code in PR #13231: URL: https://github.com/apache/kafka/pull/13231#discussion_r1118946985 ## clients/src/main/resources/common/message/AddPartitionsToTxnRequest.json: ## @@ -23,17 +23,39 @@ // Version 2 adds the support for new error code PRODUCER_FENCED.

[GitHub] [kafka] jolshan commented on a diff in pull request #13231: KAFKA-14402: Update AddPartitionsToTxn protocol to batch and handle verifyOnly requests

2023-02-27 Thread via GitHub
jolshan commented on code in PR #13231: URL: https://github.com/apache/kafka/pull/13231#discussion_r1118948279 ## clients/src/main/java/org/apache/kafka/common/requests/AddPartitionsToTxnRequest.java: ## @@ -118,11 +123,78 @@ public AddPartitionsToTxnRequestData data() {

[GitHub] [kafka] jolshan commented on a diff in pull request #13231: KAFKA-14402: Update AddPartitionsToTxn protocol to batch and handle verifyOnly requests

2023-02-27 Thread via GitHub
jolshan commented on code in PR #13231: URL: https://github.com/apache/kafka/pull/13231#discussion_r1118949475 ## clients/src/test/java/org/apache/kafka/clients/producer/internals/TransactionManagerTest.java: ## @@ -1303,11 +1305,13 @@ public void testCommitWithTopicAuthorizati

[GitHub] [kafka] jolshan commented on a diff in pull request #13231: KAFKA-14402: Update AddPartitionsToTxn protocol to batch and handle verifyOnly requests

2023-02-27 Thread via GitHub
jolshan commented on code in PR #13231: URL: https://github.com/apache/kafka/pull/13231#discussion_r1118951636 ## core/src/main/scala/kafka/server/KafkaApis.scala: ## @@ -2384,68 +2385,116 @@ class KafkaApis(val requestChannel: RequestChannel, if (config.interBrokerProtocol

[GitHub] [kafka] jolshan commented on a diff in pull request #13231: KAFKA-14402: Update AddPartitionsToTxn protocol to batch and handle verifyOnly requests

2023-02-27 Thread via GitHub
jolshan commented on code in PR #13231: URL: https://github.com/apache/kafka/pull/13231#discussion_r1118952253 ## core/src/main/scala/kafka/server/KafkaApis.scala: ## @@ -2384,68 +2385,116 @@ class KafkaApis(val requestChannel: RequestChannel, if (config.interBrokerProtocol

[GitHub] [kafka] dajac commented on a diff in pull request #13231: KAFKA-14402: Update AddPartitionsToTxn protocol to batch and handle verifyOnly requests

2023-02-27 Thread via GitHub
dajac commented on code in PR #13231: URL: https://github.com/apache/kafka/pull/13231#discussion_r1118980264 ## core/src/main/scala/kafka/server/KafkaApis.scala: ## @@ -2384,68 +2385,116 @@ class KafkaApis(val requestChannel: RequestChannel, if (config.interBrokerProtocolVe

[GitHub] [kafka] dajac commented on a diff in pull request #13231: KAFKA-14402: Update AddPartitionsToTxn protocol to batch and handle verifyOnly requests

2023-02-27 Thread via GitHub
dajac commented on code in PR #13231: URL: https://github.com/apache/kafka/pull/13231#discussion_r1118981498 ## clients/src/main/resources/common/message/AddPartitionsToTxnRequest.json: ## @@ -23,17 +23,39 @@ // Version 2 adds the support for new error code PRODUCER_FENCED.

[GitHub] [kafka] C0urante commented on a diff in pull request #13276: KAFKA-14732: Use an exponential backoff retry mechanism while reconfiguring connector tasks

2023-02-27 Thread via GitHub
C0urante commented on code in PR #13276: URL: https://github.com/apache/kafka/pull/13276#discussion_r1119036590 ## connect/runtime/src/test/java/org/apache/kafka/connect/runtime/distributed/DistributedHerderTest.java: ## @@ -3694,6 +3694,54 @@ public void shouldThrowWhenStartAn

[jira] [Created] (KAFKA-14766) Improve performance of VarInt encoding/decoding

2023-02-27 Thread Divij Vaidya (Jira)
Divij Vaidya created KAFKA-14766: Summary: Improve performance of VarInt encoding/decoding Key: KAFKA-14766 URL: https://issues.apache.org/jira/browse/KAFKA-14766 Project: Kafka Issue Type: I

[GitHub] [kafka] divijvaidya opened a new pull request, #13312: KAFKA-14766: Improve performance of VarInt encoding and decoding

2023-02-27 Thread via GitHub
divijvaidya opened a new pull request, #13312: URL: https://github.com/apache/kafka/pull/13312 # Motivation Reading/writing the protocol buffer varInt32 and varInt64 (also called varLong in our code base) is in the hot path of data plane code in Apache Kafka. We read multiple varInt in a

[GitHub] [kafka] kirktrue commented on pull request #12813: KAFKA-14317: ProduceRequest timeouts are logged as network exceptions

2023-02-27 Thread via GitHub
kirktrue commented on PR #12813: URL: https://github.com/apache/kafka/pull/12813#issuecomment-1446745731 @dajac I'm having a bit of a hard time figuring out how to test this. Per your previous comments, the `NetworkClient` already issues a request for metadata update when the connecti

[jira] [Commented] (KAFKA-14757) Kafka Cooperative Sticky Assignor results in significant duplicate consumption

2023-02-27 Thread Siddharth Anand (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17694115#comment-17694115 ] Siddharth Anand commented on KAFKA-14757: - Is there documentation that details h

[jira] [Commented] (KAFKA-14757) Kafka Cooperative Sticky Assignor results in significant duplicate consumption

2023-02-27 Thread Philip Nee (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17694119#comment-17694119 ] Philip Nee commented on KAFKA-14757: Hey Sidd, here you go: [https://kafka.apache.o

[GitHub] [kafka] junrao commented on a diff in pull request #13304: KAFKA-14726 Move/rewrite of LogReadInfo, LogOffsetSnapshot, LogStartOffsetIncrementReason to storage module

2023-02-27 Thread via GitHub
junrao commented on code in PR #13304: URL: https://github.com/apache/kafka/pull/13304#discussion_r1119112476 ## core/src/main/scala/kafka/cluster/Partition.scala: ## @@ -1434,13 +1434,13 @@ class Partition(val topicPartition: TopicPartition, minOneMessage ) -L

[GitHub] [kafka] junrao commented on a diff in pull request #13309: MINOR Moved a few log segment util methods from LocalLog to LogFileUtils

2023-02-27 Thread via GitHub
junrao commented on code in PR #13309: URL: https://github.com/apache/kafka/pull/13309#discussion_r1119124556 ## core/src/main/scala/kafka/log/LocalLog.scala: ## @@ -686,40 +685,6 @@ object LocalLog extends Logging { s"${topicPartition.topic}-${topicPartition.partition}"

[GitHub] [kafka] gharris1727 commented on pull request #13302: KAFKA-14759: Move Mock, Schema, and Verifiable connectors to new test-plugins module

2023-02-27 Thread via GitHub
gharris1727 commented on PR #13302: URL: https://github.com/apache/kafka/pull/13302#issuecomment-1446847150 > I think this may still require a KIP as it removes connectors from OOTB Connect. This is included as part of KIP-898: https://cwiki.apache.org/confluence/display/KAFKA/KIP-89

[jira] [Commented] (KAFKA-14762) Remove 0_8_2_LATEST from rolling upgrade system test

2023-02-27 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17694124#comment-17694124 ] Greg Harris commented on KAFKA-14762: - Thanks [~ijuma] for clarifying where the actu

[GitHub] [kafka] C0urante commented on pull request #13302: KAFKA-14759: Move Mock, Schema, and Verifiable connectors to new test-plugins module

2023-02-27 Thread via GitHub
C0urante commented on PR #13302: URL: https://github.com/apache/kafka/pull/13302#issuecomment-1446859760 Ah yes, good point about KIP-898! Nice that we don't have to file a separate KIP for this change. Will revisit if/when KIP-898 passes. -- This is an automated message from the Apache G

[GitHub] [kafka] C0urante commented on pull request #10566: KAFKA-12694 Avoid schema mismatch DataException when validating default values

2023-02-27 Thread via GitHub
C0urante commented on PR #10566: URL: https://github.com/apache/kafka/pull/10566#issuecomment-1446878483 Hi @urbandan, thanks for clarifying the point about using `Schema` methods. Agreed that this would be helpful. I think we should try to keep validation of optionality if possible,

[jira] [Resolved] (KAFKA-14264) Refactor coordinator code

2023-02-27 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True resolved KAFKA-14264. --- Resolution: Fixed [~pnee] can you fill in the details on the fixed versions? Thanks! > Refactor coo

[jira] [Resolved] (KAFKA-14468) Refactor Commit Logic

2023-02-27 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True resolved KAFKA-14468. --- Resolution: Fixed [~pnee] can you fill in the details on the fixed versions? Thanks! > Refactor Com

[jira] [Updated] (KAFKA-14468) Refactor Commit Logic

2023-02-27 Thread Philip Nee (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Philip Nee updated KAFKA-14468: --- Fix Version/s: 3.5.0 > Refactor Commit Logic > - > > Key: KAFKA-

[GitHub] [kafka] C0urante commented on a diff in pull request #13193: KAFKA-14659 source-record-write-[rate|total] metrics include filtered records

2023-02-27 Thread via GitHub
C0urante commented on code in PR #13193: URL: https://github.com/apache/kafka/pull/13193#discussion_r1097934299 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/ConnectMetricsRegistry.java: ## @@ -187,7 +187,8 @@ public ConnectMetricsRegistry(Set tags) {

[jira] [Updated] (KAFKA-14468) Refactor Commit Logic

2023-02-27 Thread Philip Nee (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Philip Nee updated KAFKA-14468: --- Fix Version/s: (was: 3.5.0) > Refactor Commit Logic > - > >

[jira] [Updated] (KAFKA-14264) Refactor coordinator code

2023-02-27 Thread Philip Nee (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Philip Nee updated KAFKA-14264: --- Fix Version/s: 3.4.0 > Refactor coordinator code > - > > Key

[jira] [Updated] (KAFKA-14468) Refactor Commit Logic

2023-02-27 Thread Philip Nee (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Philip Nee updated KAFKA-14468: --- Fix Version/s: 3.5.0 > Refactor Commit Logic > - > > Key: KAFKA-

[jira] [Commented] (KAFKA-14748) Relax non-null FK left-join requirement

2023-02-27 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17694147#comment-17694147 ] Guozhang Wang commented on KAFKA-14748: --- Originally I think this can be treated wi

[GitHub] [kafka] guozhangwang merged pull request #13308: MINOR: update docs of 'replica.socket.receive.buffer.bytes'

2023-02-27 Thread via GitHub
guozhangwang merged PR #13308: URL: https://github.com/apache/kafka/pull/13308 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.ap

[GitHub] [kafka] hgeraldino commented on a diff in pull request #13193: KAFKA-14659 source-record-write-[rate|total] metrics include filtered records

2023-02-27 Thread via GitHub
hgeraldino commented on code in PR #13193: URL: https://github.com/apache/kafka/pull/13193#discussion_r1119214853 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/ConnectMetricsRegistry.java: ## @@ -187,7 +187,8 @@ public ConnectMetricsRegistry(Set tags) {

[GitHub] [kafka] guozhangwang commented on pull request #13308: MINOR: update docs of 'replica.socket.receive.buffer.bytes'

2023-02-27 Thread via GitHub
guozhangwang commented on PR #13308: URL: https://github.com/apache/kafka/pull/13308#issuecomment-1446938946 LGTM. Merging to trunk. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

[GitHub] [kafka] C0urante commented on a diff in pull request #13193: KAFKA-14659 source-record-write-[rate|total] metrics include filtered records

2023-02-27 Thread via GitHub
C0urante commented on code in PR #13193: URL: https://github.com/apache/kafka/pull/13193#discussion_r1119219553 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/ConnectMetricsRegistry.java: ## @@ -187,7 +187,8 @@ public ConnectMetricsRegistry(Set tags) {

[GitHub] [kafka] C0urante commented on a diff in pull request #13193: KAFKA-14659 source-record-write-[rate|total] metrics include filtered records

2023-02-27 Thread via GitHub
C0urante commented on code in PR #13193: URL: https://github.com/apache/kafka/pull/13193#discussion_r1119219553 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/ConnectMetricsRegistry.java: ## @@ -187,7 +187,8 @@ public ConnectMetricsRegistry(Set tags) {

[GitHub] [kafka] hgeraldino commented on a diff in pull request #13193: KAFKA-14659 source-record-write-[rate|total] metrics include filtered records

2023-02-27 Thread via GitHub
hgeraldino commented on code in PR #13193: URL: https://github.com/apache/kafka/pull/13193#discussion_r1119228442 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/ConnectMetricsRegistry.java: ## @@ -187,7 +187,8 @@ public ConnectMetricsRegistry(Set tags) {

[jira] [Commented] (KAFKA-2967) Move Kafka documentation to ReStructuredText

2023-02-27 Thread Jorge Esteban Quilcate Otoya (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-2967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17694156#comment-17694156 ] Jorge Esteban Quilcate Otoya commented on KAFKA-2967: - Thanks [~mimai

[GitHub] [kafka] dajac commented on a diff in pull request #13240: KAFKA-14690: Add topic IDs to OffsetCommit API and propagate for request version >= 9

2023-02-27 Thread via GitHub
dajac commented on code in PR #13240: URL: https://github.com/apache/kafka/pull/13240#discussion_r1119248386 ## clients/src/main/resources/common/message/OffsetCommitRequest.json: ## @@ -47,8 +49,10 @@ "about": "The time period in ms to retain the offset." }, { "name

[GitHub] [kafka] divijvaidya commented on pull request #13307: MINOR: Make ByteUtilsBenchmark deterministic

2023-02-27 Thread via GitHub
divijvaidya commented on PR #13307: URL: https://github.com/apache/kafka/pull/13307#issuecomment-1447001588 @showuon I am discarding this PR as I have included it's changes in https://github.com/apache/kafka/pull/13312 -- This is an automated message from the Apache Git Service. To respo

[GitHub] [kafka] divijvaidya closed pull request #13307: MINOR: Make ByteUtilsBenchmark deterministic

2023-02-27 Thread via GitHub
divijvaidya closed pull request #13307: MINOR: Make ByteUtilsBenchmark deterministic URL: https://github.com/apache/kafka/pull/13307 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

[GitHub] [kafka] gharris1727 opened a new pull request, #13313: KAFKA-14760: Move ThroughputThrottler from tools to clients, remove tools dependency from connect-runtime

2023-02-27 Thread via GitHub
gharris1727 opened a new pull request, #13313: URL: https://github.com/apache/kafka/pull/13313 Currently connect-runtime pulls in tools as a dependency in order to use the ThroughputThrottler. In the future it will be desirable to have tools pull in connect-runtime as a (test) dependency

[GitHub] [kafka] C0urante commented on a diff in pull request #13193: KAFKA-14659 source-record-write-[rate|total] metrics include filtered records

2023-02-27 Thread via GitHub
C0urante commented on code in PR #13193: URL: https://github.com/apache/kafka/pull/13193#discussion_r1119262008 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/ConnectMetricsRegistry.java: ## @@ -187,7 +187,8 @@ public ConnectMetricsRegistry(Set tags) {

[GitHub] [kafka] hgeraldino commented on a diff in pull request #13193: KAFKA-14659 source-record-write-[rate|total] metrics include filtered records

2023-02-27 Thread via GitHub
hgeraldino commented on code in PR #13193: URL: https://github.com/apache/kafka/pull/13193#discussion_r1119279751 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/ConnectMetricsRegistry.java: ## @@ -187,7 +187,8 @@ public ConnectMetricsRegistry(Set tags) {

[GitHub] [kafka] gharris1727 commented on pull request #13291: KAFKA-14742: Throttle connectors in ExactlyOnceSourceIntegrationTest to fix flakey OOMEs

2023-02-27 Thread via GitHub
gharris1727 commented on PR #13291: URL: https://github.com/apache/kafka/pull/13291#issuecomment-1447059390 @edoardocomar I pulled these values out into three separate constants with descriptive names, let me know if this is closer to what you had in mind! -- This is an automated

[GitHub] [kafka] C0urante commented on a diff in pull request #13184: KAFKA-14671: Refactor PredicatedTransformation to not implement Transformation

2023-02-27 Thread via GitHub
C0urante commented on code in PR #13184: URL: https://github.com/apache/kafka/pull/13184#discussion_r1119281474 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/TransformationStage.java: ## @@ -16,63 +16,58 @@ */ package org.apache.kafka.connect.runtime; -i

[jira] [Commented] (KAFKA-14757) Kafka Cooperative Sticky Assignor results in significant duplicate consumption

2023-02-27 Thread Siddharth Anand (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17694182#comment-17694182 ] Siddharth Anand commented on KAFKA-14757: - We follow the pattern below in each c

[GitHub] [kafka] rittikaadhikari opened a new pull request, #13314: [DO NOT MERGE] Sync apache/trunk to confluentinc/kafka master 27-Feb-2023

2023-02-27 Thread via GitHub
rittikaadhikari opened a new pull request, #13314: URL: https://github.com/apache/kafka/pull/13314 Conflicts in Jenkinsfile and build.gradle -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

[GitHub] [kafka] rittikaadhikari closed pull request #13314: [DO NOT MERGE] Sync apache/trunk to confluentinc/kafka master 27-Feb-2023

2023-02-27 Thread via GitHub
rittikaadhikari closed pull request #13314: [DO NOT MERGE] Sync apache/trunk to confluentinc/kafka master 27-Feb-2023 URL: https://github.com/apache/kafka/pull/13314 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Created] (KAFKA-14767) Gradle build fails with missing commitId after git gc

2023-02-27 Thread Greg Harris (Jira)
Greg Harris created KAFKA-14767: --- Summary: Gradle build fails with missing commitId after git gc Key: KAFKA-14767 URL: https://issues.apache.org/jira/browse/KAFKA-14767 Project: Kafka Issue Typ

[jira] [Commented] (KAFKA-14767) Gradle build fails with missing commitId after git gc

2023-02-27 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17694207#comment-17694207 ] Greg Harris commented on KAFKA-14767: - This happens occasionally when git performs a

[GitHub] [kafka] guozhangwang commented on a diff in pull request #13190: KAFKA-12639: exit upon expired timer to prevent tight looping

2023-02-27 Thread via GitHub
guozhangwang commented on code in PR #13190: URL: https://github.com/apache/kafka/pull/13190#discussion_r1119357976 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AbstractCoordinator.java: ## @@ -500,14 +500,22 @@ boolean joinGroupIfNeeded(final Timer timer

[GitHub] [kafka] gharris1727 commented on a diff in pull request #13184: KAFKA-14671: Refactor PredicatedTransformation to not implement Transformation

2023-02-27 Thread via GitHub
gharris1727 commented on code in PR #13184: URL: https://github.com/apache/kafka/pull/13184#discussion_r1119388653 ## connect/runtime/src/test/java/org/apache/kafka/connect/runtime/ErrorHandlingTaskTest.java: ## @@ -531,8 +543,17 @@ private Converter badConverter() { re

[GitHub] [kafka] gharris1727 commented on a diff in pull request #13184: KAFKA-14671: Refactor PredicatedTransformation to not implement Transformation

2023-02-27 Thread via GitHub
gharris1727 commented on code in PR #13184: URL: https://github.com/apache/kafka/pull/13184#discussion_r1119389854 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/ConnectorConfig.java: ## @@ -268,30 +268,30 @@ public boolean includeRecordDetailsInErrorLog() {

[GitHub] [kafka] gharris1727 commented on a diff in pull request #13184: KAFKA-14671: Refactor PredicatedTransformation to not implement Transformation

2023-02-27 Thread via GitHub
gharris1727 commented on code in PR #13184: URL: https://github.com/apache/kafka/pull/13184#discussion_r1119392537 ## connect/runtime/src/test/java/org/apache/kafka/connect/runtime/ConnectorConfigTest.java: ## @@ -280,25 +283,18 @@ public void abstractPredicate() { asse

[GitHub] [kafka] philipnee commented on a diff in pull request #13190: KAFKA-12639: exit upon expired timer to prevent tight looping

2023-02-27 Thread via GitHub
philipnee commented on code in PR #13190: URL: https://github.com/apache/kafka/pull/13190#discussion_r1119397792 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AbstractCoordinator.java: ## @@ -500,14 +500,22 @@ boolean joinGroupIfNeeded(final Timer timer) {

[GitHub] [kafka] philipnee commented on a diff in pull request #13190: KAFKA-12639: exit upon expired timer to prevent tight looping

2023-02-27 Thread via GitHub
philipnee commented on code in PR #13190: URL: https://github.com/apache/kafka/pull/13190#discussion_r1119398074 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/ConsumerCoordinatorTest.java: ## @@ -1484,6 +1484,8 @@ public void testRebalanceWithMetadataChang

[GitHub] [kafka] philipnee commented on a diff in pull request #13190: KAFKA-12639: exit upon expired timer to prevent tight looping

2023-02-27 Thread via GitHub
philipnee commented on code in PR #13190: URL: https://github.com/apache/kafka/pull/13190#discussion_r1119399381 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AbstractCoordinator.java: ## @@ -500,14 +500,22 @@ boolean joinGroupIfNeeded(final Timer timer) {

[GitHub] [kafka] philipnee commented on a diff in pull request #13190: KAFKA-12639: exit upon expired timer to prevent tight looping

2023-02-27 Thread via GitHub
philipnee commented on code in PR #13190: URL: https://github.com/apache/kafka/pull/13190#discussion_r1119399381 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AbstractCoordinator.java: ## @@ -500,14 +500,22 @@ boolean joinGroupIfNeeded(final Timer timer) {

[GitHub] [kafka] philipnee commented on a diff in pull request #13190: KAFKA-12639: exit upon expired timer to prevent tight looping

2023-02-27 Thread via GitHub
philipnee commented on code in PR #13190: URL: https://github.com/apache/kafka/pull/13190#discussion_r1119398074 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/ConsumerCoordinatorTest.java: ## @@ -1484,6 +1484,8 @@ public void testRebalanceWithMetadataChang

[jira] [Commented] (KAFKA-14747) FK join should record discarded subscription responses

2023-02-27 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17694213#comment-17694213 ] Guozhang Wang commented on KAFKA-14747: --- Echoing that, I think we can piggy-back o

[GitHub] [kafka] philipnee commented on a diff in pull request #13190: KAFKA-12639: exit upon expired timer to prevent tight looping

2023-02-27 Thread via GitHub
philipnee commented on code in PR #13190: URL: https://github.com/apache/kafka/pull/13190#discussion_r1119422842 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/ConsumerCoordinatorTest.java: ## @@ -1484,6 +1484,8 @@ public void testRebalanceWithMetadataChang

  1   2   >