[jira] [Created] (KAFKA-13239) Use RocksDB.ingestExternalFile for restoration

2021-08-26 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-13239: - Summary: Use RocksDB.ingestExternalFile for restoration Key: KAFKA-13239 URL: https://issues.apache.org/jira/browse/KAFKA-13239 Project: Kafka Issue Type:

[jira] [Commented] (KAFKA-12882) Add ActiveBrokerCount and FencedBrokerCount metrics (KIP-748)

2021-08-26 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17405630#comment-17405630 ] David Jacot commented on KAFKA-12882: - [~rdielhenn] I have split the ticket into two

[jira] [Assigned] (KAFKA-13238) Add ActiveBrokerCount and FencedBrokerCount metrics to the KRaft controller (KIP-748)

2021-08-26 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot reassigned KAFKA-13238: --- Assignee: (was: David Jacot) > Add ActiveBrokerCount and FencedBrokerCount metrics to t

[jira] [Created] (KAFKA-13238) Add ActiveBrokerCount and FencedBrokerCount metrics to the KRaft controller (KIP-748)

2021-08-26 Thread David Jacot (Jira)
David Jacot created KAFKA-13238: --- Summary: Add ActiveBrokerCount and FencedBrokerCount metrics to the KRaft controller (KIP-748) Key: KAFKA-13238 URL: https://issues.apache.org/jira/browse/KAFKA-13238 P

[jira] [Created] (KAFKA-13237) Add ActiveBrokerCount and FencedBrokerCount metrics to the ZK controller (KIP-748)

2021-08-26 Thread David Jacot (Jira)
David Jacot created KAFKA-13237: --- Summary: Add ActiveBrokerCount and FencedBrokerCount metrics to the ZK controller (KIP-748) Key: KAFKA-13237 URL: https://issues.apache.org/jira/browse/KAFKA-13237 Proj

[jira] [Updated] (KAFKA-12882) Add ActiveBrokerCount and FencedBrokerCount metrics (KIP-748)

2021-08-26 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-12882: Summary: Add ActiveBrokerCount and FencedBrokerCount metrics (KIP-748) (was: Add RegisteredBroker

[jira] [Resolved] (KAFKA-13231) `TransactionalMessageCopier.start_node` should wait until the process if fully started

2021-08-26 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-13231. - Fix Version/s: 3.0.1 2.8.1 3.1.0 Reviewer: Jason G

[GitHub] [kafka] dajac commented on pull request #11264: KAFKA-13231; `TransactionalMessageCopier.start_node` should wait until the process if fully started

2021-08-26 Thread GitBox
dajac commented on pull request #11264: URL: https://github.com/apache/kafka/pull/11264#issuecomment-906960791 Merged to trunk, 3.0 and 2.8. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

[GitHub] [kafka] dajac merged pull request #11264: KAFKA-13231; `TransactionalMessageCopier.start_node` should wait until the process if fully started

2021-08-26 Thread GitBox
dajac merged pull request #11264: URL: https://github.com/apache/kafka/pull/11264 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...

[GitHub] [kafka] dajac merged pull request #11225: MINOR; Small optimizations in `ReplicaManager#becomeLeaderOrFollower`

2021-08-26 Thread GitBox
dajac merged pull request #11225: URL: https://github.com/apache/kafka/pull/11225 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...

[jira] [Commented] (KAFKA-8154) Buffer Overflow exceptions between brokers and with clients

2021-08-26 Thread Binh Van Nguyen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17405612#comment-17405612 ] Binh Van Nguyen commented on KAFKA-8154: [~gordonmessmer] I am using Kafka client

[GitHub] [kafka] ableegoldman commented on pull request #11272: KAFKA-12648: introduce TopologyConfig and TaskConfig for topology-level overrides

2021-08-26 Thread GitBox
ableegoldman commented on pull request #11272: URL: https://github.com/apache/kafka/pull/11272#issuecomment-906922473 @wcarlson5 split the config work out from the Pt. 4 branch, here's the PR as promised. I ended up refactoring things a bit while I was pulling the changes out to make thing

[jira] [Commented] (KAFKA-8154) Buffer Overflow exceptions between brokers and with clients

2021-08-26 Thread Gordon (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17405582#comment-17405582 ] Gordon commented on KAFKA-8154: --- What version of the client library are you using in your a

[jira] [Comment Edited] (KAFKA-8154) Buffer Overflow exceptions between brokers and with clients

2021-08-26 Thread Gordon (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17405582#comment-17405582 ] Gordon edited comment on KAFKA-8154 at 8/27/21, 4:47 AM: - What ve

[GitHub] [kafka] ableegoldman opened a new pull request #11272: KAFKA-12648: introduce TopologyConfig and TaskConfig for topology-level overrides

2021-08-26 Thread GitBox
ableegoldman opened a new pull request #11272: URL: https://github.com/apache/kafka/pull/11272 Most configs that are read and used by Streams today originate from the properties passed in to the KafkaStreams constructor, which means they get applied universally across all threads, tasks, s

[jira] [Commented] (KAFKA-8154) Buffer Overflow exceptions between brokers and with clients

2021-08-26 Thread Binh Van Nguyen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17405568#comment-17405568 ] Binh Van Nguyen commented on KAFKA-8154: I also faced this issue. In may case, th

[GitHub] [kafka] dielhennr commented on pull request #10463: KAFKA-12670: support unclean.leader.election.enable in KRaft mode

2021-08-26 Thread GitBox
dielhennr commented on pull request #10463: URL: https://github.com/apache/kafka/pull/10463#issuecomment-906901483 @junrao I don't have write access to this fork which is why I stacked my PR onto this one instead of committing. My PR has no conflicts with this branch so it should be mergea

[GitHub] [kafka] mjsax opened a new pull request #11271: KAFKA-13236: TopologyTestDriver should not crash for EOS-beta config

2021-08-26 Thread GitBox
mjsax opened a new pull request #11271: URL: https://github.com/apache/kafka/pull/11271 Already fixed in `trunk`/`3.0`. @dajac can we include this in 2.8.1 bug-fix release? Call for review @ableegoldman -- This is an automated message from the Apache Git Service. To respond

[jira] [Assigned] (KAFKA-13236) TopologyTestDriver crashes with EOS-beta config

2021-08-26 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-13236: --- Assignee: Matthias J. Sax > TopologyTestDriver crashes with EOS-beta config > -

[jira] [Created] (KAFKA-13236) TopologyTestDriver crashes with EOS-beta config

2021-08-26 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-13236: --- Summary: TopologyTestDriver crashes with EOS-beta config Key: KAFKA-13236 URL: https://issues.apache.org/jira/browse/KAFKA-13236 Project: Kafka Issue T

[GitHub] [kafka] ableegoldman merged pull request #11263: MINOR: remove unused Properties from GraphNode#writeToTopology

2021-08-26 Thread GitBox
ableegoldman merged pull request #11263: URL: https://github.com/apache/kafka/pull/11263 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsu

[GitHub] [kafka] ableegoldman commented on pull request #11263: MINOR: remove unused Properties from GraphNode#writeToTopology

2021-08-26 Thread GitBox
ableegoldman commented on pull request #11263: URL: https://github.com/apache/kafka/pull/11263#issuecomment-906828133 Two unrelated flaky test failures in the original build (`ControllerIntegrationTest.testPartitionReassignmentToBrokerWithOfflineLogDir` and `TransactionsTest.testCommitTran

[GitHub] [kafka] ccding opened a new pull request #11270: MINOR: print debug log for InvalidRequestException

2021-08-26 Thread GitBox
ccding opened a new pull request #11270: URL: https://github.com/apache/kafka/pull/11270 InvalidRequestException is not an error case -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

[GitHub] [kafka] guozhangwang merged pull request #11181: MINOR: optimize the OrderedBytes#upperRange for not all query cases

2021-08-26 Thread GitBox
guozhangwang merged pull request #11181: URL: https://github.com/apache/kafka/pull/11181 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsu

[GitHub] [kafka] guozhangwang commented on pull request #11181: MINOR: optimize the OrderedBytes#upperRange for not all query cases

2021-08-26 Thread GitBox
guozhangwang commented on pull request #11181: URL: https://github.com/apache/kafka/pull/11181#issuecomment-906759194 Thanks for confirming, in that case it LGTM. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[GitHub] [kafka] guozhangwang commented on a change in pull request #11228: KAFKA-12887 Skip some RuntimeExceptions from exception handler

2021-08-26 Thread GitBox
guozhangwang commented on a change in pull request #11228: URL: https://github.com/apache/kafka/pull/11228#discussion_r696990858 ## File path: streams/src/main/java/org/apache/kafka/streams/KafkaStreams.java ## @@ -495,9 +498,25 @@ private void replaceStreamThread(final Throwab

[GitHub] [kafka] guozhangwang commented on pull request #11228: KAFKA-12887 Skip some RuntimeExceptions from exception handler

2021-08-26 Thread GitBox
guozhangwang commented on pull request #11228: URL: https://github.com/apache/kafka/pull/11228#issuecomment-906753112 > But it doesn't seem related to the changes in this PR. I would say it seems a newly found regression (there isn't a ticket yet). Any opinions @cadonna @guozhangwang ?

[GitHub] [kafka] guozhangwang commented on a change in pull request #11228: KAFKA-12887 Skip some RuntimeExceptions from exception handler

2021-08-26 Thread GitBox
guozhangwang commented on a change in pull request #11228: URL: https://github.com/apache/kafka/pull/11228#discussion_r696987413 ## File path: streams/src/main/java/org/apache/kafka/streams/KafkaStreams.java ## @@ -495,9 +498,25 @@ private void replaceStreamThread(final Throwab

[GitHub] [kafka] guozhangwang commented on pull request #11228: KAFKA-12887 Skip some RuntimeExceptions from exception handler

2021-08-26 Thread GitBox
guozhangwang commented on pull request #11228: URL: https://github.com/apache/kafka/pull/11228#issuecomment-906751797 > Wouldn't it suffice to check the throwable variable in KafkaStreams#handleStreamsUncaughtException() before line 500 where the user-specified exception handler is execute

[GitHub] [kafka] hachikuji commented on pull request #11267: KAFKA-13234; Transaction system test should clear URPs after broker restarts

2021-08-26 Thread GitBox
hachikuji commented on pull request #11267: URL: https://github.com/apache/kafka/pull/11267#issuecomment-906734741 Successful test run for `group_transactions_test.py`: http://confluent-kafka-branch-builder-system-test-results.s3-us-west-2.amazonaws.com/2021-08-26--001.system-test-kafka-bra

[jira] [Commented] (KAFKA-13234) Transaction system tests should check URPs between broker bounces

2021-08-26 Thread Lucas Bradstreet (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17405454#comment-17405454 ] Lucas Bradstreet commented on KAFKA-13234: -- We do something similar in upgrade_

[GitHub] [kafka] junrao merged pull request #11253: MINOR: Improve local variable name in UnifiedLog.maybeIncrementFirstUnstableOffset

2021-08-26 Thread GitBox
junrao merged pull request #11253: URL: https://github.com/apache/kafka/pull/11253 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr..

[GitHub] [kafka] dajac commented on pull request #11264: KAFKA-13231; `TransactionalMessageCopier.start_node` should wait until the process if fully started

2021-08-26 Thread GitBox
dajac commented on pull request #11264: URL: https://github.com/apache/kafka/pull/11264#issuecomment-906709897 Successful run: http://confluent-kafka-branch-builder-system-test-results.s3-us-west-2.amazonaws.com/2021-08-26--001.system-test-kafka-branch-builder--1630007187--dajac--KAFKA-1323

[GitHub] [kafka] hachikuji commented on pull request #11267: KAFKA-13234; Transaction system test should clear URPs after broker restarts

2021-08-26 Thread GitBox
hachikuji commented on pull request #11267: URL: https://github.com/apache/kafka/pull/11267#issuecomment-906705794 Successful test run for `transactions_test.py`: http://confluent-kafka-branch-builder-system-test-results.s3-us-west-2.amazonaws.com/2021-08-26--001.system-test-kafka-branch-bu

[GitHub] [kafka] hachikuji removed a comment on pull request #11268: MINOR: Ensure transactional message copier failures are logged

2021-08-26 Thread GitBox
hachikuji removed a comment on pull request #11268: URL: https://github.com/apache/kafka/pull/11268#issuecomment-906702297 Successful test run for `transactions_test.py`: http://confluent-kafka-branch-builder-system-test-results.s3-us-west-2.amazonaws.com/2021-08-26--001.system-test-kafka-b

[GitHub] [kafka] hachikuji commented on pull request #11268: MINOR: Ensure transactional message copier failures are logged

2021-08-26 Thread GitBox
hachikuji commented on pull request #11268: URL: https://github.com/apache/kafka/pull/11268#issuecomment-906702297 Successful test run for `transactions_test.py`: http://confluent-kafka-branch-builder-system-test-results.s3-us-west-2.amazonaws.com/2021-08-26--001.system-test-kafka-branch-bu

[GitHub] [kafka] kowshik commented on pull request #11253: MINOR: Improve local variable name in UnifiedLog.maybeIncrementFirstUnstableOffset

2021-08-26 Thread GitBox
kowshik commented on pull request #11253: URL: https://github.com/apache/kafka/pull/11253#issuecomment-906698169 cc @lbradstreet -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

[GitHub] [kafka] jlprat commented on pull request #11228: KAFKA-12887 Skip some RuntimeExceptions from exception handler

2021-08-26 Thread GitBox
jlprat commented on pull request #11228: URL: https://github.com/apache/kafka/pull/11228#issuecomment-90213 Current failure is https://ci-builds.apache.org/job/Kafka/job/kafka-pr/job/PR-11228/5/testReport/org.apache.kafka.streams.integration/NamedTopologyIntegrationTest/Build___JDK_8_an

[GitHub] [kafka] dajac commented on pull request #11264: KAFKA-13231; `TransactionalMessageCopier.start_node` should wait until the process if fully started

2021-08-26 Thread GitBox
dajac commented on pull request #11264: URL: https://github.com/apache/kafka/pull/11264#issuecomment-906665382 New run to validate: https://jenkins.confluent.io/job/system-test-kafka-branch-builder/4665/ -- This is an automated message from the Apache Git Service. To respond to the messa

[GitHub] [kafka] dajac commented on pull request #11264: KAFKA-13231; `TransactionalMessageCopier.start_node` should wait until the process if fully started

2021-08-26 Thread GitBox
dajac commented on pull request #11264: URL: https://github.com/apache/kafka/pull/11264#issuecomment-906664923 @hachikuji updated the PR to add the node to the error message. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub an

[GitHub] [kafka] dajac commented on a change in pull request #11265: MINOR: Update `TransactionalMessageCopier` to use the latest transaction pattern

2021-08-26 Thread GitBox
dajac commented on a change in pull request #11265: URL: https://github.com/apache/kafka/pull/11265#discussion_r696899123 ## File path: tools/src/main/java/org/apache/kafka/tools/TransactionalMessageCopier.java ## @@ -361,7 +361,7 @@ public void onPartitionsAssigned(Collection

[jira] [Commented] (KAFKA-13227) Cancel pending AlterIsr requests after receiving LeaderAndIsr

2021-08-26 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17405420#comment-17405420 ] Jason Gustafson commented on KAFKA-13227: - [~christo_lolov] Thanks, feel free to

[GitHub] [kafka] hachikuji commented on a change in pull request #11267: KAFKA-13234; Transaction system test should clear URPs after broker restarts

2021-08-26 Thread GitBox
hachikuji commented on a change in pull request #11267: URL: https://github.com/apache/kafka/pull/11267#discussion_r696889046 ## File path: tests/kafkatest/tests/core/transactions_test.py ## @@ -108,6 +108,10 @@ def bounce_brokers(self, clean_shutdown): tim

[GitHub] [kafka] hachikuji opened a new pull request #11268: MINOR: Ensure transactional message copier failures are logged

2021-08-26 Thread GitBox
hachikuji opened a new pull request #11268: URL: https://github.com/apache/kafka/pull/11268 This patch has a couple small improvements to `TransactionalMessageCopier` logging: - Log all fatal exceptions which cause the copier to shutdown unexpectedly - Log all non-fatal exceptions

[GitHub] [kafka] ijuma commented on a change in pull request #11267: KAFKA-13234; Transaction system test should clear URPs after broker restarts

2021-08-26 Thread GitBox
ijuma commented on a change in pull request #11267: URL: https://github.com/apache/kafka/pull/11267#discussion_r69688 ## File path: tests/kafkatest/tests/core/transactions_test.py ## @@ -108,6 +108,10 @@ def bounce_brokers(self, clean_shutdown): time.sl

[GitHub] [kafka] ijuma commented on a change in pull request #11267: KAFKA-13234; Transaction system test should clear URPs after broker restarts

2021-08-26 Thread GitBox
ijuma commented on a change in pull request #11267: URL: https://github.com/apache/kafka/pull/11267#discussion_r696883461 ## File path: tests/kafkatest/tests/core/transactions_test.py ## @@ -108,6 +108,10 @@ def bounce_brokers(self, clean_shutdown): time.sl

[GitHub] [kafka] hachikuji commented on a change in pull request #11267: KAFKA-13234; Transaction system test should clear URPs after broker restarts

2021-08-26 Thread GitBox
hachikuji commented on a change in pull request #11267: URL: https://github.com/apache/kafka/pull/11267#discussion_r696881720 ## File path: tests/kafkatest/tests/core/transactions_test.py ## @@ -108,6 +108,10 @@ def bounce_brokers(self, clean_shutdown): tim

[jira] [Created] (KAFKA-13235) Add support for static groups to transaction system tests

2021-08-26 Thread Jason Gustafson (Jira)
Jason Gustafson created KAFKA-13235: --- Summary: Add support for static groups to transaction system tests Key: KAFKA-13235 URL: https://issues.apache.org/jira/browse/KAFKA-13235 Project: Kafka

[GitHub] [kafka] hachikuji commented on a change in pull request #11265: MINOR: Update `TransactionalMessageCopier` to use the latest transaction pattern

2021-08-26 Thread GitBox
hachikuji commented on a change in pull request #11265: URL: https://github.com/apache/kafka/pull/11265#discussion_r696878332 ## File path: tools/src/main/java/org/apache/kafka/tools/TransactionalMessageCopier.java ## @@ -361,7 +361,7 @@ public void onPartitionsAssigned(Collec

[GitHub] [kafka] ijuma commented on a change in pull request #11267: KAFKA-13234; Transaction system test should clear URPs after broker restarts

2021-08-26 Thread GitBox
ijuma commented on a change in pull request #11267: URL: https://github.com/apache/kafka/pull/11267#discussion_r696876840 ## File path: tests/kafkatest/tests/core/transactions_test.py ## @@ -108,6 +108,10 @@ def bounce_brokers(self, clean_shutdown): time.sl

[GitHub] [kafka] hachikuji commented on a change in pull request #11266: KAFKA-13233 Log zkVersion in more places

2021-08-26 Thread GitBox
hachikuji commented on a change in pull request #11266: URL: https://github.com/apache/kafka/pull/11266#discussion_r696875779 ## File path: core/src/main/scala/kafka/controller/KafkaController.scala ## @@ -2344,17 +2344,17 @@ class KafkaController(val config: KafkaConfig,

[GitHub] [kafka] hachikuji opened a new pull request #11267: KAFKA-13234; Transaction system test should clear URPs after broker restarts

2021-08-26 Thread GitBox
hachikuji opened a new pull request #11267: URL: https://github.com/apache/kafka/pull/11267 Clearing under-replicated-partitions helps ensure that partitions do not become unavailable longer than necessary as brokers are rolled. This prevents flakiness due to transaction timeouts. #

[GitHub] [kafka] hachikuji commented on a change in pull request #11266: KAFKA-13233 Log zkVersion in more places

2021-08-26 Thread GitBox
hachikuji commented on a change in pull request #11266: URL: https://github.com/apache/kafka/pull/11266#discussion_r696859115 ## File path: core/src/main/scala/kafka/controller/PartitionStateMachine.scala ## @@ -437,6 +437,11 @@ class ZkPartitionStateMachine(config: KafkaConfig

[GitHub] [kafka] mumrah commented on pull request #11266: KAFKA-13233 Log zkVersion in more places

2021-08-26 Thread GitBox
mumrah commented on pull request #11266: URL: https://github.com/apache/kafka/pull/11266#issuecomment-906622164 > A side question is whether any of the zk updates in ReplicaStateMachine and PartitionStateMachine need similar enhancements? Added a debug of the partitions to retry in t

[jira] [Created] (KAFKA-13234) Transaction system tests should check URPs between broker bounces

2021-08-26 Thread Jason Gustafson (Jira)
Jason Gustafson created KAFKA-13234: --- Summary: Transaction system tests should check URPs between broker bounces Key: KAFKA-13234 URL: https://issues.apache.org/jira/browse/KAFKA-13234 Project: Kafk

[GitHub] [kafka] jolshan commented on pull request #11073: KAFKA-13092: Perf regression in LISR requests

2021-08-26 Thread GitBox
jolshan commented on pull request #11073: URL: https://github.com/apache/kafka/pull/11073#issuecomment-906611414 Ok will do. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [kafka] dajac commented on pull request #11073: KAFKA-13092: Perf regression in LISR requests

2021-08-26 Thread GitBox
dajac commented on pull request #11073: URL: https://github.com/apache/kafka/pull/11073#issuecomment-906600948 @jolshan All tests failed, again. I think that you have to rebase to include the fix. -- This is an automated message from the Apache Git Service. To respond to the message, ple

[GitHub] [kafka] hachikuji commented on a change in pull request #11266: KAFKA-13233 Log zkVersion in more places

2021-08-26 Thread GitBox
hachikuji commented on a change in pull request #11266: URL: https://github.com/apache/kafka/pull/11266#discussion_r696830865 ## File path: core/src/main/scala/kafka/controller/KafkaController.scala ## @@ -2345,14 +2345,14 @@ class KafkaController(val config: KafkaConfig,

[GitHub] [kafka] mumrah opened a new pull request #11266: KAFKA-13233 Log zkVersion in more places

2021-08-26 Thread GitBox
mumrah opened a new pull request #11266: URL: https://github.com/apache/kafka/pull/11266 When debugging issues with partition state, it's very useful to know the zkVersion that was written. This patch adds the zkVersion of LeaderAndIsr in a few more places. -- This is an automated messa

[GitHub] [kafka] dajac commented on a change in pull request #11265: MINOR: Update `TransactionalMessageCopier` to use the latest transaction pattern

2021-08-26 Thread GitBox
dajac commented on a change in pull request #11265: URL: https://github.com/apache/kafka/pull/11265#discussion_r696818318 ## File path: tools/src/main/java/org/apache/kafka/tools/TransactionalMessageCopier.java ## @@ -361,7 +361,7 @@ public void onPartitionsAssigned(Collection

[GitHub] [kafka] hachikuji commented on a change in pull request #11265: MINOR: Update `TransactionalMessageCopier` to use the latest transaction pattern

2021-08-26 Thread GitBox
hachikuji commented on a change in pull request #11265: URL: https://github.com/apache/kafka/pull/11265#discussion_r696814285 ## File path: tools/src/main/java/org/apache/kafka/tools/TransactionalMessageCopier.java ## @@ -361,7 +361,7 @@ public void onPartitionsAssigned(Collec

[GitHub] [kafka] hachikuji commented on a change in pull request #11264: KAFKA-13231; `TransactionalMessageCopier.start_node` should wait until the process if fully started

2021-08-26 Thread GitBox
hachikuji commented on a change in pull request #11264: URL: https://github.com/apache/kafka/pull/11264#discussion_r696813850 ## File path: tests/kafkatest/services/transactional_message_copier.py ## @@ -159,12 +159,16 @@ def pids(self, node): def alive(self, node):

[jira] [Created] (KAFKA-13233) Log the partition state zkVersion in more places in the controller

2021-08-26 Thread David Arthur (Jira)
David Arthur created KAFKA-13233: Summary: Log the partition state zkVersion in more places in the controller Key: KAFKA-13233 URL: https://issues.apache.org/jira/browse/KAFKA-13233 Project: Kafka

[GitHub] [kafka] dajac commented on a change in pull request #11265: MINOR: Update `TransactionalMessageCopier` to use the latest transaction pattern

2021-08-26 Thread GitBox
dajac commented on a change in pull request #11265: URL: https://github.com/apache/kafka/pull/11265#discussion_r696812903 ## File path: tools/src/main/java/org/apache/kafka/tools/TransactionalMessageCopier.java ## @@ -361,7 +361,7 @@ public void onPartitionsAssigned(Collection

[GitHub] [kafka] hachikuji commented on a change in pull request #11265: MINOR: Update `TransactionalMessageCopier` to use the latest transaction pattern

2021-08-26 Thread GitBox
hachikuji commented on a change in pull request #11265: URL: https://github.com/apache/kafka/pull/11265#discussion_r696810930 ## File path: tools/src/main/java/org/apache/kafka/tools/TransactionalMessageCopier.java ## @@ -361,7 +361,7 @@ public void onPartitionsAssigned(Collec

[GitHub] [kafka] jlprat commented on a change in pull request #11228: KAFKA-12887 Skip some RuntimeExceptions from exception handler

2021-08-26 Thread GitBox
jlprat commented on a change in pull request #11228: URL: https://github.com/apache/kafka/pull/11228#discussion_r696809049 ## File path: streams/src/test/java/org/apache/kafka/streams/integration/EmitOnChangeIntegrationTest.java ## @@ -104,7 +104,7 @@ public void shouldEmitSam

[GitHub] [kafka] junrao commented on pull request #10463: KAFKA-12670: support unclean.leader.election.enable in KRaft mode

2021-08-26 Thread GitBox
junrao commented on pull request #10463: URL: https://github.com/apache/kafka/pull/10463#issuecomment-906572591 Thanks @dielhennr . Could you rebase this PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[GitHub] [kafka] jlprat commented on pull request #11228: KAFKA-12887 Skip some RuntimeExceptions from exception handler

2021-08-26 Thread GitBox
jlprat commented on pull request #11228: URL: https://github.com/apache/kafka/pull/11228#issuecomment-906570612 Tests failures seem related, I will investigate them -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [kafka] jlprat closed pull request #11228: KAFKA-12887 Skip some RuntimeExceptions from exception handler

2021-08-26 Thread GitBox
jlprat closed pull request #11228: URL: https://github.com/apache/kafka/pull/11228 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr..

[GitHub] [kafka] junrao commented on a change in pull request #11060: MINOR Refactored the existing CheckpointFile in core module, moved to server-common module and introduced it as SnapshotFile.

2021-08-26 Thread GitBox
junrao commented on a change in pull request #11060: URL: https://github.com/apache/kafka/pull/11060#discussion_r696789655 ## File path: server-common/src/main/java/org/apache/kafka/server/common/SnapshotFile.java ## @@ -0,0 +1,198 @@ +/* + * Licensed to the Apache Software Fo

[GitHub] [kafka] dajac commented on pull request #11073: KAFKA-13092: Perf regression in LISR requests

2021-08-26 Thread GitBox
dajac commented on pull request #11073: URL: https://github.com/apache/kafka/pull/11073#issuecomment-906522684 > I think you may be able to just restart the build. (I think only committers can do that). If that doesn't work, I'll rebase. Done, thanks. -- This is an automated messa

[GitHub] [kafka] jasonyanwenl commented on a change in pull request #11241: KAFKA-13032: add NPE checker for KeyValueMapper

2021-08-26 Thread GitBox
jasonyanwenl commented on a change in pull request #11241: URL: https://github.com/apache/kafka/pull/11241#discussion_r696737354 ## File path: streams/src/test/java/org/apache/kafka/streams/kstream/internals/KStreamFlatMapTest.java ## @@ -86,4 +88,12 @@ public void testFlatMap

[GitHub] [kafka] jolshan commented on pull request #11073: KAFKA-13092: Perf regression in LISR requests

2021-08-26 Thread GitBox
jolshan commented on pull request #11073: URL: https://github.com/apache/kafka/pull/11073#issuecomment-906500017 I think you may be able to just restart the build. (I think only committers can do that). If that doesn't work, I'll rebase. -- This is an automated message from the Apache Gi

[GitHub] [kafka] ccding commented on pull request #11110: MINOR: move tiered storage related configs to a separate class within LogConfig

2021-08-26 Thread GitBox
ccding commented on pull request #0: URL: https://github.com/apache/kafka/pull/0#issuecomment-906457166 Thank you @satishd Addressed your comments. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[GitHub] [kafka] 0x1991babe closed pull request #11014: MINOR: Add default for EndOffset and Epoch in FetchSnapshotResponse.

2021-08-26 Thread GitBox
0x1991babe closed pull request #11014: URL: https://github.com/apache/kafka/pull/11014 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubs

[GitHub] [kafka] showuon commented on pull request #11242: [WIP] MINOR: POC for KIP-591: Add config to set default store impl class

2021-08-26 Thread GitBox
showuon commented on pull request #11242: URL: https://github.com/apache/kafka/pull/11242#issuecomment-906431308 @mjsax @vvcephei @guozhangwang , could you have a look at this POC when available? I need your advice before I can update the KIP and continue to the DISCUSS/VOTE process. Thank

[GitHub] [kafka] jlprat commented on pull request #11228: KAFKA-12887 Skip some RuntimeExceptions from exception handler

2021-08-26 Thread GitBox
jlprat commented on pull request #11228: URL: https://github.com/apache/kafka/pull/11228#issuecomment-906397381 Ping @cadonna and @guozhangwang Let me know what you think about this version. Thanks! -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [kafka] jlprat commented on a change in pull request #11228: KAFKA-12887 Skip some RuntimeExceptions from exception handler

2021-08-26 Thread GitBox
jlprat commented on a change in pull request #11228: URL: https://github.com/apache/kafka/pull/11228#discussion_r696609988 ## File path: streams/src/main/java/org/apache/kafka/streams/KafkaStreams.java ## @@ -495,9 +498,25 @@ private void replaceStreamThread(final Throwable th

[GitHub] [kafka] showuon commented on a change in pull request #11242: [WIP] MINOR: POC for KIP-591: Add config to set default store impl class

2021-08-26 Thread GitBox
showuon commented on a change in pull request #11242: URL: https://github.com/apache/kafka/pull/11242#discussion_r696592661 ## File path: streams/src/test/java/org/apache/kafka/streams/KafkaStreamsTest.java ## @@ -1066,12 +1068,22 @@ private Topology getStatefulTopology(final S

[GitHub] [kafka] dajac commented on pull request #11073: KAFKA-13092: Perf regression in LISR requests

2021-08-26 Thread GitBox
dajac commented on pull request #11073: URL: https://github.com/apache/kafka/pull/11073#issuecomment-906334811 Do you need to rebase the PR to include it? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [kafka] dajac commented on pull request #11264: KAFKA-13231; `TransactionalMessageCopier.start_node` should wait until the process if fully started

2021-08-26 Thread GitBox
dajac commented on pull request #11264: URL: https://github.com/apache/kafka/pull/11264#issuecomment-906316909 > Transactions system tests: https://jenkins.confluent.io/job/system-test-kafka-branch-builder/4663/ All tests have passed: http://confluent-kafka-branch-builder-system-tes

[jira] [Updated] (KAFKA-13232) UnknownTopicOrPartitionException for loading topic during broker startup.

2021-08-26 Thread Pranciskus Gecas (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pranciskus Gecas updated KAFKA-13232: - Priority: Minor (was: Major) > UnknownTopicOrPartitionException for loading topic durin

[jira] [Created] (KAFKA-13232) UnknownTopicOrPartitionException for loading topic during broker startup.

2021-08-26 Thread Pranciskus Gecas (Jira)
Pranciskus Gecas created KAFKA-13232: Summary: UnknownTopicOrPartitionException for loading topic during broker startup. Key: KAFKA-13232 URL: https://issues.apache.org/jira/browse/KAFKA-13232 Pro

[GitHub] [kafka] dajac opened a new pull request #11265: MINOR: Update `TransactionalMessageCopier` to use the latest transaction pattern

2021-08-26 Thread GitBox
dajac opened a new pull request #11265: URL: https://github.com/apache/kafka/pull/11265 `ExactlyOnceMessageProcessor` is the reference so this patch updates `TransactionalMessageCopier` to be similar. ### Committer Checklist (excluded from commit message) - [ ] Verify design and i

[GitHub] [kafka] dajac commented on pull request #11264: KAFKA-13231; `TransactionalMessageCopier.start_node` should wait until the process if fully started

2021-08-26 Thread GitBox
dajac commented on pull request #11264: URL: https://github.com/apache/kafka/pull/11264#issuecomment-90626 Transactions system tests: https://jenkins.confluent.io/job/system-test-kafka-branch-builder/4663/ -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [kafka] dajac opened a new pull request #11264: KAFKA-13231; `TransactionalMessageCopier.start_node` should wait until the process if fully started

2021-08-26 Thread GitBox
dajac opened a new pull request #11264: URL: https://github.com/apache/kafka/pull/11264 ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI build status - [ ] Verify documentation (including upgrade

[jira] [Created] (KAFKA-13231) `TransactionalMessageCopier.start_node` should wait until the process if fully started

2021-08-26 Thread David Jacot (Jira)
David Jacot created KAFKA-13231: --- Summary: `TransactionalMessageCopier.start_node` should wait until the process if fully started Key: KAFKA-13231 URL: https://issues.apache.org/jira/browse/KAFKA-13231

[GitHub] [kafka] satishd commented on pull request #11110: MINOR: move tiered storage related configs to a separate class within LogConfig

2021-08-26 Thread GitBox
satishd commented on pull request #0: URL: https://github.com/apache/kafka/pull/0#issuecomment-906243973 @junrao The intention of the PR looks reasonable to me. I left a comment [here](https://github.com/apache/kafka/pull/0#discussion_r696454031) on one of the changes. --

[GitHub] [kafka] satishd commented on a change in pull request #11110: MINOR: move tiered storage related configs to a separate class within LogConfig

2021-08-26 Thread GitBox
satishd commented on a change in pull request #0: URL: https://github.com/apache/kafka/pull/0#discussion_r696454031 ## File path: storage/src/main/java/org/apache/kafka/server/log/remote/storage/RemoteLogManagerConfig.java ## @@ -253,9 +253,9 @@ public RemoteLogManager

[GitHub] [kafka] showuon commented on a change in pull request #9858: KAFKA-12173 Migrate streams:streams-scala module to JUnit 5

2021-08-26 Thread GitBox
showuon commented on a change in pull request #9858: URL: https://github.com/apache/kafka/pull/9858#discussion_r696447534 ## File path: streams/src/test/java/org/apache/kafka/streams/integration/AdjustStreamThreadCountTest.java ## @@ -75,9 +76,19 @@ @Category(IntegrationTest.

[jira] [Created] (KAFKA-13230) port EmbeddedKafkaCluster back to auto clean up way

2021-08-26 Thread Luke Chen (Jira)
Luke Chen created KAFKA-13230: - Summary: port EmbeddedKafkaCluster back to auto clean up way Key: KAFKA-13230 URL: https://issues.apache.org/jira/browse/KAFKA-13230 Project: Kafka Issue Type: Imp

[GitHub] [kafka] cadonna commented on pull request #11228: KAFKA-12887 Skip some RuntimeExceptions from exception handler

2021-08-26 Thread GitBox
cadonna commented on pull request #11228: URL: https://github.com/apache/kafka/pull/11228#issuecomment-906227809 @guozhangwang What do you mean exactly by "this would require us to add another private function like handleStreamsUncaughtException(StreamThreadExceptionResponse)"? Wouldn'

[GitHub] [kafka] cadonna commented on pull request #11241: KAFKA-13032: add NPE checker for KeyValueMapper

2021-08-26 Thread GitBox
cadonna commented on pull request #11241: URL: https://github.com/apache/kafka/pull/11241#issuecomment-906204832 > > Thanks for the PR @jasonyanwenl ! > > Here my feedback! > > I think we should consider to introduce a specific exception for exceptions that originate from user code. S

[GitHub] [kafka] cadonna commented on a change in pull request #11241: KAFKA-13032: add NPE checker for KeyValueMapper

2021-08-26 Thread GitBox
cadonna commented on a change in pull request #11241: URL: https://github.com/apache/kafka/pull/11241#discussion_r696409669 ## File path: streams/src/test/java/org/apache/kafka/streams/kstream/internals/KStreamFlatMapTest.java ## @@ -86,4 +88,12 @@ public void testFlatMap() {

[GitHub] [kafka] dajac commented on pull request #11104: KAFKA-13079: Forgotten Topics in Fetch Requests may incorrectly use topic IDs

2021-08-26 Thread GitBox
dajac commented on pull request #11104: URL: https://github.com/apache/kafka/pull/11104#issuecomment-906181988 Started a new build. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

[GitHub] [kafka] showuon commented on a change in pull request #11227: KAFKA-13211: add support for infinite range query for WindowStore

2021-08-26 Thread GitBox
showuon commented on a change in pull request #11227: URL: https://github.com/apache/kafka/pull/11227#discussion_r696369857 ## File path: streams/src/main/java/org/apache/kafka/streams/state/internals/AbstractRocksDBSegmentedBytesStore.java ## @@ -124,8 +124,8 @@ fi

[GitHub] [kafka] showuon commented on pull request #11227: KAFKA-13211: add support for infinite range query for WindowStore

2021-08-26 Thread GitBox
showuon commented on pull request #11227: URL: https://github.com/apache/kafka/pull/11227#issuecomment-906167845 @patrickstuedi , thanks for the comments. I've addressed all your comments and add test coverage. Please take a look again. Thank you. -- This is an automated message from the

[jira] [Commented] (KAFKA-13227) Cancel pending AlterIsr requests after receiving LeaderAndIsr

2021-08-26 Thread Christo Lolov (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17405006#comment-17405006 ] Christo Lolov commented on KAFKA-13227: --- Hello, I would be interested in picking