[GitHub] [kafka] ijuma commented on pull request #8936: KAFKA-10207: Fixed padded timeindex causing premature data deletion

2020-07-27 Thread GitBox
ijuma commented on pull request #8936: URL: https://github.com/apache/kafka/pull/8936#issuecomment-664203022 It would be useful to provide a summary of where we are with this. Do we have a consensus on what's needed to get this to a state where it can be merged? --

[GitHub] [kafka] ijuma commented on pull request #9082: MINOR: Update dependencies for Kafka 2.7 (part 1)

2020-07-27 Thread GitBox
ijuma commented on pull request #9082: URL: https://github.com/apache/kafka/pull/9082#issuecomment-664234424 Two builds passed, one had one failure due to existing flaky test: ``` org.apache.kafka.connect.mirror.MirrorConnectorsIntegrationTest > testOneWayReplicationWithAutorOffse

[GitHub] [kafka] cadonna commented on pull request #9066: KAFKA-10287: Skip unknown offsets when computing sum of changelog offsets

2020-07-27 Thread GitBox
cadonna commented on pull request #9066: URL: https://github.com/apache/kafka/pull/9066#issuecomment-664235920 Java 8 was aborted due to a timeout. ``` 04:56:02 Build timed out (after 270 minutes). Marking the build as aborted. ``` -

[GitHub] [kafka] cadonna commented on pull request #9066: KAFKA-10287: Skip unknown offsets when computing sum of changelog offsets

2020-07-27 Thread GitBox
cadonna commented on pull request #9066: URL: https://github.com/apache/kafka/pull/9066#issuecomment-664237012 @chia7712 Please do trigger Jenkins in the future. The more we have that have permission to trigger Jenkins and do it, the better it is. Especially for people like me that do not

[GitHub] [kafka] chia7712 commented on pull request #9066: KAFKA-10287: Skip unknown offsets when computing sum of changelog offsets

2020-07-27 Thread GitBox
chia7712 commented on pull request #9066: URL: https://github.com/apache/kafka/pull/9066#issuecomment-664238134 > Please do trigger Jenkins in the future. Copy that. Let me do it at once. Test this please This is an au

[GitHub] [kafka] viktorsomogyi commented on a change in pull request #4090: [KAFKA-6084] Propagate JSON parsing errors in ReassignPartitionsCommand

2020-07-27 Thread GitBox
viktorsomogyi commented on a change in pull request #4090: URL: https://github.com/apache/kafka/pull/4090#discussion_r460781660 ## File path: core/src/test/scala/unit/kafka/utils/JsonTest.scala ## @@ -41,14 +42,23 @@ class JsonTest { val jnf = JsonNodeFactory.instance

[GitHub] [kafka] viktorsomogyi commented on a change in pull request #4090: [KAFKA-6084] Propagate JSON parsing errors in ReassignPartitionsCommand

2020-07-27 Thread GitBox
viktorsomogyi commented on a change in pull request #4090: URL: https://github.com/apache/kafka/pull/4090#discussion_r460781753 ## File path: core/src/test/scala/unit/kafka/admin/ReassignPartitionsUnitTest.scala ## @@ -30,7 +30,7 @@ import org.apache.kafka.common.{Node, TopicPa

[GitHub] [kafka] ijuma commented on pull request #4090: [KAFKA-6084] Propagate JSON parsing errors in ReassignPartitionsCommand

2020-07-27 Thread GitBox
ijuma commented on pull request #4090: URL: https://github.com/apache/kafka/pull/4090#issuecomment-664265438 ok to test This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

[GitHub] [kafka] ijuma merged pull request #9082: MINOR: Update dependencies for Kafka 2.7 (part 1)

2020-07-27 Thread GitBox
ijuma merged pull request #9082: URL: https://github.com/apache/kafka/pull/9082 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] vvcephei merged pull request #9066: KAFKA-10287: Skip unknown offsets when computing sum of changelog offsets

2020-07-29 Thread GitBox
vvcephei merged pull request #9066: URL: https://github.com/apache/kafka/pull/9066 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [kafka] guozhangwang commented on pull request #9084: MINOR: Preserve Kafka exception from RebalanceListener [Do Not Merge]

2020-07-29 Thread GitBox
guozhangwang commented on pull request #9084: URL: https://github.com/apache/kafka/pull/9084#issuecomment-664698317 @abbccdda The exception is thrown from the consumer.poll, and the caller of the consumer could be expecting specific exceptions, e.g. TaskMigratedException will be handled sp

[GitHub] [kafka] dajac commented on a change in pull request #9072: KAFKA-10162; Make the rate based quota behave more like a Token Bucket (KIP-599, Part III)

2020-07-29 Thread GitBox
dajac commented on a change in pull request #9072: URL: https://github.com/apache/kafka/pull/9072#discussion_r461123154 ## File path: clients/src/main/java/org/apache/kafka/common/metrics/stats/TokenBucket.java ## @@ -0,0 +1,150 @@ +/* + * Licensed to the Apache Software Found

[GitHub] [kafka] guozhangwang commented on a change in pull request #8964: KAFKA-9450: Decouple flushing state from commiting

2020-07-29 Thread GitBox
guozhangwang commented on a change in pull request #8964: URL: https://github.com/apache/kafka/pull/8964#discussion_r461266795 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StateManagerUtil.java ## @@ -38,13 +41,39 @@ */ final class StateM

[GitHub] [kafka] rgroothuijsen commented on pull request #9089: KAFKA-10224: Update jersey license from CDDL to EPLv2

2020-07-29 Thread GitBox
rgroothuijsen commented on pull request #9089: URL: https://github.com/apache/kafka/pull/9089#issuecomment-665171345 @rhauch No problem, thanks for the help! I used the version from the Eclipse home page, but this one has much nicer formatting as well.

[GitHub] [kafka] rgroothuijsen opened a new pull request #9089: KAFKA-10224: Update jersey license from CDDL to EPLv2

2020-07-29 Thread GitBox
rgroothuijsen opened a new pull request #9089: URL: https://github.com/apache/kafka/pull/9089 Jersey has changed its license from CDDL to EPLv2 starting from version 2.28. This PR updates the included license information to reflect this. ---

[GitHub] [kafka] jeffkbkim commented on a change in pull request #9050: KAFKA-10193: Add preemption for controller events that have callbacks

2020-07-29 Thread GitBox
jeffkbkim commented on a change in pull request #9050: URL: https://github.com/apache/kafka/pull/9050#discussion_r461742057 ## File path: core/src/main/scala/kafka/controller/KafkaController.scala ## @@ -1986,101 +1965,125 @@ private[controller] class ControllerStats extends K

[GitHub] [kafka] guozhangwang commented on pull request #8964: KAFKA-9450: Decouple flushing state from commiting

2020-07-29 Thread GitBox
guozhangwang commented on pull request #8964: URL: https://github.com/apache/kafka/pull/8964#issuecomment-664688329 @ableegoldman @vvcephei I've thought about controlling the frequency of flushing, and I've decided to expose another public config to let users specify. But I'd defer that to

[GitHub] [kafka] junrao commented on pull request #8657: KAFKA-8334 Make sure the thread which tries to complete delayed reque…

2020-07-29 Thread GitBox
junrao commented on pull request #8657: URL: https://github.com/apache/kafka/pull/8657#issuecomment-664652669 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [kafka] rgibaiev edited a comment on pull request #8575: KAFKA-8713 KIP-581 Add accept.optional.null to solve optional null

2020-07-29 Thread GitBox
rgibaiev edited a comment on pull request #8575: URL: https://github.com/apache/kafka/pull/8575#issuecomment-665225469 Any update? @rhauch This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [kafka] guozhangwang commented on pull request #9087: HOTFIX: Set session timeout and heartbeat interval to default to decrease flakiness

2020-07-29 Thread GitBox
guozhangwang commented on pull request #9087: URL: https://github.com/apache/kafka/pull/9087#issuecomment-665171108 For correctness I agree; though for some tests we cover the rebalance triggered by member dropping out of the group and hence reducing the session timeout also largely reduce

[GitHub] [kafka] rhauch commented on pull request #9066: KAFKA-10287: Skip unknown offsets when computing sum of changelog offsets

2020-07-29 Thread GitBox
rhauch commented on pull request #9066: URL: https://github.com/apache/kafka/pull/9066#issuecomment-665065731 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [kafka] apovzner commented on a change in pull request #9072: KAFKA-10162; Make the rate based quota behave more like a Token Bucket (KIP-599, Part III)

2020-07-29 Thread GitBox
apovzner commented on a change in pull request #9072: URL: https://github.com/apache/kafka/pull/9072#discussion_r461297706 ## File path: clients/src/main/java/org/apache/kafka/common/metrics/stats/TokenBucket.java ## @@ -0,0 +1,150 @@ +/* + * Licensed to the Apache Software Fo

[GitHub] [kafka] huxihx commented on pull request #8984: KAFKA-10227: Enforce cleanup policy to only contain compact or delete once

2020-07-29 Thread GitBox
huxihx commented on pull request #8984: URL: https://github.com/apache/kafka/pull/8984#issuecomment-664804260 Ping @omkreddy @mimaison for review. This is an automated message from the Apache Git Service. To respond to the me

[GitHub] [kafka] rhauch commented on pull request #8575: KAFKA-8713 KIP-581 Add accept.optional.null to solve optional null

2020-07-29 Thread GitBox
rhauch commented on pull request #8575: URL: https://github.com/apache/kafka/pull/8575#issuecomment-665303585 This PR has a conflict that has to be resolved first. Also, KIP-581 must be passed before this can be merged. See the discussion thread for the KIP. ---

[GitHub] [kafka] guozhangwang edited a comment on pull request #9011: KAFKA-10134: Still depends on existence of any fetchable partitions to block on join

2020-07-29 Thread GitBox
guozhangwang edited a comment on pull request #9011: URL: https://github.com/apache/kafka/pull/9011#issuecomment-665182983 @hachikuji That's what I was wondering as well. From the logs we have: https://issues.apache.org/jira/secure/attachment/13008127/consumer5.log.2020-07-22.log If

[GitHub] [kafka] mumrah commented on a change in pull request #9050: KAFKA-10193: Add preemption for controller events that have callbacks

2020-07-29 Thread GitBox
mumrah commented on a change in pull request #9050: URL: https://github.com/apache/kafka/pull/9050#discussion_r461709093 ## File path: core/src/main/scala/kafka/controller/KafkaController.scala ## @@ -1986,101 +1965,125 @@ private[controller] class ControllerStats extends Kafk

[GitHub] [kafka] dajac opened a new pull request #9091: MINOR; Make KafkaAdminClientTest.testDescribeLogDirsPartialFailure and KafkaAdminClientTest.testAlterReplicaLogDirsPartialFailure test more reli

2020-07-29 Thread GitBox
dajac opened a new pull request #9091: URL: https://github.com/apache/kafka/pull/9091 I have seem them failing locally from times to times. It seems that the changes made in https://github.com/apache/kafka/pull/8864 have made them more fragile. I have updated them to be more reliable.

[GitHub] [kafka] showuon opened a new pull request #9096: Add comments to constrainedAssign and generalAssign method

2020-07-29 Thread GitBox
showuon opened a new pull request #9096: URL: https://github.com/apache/kafka/pull/9096 Recently, I tried to read the codes to understand what the `constrainedAssign` and `generalAssign` method is doing, but it is so difficult and suffering due to the complexity of the algorithm. And then

[GitHub] [kafka] viktorsomogyi commented on pull request #4090: [KAFKA-6084] Propagate JSON parsing errors in ReassignPartitionsCommand

2020-07-29 Thread GitBox
viktorsomogyi commented on pull request #4090: URL: https://github.com/apache/kafka/pull/4090#issuecomment-664920356 Also the jdk11&scala2.13 build timed out due to another test: ``` 12:49:33 org.apache.kafka.streams.processor.internals.GlobalStreamThreadTest > shouldDieOnInvalidOffse

[GitHub] [kafka] guozhangwang commented on pull request #9011: KAFKA-10134: Still depends on existence of any fetchable partitions to block on join

2020-07-29 Thread GitBox
guozhangwang commented on pull request #9011: URL: https://github.com/apache/kafka/pull/9011#issuecomment-665182983 That's what I was wondering as well. From the logs we have: https://issues.apache.org/jira/secure/attachment/13008127/consumer5.log.2020-07-22.log If you search for `Re

[GitHub] [kafka] rhauch merged pull request #9089: KAFKA-10224: Update jersey license from CDDL to EPLv2

2020-07-29 Thread GitBox
rhauch merged pull request #9089: URL: https://github.com/apache/kafka/pull/9089 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] tombentley commented on pull request #8312: KAFKA-9432 automated protocol for DescribeConfigs

2020-07-29 Thread GitBox
tombentley commented on pull request #8312: URL: https://github.com/apache/kafka/pull/8312#issuecomment-664832499 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [kafka] tombentley commented on pull request #9007: KAFKA-10120: Deprecate DescribeLogDirsResult.all() and .values()

2020-07-29 Thread GitBox
tombentley commented on pull request #9007: URL: https://github.com/apache/kafka/pull/9007#issuecomment-664836543 @mimaison done, thanks. This is an automated message from the Apache Git Service. To respond to the message, pl

[GitHub] [kafka] ableegoldman commented on a change in pull request #8964: KAFKA-9450: Decouple flushing state from commiting

2020-07-29 Thread GitBox
ableegoldman commented on a change in pull request #8964: URL: https://github.com/apache/kafka/pull/8964#discussion_r461229173 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StateManagerUtil.java ## @@ -38,13 +41,39 @@ */ final class StateM

[GitHub] [kafka] dajac commented on pull request #9072: KAFKA-10162; Make the rate based quota behave more like a Token Bucket (KIP-599, Part III)

2020-07-29 Thread GitBox
dajac commented on pull request #9072: URL: https://github.com/apache/kafka/pull/9072#issuecomment-664923691 @apovzner Thanks for your comments. I have updated the PR to incorporate your feedback. I have also fixed a bug in unrecord and added the javadoc. -

[GitHub] [kafka] cyrusv opened a new pull request #9093: Throw error on when keys not found in FileConfigProvider

2020-07-29 Thread GitBox
cyrusv opened a new pull request #9093: URL: https://github.com/apache/kafka/pull/9093 *More detailed description of your change, if necessary. The PR title and PR message become the squashed commit message, so use a separate comment to ping reviewers.* *Summary of testing st

[GitHub] [kafka] sasakitoa commented on pull request #9081: KAFKA-10309: KafkaProducer's sendOffsetsToTransaction should not block infinitively

2020-07-29 Thread GitBox
sasakitoa commented on pull request #9081: URL: https://github.com/apache/kafka/pull/9081#issuecomment-664725165 Thank you for kindness comments. I updated to improve java doc and related test code. This is an automated mess

[GitHub] [kafka] huxihx edited a comment on pull request #8984: KAFKA-10227: Enforce cleanup policy to only contain compact or delete once

2020-07-29 Thread GitBox
huxihx edited a comment on pull request #8984: URL: https://github.com/apache/kafka/pull/8984#issuecomment-664804260 Ping @omkreddy @mimaison @dajac for review. This is an automated message from the Apache Git Service. To re

[GitHub] [kafka] dajac commented on pull request #9091: MINOR; Make KafkaAdminClientTest.testDescribeLogDirsPartialFailure and KafkaAdminClientTest.testAlterReplicaLogDirsPartialFailure test more reli

2020-07-29 Thread GitBox
dajac commented on pull request #9091: URL: https://github.com/apache/kafka/pull/9091#issuecomment-664848664 @chia7712 Ack. I reverted `testMetadataRetries` back to the original version prior to #8864. That test is specific for the retries so it doesn't make sense to remove the retries con

[GitHub] [kafka] mjsax commented on pull request #9086: FIX: Remove staticmethod tag to be able to use logger of instance

2020-07-29 Thread GitBox
mjsax commented on pull request #9086: URL: https://github.com/apache/kafka/pull/9086#issuecomment-664684265 Merged to `trunk` and cherry-picked to `2.6`, `2.5`, `2.4`, and `2.3` branches. This is an automated message from t

[GitHub] [kafka] cmccabe commented on a change in pull request #9012: KAFKA-10270: A broker to controller channel manager

2020-07-29 Thread GitBox
cmccabe commented on a change in pull request #9012: URL: https://github.com/apache/kafka/pull/9012#discussion_r461884961 ## File path: core/src/main/scala/kafka/server/BrokerToControllerChannelManager.scala ## @@ -0,0 +1,211 @@ +/* + * Licensed to the Apache Software Foundati

[GitHub] [kafka] rhauch commented on pull request #9051: KAFKA-10268: dynamic config like "--delete-config log.retention.ms" doesn't work

2020-07-29 Thread GitBox
rhauch commented on pull request #9051: URL: https://github.com/apache/kafka/pull/9051#issuecomment-665124035 This was also cherry-picked to `2.6`, but that branch has been frozen while we try to release AK 2.6.0. However, given that this is low-risk, I'll leave it on `2.6` and update [KA

[GitHub] [kafka] ableegoldman commented on pull request #9094: KAFKA-10054: KIP-613, add TRACE-level e2e latency metrics

2020-07-29 Thread GitBox
ableegoldman commented on pull request #9094: URL: https://github.com/apache/kafka/pull/9094#issuecomment-665394762 call for review @vvcephei @cadonna @guozhangwang This is an automated message from the Apache Git Service. T

[GitHub] [kafka] rhauch commented on pull request #9089: KAFKA-10224: Update jersey license from CDDL to EPLv2

2020-07-29 Thread GitBox
rhauch commented on pull request #9089: URL: https://github.com/apache/kafka/pull/9089#issuecomment-665168618 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [kafka] codelabor opened a new pull request #9090: toString pattern change like ProducerRecord.java

2020-07-29 Thread GitBox
codelabor opened a new pull request #9090: URL: https://github.com/apache/kafka/pull/9090 In most of 'toString()' methods,'=' is used instead of ' = ', so I followed the convention. Actually, if you print 'ProducerRecord' and 'ConsumerRecord', the pattern looks different and looks s

[GitHub] [kafka] hachikuji commented on a change in pull request #9047: KAFKA-9274: Remove `retries` for global task

2020-07-29 Thread GitBox
hachikuji commented on a change in pull request #9047: URL: https://github.com/apache/kafka/pull/9047#discussion_r461114945 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/GlobalStateManagerImpl.java ## @@ -292,21 +278,36 @@ private void restor

[GitHub] [kafka] rgibaiev commented on pull request #8575: KAFKA-8713 KIP-581 Add accept.optional.null to solve optional null

2020-07-29 Thread GitBox
rgibaiev commented on pull request #8575: URL: https://github.com/apache/kafka/pull/8575#issuecomment-665225469 Any update? This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [kafka] showuon commented on pull request #9062: KAFKA-8098: fix the flaky test by disabling the auto commit to avoid member rejoining

2020-07-29 Thread GitBox
showuon commented on pull request #9062: URL: https://github.com/apache/kafka/pull/9062#issuecomment-664801932 hi @feyman2016 @huxihx , could you help review this small PR? Thanks. This is an automated message from the Apach

[GitHub] [kafka] dajac commented on pull request #9092: KAFKA-10163; Define `controller_mutation_rate` a Double instead of a Long

2020-07-29 Thread GitBox
dajac commented on pull request #9092: URL: https://github.com/apache/kafka/pull/9092#issuecomment-664996150 @rajinisivaram I have updated an existing test to use 1.5 instead of 2 to verify this. https://github.com/apache/kafka/pull/9092/files#diff-296d7b93103356535b8b891f019e4651R113. -

[GitHub] [kafka] vvcephei commented on pull request #9004: KAFKA-10261: Introduce the KIP-478 apis with shims

2020-07-29 Thread GitBox
vvcephei commented on pull request #9004: URL: https://github.com/apache/kafka/pull/9004#issuecomment-664740837 Thanks for the review, @abbccdda ! I've addressed your feedback. This is an automated message from the Apache Git

[GitHub] [kafka] vvcephei commented on a change in pull request #9047: KAFKA-9274: Remove `retries` for global task

2020-07-29 Thread GitBox
vvcephei commented on a change in pull request #9047: URL: https://github.com/apache/kafka/pull/9047#discussion_r461143961 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/GlobalStateManagerImpl.java ## @@ -275,31 +259,70 @@ private void restore

[GitHub] [kafka] chia7712 edited a comment on pull request #8657: KAFKA-8334 Make sure the thread which tries to complete delayed reque…

2020-07-29 Thread GitBox
chia7712 edited a comment on pull request #8657: URL: https://github.com/apache/kafka/pull/8657#issuecomment-665149860 ```streams_standby_replica_test``` -> https://issues.apache.org/jira/browse/KAFKA-10287 I will take a look at ```streams_broker_bounce_test``` (https://issues.apac

[GitHub] [kafka] cadonna commented on pull request #9087: HOTFIX: Set session timeout and heartbeat interval to default to decrease flakiness

2020-07-29 Thread GitBox
cadonna commented on pull request #9087: URL: https://github.com/apache/kafka/pull/9087#issuecomment-664621717 @abbccdda Looking at this test class again, I even think that we could set session timeout and heartbeat interval to default for all tests. The main motivation to reduce them was

[GitHub] [kafka] abbccdda commented on pull request #9012: KAFKA-10270: A broker to controller channel manager

2020-07-29 Thread GitBox
abbccdda commented on pull request #9012: URL: https://github.com/apache/kafka/pull/9012#issuecomment-665410633 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

[GitHub] [kafka] abbccdda commented on a change in pull request #9004: KAFKA-10261: Introduce the KIP-478 apis with adapters

2020-07-29 Thread GitBox
abbccdda commented on a change in pull request #9004: URL: https://github.com/apache/kafka/pull/9004#discussion_r462057744 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/InternalTopologyBuilder.java ## @@ -764,12 +764,12 @@ private void connec

[GitHub] [kafka] cmccabe commented on pull request #9012: KAFKA-10270: A broker to controller channel manager

2020-07-29 Thread GitBox
cmccabe commented on pull request #9012: URL: https://github.com/apache/kafka/pull/9012#issuecomment-665288947 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and us

[GitHub] [kafka] ableegoldman opened a new pull request #9094: KAFKA-10054: add TRACE-level e2e latency metrics

2020-07-29 Thread GitBox
ableegoldman opened a new pull request #9094: URL: https://github.com/apache/kafka/pull/9094 Adds avg, min, and max e2e latency metrics at the new TRACE level. Also adds the missing `avg` task-level metric at the INFO level.

[GitHub] [kafka] abbccdda edited a comment on pull request #9012: KAFKA-10270: A broker to controller channel manager

2020-07-29 Thread GitBox
abbccdda edited a comment on pull request #9012: URL: https://github.com/apache/kafka/pull/9012#issuecomment-665410633 Got 2/3 green, with one jenkins job terminated unexpectedly. https://builds.apache.org/job/kafka-pr-jdk11-scala2.13/7602/console -

[GitHub] [kafka] abbccdda commented on pull request #9081: KAFKA-10309: KafkaProducer's sendOffsetsToTransaction should not block infinitively

2020-07-29 Thread GitBox
abbccdda commented on pull request #9081: URL: https://github.com/apache/kafka/pull/9081#issuecomment-665157437 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

[GitHub] [kafka] abbccdda commented on a change in pull request #9081: KAFKA-10309: KafkaProducer's sendOffsetsToTransaction should not block infinitively

2020-07-29 Thread GitBox
abbccdda commented on a change in pull request #9081: URL: https://github.com/apache/kafka/pull/9081#discussion_r461313377 ## File path: core/src/test/scala/integration/kafka/api/TransactionsTest.scala ## @@ -406,6 +406,26 @@ class TransactionsTest extends KafkaServerTestHarnes

[GitHub] [kafka] mjsax commented on pull request #9047: KAFKA-9274: Remove `retries` for global task

2020-07-29 Thread GitBox
mjsax commented on pull request #9047: URL: https://github.com/apache/kafka/pull/9047#issuecomment-664773350 @vvcephei @abbccdda @guozhangwang @hachikuji -- I updated this PR according to your discussions. Needed to squash for rebasing to resolve conflicts. ---

[GitHub] [kafka] vvcephei commented on a change in pull request #9004: KAFKA-10261: Introduce the KIP-478 apis with shims

2020-07-29 Thread GitBox
vvcephei commented on a change in pull request #9004: URL: https://github.com/apache/kafka/pull/9004#discussion_r461271276 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/InternalTopologyBuilder.java ## @@ -880,40 +880,41 @@ public synchronized

[GitHub] [kafka] cyrusv closed pull request #9093: Throw error on when keys not found in FileConfigProvider

2020-07-29 Thread GitBox
cyrusv closed pull request #9093: URL: https://github.com/apache/kafka/pull/9093 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] chia7712 commented on pull request #9066: KAFKA-10287: Skip unknown offsets when computing sum of changelog offsets

2020-07-29 Thread GitBox
chia7712 commented on pull request #9066: URL: https://github.com/apache/kafka/pull/9066#issuecomment-664764918 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

[GitHub] [kafka] showuon commented on pull request #9096: Add comments to constrainedAssign and generalAssign method

2020-07-29 Thread GitBox
showuon commented on pull request #9096: URL: https://github.com/apache/kafka/pull/9096#issuecomment-665472409 @ableegoldman @vahidhashemian , please help review this PR to add comments to the assign methods. Thanks. This is

[GitHub] [kafka] dajac opened a new pull request #9092: KAFKA-10163; Define `controller_mutation_rate` a Double instead of a Long

2020-07-29 Thread GitBox
dajac opened a new pull request #9092: URL: https://github.com/apache/kafka/pull/9092 First tests have shown that `controller_mutation_rate` can be quite low (e.g. around 1) in clusters with multiple tenants. At the moment, the rate is defined as a Long which limits the possible low values

[GitHub] [kafka] chia7712 commented on pull request #8657: KAFKA-8334 Make sure the thread which tries to complete delayed reque…

2020-07-29 Thread GitBox
chia7712 commented on pull request #8657: URL: https://github.com/apache/kafka/pull/8657#issuecomment-665149860 ```streams_standby_replica_test``` -> https://issues.apache.org/jira/browse/KAFKA-10287 I will take a look at ```streams_broker_bounce_test``` --

[GitHub] [kafka] hachikuji commented on a change in pull request #9008: KAFKA-9629 Use generated protocol for Fetch API

2020-07-29 Thread GitBox
hachikuji commented on a change in pull request #9008: URL: https://github.com/apache/kafka/pull/9008#discussion_r461173162 ## File path: clients/src/main/resources/common/message/FetchRequest.json ## @@ -55,35 +55,35 @@ "about": "The minimum bytes to accumulate in the r

[GitHub] [kafka] abbccdda commented on pull request #9001: KAFKA-10028: Implement write path for feature versioning system (KIP-584)

2020-07-29 Thread GitBox
abbccdda commented on pull request #9001: URL: https://github.com/apache/kafka/pull/9001#issuecomment-665189199 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

[GitHub] [kafka] bob-barrett commented on a change in pull request #9054: KAFKA-10282: Remove Log metrics immediately when deleting log

2020-07-29 Thread GitBox
bob-barrett commented on a change in pull request #9054: URL: https://github.com/apache/kafka/pull/9054#discussion_r461721737 ## File path: core/src/main/scala/kafka/log/LogManager.scala ## @@ -932,6 +927,7 @@ class LogManager(logDirs: Seq[File], val logsToCheckpoint =

[GitHub] [kafka] guozhangwang commented on pull request #9083: KAFKA-9450: Follow-up; Forbid process after closed [WIP]

2020-07-29 Thread GitBox
guozhangwang commented on pull request #9083: URL: https://github.com/apache/kafka/pull/9083#issuecomment-664699699 cc @ableegoldman @mjsax This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [kafka] abbccdda commented on a change in pull request #9047: KAFKA-9274: Remove `retries` for global task

2020-07-29 Thread GitBox
abbccdda commented on a change in pull request #9047: URL: https://github.com/apache/kafka/pull/9047#discussion_r462047068 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/GlobalStateManagerImpl.java ## @@ -274,30 +252,74 @@ private void restore

[GitHub] [kafka] vvcephei commented on pull request #9066: KAFKA-10287: Skip unknown offsets when computing sum of changelog offsets

2020-07-29 Thread GitBox
vvcephei commented on pull request #9066: URL: https://github.com/apache/kafka/pull/9066#issuecomment-665126186 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

[GitHub] [kafka] yeralin commented on pull request #6592: KAFKA-8326: Introduce List Serde

2020-07-29 Thread GitBox
yeralin commented on pull request #6592: URL: https://github.com/apache/kafka/pull/6592#issuecomment-665078937 Any updates? This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [kafka] sasakitoa commented on a change in pull request #9081: KAFKA-10309: KafkaProducer's sendOffsetsToTransaction should not block infinitively

2020-07-29 Thread GitBox
sasakitoa commented on a change in pull request #9081: URL: https://github.com/apache/kafka/pull/9081#discussion_r461264833 ## File path: core/src/test/scala/integration/kafka/api/TransactionsTest.scala ## @@ -406,6 +406,26 @@ class TransactionsTest extends KafkaServerTestHarne

[GitHub] [kafka] rajinisivaram commented on pull request #9092: KAFKA-10163; Define `controller_mutation_rate` a Double instead of a Long

2020-07-29 Thread GitBox
rajinisivaram commented on pull request #9092: URL: https://github.com/apache/kafka/pull/9092#issuecomment-664990134 ok to test This is an automated message from the Apache Git Service. To respond to the message, please log o

[GitHub] [kafka] mjsax commented on pull request #6592: KAFKA-8326: Introduce List Serde

2020-07-29 Thread GitBox
mjsax commented on pull request #6592: URL: https://github.com/apache/kafka/pull/6592#issuecomment-665304810 @yeralin -- your PR is in my review queue. Not sure how quickly I will find time to have a look though atm -- maybe next week, but I can't promise.

[GitHub] [kafka] guozhangwang commented on pull request #9081: KAFKA-10309: KafkaProducer's sendOffsetsToTransaction should not block infinitively

2020-07-29 Thread GitBox
guozhangwang commented on pull request #9081: URL: https://github.com/apache/kafka/pull/9081#issuecomment-664690277 Any blocking APIs should be covered by the `max.block.ms` so I think this is rather a bug-fix. This is an au

[GitHub] [kafka] mjsax commented on a change in pull request #9047: KAFKA-9274: Remove `retries` for global task

2020-07-29 Thread GitBox
mjsax commented on a change in pull request #9047: URL: https://github.com/apache/kafka/pull/9047#discussion_r461302625 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/GlobalStateManagerImpl.java ## @@ -275,31 +259,70 @@ private void restoreSta

[GitHub] [kafka] abbccdda opened a new pull request #9095: KAFKA-10321: fix infinite blocking for global stream thread startup

2020-07-29 Thread GitBox
abbccdda opened a new pull request #9095: URL: https://github.com/apache/kafka/pull/9095 In the unit test `shouldDieOnInvalidOffsetExceptionDuringStartup` for JDK 11, we spotted a case where a global stream thread startup would stall if it fails immediately upon the first poll. The reason

[GitHub] [kafka] pan3793 commented on pull request #8575: KAFKA-8713 KIP-581 Add accept.optional.null to solve optional null

2020-07-29 Thread GitBox
pan3793 commented on pull request #8575: URL: https://github.com/apache/kafka/pull/8575#issuecomment-665405076 Fixed the mail thread, do you have any comments on the discussion and KIP doc? @rhauch This is an automated mess

[GitHub] [kafka] ableegoldman commented on a change in pull request #9094: KAFKA-10054: add TRACE-level e2e latency metrics

2020-07-29 Thread GitBox
ableegoldman commented on a change in pull request #9094: URL: https://github.com/apache/kafka/pull/9094#discussion_r461993688 ## File path: clients/src/main/java/org/apache/kafka/clients/admin/AdminClientConfig.java ## @@ -198,7 +198,7 @@ .def

[GitHub] [kafka] guozhangwang commented on pull request #8993: KAFKA-10173: Use SmokeTest for upgrade system tests (#8938)

2020-07-29 Thread GitBox
guozhangwang commented on pull request #8993: URL: https://github.com/apache/kafka/pull/8993#issuecomment-665190912 Sorry for the long delay @vvcephei , the PR lgtm! This is an automated message from the Apache Git Service. T

[GitHub] [kafka] junrao commented on pull request #8936: KAFKA-10207: Fixed padded timeindex causing premature data deletion

2020-07-29 Thread GitBox
junrao commented on pull request #8936: URL: https://github.com/apache/kafka/pull/8936#issuecomment-665148070 I think we agreed to change the logic to do the index sanity check on index opening. This is an automated message

[GitHub] [kafka] gwenshap commented on pull request #9054: KAFKA-10282: Remove Log metrics immediately when deleting log

2020-07-29 Thread GitBox
gwenshap commented on pull request #9054: URL: https://github.com/apache/kafka/pull/9054#issuecomment-665773125 retest this please This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [kafka] soarez commented on pull request #9000: KAFKA-10036 Improve handling and documentation of Suppliers

2020-07-29 Thread GitBox
soarez commented on pull request #9000: URL: https://github.com/apache/kafka/pull/9000#issuecomment-665668720 @mjsax what can we do to proceed? This is an automated message from the Apache Git Service. To respond to the messa

[GitHub] [kafka] badaiaqrandista commented on pull request #4807: KAFKA-6733: Support of printing additional ConsumerRecord fields in DefaultMessageFormatter

2020-07-29 Thread GitBox
badaiaqrandista commented on pull request #4807: URL: https://github.com/apache/kafka/pull/4807#issuecomment-665660018 Closing this PR as it has been superseded by PR 9099 (https://github.com/apache/kafka/pull/9099). This is

[GitHub] [kafka] chia7712 commented on pull request #9096: MINOR: Add comments to constrainedAssign and generalAssign method

2020-07-29 Thread GitBox
chia7712 commented on pull request #9096: URL: https://github.com/apache/kafka/pull/9096#issuecomment-665504255 retest this please This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [kafka] mumrah commented on a change in pull request #9012: KAFKA-10270: A broker to controller channel manager

2020-07-29 Thread GitBox
mumrah commented on a change in pull request #9012: URL: https://github.com/apache/kafka/pull/9012#discussion_r462352682 ## File path: core/src/main/scala/kafka/server/BrokerToControllerChannelManager.scala ## @@ -0,0 +1,188 @@ +/* + * Licensed to the Apache Software Foundatio

[GitHub] [kafka] mumrah commented on a change in pull request #9008: KAFKA-9629 Use generated protocol for Fetch API

2020-07-29 Thread GitBox
mumrah commented on a change in pull request #9008: URL: https://github.com/apache/kafka/pull/9008#discussion_r462364719 ## File path: clients/src/main/java/org/apache/kafka/common/requests/FetchResponse.java ## @@ -366,225 +255,128 @@ public FetchResponse(Errors error,

[GitHub] [kafka] abbccdda commented on pull request #9012: KAFKA-10270: A broker to controller channel manager

2020-07-29 Thread GitBox
abbccdda commented on pull request #9012: URL: https://github.com/apache/kafka/pull/9012#issuecomment-665757647 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

[GitHub] [kafka] guozhangwang commented on pull request #9087: HOTFIX: Set session timeout and heartbeat interval to default to decrease flakiness

2020-07-29 Thread GitBox
guozhangwang commented on pull request #9087: URL: https://github.com/apache/kafka/pull/9087#issuecomment-665779451 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

[GitHub] [kafka] badaiaqrandista opened a new pull request #9099: KAFKA-6733: Printing additional ConsumerRecord fields in DefaultMessageFormatter

2020-07-29 Thread GitBox
badaiaqrandista opened a new pull request #9099: URL: https://github.com/apache/kafka/pull/9099 Implementation of KIP-431 - Support of printing additional ConsumerRecord fields in DefaultMessageFormatter https://cwiki.apache.org/confluence/display/KAFKA/KIP-431%3A+Support+of+printin

[GitHub] [kafka] cadonna commented on a change in pull request #9094: KAFKA-10054: KIP-613, add TRACE-level e2e latency metrics

2020-07-29 Thread GitBox
cadonna commented on a change in pull request #9094: URL: https://github.com/apache/kafka/pull/9094#discussion_r462327050 ## File path: streams/src/main/java/org/apache/kafka/streams/state/internals/MeteredKeyValueStore.java ## @@ -227,6 +234,14 @@ protected Bytes keyBytes(fin

[GitHub] [kafka] mumrah commented on pull request #9008: KAFKA-9629 Use generated protocol for Fetch API

2020-07-29 Thread GitBox
mumrah commented on pull request #9008: URL: https://github.com/apache/kafka/pull/9008#issuecomment-665795947 I ran a console consumer perf test (at @hachikuji's suggestion) and took a profile. ![image](https://user-images.githubusercontent.com/55116/88832229-81be6d00-d19e-11ea-9ee

[GitHub] [kafka] cadonna commented on pull request #9098: KAFKA-9924: Prepare RocksDB and metrics for RocksDB properties recording

2020-07-29 Thread GitBox
cadonna commented on pull request #9098: URL: https://github.com/apache/kafka/pull/9098#issuecomment-665616943 Call for review: @vvcephei @guozhangwang This is an automated message from the Apache Git Service. To respond to

[GitHub] [kafka] dajac commented on a change in pull request #9099: KAFKA-6733: Printing additional ConsumerRecord fields in DefaultMessageFormatter

2020-07-29 Thread GitBox
dajac commented on a change in pull request #9099: URL: https://github.com/apache/kafka/pull/9099#discussion_r462306541 ## File path: core/src/main/scala/kafka/tools/ConsoleConsumer.scala ## @@ -459,48 +466,32 @@ class DefaultMessageFormatter extends MessageFormatter { var p

[GitHub] [kafka] chia7712 commented on a change in pull request #9092: KAFKA-10163; Define `controller_mutation_rate` as a Double instead of a Long

2020-07-29 Thread GitBox
chia7712 commented on a change in pull request #9092: URL: https://github.com/apache/kafka/pull/9092#discussion_r462394461 ## File path: core/src/main/scala/kafka/server/DynamicConfig.scala ## @@ -103,7 +103,7 @@ object DynamicConfig { .define(ProducerByteRateOverridePro

[GitHub] [kafka] cadonna commented on pull request #9087: HOTFIX: Set session timeout and heartbeat interval to default to decrease flakiness

2020-07-29 Thread GitBox
cadonna commented on pull request #9087: URL: https://github.com/apache/kafka/pull/9087#issuecomment-665526207 I did some runs of the `RestoreIntegrationTest` and the runtime does not significantly change between runs with default values for session timeout and heartbeat interval and reduc

[GitHub] [kafka] badaiaqrandista edited a comment on pull request #4807: KAFKA-6733: Support of printing additional ConsumerRecord fields in DefaultMessageFormatter

2020-07-29 Thread GitBox
badaiaqrandista edited a comment on pull request #4807: URL: https://github.com/apache/kafka/pull/4807#issuecomment-665660018 This PR should be closed as it has been superseded by PR 9099 (https://github.com/apache/kafka/pull/9099).

<    1   2   3   4   5   6   7   8   9   10   >