[GitHub] [kafka] ableegoldman commented on a change in pull request #9039: KAFKA-5636: SlidingWindows (KIP-450)

2020-08-05 Thread GitBox
ableegoldman commented on a change in pull request #9039: URL: https://github.com/apache/kafka/pull/9039#discussion_r466052825 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregate.java ## @@ -0,0 +1,391 @@ +/* + * License

[GitHub] [kafka] mumrah commented on pull request #7222: KAFKA-8806 Reduce calls to validateOffsetsIfNeeded

2020-08-05 Thread GitBox
mumrah commented on pull request #7222: URL: https://github.com/apache/kafka/pull/7222#issuecomment-669597940 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [kafka] ableegoldman commented on a change in pull request #9039: KAFKA-5636: SlidingWindows (KIP-450)

2020-08-05 Thread GitBox
ableegoldman commented on a change in pull request #9039: URL: https://github.com/apache/kafka/pull/9039#discussion_r466063583 ## File path: streams/src/test/java/org/apache/kafka/streams/integration/KStreamAggregationIntegrationTest.java ## @@ -459,6 +460,95 @@ public void sh

[GitHub] [kafka] lct45 commented on a change in pull request #9039: KAFKA-5636: SlidingWindows (KIP-450)

2020-08-05 Thread GitBox
lct45 commented on a change in pull request #9039: URL: https://github.com/apache/kafka/pull/9039#discussion_r466070317 ## File path: streams/src/test/java/org/apache/kafka/streams/integration/KStreamAggregationIntegrationTest.java ## @@ -459,6 +460,95 @@ public void shouldGro

[GitHub] [kafka] mjsax commented on a change in pull request #8964: KAFKA-9450: Decouple flushing state from commiting

2020-08-05 Thread GitBox
mjsax commented on a change in pull request #8964: URL: https://github.com/apache/kafka/pull/8964#discussion_r466056481 ## File path: streams/src/test/java/org/apache/kafka/streams/tests/EosTestDriver.java ## @@ -379,9 +379,18 @@ private static void verifyReceivedAllRecords(fi

[GitHub] [kafka] soarez commented on a change in pull request #9000: KAFKA-10036 Improve handling and documentation of Suppliers

2020-08-05 Thread GitBox
soarez commented on a change in pull request #9000: URL: https://github.com/apache/kafka/pull/9000#discussion_r466080451 ## File path: streams/src/test/java/org/apache/kafka/streams/kstream/internals/KStreamImplTest.java ## @@ -1865,6 +1865,17 @@ public void shouldNotAllowNul

[GitHub] [kafka] mjsax commented on pull request #9120: KAFKA-10316: Consider renaming getter method for Interactive Queries

2020-08-05 Thread GitBox
mjsax commented on pull request #9120: URL: https://github.com/apache/kafka/pull/9120#issuecomment-669617981 Retest this please. This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [kafka] soarez commented on a change in pull request #9000: KAFKA-10036 Improve handling and documentation of Suppliers

2020-08-05 Thread GitBox
soarez commented on a change in pull request #9000: URL: https://github.com/apache/kafka/pull/9000#discussion_r466081647 ## File path: streams/src/test/java/org/apache/kafka/streams/processor/internals/InternalTopologyBuilderTest.java ## @@ -175,6 +177,12 @@ public void testAd

[GitHub] [kafka] guozhangwang commented on a change in pull request #8964: KAFKA-9450: Decouple flushing state from commiting

2020-08-05 Thread GitBox
guozhangwang commented on a change in pull request #8964: URL: https://github.com/apache/kafka/pull/8964#discussion_r466082144 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/AbstractTask.java ## @@ -49,6 +61,30 @@ this.stateDirectory

[GitHub] [kafka] guozhangwang commented on a change in pull request #8964: KAFKA-9450: Decouple flushing state from commiting

2020-08-05 Thread GitBox
guozhangwang commented on a change in pull request #8964: URL: https://github.com/apache/kafka/pull/8964#discussion_r466082424 ## File path: streams/src/test/java/org/apache/kafka/streams/tests/EosTestDriver.java ## @@ -390,9 +399,12 @@ private static void verifyReceivedAllRec

[GitHub] [kafka] guozhangwang commented on a change in pull request #8964: KAFKA-9450: Decouple flushing state from commiting

2020-08-05 Thread GitBox
guozhangwang commented on a change in pull request #8964: URL: https://github.com/apache/kafka/pull/8964#discussion_r466082319 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/ProcessorStateManager.java ## @@ -454,6 +456,41 @@ public void flush(

[GitHub] [kafka] guozhangwang commented on a change in pull request #8964: KAFKA-9450: Decouple flushing state from commiting

2020-08-05 Thread GitBox
guozhangwang commented on a change in pull request #8964: URL: https://github.com/apache/kafka/pull/8964#discussion_r466082830 ## File path: streams/src/test/java/org/apache/kafka/streams/tests/EosTestDriver.java ## @@ -379,9 +379,18 @@ private static void verifyReceivedAllRec

[GitHub] [kafka] guozhangwang commented on a change in pull request #8964: KAFKA-9450: Decouple flushing state from commiting

2020-08-05 Thread GitBox
guozhangwang commented on a change in pull request #8964: URL: https://github.com/apache/kafka/pull/8964#discussion_r466083086 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/ProcessorStateManager.java ## @@ -461,6 +463,42 @@ public void flush(

[GitHub] [kafka] guozhangwang commented on a change in pull request #8964: KAFKA-9450: Decouple flushing state from commiting

2020-08-05 Thread GitBox
guozhangwang commented on a change in pull request #8964: URL: https://github.com/apache/kafka/pull/8964#discussion_r466084079 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StateManagerUtil.java ## @@ -38,13 +41,39 @@ */ final class StateM

[GitHub] [kafka] guozhangwang commented on a change in pull request #8964: KAFKA-9450: Decouple flushing state from commiting

2020-08-05 Thread GitBox
guozhangwang commented on a change in pull request #8964: URL: https://github.com/apache/kafka/pull/8964#discussion_r466085153 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamTask.java ## @@ -344,40 +343,41 @@ public void resume() {

[GitHub] [kafka] soarez commented on pull request #9000: KAFKA-10036 Improve handling and documentation of Suppliers

2020-08-05 Thread GitBox
soarez commented on pull request #9000: URL: https://github.com/apache/kafka/pull/9000#issuecomment-669622098 Thanks for the review @mjsax. I think I've addressed your feedback and I have a question about whether or not we should extend this to `ValueTransformerSupplier`. ---

[GitHub] [kafka] junrao commented on pull request #9114: KAFKA-10162; Use Token Bucket algorithm for controller mutation quota (KIP-599, Part III)

2020-08-05 Thread GitBox
junrao commented on pull request #9114: URL: https://github.com/apache/kafka/pull/9114#issuecomment-669622211 The failed unit test seems unrelated. @apovzner : Do you have any other comments on this? Thanks. This is an

[GitHub] [kafka] soarez commented on pull request #9064: KAFKA-10205: Documentation and handling of non deterministic Topologies

2020-08-05 Thread GitBox
soarez commented on pull request #9064: URL: https://github.com/apache/kafka/pull/9064#issuecomment-669622553 Thanks for the review @mjsax. I've addressed your feedback. Please take another look. This is an automated message

[GitHub] [kafka] thomaslee commented on pull request #9111: KAFKA-10337: await async commits in commitSync even if no offsets given

2020-08-05 Thread GitBox
thomaslee commented on pull request #9111: URL: https://github.com/apache/kafka/pull/9111#issuecomment-669624137 It's somewhat easy to do it accidentally. The scenario I was concerned about looks something like this with auto offset commits disabled: ```java KafkaConsumer<...> con

[GitHub] [kafka] thomaslee edited a comment on pull request #9111: KAFKA-10337: await async commits in commitSync even if no offsets given

2020-08-05 Thread GitBox
thomaslee edited a comment on pull request #9111: URL: https://github.com/apache/kafka/pull/9111#issuecomment-669624137 It's somewhat easy to do it accidentally. The scenario I was concerned about looks something like this with auto offset commits disabled: ```java KafkaConsumer<.

[GitHub] [kafka] chia7712 commented on a change in pull request #9102: KAFKA-10326 Both serializer and deserializer should be able to see th…

2020-08-05 Thread GitBox
chia7712 commented on a change in pull request #9102: URL: https://github.com/apache/kafka/pull/9102#discussion_r466092016 ## File path: clients/src/test/java/org/apache/kafka/clients/consumer/KafkaConsumerTest.java ## @@ -2511,4 +2511,39 @@ public void testEnforceRebalanceTr

[GitHub] [kafka] guozhangwang commented on a change in pull request #8964: KAFKA-9450: Decouple flushing state from commiting

2020-08-05 Thread GitBox
guozhangwang commented on a change in pull request #8964: URL: https://github.com/apache/kafka/pull/8964#discussion_r466099908 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamTask.java ## @@ -428,53 +428,28 @@ public void resume() {

[GitHub] [kafka] guozhangwang commented on a change in pull request #8964: KAFKA-9450: Decouple flushing state from commiting

2020-08-05 Thread GitBox
guozhangwang commented on a change in pull request #8964: URL: https://github.com/apache/kafka/pull/8964#discussion_r466103277 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamTask.java ## @@ -428,53 +428,28 @@ public void resume() {

[GitHub] [kafka] guozhangwang commented on a change in pull request #8964: KAFKA-9450: Decouple flushing state from commiting

2020-08-05 Thread GitBox
guozhangwang commented on a change in pull request #8964: URL: https://github.com/apache/kafka/pull/8964#discussion_r466103562 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/TaskManager.java ## @@ -248,12 +248,11 @@ public void handleAssignmen

[GitHub] [kafka] guozhangwang commented on a change in pull request #8964: KAFKA-9450: Decouple flushing state from commiting

2020-08-05 Thread GitBox
guozhangwang commented on a change in pull request #8964: URL: https://github.com/apache/kafka/pull/8964#discussion_r466104671 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/TaskManager.java ## @@ -243,18 +242,24 @@ public void handleAssignmen

[GitHub] [kafka] guozhangwang commented on a change in pull request #8964: KAFKA-9450: Decouple flushing state from commiting

2020-08-05 Thread GitBox
guozhangwang commented on a change in pull request #8964: URL: https://github.com/apache/kafka/pull/8964#discussion_r466105496 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/TaskManager.java ## @@ -267,80 +266,19 @@ public void handleAssignmen

[GitHub] [kafka] guozhangwang commented on a change in pull request #8964: KAFKA-9450: Decouple flushing state from commiting

2020-08-05 Thread GitBox
guozhangwang commented on a change in pull request #8964: URL: https://github.com/apache/kafka/pull/8964#discussion_r466107280 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/TaskManager.java ## @@ -368,7 +306,102 @@ public void handleAssignmen

[GitHub] [kafka] guozhangwang commented on a change in pull request #8964: KAFKA-9450: Decouple flushing state from commiting

2020-08-05 Thread GitBox
guozhangwang commented on a change in pull request #8964: URL: https://github.com/apache/kafka/pull/8964#discussion_r466108344 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/TaskManager.java ## @@ -479,24 +512,20 @@ boolean tryToCompleteRestor

[GitHub] [kafka] ableegoldman commented on a change in pull request #8964: KAFKA-9450: Decouple flushing state from commiting

2020-08-05 Thread GitBox
ableegoldman commented on a change in pull request #8964: URL: https://github.com/apache/kafka/pull/8964#discussion_r466109545 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/TaskManager.java ## @@ -248,12 +248,11 @@ public void handleAssignmen

[GitHub] [kafka] chia7712 commented on pull request #8657: KAFKA-8334 Make sure the thread which tries to complete delayed reque…

2020-08-05 Thread GitBox
chia7712 commented on pull request #8657: URL: https://github.com/apache/kafka/pull/8657#issuecomment-669647781 @junrao I also don't want to include more mechanisms to complicate this story. It seems to me we can do a litter factor for ```DelayedOperation``` to resolve this issue. ```force

[GitHub] [kafka] guozhangwang commented on a change in pull request #8964: KAFKA-9450: Decouple flushing state from commiting

2020-08-05 Thread GitBox
guozhangwang commented on a change in pull request #8964: URL: https://github.com/apache/kafka/pull/8964#discussion_r466113898 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/TaskManager.java ## @@ -248,12 +248,11 @@ public void handleAssignmen

[GitHub] [kafka] johnthotekat commented on pull request #9120: KAFKA-10316: Consider renaming getter method for Interactive Queries

2020-08-05 Thread GitBox
johnthotekat commented on pull request #9120: URL: https://github.com/apache/kafka/pull/9120#issuecomment-669664246 > @johnthotekat Some testa are know to be flaky and we try to work on them to avoid those build issues. It's constant effort to keep the build stable. Will trigger a new Jenk

[GitHub] [kafka] guozhangwang commented on pull request #8964: KAFKA-9450: Decouple flushing state from commiting

2020-08-05 Thread GitBox
guozhangwang commented on pull request #8964: URL: https://github.com/apache/kafka/pull/8964#issuecomment-669664978 I've addressed the comments and here are the major changes: 1) do not delete checkpoint file upon loading it, and as a result simplify the checkpointNeeded logic, initi

[GitHub] [kafka] guozhangwang commented on a change in pull request #9094: KAFKA-10054: KIP-613, add TRACE-level e2e latency metrics

2020-08-05 Thread GitBox
guozhangwang commented on a change in pull request #9094: URL: https://github.com/apache/kafka/pull/9094#discussion_r466134186 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamTask.java ## @@ -154,15 +153,15 @@ public StreamTask(final Task

[GitHub] [kafka] abbccdda commented on a change in pull request #8923: KAFKA-6435: KIP-623 Add internal topics option to streamResetter

2020-08-05 Thread GitBox
abbccdda commented on a change in pull request #8923: URL: https://github.com/apache/kafka/pull/8923#discussion_r466127053 ## File path: core/src/main/scala/kafka/tools/StreamsResetter.java ## @@ -646,22 +655,68 @@ private boolean isIntermediateTopic(final String topic) {

[GitHub] [kafka] omkreddy commented on pull request #9050: KAFKA-10193: Add preemption for controller events that have callbacks

2020-08-05 Thread GitBox
omkreddy commented on pull request #9050: URL: https://github.com/apache/kafka/pull/9050#issuecomment-669692997 retest this please This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [kafka] apovzner commented on a change in pull request #9114: KAFKA-10162; Use Token Bucket algorithm for controller mutation quota (KIP-599, Part III)

2020-08-05 Thread GitBox
apovzner commented on a change in pull request #9114: URL: https://github.com/apache/kafka/pull/9114#discussion_r466161719 ## File path: clients/src/main/java/org/apache/kafka/common/metrics/stats/TokenBucket.java ## @@ -0,0 +1,83 @@ +/* + * Licensed to the Apache Software Fou

[GitHub] [kafka] apovzner commented on a change in pull request #9114: KAFKA-10162; Use Token Bucket algorithm for controller mutation quota (KIP-599, Part III)

2020-08-05 Thread GitBox
apovzner commented on a change in pull request #9114: URL: https://github.com/apache/kafka/pull/9114#discussion_r466162270 ## File path: clients/src/main/java/org/apache/kafka/common/metrics/stats/TokenBucket.java ## @@ -0,0 +1,83 @@ +/* + * Licensed to the Apache Software Fou

[GitHub] [kafka] kowshik commented on a change in pull request #9001: KAFKA-10028: Implement write path for feature versioning system (KIP-584)

2020-08-05 Thread GitBox
kowshik commented on a change in pull request #9001: URL: https://github.com/apache/kafka/pull/9001#discussion_r463912157 ## File path: clients/src/main/java/org/apache/kafka/clients/admin/KafkaAdminClient.java ## @@ -4052,6 +4058,128 @@ void handleFailure(Throwable throwable)

[GitHub] [kafka] mimaison opened a new pull request #9131: KAFKA-10367: Allow running the Streams demo app with a config file

2020-08-06 Thread GitBox
mimaison opened a new pull request #9131: URL: https://github.com/apache/kafka/pull/9131 Update the 3 WordCount demos to accept a configuration file. I kept the changes to the minimum as the point of these samples is not to add a lot of logic for parsing arguments and handling usage errors

[GitHub] [kafka] serjchebotarev commented on pull request #9028: KAFKA-10035: Safer conversion of consumer timeout parameters

2020-08-06 Thread GitBox
serjchebotarev commented on pull request #9028: URL: https://github.com/apache/kafka/pull/9028#issuecomment-669823727 @vvcephei & @mjsax this one seems to get stalled a bit - could you let me know if anything else is to be corrected here or should we move on with retesting the changes? -

[GitHub] [kafka] tombentley commented on pull request #8878: MINOR: Generator config-specific HTML ids

2020-08-06 Thread GitBox
tombentley commented on pull request #8878: URL: https://github.com/apache/kafka/pull/8878#issuecomment-669856151 @omkreddy any progress on this? This is an automated message from the Apache Git Service. To respond to the mes

[GitHub] [kafka] omkreddy commented on pull request #9050: KAFKA-10193: Add preemption for controller events that have callbacks

2020-08-06 Thread GitBox
omkreddy commented on pull request #9050: URL: https://github.com/apache/kafka/pull/9050#issuecomment-669866356 ok to test This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [kafka] lct45 commented on a change in pull request #9039: KAFKA-5636: SlidingWindows (KIP-450)

2020-08-06 Thread GitBox
lct45 commented on a change in pull request #9039: URL: https://github.com/apache/kafka/pull/9039#discussion_r466425932 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/CogroupedStreamAggregateBuilder.java ## @@ -132,16 +135,19 @@

[GitHub] [kafka] omkreddy commented on a change in pull request #9050: KAFKA-10193: Add preemption for controller events that have callbacks

2020-08-06 Thread GitBox
omkreddy commented on a change in pull request #9050: URL: https://github.com/apache/kafka/pull/9050#discussion_r466455643 ## File path: core/src/main/scala/kafka/controller/KafkaController.scala ## @@ -1986,101 +1965,125 @@ private[controller] class ControllerStats extends Ka

[GitHub] [kafka] guillaumebort opened a new pull request #9132: Times for offsets

2020-08-06 Thread GitBox
guillaumebort opened a new pull request #9132: URL: https://github.com/apache/kafka/pull/9132 *More detailed description of your change, if necessary. The PR title and PR message become the squashed commit message, so use a separate comment to ping reviewers.* *Summary of tes

[GitHub] [kafka] dajac commented on pull request #9114: KAFKA-10162; Use Token Bucket algorithm for controller mutation quota (KIP-599, Part III)

2020-08-06 Thread GitBox
dajac commented on pull request #9114: URL: https://github.com/apache/kafka/pull/9114#issuecomment-669977494 @junrao I have updated the KIP and posted an update to the thread in the mailing list. This is an automated message

[GitHub] [kafka] stanislavkozlovski commented on pull request #9079: KAFKA-10308 fix flaky core/round_trip_fault_test.py

2020-08-06 Thread GitBox
stanislavkozlovski commented on pull request #9079: URL: https://github.com/apache/kafka/pull/9079#issuecomment-669992453 @ijuma considering this is causing the system test to be flaky, is it worth backporting? It seems like the test is present since 1.1 --

[GitHub] [kafka] junrao merged pull request #9114: KAFKA-10162; Use Token Bucket algorithm for controller mutation quota (KIP-599, Part III)

2020-08-06 Thread GitBox
junrao merged pull request #9114: URL: https://github.com/apache/kafka/pull/9114 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] mjsax commented on pull request #9131: KAFKA-10367: Allow running the Streams demo app with a config file

2020-08-06 Thread GitBox
mjsax commented on pull request #9131: URL: https://github.com/apache/kafka/pull/9131#issuecomment-670039989 Checkstyle error: ``` > Task :streams:examples:checkstyleMain FAILED 02:46:32 [ant:checkstyle] [ERROR] /home/jenkins/jenkins-slave/workspace/kafka-pr-jdk11-scala2.13/streams

[GitHub] [kafka] hachikuji commented on a change in pull request #9110: MINOR: Ensure a reason is logged for all segment deletion operations

2020-08-06 Thread GitBox
hachikuji commented on a change in pull request #9110: URL: https://github.com/apache/kafka/pull/9110#discussion_r466550492 ## File path: core/src/main/scala/kafka/log/Log.scala ## @@ -2227,13 +2210,16 @@ class Log(@volatile private var _dir: File, * @param segments The log

[GitHub] [kafka] abbccdda commented on a change in pull request #9103: Add redirection for (Incremental)AlterConfig

2020-08-06 Thread GitBox
abbccdda commented on a change in pull request #9103: URL: https://github.com/apache/kafka/pull/9103#discussion_r466582281 ## File path: core/src/main/scala/kafka/server/KafkaApis.scala ## @@ -2982,12 +3089,33 @@ class KafkaApis(val requestChannel: RequestChannel,

[GitHub] [kafka] mjsax commented on a change in pull request #9131: KAFKA-10367: Allow running the Streams demo app with a config file

2020-08-06 Thread GitBox
mjsax commented on a change in pull request #9131: URL: https://github.com/apache/kafka/pull/9131#discussion_r466596054 ## File path: streams/examples/src/main/java/org/apache/kafka/streams/examples/wordcount/WordCountDemo.java ## @@ -47,18 +49,23 @@ public static final S

[GitHub] [kafka] mjsax merged pull request #9120: KAFKA-10316: Consider renaming getter method for Interactive Queries

2020-08-06 Thread GitBox
mjsax merged pull request #9120: URL: https://github.com/apache/kafka/pull/9120 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] mjsax commented on pull request #9120: KAFKA-10316: Consider renaming getter method for Interactive Queries

2020-08-06 Thread GitBox
mjsax commented on pull request #9120: URL: https://github.com/apache/kafka/pull/9120#issuecomment-670094310 Thanks for the KIP and PR @johnthotekat. Merged to `trunk`. This is an automated message from the Apache Git Service

[GitHub] [kafka] mjsax commented on pull request #9120: KAFKA-10316: Consider renaming getter method for Interactive Queries

2020-08-06 Thread GitBox
mjsax commented on pull request #9120: URL: https://github.com/apache/kafka/pull/9120#issuecomment-670095558 One more thing: could you do a second PR to update the docs accordingly? We should list the KIP at lest in `docs/streams/upgrade-guide.html` (there should be already a section for 2

[GitHub] [kafka] dhruvilshah3 commented on a change in pull request #9110: MINOR: Ensure a reason is logged for all segment deletion operations

2020-08-06 Thread GitBox
dhruvilshah3 commented on a change in pull request #9110: URL: https://github.com/apache/kafka/pull/9110#discussion_r466601556 ## File path: core/src/main/scala/kafka/log/Log.scala ## @@ -2227,13 +2210,16 @@ class Log(@volatile private var _dir: File, * @param segments The

[GitHub] [kafka] mjsax merged pull request #9127: MINOR: fix HTML

2020-08-06 Thread GitBox
mjsax merged pull request #9127: URL: https://github.com/apache/kafka/pull/9127 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] mjsax commented on pull request #9127: MINOR: fix HTML

2020-08-06 Thread GitBox
mjsax commented on pull request #9127: URL: https://github.com/apache/kafka/pull/9127#issuecomment-670098130 Merged to `trunk` and cherry-picked to `2.6`. This is an automated message from the Apache Git Service. To respond t

[GitHub] [kafka] mjsax merged pull request #9060: KAFKA-9274: Remove `retries` from InternalTopicManager

2020-08-06 Thread GitBox
mjsax merged pull request #9060: URL: https://github.com/apache/kafka/pull/9060 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] junrao commented on pull request #8657: KAFKA-8334 Make sure the thread which tries to complete delayed reque…

2020-08-06 Thread GitBox
junrao commented on pull request #8657: URL: https://github.com/apache/kafka/pull/8657#issuecomment-670113688 @chia7712 : If we could solve the issue by simplifying DelayedOperation, it would be ideal. I am not sure how your proposal avoids the above potential deadlock. Could you provide a

[GitHub] [kafka] hachikuji commented on pull request #9110: MINOR: Ensure a reason is logged for all segment deletion operations

2020-08-06 Thread GitBox
hachikuji commented on pull request #9110: URL: https://github.com/apache/kafka/pull/9110#issuecomment-670127847 retest this please This is an automated message from the Apache Git Service. To respond to the message, please l

[GitHub] [kafka] hachikuji commented on pull request #9110: MINOR: Ensure a reason is logged for all segment deletion operations

2020-08-06 Thread GitBox
hachikuji commented on pull request #9110: URL: https://github.com/apache/kafka/pull/9110#issuecomment-670126784 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [kafka] ableegoldman commented on a change in pull request #9039: KAFKA-5636: SlidingWindows (KIP-450)

2020-08-06 Thread GitBox
ableegoldman commented on a change in pull request #9039: URL: https://github.com/apache/kafka/pull/9039#discussion_r466618450 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/CogroupedStreamAggregateBuilder.java ## @@ -132,16 +135,19 @@

[GitHub] [kafka] dielhennr commented on a change in pull request #9101: KAFKA-10325: KIP-649 implementation

2020-08-06 Thread GitBox
dielhennr commented on a change in pull request #9101: URL: https://github.com/apache/kafka/pull/9101#discussion_r466653159 ## File path: clients/src/main/java/org/apache/kafka/clients/consumer/internals/AbstractCoordinator.java ## @@ -504,6 +515,7 @@ public void onSuccess(Byt

[GitHub] [kafka] CEikermann commented on pull request #7539: KAFKA-6968: Adds calls to listener on rebalance of MockConsumer

2020-08-06 Thread GitBox
CEikermann commented on pull request #7539: URL: https://github.com/apache/kafka/pull/7539#issuecomment-670164657 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [kafka] CEikermann removed a comment on pull request #7539: KAFKA-6968: Adds calls to listener on rebalance of MockConsumer

2020-08-06 Thread GitBox
CEikermann removed a comment on pull request #7539: URL: https://github.com/apache/kafka/pull/7539#issuecomment-670164684 Would be nice to merge this Is anything open for this merge request before it can be merged? Thi

[GitHub] [kafka] rondagostino commented on a change in pull request #9032: KAFKA-10259: KIP-554 Broker-side SCRAM Config API

2020-08-06 Thread GitBox
rondagostino commented on a change in pull request #9032: URL: https://github.com/apache/kafka/pull/9032#discussion_r466681231 ## File path: clients/src/main/java/org/apache/kafka/clients/admin/KafkaAdminClient.java ## @@ -4071,6 +4081,168 @@ void handleFailure(Throwable throw

[GitHub] [kafka] dielhennr commented on a change in pull request #9101: KAFKA-10325: KIP-649 implementation

2020-08-06 Thread GitBox
dielhennr commented on a change in pull request #9101: URL: https://github.com/apache/kafka/pull/9101#discussion_r466653159 ## File path: clients/src/main/java/org/apache/kafka/clients/consumer/internals/AbstractCoordinator.java ## @@ -504,6 +515,7 @@ public void onSuccess(Byt

[GitHub] [kafka] dielhennr commented on a change in pull request #9101: KAFKA-10325: KIP-649 implementation

2020-08-06 Thread GitBox
dielhennr commented on a change in pull request #9101: URL: https://github.com/apache/kafka/pull/9101#discussion_r466653159 ## File path: clients/src/main/java/org/apache/kafka/clients/consumer/internals/AbstractCoordinator.java ## @@ -504,6 +515,7 @@ public void onSuccess(Byt

[GitHub] [kafka] abbccdda commented on a change in pull request #9103: Add redirection for (Incremental)AlterConfig

2020-08-06 Thread GitBox
abbccdda commented on a change in pull request #9103: URL: https://github.com/apache/kafka/pull/9103#discussion_r466714423 ## File path: core/src/main/scala/kafka/server/KafkaApis.scala ## @@ -2982,12 +3089,33 @@ class KafkaApis(val requestChannel: RequestChannel,

[GitHub] [kafka] mjsax commented on a change in pull request #8964: KAFKA-9450: Decouple flushing state from commiting

2020-08-06 Thread GitBox
mjsax commented on a change in pull request #8964: URL: https://github.com/apache/kafka/pull/8964#discussion_r466716421 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/AbstractTask.java ## @@ -49,6 +61,30 @@ this.stateDirectory = state

[GitHub] [kafka] mjsax commented on a change in pull request #8964: KAFKA-9450: Decouple flushing state from commiting

2020-08-06 Thread GitBox
mjsax commented on a change in pull request #8964: URL: https://github.com/apache/kafka/pull/8964#discussion_r466717212 ## File path: streams/src/test/java/org/apache/kafka/streams/tests/EosTestDriver.java ## @@ -379,9 +379,18 @@ private static void verifyReceivedAllRecords(fi

[GitHub] [kafka] mjsax commented on a change in pull request #8964: KAFKA-9450: Decouple flushing state from commiting

2020-08-06 Thread GitBox
mjsax commented on a change in pull request #8964: URL: https://github.com/apache/kafka/pull/8964#discussion_r466717608 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamTask.java ## @@ -344,40 +343,41 @@ public void resume() { }

[GitHub] [kafka] hachikuji commented on pull request #9110: MINOR: Ensure a reason is logged for all segment deletion operations

2020-08-06 Thread GitBox
hachikuji commented on pull request #9110: URL: https://github.com/apache/kafka/pull/9110#issuecomment-670239077 retest this please This is an automated message from the Apache Git Service. To respond to the message, please l

[GitHub] [kafka] LMnet commented on pull request #8955: KAFKA-10020: Create a new version of a scala Serdes without name clash (KIP-616)

2020-08-06 Thread GitBox
LMnet commented on pull request #8955: URL: https://github.com/apache/kafka/pull/8955#issuecomment-670265314 I added `nullSerde` and rebased branch to the current trunk. This is an automated message from the Apache Git Servic

[GitHub] [kafka] ableegoldman commented on pull request #9094: KAFKA-10054: KIP-613, add TRACE-level e2e latency metrics

2020-08-06 Thread GitBox
ableegoldman commented on pull request #9094: URL: https://github.com/apache/kafka/pull/9094#issuecomment-670281342 Hey @guozhangwang Thanks for the review. You have some high-level questions so I'll try to answer them here but let me know if you want to sync offline. > the only

[GitHub] [kafka] ableegoldman edited a comment on pull request #9094: KAFKA-10054: KIP-613, add TRACE-level e2e latency metrics

2020-08-06 Thread GitBox
ableegoldman edited a comment on pull request #9094: URL: https://github.com/apache/kafka/pull/9094#issuecomment-670281342 Hey @guozhangwang Thanks for the review. You have some high-level questions so I'll try to answer them here but let me know if you want to sync offline. edit

[GitHub] [kafka] ableegoldman commented on pull request #9094: KAFKA-10054: KIP-613, add TRACE-level e2e latency metrics

2020-08-06 Thread GitBox
ableegoldman commented on pull request #9094: URL: https://github.com/apache/kafka/pull/9094#issuecomment-670282246 Oh I think I misread your original comment, editing my response above This is an automated message from the A

[GitHub] [kafka] ableegoldman edited a comment on pull request #9094: KAFKA-10054: KIP-613, add TRACE-level e2e latency metrics

2020-08-06 Thread GitBox
ableegoldman edited a comment on pull request #9094: URL: https://github.com/apache/kafka/pull/9094#issuecomment-670281342 Hey @guozhangwang Thanks for the review. You have some high-level questions so I'll try to answer them here but let me know if you want to sync offline. > th

[GitHub] [kafka] chia7712 commented on pull request #8657: KAFKA-8334 Make sure the thread which tries to complete delayed reque…

2020-08-06 Thread GitBox
chia7712 commented on pull request #8657: URL: https://github.com/apache/kafka/pull/8657#issuecomment-670293057 > Could you provide a bit more detail? The new deadlock you mentioned is caused by PR. This PR introduces extra lock (```ReentrantLock```) to ```DelayedJoin``` (By contrast

[GitHub] [kafka] johnthotekat opened a new pull request #9133: KAFKA-10316: Updated Kafka Streams upgrade notes.

2020-08-06 Thread GitBox
johnthotekat opened a new pull request #9133: URL: https://github.com/apache/kafka/pull/9133 * Added the details on KIP-648 to 2.7.0 upgrade notes - `docs/streams/upgrade-guide.html` @mjsax This is an automated mess

[GitHub] [kafka] johnthotekat commented on pull request #9133: KAFKA-10316: Updated Kafka Streams upgrade notes.

2020-08-06 Thread GitBox
johnthotekat commented on pull request #9133: URL: https://github.com/apache/kafka/pull/9133#issuecomment-670322175 @mjsax I've checked the actual documentations and just to make sure I've also checked for the occurrence of the deprecated methods throughout the repo and found none (except

[GitHub] [kafka] johnthotekat commented on pull request #9120: KAFKA-10316: Consider renaming getter method for Interactive Queries

2020-08-06 Thread GitBox
johnthotekat commented on pull request #9120: URL: https://github.com/apache/kafka/pull/9120#issuecomment-670322541 @mjsax Made the changes and raised PR : https://github.com/apache/kafka/pull/9133 Checked the actual documentations, we're good here. --

[GitHub] [kafka] chia7712 opened a new pull request #9134: MINOR: set initial capacity for all array buffers in converting produ…

2020-08-07 Thread GitBox
chia7712 opened a new pull request #9134: URL: https://github.com/apache/kafka/pull/9134 this is a bit optimization of converting producer responses. Those array buffers need initial capacity to avoid growing continually if the request carries a bunch of small messages and those messages a

[GitHub] [kafka] tom1299 opened a new pull request #9135: MINOR [WIP] Refactor Producer class in examples

2020-08-07 Thread GitBox
tom1299 opened a new pull request #9135: URL: https://github.com/apache/kafka/pull/9135 I'm a newbie to the Kafka project and going through the examples. Along the way I did a very small refactoring to the Producer class: * Convert the Callback class into a method The aim was to s

[GitHub] [kafka] tombentley commented on pull request #8878: MINOR: Generator config-specific HTML ids

2020-08-07 Thread GitBox
tombentley commented on pull request #8878: URL: https://github.com/apache/kafka/pull/8878#issuecomment-670404348 Thinking about, it we could avoid breaking existing links by generating both old and new style ids: `whatever.config.name`. WDYT @mimaison @omkreddy? -

[GitHub] [kafka] tombentley opened a new pull request #9136: KAFKA-10211: Add DirectoryConfigProvider

2020-08-07 Thread GitBox
tombentley opened a new pull request #9136: URL: https://github.com/apache/kafka/pull/9136 See KIP-632. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [kafka] tombentley commented on pull request #9136: KAFKA-10211: Add DirectoryConfigProvider

2020-08-07 Thread GitBox
tombentley commented on pull request #9136: URL: https://github.com/apache/kafka/pull/9136#issuecomment-670438137 @omkreddy, @mimaison, @rajinisivaram, @kkonstantine, @dajac thanks for voting on the KIP. I'd be grateful for review. -

[GitHub] [kafka] rajinisivaram commented on a change in pull request #9032: KAFKA-10259: KIP-554 Broker-side SCRAM Config API

2020-08-07 Thread GitBox
rajinisivaram commented on a change in pull request #9032: URL: https://github.com/apache/kafka/pull/9032#discussion_r467052269 ## File path: clients/src/main/java/org/apache/kafka/clients/admin/KafkaAdminClient.java ## @@ -4071,6 +4081,168 @@ void handleFailure(Throwable thro

[GitHub] [kafka] jeqo opened a new pull request #9137: KAFKA-9929: Support reverse iterator on KeyValueStore

2020-08-07 Thread GitBox
jeqo opened a new pull request #9137: URL: https://github.com/apache/kafka/pull/9137 *More detailed description of your change, if necessary. The PR title and PR message become the squashed commit message, so use a separate comment to ping reviewers.* *Summary of testing stra

[GitHub] [kafka] jeqo opened a new pull request #9138: Backward windowstore

2020-08-07 Thread GitBox
jeqo opened a new pull request #9138: URL: https://github.com/apache/kafka/pull/9138 Depends on https://github.com/apache/kafka/pull/9137 *More detailed description of your change, if necessary. The PR title and PR message become the squashed commit message, so use a separate

[GitHub] [kafka] jeqo opened a new pull request #9139: KAFKA-9929: Support backward iterator on SessionStore

2020-08-07 Thread GitBox
jeqo opened a new pull request #9139: URL: https://github.com/apache/kafka/pull/9139 Depends on https://github.com/apache/kafka/pull/9138 *More detailed description of your change, if necessary. The PR title and PR message become the squashed commit message, so use a separate

[GitHub] [kafka] hachikuji commented on a change in pull request #7222: KAFKA-8806 Reduce calls to validateOffsetsIfNeeded

2020-08-07 Thread GitBox
hachikuji commented on a change in pull request #7222: URL: https://github.com/apache/kafka/pull/7222#discussion_r467139256 ## File path: clients/src/main/java/org/apache/kafka/clients/consumer/internals/SubscriptionState.java ## @@ -406,6 +407,10 @@ synchronized void maybeSee

[GitHub] [kafka] jeqo commented on pull request #8976: KIP-617: Allow Kafka Streams State Stores to be iterated backwards

2020-08-07 Thread GitBox
jeqo commented on pull request #8976: URL: https://github.com/apache/kafka/pull/8976#issuecomment-670601289 @ableegoldman great feedback. It makes sense to group changes in 3 different PRs. As there is dependencies between stores, let's start with KeyValue, then Window and finally Session

[GitHub] [kafka] dajac opened a new pull request #9140: KAFKA-10371; Partition reassignments can result in crashed ReplicaFetcherThreads

2020-08-07 Thread GitBox
dajac opened a new pull request #9140: URL: https://github.com/apache/kafka/pull/9140 https://github.com/apache/kafka/pull/8672 introduced a bug leading to crashing the replica fetcher threads. The issue is that https://github.com/apache/kafka/pull/8672 deletes the Partitions prior to sto

[GitHub] [kafka] jeqo closed pull request #8976: KIP-617: Allow Kafka Streams State Stores to be iterated backwards

2020-08-07 Thread GitBox
jeqo closed pull request #8976: URL: https://github.com/apache/kafka/pull/8976 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

[GitHub] [kafka] jeqo commented on pull request #8976: KIP-617: Allow Kafka Streams State Stores to be iterated backwards

2020-08-07 Thread GitBox
jeqo commented on pull request #8976: URL: https://github.com/apache/kafka/pull/8976#issuecomment-670601500 Closing in favor of #9137, #9138 and #9139 This is an automated message from the Apache Git Service. To respond to t

[GitHub] [kafka] hachikuji commented on pull request #9140: KAFKA-10371; Partition reassignments can result in crashed ReplicaFetcherThreads

2020-08-07 Thread GitBox
hachikuji commented on pull request #9140: URL: https://github.com/apache/kafka/pull/9140#issuecomment-670606960 ok to test This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [kafka] dajac commented on pull request #9140: KAFKA-10371; Partition reassignments can result in crashed ReplicaFetcherThreads

2020-08-07 Thread GitBox
dajac commented on pull request #9140: URL: https://github.com/apache/kafka/pull/9140#issuecomment-670607229 Jira: https://issues.apache.org/jira/browse/KAFKA-10374 This is an automated message from the Apache Git Service. To

<    3   4   5   6   7   8   9   10   11   12   >