[jira] [Commented] (KAFKA-7304) memory leakage in org.apache.kafka.common.network.Selector

2020-07-07 Thread Stanislav Kozlovski (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17152523#comment-17152523 ] Stanislav Kozlovski commented on KAFKA-7304: Given that this Jira is for repo

[GitHub] [kafka] dajac commented on pull request #8683: KAFKA-9893: Configurable TCP connection timeout and improve the initial metadata fetch

2020-07-07 Thread GitBox
dajac commented on pull request #8683: URL: https://github.com/apache/kafka/pull/8683#issuecomment-654671084 Investigating this. This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [kafka] rajinisivaram commented on a change in pull request #8683: KAFKA-9893: Configurable TCP connection timeout and improve the initial metadata fetch

2020-07-07 Thread GitBox
rajinisivaram commented on a change in pull request #8683: URL: https://github.com/apache/kafka/pull/8683#discussion_r450706026 ## File path: clients/src/main/java/org/apache/kafka/clients/NetworkClient.java ## @@ -786,6 +809,29 @@ private void handleAbortedSends(List response

[jira] [Created] (KAFKA-10243) ConcurrentModificationException while processing connection setup timeouts

2020-07-07 Thread Rajini Sivaram (Jira)
Rajini Sivaram created KAFKA-10243: -- Summary: ConcurrentModificationException while processing connection setup timeouts Key: KAFKA-10243 URL: https://issues.apache.org/jira/browse/KAFKA-10243 Projec

[GitHub] [kafka] omkreddy commented on pull request #8885: KAFKA-8264: decrease the record size for flaky test

2020-07-07 Thread GitBox
omkreddy commented on pull request #8885: URL: https://github.com/apache/kafka/pull/8885#issuecomment-654729182 retest this please This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [kafka] rajinisivaram commented on pull request #8979: KAFKA-10223; Make ReplicaNotAvailableException retriable metadata exception

2020-07-07 Thread GitBox
rajinisivaram commented on pull request #8979: URL: https://github.com/apache/kafka/pull/8979#issuecomment-654729231 @ijuma @hachikuji Thank you, I guess we need a KIP anyway even for renaming `NOT_LEADER_FOR_PARTITION`. We can discuss the options during KIP discussion. My only concern ab

[GitHub] [kafka] dongjinleekr commented on pull request #8150: KAFKA-9587: Producer configs are omitted in the documentation

2020-07-07 Thread GitBox
dongjinleekr commented on pull request #8150: URL: https://github.com/apache/kafka/pull/8150#issuecomment-654736525 Retest this please. This is an automated message from the Apache Git Service. To respond to the message, plea

[GitHub] [kafka] dongjinleekr edited a comment on pull request #8150: KAFKA-9587: Producer configs are omitted in the documentation

2020-07-07 Thread GitBox
dongjinleekr edited a comment on pull request #8150: URL: https://github.com/apache/kafka/pull/8150#issuecomment-649403477 Rebased onto the latest trunk and I reviewed the problem more carefully and here is the summary: 1. As @kkonstantine stated, [the default value of `retries` conf

[GitHub] [kafka] dajac opened a new pull request #8990: KAFKA-10243; ConcurrentModificationException while processing connection setup timeouts

2020-07-07 Thread GitBox
dajac opened a new pull request #8990: URL: https://github.com/apache/kafka/pull/8990 This PR fixes a bug introduced in https://github.com/apache/kafka/pull/8683/. While processing connection set up timeouts, we are iterating through the connecting nodes to process timeouts and we di

[GitHub] [kafka] rajinisivaram commented on pull request #8990: KAFKA-10243; ConcurrentModificationException while processing connection setup timeouts

2020-07-07 Thread GitBox
rajinisivaram commented on pull request #8990: URL: https://github.com/apache/kafka/pull/8990#issuecomment-654748250 ok to test This is an automated message from the Apache Git Service. To respond to the message, please log o

[GitHub] [kafka] rajinisivaram commented on a change in pull request #8990: KAFKA-10243; ConcurrentModificationException while processing connection setup timeouts

2020-07-07 Thread GitBox
rajinisivaram commented on a change in pull request #8990: URL: https://github.com/apache/kafka/pull/8990#discussion_r450752852 ## File path: clients/src/test/java/org/apache/kafka/clients/ClusterConnectionStatesTest.java ## @@ -365,4 +367,48 @@ public void testExponentialConn

[GitHub] [kafka] dajac commented on a change in pull request #8990: KAFKA-10243; ConcurrentModificationException while processing connection setup timeouts

2020-07-07 Thread GitBox
dajac commented on a change in pull request #8990: URL: https://github.com/apache/kafka/pull/8990#discussion_r450756672 ## File path: clients/src/main/java/org/apache/kafka/clients/ClusterConnectionStates.java ## @@ -440,6 +441,20 @@ public boolean isConnectionSetupTimeout(Str

[GitHub] [kafka] dajac commented on pull request #8990: KAFKA-10243; ConcurrentModificationException while processing connection setup timeouts

2020-07-07 Thread GitBox
dajac commented on pull request #8990: URL: https://github.com/apache/kafka/pull/8990#issuecomment-654752598 @rajinisivaram Thanks for the review. I just pushed an update that addresses your feedback. This is an automated me

[GitHub] [kafka] rajinisivaram commented on pull request #8990: KAFKA-10243; ConcurrentModificationException while processing connection setup timeouts

2020-07-07 Thread GitBox
rajinisivaram commented on pull request #8990: URL: https://github.com/apache/kafka/pull/8990#issuecomment-654755355 retest this please This is an automated message from the Apache Git Service. To respond to the message, plea

[GitHub] [kafka] mimaison commented on pull request #8984: KAFKA-10227: Enforce cleanup policy to only contain compact or delete once

2020-07-07 Thread GitBox
mimaison commented on pull request #8984: URL: https://github.com/apache/kafka/pull/8984#issuecomment-654782138 @huxihx As @dajac mentioned, I also envisioned doing this check on the broker side. I actually initially hit this issue with a 3rd party client and just included the kafka

[jira] [Commented] (KAFKA-9168) Integrate JNI direct buffer support to RocksDBStore

2020-07-07 Thread Adam Bellemare (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17152701#comment-17152701 ] Adam Bellemare commented on KAFKA-9168: --- This would be incredibly useful for improv

[GitHub] [kafka] ijuma commented on a change in pull request #8936: KAFKA-10207: Fixed padded timeindex causing premature data deletion

2020-07-07 Thread GitBox
ijuma commented on a change in pull request #8936: URL: https://github.com/apache/kafka/pull/8936#discussion_r450843637 ## File path: core/src/test/scala/unit/kafka/log/TimeIndexTest.scala ## @@ -148,5 +148,39 @@ class TimeIndexTest { idx.close() } -} + /** + * I

[GitHub] [kafka] ijuma commented on a change in pull request #8936: KAFKA-10207: Fixed padded timeindex causing premature data deletion

2020-07-07 Thread GitBox
ijuma commented on a change in pull request #8936: URL: https://github.com/apache/kafka/pull/8936#discussion_r450844571 ## File path: core/src/main/scala/kafka/log/LogSegment.scala ## @@ -87,6 +87,12 @@ class LogSegment private[log] (val log: FileRecords, // we will reco

[GitHub] [kafka] ijuma commented on pull request #8979: KAFKA-10223; Make ReplicaNotAvailableException retriable metadata exception

2020-07-07 Thread GitBox
ijuma commented on pull request #8979: URL: https://github.com/apache/kafka/pull/8979#issuecomment-654842200 Renaming the error code name has no compatibility implications so in theory it could be done without a KIP. We could make this really boring and safe and call it `NOT_LEADER_OR_FOLL

[GitHub] [kafka] ijuma commented on pull request #8979: KAFKA-10223; Make ReplicaNotAvailableException retriable metadata exception

2020-07-07 Thread GitBox
ijuma commented on pull request #8979: URL: https://github.com/apache/kafka/pull/8979#issuecomment-654843181 If you both agree that the name above is reasonable, I would suggest sending a follow up to the KIP-320 thread covering what we've learned and how we're addressing it. It would be g

[GitHub] [kafka] ijuma commented on pull request #8979: KAFKA-10223; Make ReplicaNotAvailableException retriable metadata exception

2020-07-07 Thread GitBox
ijuma commented on pull request #8979: URL: https://github.com/apache/kafka/pull/8979#issuecomment-654844522 One issue is that the exception `NotLeaderForPartitionException` is in a public package. We could introduce a subclass, alwayys throw the subclass and deprecate `NotLeaderForPartiti

[GitHub] [kafka] dongjinleekr removed a comment on pull request #7204: KAFKA-8794: Provide Javadoc on DescribeLogDirsResult

2020-07-07 Thread GitBox
dongjinleekr removed a comment on pull request #7204: URL: https://github.com/apache/kafka/pull/7204#issuecomment-653769037 Retest this please. This is an automated message from the Apache Git Service. To respond to the messa

[GitHub] [kafka] rajinisivaram commented on pull request #8990: KAFKA-10243; ConcurrentModificationException while processing connection setup timeouts

2020-07-07 Thread GitBox
rajinisivaram commented on pull request #8990: URL: https://github.com/apache/kafka/pull/8990#issuecomment-654860922 retest this please This is an automated message from the Apache Git Service. To respond to the message, plea

[GitHub] [kafka] dongjinleekr commented on pull request #7204: KAFKA-8794: Deprecate DescribeLogDirsResponse.[LogDirInfo, ReplicaInfo]

2020-07-07 Thread GitBox
dongjinleekr commented on pull request #7204: URL: https://github.com/apache/kafka/pull/7204#issuecomment-654863820 @mimaison Hi. I updated the PR and submitted the [KIP](https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=158866169). I know that you must be on working frenzy

[GitHub] [kafka] dongjinleekr commented on pull request #7204: KAFKA-8794: Deprecate DescribeLogDirsResponse.[LogDirInfo, ReplicaInfo]

2020-07-07 Thread GitBox
dongjinleekr commented on pull request #7204: URL: https://github.com/apache/kafka/pull/7204#issuecomment-654864266 Retest this please This is an automated message from the Apache Git Service. To respond to the message, pleas

[GitHub] [kafka] dongjinleekr removed a comment on pull request #7204: KAFKA-8794: Deprecate DescribeLogDirsResponse.[LogDirInfo, ReplicaInfo]

2020-07-07 Thread GitBox
dongjinleekr removed a comment on pull request #7204: URL: https://github.com/apache/kafka/pull/7204#issuecomment-654864266 Retest this please This is an automated message from the Apache Git Service. To respond to the messag

[jira] [Assigned] (KAFKA-10241) Pursue a better way to cover ignorable RPC fields

2020-07-07 Thread Tom Bentley (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom Bentley reassigned KAFKA-10241: --- Assignee: Tom Bentley > Pursue a better way to cover ignorable RPC fields > --

[jira] [Assigned] (KAFKA-6453) Reconsider timestamp propagation semantics

2020-07-07 Thread Victoria Bialas (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Victoria Bialas reassigned KAFKA-6453: -- Assignee: (was: Victoria Bialas) > Reconsider timestamp propagation semantics > --

[GitHub] [kafka] mimaison commented on pull request #7204: KAFKA-8794: Deprecate DescribeLogDirsResponse.[LogDirInfo, ReplicaInfo]

2020-07-07 Thread GitBox
mimaison commented on pull request #7204: URL: https://github.com/apache/kafka/pull/7204#issuecomment-654883342 In the meantime, someone else had submitted a KIP for this change: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=158862109. I see both KIPs have active threads

[jira] [Commented] (KAFKA-6453) Reconsider timestamp propagation semantics

2020-07-07 Thread Victoria Bialas (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17152765#comment-17152765 ] Victoria Bialas commented on KAFKA-6453: Hi [~mjsax], I tried to re-assign this t

[jira] [Assigned] (KAFKA-6453) Reconsider timestamp propagation semantics

2020-07-07 Thread Victoria Bialas (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Victoria Bialas reassigned KAFKA-6453: -- Assignee: Victoria Bialas > Reconsider timestamp propagation semantics > -

[GitHub] [kafka] rajinisivaram commented on pull request #8979: KAFKA-10223; Make ReplicaNotAvailableException retriable metadata exception

2020-07-07 Thread GitBox
rajinisivaram commented on pull request #8979: URL: https://github.com/apache/kafka/pull/8979#issuecomment-654897593 @ijuma Sounds good to me. Will see what @hachikuji thinks as well. This is an automated message from the Apa

[GitHub] [kafka] ijuma commented on pull request #8979: KAFKA-10223; Make ReplicaNotAvailableException retriable metadata exception

2020-07-07 Thread GitBox
ijuma commented on pull request #8979: URL: https://github.com/apache/kafka/pull/8979#issuecomment-654900194 Also cc @edenhill as this affects non Java clients too. This is an automated message from the Apache Git Service. To

[GitHub] [kafka] vvcephei commented on a change in pull request #8962: KAFKA-10166: checkpoint recycled standbys and ignore empty rocksdb base directory

2020-07-07 Thread GitBox
vvcephei commented on a change in pull request #8962: URL: https://github.com/apache/kafka/pull/8962#discussion_r450513288 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/TaskManager.java ## @@ -270,8 +270,11 @@ public void handleAssignment(fin

[GitHub] [kafka] huxihx commented on pull request #7711: KAFKA-9157: Avoid generating empty segments if all records are deleted after cleaning

2020-07-07 Thread GitBox
huxihx commented on pull request #7711: URL: https://github.com/apache/kafka/pull/7711#issuecomment-654901088 @junrao Sorry for the long delay. Please review this patch again. This is an automated message from the Apache Git

[GitHub] [kafka] ijuma commented on pull request #8979: KAFKA-10223; Make ReplicaNotAvailableException retriable metadata exception

2020-07-07 Thread GitBox
ijuma commented on pull request #8979: URL: https://github.com/apache/kafka/pull/8979#issuecomment-654904651 We may also want to deprecate the error and exception for ReplicaNotAvailable since it would not serve any purpose, I think. ---

[GitHub] [kafka] ijuma edited a comment on pull request #8979: KAFKA-10223; Make ReplicaNotAvailableException retriable metadata exception

2020-07-07 Thread GitBox
ijuma edited a comment on pull request #8979: URL: https://github.com/apache/kafka/pull/8979#issuecomment-654904651 We may also want to deprecate the error and exception for ReplicaNotAvailable since it would not serve any purpose (apart from clients retaining compatibility with some broke

[GitHub] [kafka] edenhill commented on pull request #8979: KAFKA-10223; Make ReplicaNotAvailableException retriable metadata exception

2020-07-07 Thread GitBox
edenhill commented on pull request #8979: URL: https://github.com/apache/kafka/pull/8979#issuecomment-654911887 Renaming to NOT_LEADER_OR_FOLLOWER and reusing that error code in place of REPLICA_NOT_AVAILABLE sounds like a good idea. :+1: --

[GitHub] [kafka] cmccabe commented on pull request #8985: MINOR; KafkaAdminClient#alterReplicaLogDirs should not fail all the futures when only one call fails

2020-07-07 Thread GitBox
cmccabe commented on pull request #8985: URL: https://github.com/apache/kafka/pull/8985#issuecomment-654912275 good find, @dajac! LGTM pending Jenkins This is an automated message from the Apache Git Service. To respond to t

[GitHub] [kafka] huxihx commented on pull request #8984: KAFKA-10227: Enforce cleanup policy to only contain compact or delete once

2020-07-07 Thread GitBox
huxihx commented on pull request #8984: URL: https://github.com/apache/kafka/pull/8984#issuecomment-654913649 @mimaison @dajac If that's the case, I agree to move the logic into broker side. However, I suggest we keep the current refinement in `TopicCommand` and `ConfigCommand` since these

[jira] [Commented] (KAFKA-10243) ConcurrentModificationException while processing connection setup timeouts

2020-07-07 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17152797#comment-17152797 ] John Roesler commented on KAFKA-10243: -- Hey all, it seems like this is fixing a reg

[GitHub] [kafka] cmccabe commented on a change in pull request #8863: KAFKA-8528: Expose Trogdor-specific JMX metrics for Tasks and Agents

2020-07-07 Thread GitBox
cmccabe commented on a change in pull request #8863: URL: https://github.com/apache/kafka/pull/8863#discussion_r450921851 ## File path: tools/src/main/java/org/apache/kafka/trogdor/agent/Agent.java ## @@ -92,6 +93,8 @@ private final Time time; +final TrogdorMetrics

[GitHub] [kafka] cmccabe commented on a change in pull request #8863: KAFKA-8528: Expose Trogdor-specific JMX metrics for Tasks and Agents

2020-07-07 Thread GitBox
cmccabe commented on a change in pull request #8863: URL: https://github.com/apache/kafka/pull/8863#discussion_r450505811 ## File path: tools/src/main/java/org/apache/kafka/trogdor/coordinator/Coordinator.java ## @@ -70,6 +70,8 @@ private final Time time; +final T

[GitHub] [kafka] vvcephei commented on pull request #8902: KAFKA-10179: Pass correct changelog topic to state serdes

2020-07-07 Thread GitBox
vvcephei commented on pull request #8902: URL: https://github.com/apache/kafka/pull/8902#issuecomment-654916732 Test this please This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Commented] (KAFKA-10243) ConcurrentModificationException while processing connection setup timeouts

2020-07-07 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17152805#comment-17152805 ] David Jacot commented on KAFKA-10243: - [~vvcephei] This only affects trunk AFAIK. >

[GitHub] [kafka] akatona84 commented on a change in pull request #8019: KAFKA-8164: Improve test passing rate by rerunning flaky tests

2020-07-07 Thread GitBox
akatona84 commented on a change in pull request #8019: URL: https://github.com/apache/kafka/pull/8019#discussion_r450931353 ## File path: README.md ## @@ -48,6 +48,13 @@ Change the log4j setting in either `clients/src/test/resources/log4j.properties` ./gradlew clients:t

[jira] [Created] (KAFKA-10244) An new java interface to replace 'kafka.common.MessageReader'

2020-07-07 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-10244: -- Summary: An new java interface to replace 'kafka.common.MessageReader' Key: KAFKA-10244 URL: https://issues.apache.org/jira/browse/KAFKA-10244 Project: Kafka

[GitHub] [kafka] vvcephei commented on pull request #8987: KAFKA-10221: Backport fix for KAFKA-9603 to 2.5

2020-07-07 Thread GitBox
vvcephei commented on pull request #8987: URL: https://github.com/apache/kafka/pull/8987#issuecomment-654946672 Test this please This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [kafka] hachikuji commented on a change in pull request #8934: KAFKA-10134: Use long poll if we do not have fetchable partitions

2020-07-07 Thread GitBox
hachikuji commented on a change in pull request #8934: URL: https://github.com/apache/kafka/pull/8934#discussion_r450960971 ## File path: clients/src/main/java/org/apache/kafka/clients/consumer/KafkaConsumer.java ## @@ -1218,17 +1218,20 @@ public void assign(Collection partit

[GitHub] [kafka] vvcephei commented on a change in pull request #8987: KAFKA-10221: Backport fix for KAFKA-9603 to 2.5

2020-07-07 Thread GitBox
vvcephei commented on a change in pull request #8987: URL: https://github.com/apache/kafka/pull/8987#discussion_r450961919 ## File path: streams/src/main/java/org/apache/kafka/streams/state/internals/AbstractRocksDBSegmentedBytesStore.java ## @@ -251,7 +252,7 @@ void restoreAl

[GitHub] [kafka] vvcephei commented on pull request #8987: KAFKA-10221: Backport fix for KAFKA-9603 to 2.5

2020-07-07 Thread GitBox
vvcephei commented on pull request #8987: URL: https://github.com/apache/kafka/pull/8987#issuecomment-654951589 Retest this please This is an automated message from the Apache Git Service. To respond to the message, please lo

[jira] [Commented] (KAFKA-9630) Replace OffsetsForLeaderEpoch request/response with automated protocol

2020-07-07 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17152831#comment-17152831 ] David Jacot commented on KAFKA-9630: [~mimaison] Are you working on this one? If not,

[GitHub] [kafka] rajinisivaram commented on pull request #8990: KAFKA-10243; ConcurrentModificationException while processing connection setup timeouts

2020-07-07 Thread GitBox
rajinisivaram commented on pull request #8990: URL: https://github.com/apache/kafka/pull/8990#issuecomment-654954129 @dajac Thanks for the fix - wow, green build, haven't seen that in a while! Merging to trunk. This is an au

[GitHub] [kafka] rajinisivaram merged pull request #8990: KAFKA-10243; ConcurrentModificationException while processing connection setup timeouts

2020-07-07 Thread GitBox
rajinisivaram merged pull request #8990: URL: https://github.com/apache/kafka/pull/8990 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Resolved] (KAFKA-10243) ConcurrentModificationException while processing connection setup timeouts

2020-07-07 Thread Rajini Sivaram (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-10243. Reviewer: Rajini Sivaram Resolution: Fixed > ConcurrentModificationException while p

[jira] [Commented] (KAFKA-9630) Replace OffsetsForLeaderEpoch request/response with automated protocol

2020-07-07 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17152837#comment-17152837 ] Mickael Maison commented on KAFKA-9630: --- No I have not started yet, so go for it!

[jira] [Assigned] (KAFKA-9630) Replace OffsetsForLeaderEpoch request/response with automated protocol

2020-07-07 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot reassigned KAFKA-9630: -- Assignee: David Jacot (was: Mickael Maison) > Replace OffsetsForLeaderEpoch request/response

[GitHub] [kafka] hachikuji commented on pull request #8979: KAFKA-10223; Make ReplicaNotAvailableException retriable metadata exception

2020-07-07 Thread GitBox
hachikuji commented on pull request #8979: URL: https://github.com/apache/kafka/pull/8979#issuecomment-654959200 `NOT_LEADER_OR_FOLLOWER` sounds good to me. If we're looking to attach the change to a KIP, then KIP-392 might be a better option. -

[jira] [Commented] (KAFKA-10017) Flaky Test EosBetaUpgradeIntegrationTest.shouldUpgradeFromEosAlphaToEosBeta

2020-07-07 Thread Dima R (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17152848#comment-17152848 ] Dima R commented on KAFKA-10017: Hi [~ableegoldman], I just found that  shouldUpgradeF

[GitHub] [kafka] hachikuji commented on a change in pull request #8934: KAFKA-10134: Use long poll if we do not have fetchable partitions

2020-07-07 Thread GitBox
hachikuji commented on a change in pull request #8934: URL: https://github.com/apache/kafka/pull/8934#discussion_r450978217 ## File path: clients/src/main/java/org/apache/kafka/clients/consumer/KafkaConsumer.java ## @@ -1218,17 +1218,20 @@ public void assign(Collection partit

[GitHub] [kafka] ijuma commented on pull request #8979: KAFKA-10223; Make ReplicaNotAvailableException retriable metadata exception

2020-07-07 Thread GitBox
ijuma commented on pull request #8979: URL: https://github.com/apache/kafka/pull/8979#issuecomment-654965817 KIP-392 sounds good. This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Comment Edited] (KAFKA-10017) Flaky Test EosBetaUpgradeIntegrationTest.shouldUpgradeFromEosAlphaToEosBeta

2020-07-07 Thread Dima R (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17152848#comment-17152848 ] Dima R edited comment on KAFKA-10017 at 7/7/20, 4:09 PM: - Hi [~a

[GitHub] [kafka] vvcephei commented on a change in pull request #8902: KAFKA-10179: Pass correct changelog topic to state serdes

2020-07-07 Thread GitBox
vvcephei commented on a change in pull request #8902: URL: https://github.com/apache/kafka/pull/8902#discussion_r450979875 ## File path: streams/src/test/java/org/apache/kafka/test/InternalMockProcessorContext.java ## @@ -193,6 +194,11 @@ public InternalMockProcessorContext(fi

[jira] [Commented] (KAFKA-10243) ConcurrentModificationException while processing connection setup timeouts

2020-07-07 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17152856#comment-17152856 ] John Roesler commented on KAFKA-10243: -- Thanks, [~dajac] ! > ConcurrentModificatio

[GitHub] [kafka] vvcephei commented on pull request #8913: KAFKA-10191 fix flaky StreamsOptimizedTest

2020-07-07 Thread GitBox
vvcephei commented on pull request #8913: URL: https://github.com/apache/kafka/pull/8913#issuecomment-654971292 Thanks, @chia7712 , your response makes sense. This is an automated message from the Apache Git Service. To respo

[GitHub] [kafka] hachikuji commented on a change in pull request #8934: KAFKA-10134: Use long poll if we do not have fetchable partitions

2020-07-07 Thread GitBox
hachikuji commented on a change in pull request #8934: URL: https://github.com/apache/kafka/pull/8934#discussion_r450978217 ## File path: clients/src/main/java/org/apache/kafka/clients/consumer/KafkaConsumer.java ## @@ -1218,17 +1218,20 @@ public void assign(Collection partit

[GitHub] [kafka] vvcephei commented on pull request #8913: KAFKA-10191 fix flaky StreamsOptimizedTest

2020-07-07 Thread GitBox
vvcephei commented on pull request #8913: URL: https://github.com/apache/kafka/pull/8913#issuecomment-654972949 I'm sure you did this locally, but I'm running the system tests one more time, just to be on the safe side before merging: https://jenkins.confluent.io/job/system-test-kafka-br

[GitHub] [kafka] cadonna commented on a change in pull request #8987: KAFKA-10221: Backport fix for KAFKA-9603 to 2.5

2020-07-07 Thread GitBox
cadonna commented on a change in pull request #8987: URL: https://github.com/apache/kafka/pull/8987#discussion_r450989016 ## File path: streams/src/main/java/org/apache/kafka/streams/state/internals/AbstractRocksDBSegmentedBytesStore.java ## @@ -251,7 +252,7 @@ void restoreAll

[jira] [Comment Edited] (KAFKA-4273) Streams DSL - Add TTL / retention period support for intermediate topics and state stores

2020-07-07 Thread Di Campo (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17152866#comment-17152866 ] Di Campo edited comment on KAFKA-4273 at 7/7/20, 4:27 PM: -- Thank

[jira] [Commented] (KAFKA-4273) Streams DSL - Add TTL / retention period support for intermediate topics and state stores

2020-07-07 Thread Di Campo (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17152866#comment-17152866 ] Di Campo commented on KAFKA-4273: - Thanks Matthias. In my case I want an emit-on-change

[jira] [Comment Edited] (KAFKA-4273) Streams DSL - Add TTL / retention period support for intermediate topics and state stores

2020-07-07 Thread Di Campo (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17152866#comment-17152866 ] Di Campo edited comment on KAFKA-4273 at 7/7/20, 4:27 PM: -- Thank

[jira] [Comment Edited] (KAFKA-4273) Streams DSL - Add TTL / retention period support for intermediate topics and state stores

2020-07-07 Thread Di Campo (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17152866#comment-17152866 ] Di Campo edited comment on KAFKA-4273 at 7/7/20, 4:28 PM: -- Thank

[jira] [Assigned] (KAFKA-10215) MockProcessorContext doesn't work with SessionStores

2020-07-07 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler reassigned KAFKA-10215: Assignee: John Roesler > MockProcessorContext doesn't work with SessionStores > -

[jira] [Commented] (KAFKA-10226) KStream without SASL information should return error in confluent cloud

2020-07-07 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17152888#comment-17152888 ] John Roesler commented on KAFKA-10226: -- Hi [~wdaehn] , Thanks for the report, and

[GitHub] [kafka] C0urante commented on a change in pull request #8928: KAFKA-10192: Wait for REST API to become available before testing blocked connectors

2020-07-07 Thread GitBox
C0urante commented on a change in pull request #8928: URL: https://github.com/apache/kafka/pull/8928#discussion_r451008207 ## File path: connect/runtime/src/test/java/org/apache/kafka/connect/integration/BlockingConnectorTest.java ## @@ -76,6 +78,15 @@ public void setup() {

[GitHub] [kafka] dajac commented on pull request #8984: KAFKA-10227: Enforce cleanup policy to only contain compact or delete once

2020-07-07 Thread GitBox
dajac commented on pull request #8984: URL: https://github.com/apache/kafka/pull/8984#issuecomment-654993589 @huxihx I am not against improving the command line but I think that the approach that you are proposing in this PR is a bit risky for the future. Please, take a look at my previous

[GitHub] [kafka] Johnny-Malizia commented on a change in pull request #8936: KAFKA-10207: Fixed padded timeindex causing premature data deletion

2020-07-07 Thread GitBox
Johnny-Malizia commented on a change in pull request #8936: URL: https://github.com/apache/kafka/pull/8936#discussion_r451015408 ## File path: core/src/main/scala/kafka/log/LogSegment.scala ## @@ -87,6 +87,12 @@ class LogSegment private[log] (val log: FileRecords, // we

[jira] [Commented] (KAFKA-10017) Flaky Test EosBetaUpgradeIntegrationTest.shouldUpgradeFromEosAlphaToEosBeta

2020-07-07 Thread Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17152909#comment-17152909 ] Sophie Blee-Goldman commented on KAFKA-10017: - Hey [~dima5rr] This test ass

[GitHub] [kafka] guozhangwang commented on a change in pull request #8964: KAFKA-9450: Decouple flushing state from commiting

2020-07-07 Thread GitBox
guozhangwang commented on a change in pull request #8964: URL: https://github.com/apache/kafka/pull/8964#discussion_r451021225 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/TaskManager.java ## @@ -243,18 +242,24 @@ public void handleAssignmen

[GitHub] [kafka] abbccdda commented on a change in pull request #8986: KAFKA-10233; Add backoff after AuthorizationExceptions in consumer

2020-07-07 Thread GitBox
abbccdda commented on a change in pull request #8986: URL: https://github.com/apache/kafka/pull/8986#discussion_r451022144 ## File path: clients/src/main/java/org/apache/kafka/clients/consumer/internals/AbstractCoordinator.java ## @@ -460,15 +463,21 @@ boolean joinGroupIfNeede

[jira] [Commented] (KAFKA-10229) Kafka stream dies for no apparent reason, no errors logged on client or server

2020-07-07 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17152912#comment-17152912 ] Guozhang Wang commented on KAFKA-10229: --- Thanks, please feel free to update this t

[GitHub] [kafka] dhruvilshah3 commented on a change in pull request #8936: KAFKA-10207: Fixed padded timeindex causing premature data deletion

2020-07-07 Thread GitBox
dhruvilshah3 commented on a change in pull request #8936: URL: https://github.com/apache/kafka/pull/8936#discussion_r451024024 ## File path: core/src/main/scala/kafka/log/LogSegment.scala ## @@ -87,6 +87,12 @@ class LogSegment private[log] (val log: FileRecords, // we wi

[GitHub] [kafka] junrao commented on a change in pull request #8936: KAFKA-10207: Fixed padded timeindex causing premature data deletion

2020-07-07 Thread GitBox
junrao commented on a change in pull request #8936: URL: https://github.com/apache/kafka/pull/8936#discussion_r451024109 ## File path: core/src/main/scala/kafka/log/LogSegment.scala ## @@ -87,6 +87,12 @@ class LogSegment private[log] (val log: FileRecords, // we will rec

[jira] [Commented] (KAFKA-10207) Untrimmed Index files cause premature log segment deletions on startup

2020-07-07 Thread Dhruvil Shah (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17152915#comment-17152915 ] Dhruvil Shah commented on KAFKA-10207: -- Hmm, this seems pretty strange. Do you know

[GitHub] [kafka] junrao commented on a change in pull request #8936: KAFKA-10207: Fixed padded timeindex causing premature data deletion

2020-07-07 Thread GitBox
junrao commented on a change in pull request #8936: URL: https://github.com/apache/kafka/pull/8936#discussion_r451024109 ## File path: core/src/main/scala/kafka/log/LogSegment.scala ## @@ -87,6 +87,12 @@ class LogSegment private[log] (val log: FileRecords, // we will rec

[GitHub] [kafka] vvcephei commented on pull request #8902: KAFKA-10179: Pass correct changelog topic to state serdes

2020-07-07 Thread GitBox
vvcephei commented on pull request #8902: URL: https://github.com/apache/kafka/pull/8902#issuecomment-655012979 Test this please This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [kafka] vvcephei commented on pull request #8902: KAFKA-10179: Pass correct changelog topic to state serdes

2020-07-07 Thread GitBox
vvcephei commented on pull request #8902: URL: https://github.com/apache/kafka/pull/8902#issuecomment-655013091 Test this please This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Commented] (KAFKA-4273) Streams DSL - Add TTL / retention period support for intermediate topics and state stores

2020-07-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17152928#comment-17152928 ] Matthias J. Sax commented on KAFKA-4273: I see. I guess it's safe. Not sure how p

[jira] [Commented] (KAFKA-10226) KStream without SASL information should return error in confluent cloud

2020-07-07 Thread Werner Daehn (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17152932#comment-17152932 ] Werner Daehn commented on KAFKA-10226: -- As I am using the Kafka Client there are no

[GitHub] [kafka] vvcephei commented on pull request #8913: KAFKA-10191 fix flaky StreamsOptimizedTest

2020-07-07 Thread GitBox
vvcephei commented on pull request #8913: URL: https://github.com/apache/kafka/pull/8913#issuecomment-655019753 Looks good! http://confluent-kafka-branch-builder-system-test-results.s3-us-west-2.amazonaws.com/2020-07-07--001.1594143314--chia7712--KAFKA-10191--4268ab25b/report.html ---

[jira] [Commented] (KAFKA-4273) Streams DSL - Add TTL / retention period support for intermediate topics and state stores

2020-07-07 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-4273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17152944#comment-17152944 ] Clément MATHIEU commented on KAFKA-4273: It would be useful. Incidentally, I have

[GitHub] [kafka] mjsax merged pull request #8980: KAFKA-10222:Incorrect methods show up in 0.10 Kafka Streams docs

2020-07-07 Thread GitBox
mjsax merged pull request #8980: URL: https://github.com/apache/kafka/pull/8980 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Commented] (KAFKA-10222) Incorrect methods show up in 0.10 Kafka Streams docs

2020-07-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17152947#comment-17152947 ] ASF GitHub Bot commented on KAFKA-10222: huxihx opened a new pull request #272:

[jira] [Commented] (KAFKA-10222) Incorrect methods show up in 0.10 Kafka Streams docs

2020-07-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17152949#comment-17152949 ] ASF GitHub Bot commented on KAFKA-10222: mjsax merged pull request #272: URL: ht

[jira] [Commented] (KAFKA-10222) Incorrect methods show up in 0.10 Kafka Streams docs

2020-07-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17152948#comment-17152948 ] ASF GitHub Bot commented on KAFKA-10222: mjsax commented on pull request #272: U

[GitHub] [kafka] vvcephei commented on pull request #8913: KAFKA-10191 fix flaky StreamsOptimizedTest

2020-07-07 Thread GitBox
vvcephei commented on pull request #8913: URL: https://github.com/apache/kafka/pull/8913#issuecomment-655022914 Merged. Thanks, @chia7712 ! This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [kafka] vvcephei merged pull request #8913: KAFKA-10191 fix flaky StreamsOptimizedTest

2020-07-07 Thread GitBox
vvcephei merged pull request #8913: URL: https://github.com/apache/kafka/pull/8913 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [kafka] Johnny-Malizia commented on a change in pull request #8936: KAFKA-10207: Fixed padded timeindex causing premature data deletion

2020-07-07 Thread GitBox
Johnny-Malizia commented on a change in pull request #8936: URL: https://github.com/apache/kafka/pull/8936#discussion_r451040852 ## File path: core/src/test/scala/unit/kafka/log/TimeIndexTest.scala ## @@ -148,5 +148,39 @@ class TimeIndexTest { idx.close() } -} + /*

[GitHub] [kafka] Johnny-Malizia commented on a change in pull request #8936: KAFKA-10207: Fixed padded timeindex causing premature data deletion

2020-07-07 Thread GitBox
Johnny-Malizia commented on a change in pull request #8936: URL: https://github.com/apache/kafka/pull/8936#discussion_r451043580 ## File path: core/src/main/scala/kafka/log/LogSegment.scala ## @@ -87,6 +87,12 @@ class LogSegment private[log] (val log: FileRecords, // we

[GitHub] [kafka] vvcephei commented on pull request #8902: KAFKA-10179: Pass correct changelog topic to state serdes

2020-07-07 Thread GitBox
vvcephei commented on pull request #8902: URL: https://github.com/apache/kafka/pull/8902#issuecomment-655026893 ``` 00:05:04.438 > Task :streams:compileTestJava 00:05:04.438 /home/jenkins/jenkins-slave/workspace/kafka-pr-jdk11-scala2.13@2/streams/src/test/java/org/apache/kafka/test/No

  1   2   >