[GitHub] [kafka] huxihx commented on pull request #9225: KAFKA-10431: Sequential selection of payload in ProducerPerformance

2020-10-12 Thread GitBox
huxihx commented on pull request #9225: URL: https://github.com/apache/kafka/pull/9225#issuecomment-706983935 @zaahirlaher Duplicates could not be avoided with the randomly-selecting strategy as well. Besides, it could happen that some events would not be chosen to be sent at all. Looping

[GitHub] [kafka] huxihx commented on pull request #9218: MINOR: Fix shouldNotResetEpochHistoryHeadIfUndefinedPassed

2020-10-12 Thread GitBox
huxihx commented on pull request #9218: URL: https://github.com/apache/kafka/pull/9218#issuecomment-706985770 @ijuma Please take some time to review. This is an automated message from the Apache Git Service. To respond to th

[GitHub] [kafka] cadonna commented on a change in pull request #8988: KAFKA-10199: Separate restore threads

2020-10-12 Thread GitBox
cadonna commented on a change in pull request #8988: URL: https://github.com/apache/kafka/pull/8988#discussion_r502525264 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StateRestoreThread.java ## @@ -0,0 +1,316 @@ +/* + * Licensed to the Apach

[jira] [Commented] (KAFKA-10477) Sink Connector fails with DataException when trying to convert Kafka record with empty key to Connect Record

2020-10-12 Thread Shaik Zakir Hussain (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212338#comment-17212338 ] Shaik Zakir Hussain commented on KAFKA-10477: - Thanks [~rhauch] for helping

[GitHub] [kafka] dongjinleekr opened a new pull request #9414: KAFKA-10585: Kafka Streams should clean up the state store directory from cleanup

2020-10-12 Thread GitBox
dongjinleekr opened a new pull request #9414: URL: https://github.com/apache/kafka/pull/9414 ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI build status - [ ] Verify documentation (including upgrade no

[jira] [Assigned] (KAFKA-10585) Kafka Streams should clean up the state store directory from cleanup

2020-10-12 Thread Dongjin Lee (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjin Lee reassigned KAFKA-10585: --- Assignee: Dongjin Lee > Kafka Streams should clean up the state store directory from cleanu

[GitHub] [kafka] lct45 commented on pull request #9383: KAFKA-10455: Ensure that probing rebalances always occur

2020-10-12 Thread GitBox
lct45 commented on pull request #9383: URL: https://github.com/apache/kafka/pull/9383#issuecomment-707127859 One test failing: testRollingBrokerRestartsWithSmallerMaxGroupSizeConfigDisruptsBigGroup This is an automated messa

[jira] [Commented] (KAFKA-10582) Mirror Maker 2 not replicating new topics until restart

2020-10-12 Thread Robert Martin (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212398#comment-17212398 ] Robert Martin commented on KAFKA-10582: --- We are running MM2 as a standalone cluste

[GitHub] [kafka] dajac commented on a change in pull request #9386: KAFKA-10024: Add dynamic configuration and enforce quota for per-IP connection rate limits

2020-10-12 Thread GitBox
dajac commented on a change in pull request #9386: URL: https://github.com/apache/kafka/pull/9386#discussion_r503249872 ## File path: core/src/main/scala/kafka/network/SocketServer.scala ## @@ -1203,14 +1261,28 @@ class ConnectionQuotas(config: KafkaConfig, time: Time, metrics

[jira] [Commented] (KAFKA-8656) Kafka Consumer Record Latency Metric

2020-10-12 Thread Jonathan Miles (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212400#comment-17212400 ] Jonathan Miles commented on KAFKA-8656: --- KIP link should be [https://cwiki.apache.

[GitHub] [kafka] vvcephei merged pull request #9408: KAFKA-10598: Improve IQ name and type checks

2020-10-12 Thread GitBox
vvcephei merged pull request #9408: URL: https://github.com/apache/kafka/pull/9408 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [kafka] vvcephei commented on pull request #9408: KAFKA-10598: Improve IQ name and type checks

2020-10-12 Thread GitBox
vvcephei commented on pull request #9408: URL: https://github.com/apache/kafka/pull/9408#issuecomment-707205474 Merged to trunk and cherry-picked to 2.7 and 2.6 This is an automated message from the Apache Git Service. To res

[jira] [Created] (KAFKA-10600) Connect adds error to property in validation result if connector does not define the property

2020-10-12 Thread Randall Hauch (Jira)
Randall Hauch created KAFKA-10600: - Summary: Connect adds error to property in validation result if connector does not define the property Key: KAFKA-10600 URL: https://issues.apache.org/jira/browse/KAFKA-10600

[GitHub] [kafka] rhauch merged pull request #9375: KAFKA-10574: Fix infinite loop in Values::parseString

2020-10-12 Thread GitBox
rhauch merged pull request #9375: URL: https://github.com/apache/kafka/pull/9375 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Updated] (KAFKA-10600) Connect adds error to property in validation result if connector does not define the property

2020-10-12 Thread Randall Hauch (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Randall Hauch updated KAFKA-10600: -- Description: Kafka Connect's {{AbstractHerder.generateResult(...)}} method is responsible for

[GitHub] [kafka] abbccdda commented on a change in pull request #9412: MINOR: Ensure broker advertises features only when versioning system is enabled

2020-10-12 Thread GitBox
abbccdda commented on a change in pull request #9412: URL: https://github.com/apache/kafka/pull/9412#discussion_r503411583 ## File path: core/src/main/scala/kafka/server/KafkaServer.scala ## @@ -494,8 +495,14 @@ class KafkaServer(val config: KafkaConfig, time: Time = Time.SYST

[GitHub] [kafka] junrao commented on pull request #9364: KAFKA-10471 Mark broker crash during log loading as unclean shutdown

2020-10-12 Thread GitBox
junrao commented on pull request #9364: URL: https://github.com/apache/kafka/pull/9364#issuecomment-707238957 @RamanVerma : Thanks for addressing the comments. Did you push the new commits? This is an automated message from

[GitHub] [kafka] kowshik commented on pull request #9412: MINOR: Ensure broker advertises features only when versioning system is enabled

2020-10-12 Thread GitBox
kowshik commented on pull request #9412: URL: https://github.com/apache/kafka/pull/9412#issuecomment-707241757 @abbccdda Sorry for the confusion. Upon second look, I feel we can abandon this PR containing the fix. I was looking at the code again, and it seems the requirement is already

[GitHub] [kafka] kowshik edited a comment on pull request #9412: MINOR: Ensure broker advertises features only when versioning system is enabled

2020-10-12 Thread GitBox
kowshik edited a comment on pull request #9412: URL: https://github.com/apache/kafka/pull/9412#issuecomment-707241757 @abbccdda Sorry for the confusion. Upon second look, I feel we can abandon this PR containing the fix. I was looking at the code again, and it seems the requirement is al

[jira] [Updated] (KAFKA-10494) Streams: enableSendingOldValues should not call parent if node is itself materialized

2020-10-12 Thread Andy Coates (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Coates updated KAFKA-10494: Affects Version/s: 2.7.0 > Streams: enableSendingOldValues should not call parent if node is itsel

[jira] [Updated] (KAFKA-10494) Streams: enableSendingOldValues should not call parent if node is itself materialized

2020-10-12 Thread Andy Coates (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Coates updated KAFKA-10494: Priority: Blocker (was: Major) > Streams: enableSendingOldValues should not call parent if node i

[jira] [Assigned] (KAFKA-10494) Streams: enableSendingOldValues should not call parent if node is itself materialized

2020-10-12 Thread Andy Coates (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Coates reassigned KAFKA-10494: --- Assignee: Andy Coates > Streams: enableSendingOldValues should not call parent if node is i

[jira] [Updated] (KAFKA-10494) Streams: enableSendingOldValues should not call parent if node is itself materialized

2020-10-12 Thread Andy Coates (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Coates updated KAFKA-10494: Fix Version/s: 2.7.0 > Streams: enableSendingOldValues should not call parent if node is itself >

[GitHub] [kafka] kowshik closed pull request #9412: MINOR: Ensure broker advertises features only when versioning system is enabled

2020-10-12 Thread GitBox
kowshik closed pull request #9412: URL: https://github.com/apache/kafka/pull/9412 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

[jira] [Resolved] (KAFKA-10598) KafkaStreams reports inappropriate error message for IQ

2020-10-12 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler resolved KAFKA-10598. -- Resolution: Fixed > KafkaStreams reports inappropriate error message for IQ >

[jira] [Commented] (KAFKA-10592) system tests not running after python3 merge

2020-10-12 Thread Nikolay Izhikov (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212546#comment-17212546 ] Nikolay Izhikov commented on KAFKA-10592: - Hello, [~rndgstn] I run {{test_perfo

[GitHub] [kafka] vvcephei commented on pull request #9414: KAFKA-10585: Kafka Streams should clean up the state store directory from cleanup

2020-10-12 Thread GitBox
vvcephei commented on pull request #9414: URL: https://github.com/apache/kafka/pull/9414#issuecomment-707271073 Thanks for the PR, @dongjinleekr ! Just a couple of meta-questions: 1. Should we have some tests for this change? 2. I think that right now, we'd be leaving behind som

[jira] [Commented] (KAFKA-6642) Rack aware task assignment in kafka streams

2020-10-12 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212568#comment-17212568 ] Matthias J. Sax commented on KAFKA-6642: This ticket is close as duplicate alread

[GitHub] [kafka] abbccdda commented on a change in pull request #9409: KAFKA-10599: Implement basic CLI tool for feature versioning system

2020-10-12 Thread GitBox
abbccdda commented on a change in pull request #9409: URL: https://github.com/apache/kafka/pull/9409#discussion_r503443796 ## File path: core/src/main/scala/kafka/admin/FeatureCommand.scala ## @@ -0,0 +1,350 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under one

[jira] [Commented] (KAFKA-8318) Session Window Aggregations generate an extra tombstone

2020-10-12 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212583#comment-17212583 ] Matthias J. Sax commented on KAFKA-8318: Sessions are merged here: [https://gith

[jira] [Commented] (KAFKA-10472) Consider migrating Topology methods to the Builder pattern

2020-10-12 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212587#comment-17212587 ] Matthias J. Sax commented on KAFKA-10472: - [~hqt] – Thanks for your interest. No

[GitHub] [kafka] big-andy-coates opened a new pull request #9415: KAFKA-10494: eager handling of sending old values

2020-10-12 Thread GitBox
big-andy-coates opened a new pull request #9415: URL: https://github.com/apache/kafka/pull/9415 fixes: https://issues.apache.org/jira/browse/KAFKA-10494 Nodes that are materialized should not forward requests to `enableSendingOldValues` to parent nodes, as they themselves can handle

[GitHub] [kafka] scanterog commented on a change in pull request #9313: [mm2] Fix consumer/producer properties override

2020-10-12 Thread GitBox
scanterog commented on a change in pull request #9313: URL: https://github.com/apache/kafka/pull/9313#discussion_r503489280 ## File path: connect/mirror/src/test/java/org/apache/kafka/connect/mirror/MirrorMakerConfigTest.java ## @@ -52,10 +52,10 @@ public void testClusterConfi

[GitHub] [kafka] kowshik commented on a change in pull request #9409: KAFKA-10599: Implement basic CLI tool for feature versioning system

2020-10-12 Thread GitBox
kowshik commented on a change in pull request #9409: URL: https://github.com/apache/kafka/pull/9409#discussion_r503494114 ## File path: core/src/main/scala/kafka/admin/FeatureCommand.scala ## @@ -0,0 +1,350 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under one

[GitHub] [kafka] hachikuji merged pull request #8891: KAFKA-10143: Improve test coverage for throttle changes during reassignment

2020-10-12 Thread GitBox
hachikuji merged pull request #8891: URL: https://github.com/apache/kafka/pull/8891 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Resolved] (KAFKA-10143) Add integration testing ensuring that the reassignment tool can change replication quota with rebalance in progress

2020-10-12 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-10143. - Fix Version/s: (was: 2.6.1) Resolution: Fixed > Add integration testing ensur

[jira] [Updated] (KAFKA-10143) Add integration testing ensuring that the reassignment tool can change replication quota with rebalance in progress

2020-10-12 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-10143: Issue Type: Improvement (was: Bug) > Add integration testing ensuring that the reassignme

[jira] [Commented] (KAFKA-10574) Infinite loop in SimpleHeaderConverter and Values classes

2020-10-12 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212643#comment-17212643 ] Chris Egerton commented on KAFKA-10574: --- Thanks [~rhauch]. Really appreciate the b

[jira] [Created] (KAFKA-10601) Add linger semantics to raft

2020-10-12 Thread Jason Gustafson (Jira)
Jason Gustafson created KAFKA-10601: --- Summary: Add linger semantics to raft Key: KAFKA-10601 URL: https://issues.apache.org/jira/browse/KAFKA-10601 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-10602) DLQ Reporter throws NPE when reporting from different thread

2020-10-12 Thread Lev Zemlyanov (Jira)
Lev Zemlyanov created KAFKA-10602: - Summary: DLQ Reporter throws NPE when reporting from different thread Key: KAFKA-10602 URL: https://issues.apache.org/jira/browse/KAFKA-10602 Project: Kafka

[jira] [Updated] (KAFKA-10602) DLQ Reporter throws NPE when reporting from different thread

2020-10-12 Thread Lev Zemlyanov (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lev Zemlyanov updated KAFKA-10602: -- Description: The Elasticsearch connector uses separate threads to report errant records using

[jira] [Updated] (KAFKA-10602) DLQ Reporter throws NPE when reporting from different thread

2020-10-12 Thread Lev Zemlyanov (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lev Zemlyanov updated KAFKA-10602: -- Description: If a connector uses separate threads to report errant records using the ErrantRe

[GitHub] [kafka] big-andy-coates commented on pull request #9415: KAFKA-10494: eager handling of sending old values

2020-10-12 Thread GitBox
big-andy-coates commented on pull request #9415: URL: https://github.com/apache/kafka/pull/9415#issuecomment-707352917 retest this please This is an automated message from the Apache Git Service. To respond to the message, pl

[GitHub] [kafka] guozhangwang opened a new pull request #9416: MINOR: more log4j entry on elect / resignation of coordinators

2020-10-12 Thread GitBox
guozhangwang opened a new pull request #9416: URL: https://github.com/apache/kafka/pull/9416 When a coordinator module is being elected / resigned, our log entry is usually associated with a background scheduler on loading / unloading entries and hence it is unclear at the exact time when

[GitHub] [kafka] guozhangwang commented on pull request #9416: MINOR: more log4j entry on elect / resignation of coordinators

2020-10-12 Thread GitBox
guozhangwang commented on pull request #9416: URL: https://github.com/apache/kafka/pull/9416#issuecomment-707375065 cc @abbccdda @cadonna for reviews. This is an automated message from the Apache Git Service. To respond to th

[GitHub] [kafka] splett2 opened a new pull request #9417: MINOR: Fix flaky testQuotaMetric

2020-10-12 Thread GitBox
splett2 opened a new pull request #9417: URL: https://github.com/apache/kafka/pull/9417 ### What `ClientQuotaManager.updateQuota` updates `quotaCallback` before updating metric configs. `ClientQuotaManager.quota()` performs an unlocked call to `quotaLimit()`, so we can run into a cas

[GitHub] [kafka] guozhangwang commented on a change in pull request #9352: KAFKA-10533; KafkaRaftClient should flush log after appends

2020-10-12 Thread GitBox
guozhangwang commented on a change in pull request #9352: URL: https://github.com/apache/kafka/pull/9352#discussion_r503567593 ## File path: raft/src/main/java/org/apache/kafka/raft/KafkaRaftClient.java ## @@ -193,8 +193,9 @@ private void updateFollowerHighWatermark( ) {

[GitHub] [kafka] guozhangwang commented on a change in pull request #9396: KAFKA-10437: Implement new PAPI support for test-utils

2020-10-12 Thread GitBox
guozhangwang commented on a change in pull request #9396: URL: https://github.com/apache/kafka/pull/9396#discussion_r503574736 ## File path: streams/test-utils/src/main/java/org/apache/kafka/streams/processor/api/MockProcessorContext.java ## @@ -0,0 +1,494 @@ +/* + * Licensed

[GitHub] [kafka] hachikuji opened a new pull request #9418: KAFKA-10601; Add support for append linger to Raft implementation

2020-10-12 Thread GitBox
hachikuji opened a new pull request #9418: URL: https://github.com/apache/kafka/pull/9418 The main purpose of this patch is to add `quorum.linger.ms` behavior to the raft implementation. This gives users a powerful knob to tune the impact of fsync. When an append is accepted from the stat

[GitHub] [kafka] hachikuji commented on a change in pull request #9352: KAFKA-10533; KafkaRaftClient should flush log after appends

2020-10-12 Thread GitBox
hachikuji commented on a change in pull request #9352: URL: https://github.com/apache/kafka/pull/9352#discussion_r503578114 ## File path: raft/src/main/java/org/apache/kafka/raft/KafkaRaftClient.java ## @@ -193,8 +193,9 @@ private void updateFollowerHighWatermark( ) {

[GitHub] [kafka] hachikuji commented on a change in pull request #9352: KAFKA-10533; KafkaRaftClient should flush log after appends

2020-10-12 Thread GitBox
hachikuji commented on a change in pull request #9352: URL: https://github.com/apache/kafka/pull/9352#discussion_r503578710 ## File path: raft/src/main/java/org/apache/kafka/raft/ReplicatedLog.java ## @@ -103,6 +103,16 @@ */ void updateHighWatermark(LogOffsetMetadata

[GitHub] [kafka] hachikuji commented on a change in pull request #9352: KAFKA-10533; KafkaRaftClient should flush log after appends

2020-10-12 Thread GitBox
hachikuji commented on a change in pull request #9352: URL: https://github.com/apache/kafka/pull/9352#discussion_r503578816 ## File path: raft/src/main/java/org/apache/kafka/raft/KafkaRaftClient.java ## @@ -985,6 +986,8 @@ private boolean handleFetchResponse( R

[GitHub] [kafka] hachikuji commented on a change in pull request #9352: KAFKA-10533; KafkaRaftClient should flush log after appends

2020-10-12 Thread GitBox
hachikuji commented on a change in pull request #9352: URL: https://github.com/apache/kafka/pull/9352#discussion_r503578710 ## File path: raft/src/main/java/org/apache/kafka/raft/ReplicatedLog.java ## @@ -103,6 +103,16 @@ */ void updateHighWatermark(LogOffsetMetadata

[GitHub] [kafka] guozhangwang commented on a change in pull request #9352: KAFKA-10533; KafkaRaftClient should flush log after appends

2020-10-12 Thread GitBox
guozhangwang commented on a change in pull request #9352: URL: https://github.com/apache/kafka/pull/9352#discussion_r503585228 ## File path: raft/src/main/java/org/apache/kafka/raft/ReplicatedLog.java ## @@ -103,6 +103,16 @@ */ void updateHighWatermark(LogOffsetMetad

[jira] [Commented] (KAFKA-9915) Throttle Create Topic, Create Partition and Delete Topic Operations

2020-10-12 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212729#comment-17212729 ] Ismael Juma commented on KAFKA-9915: [~dajac] should this KIP be in the release plan?

[GitHub] [kafka] wcarlson5 commented on a change in pull request #9273: KAFKA-9331: changes for Streams uncaught exception handler

2020-10-12 Thread GitBox
wcarlson5 commented on a change in pull request #9273: URL: https://github.com/apache/kafka/pull/9273#discussion_r503568832 ## File path: streams/src/main/java/org/apache/kafka/streams/KafkaStreams.java ## @@ -931,6 +1033,62 @@ public synchronized boolean close(final long timeo

[GitHub] [kafka] junrao commented on a change in pull request #9353: KAFKA-10521; Skip partition watch registration when `AlterIsr` is expected

2020-10-12 Thread GitBox
junrao commented on a change in pull request #9353: URL: https://github.com/apache/kafka/pull/9353#discussion_r503597917 ## File path: core/src/main/scala/kafka/controller/KafkaController.scala ## @@ -1907,6 +1915,20 @@ class KafkaController(val config: KafkaConfig, }

[GitHub] [kafka] AndreyBozhko commented on pull request #9413: MINOR: Fix typos in DefaultSslEngineFactory javadoc

2020-10-12 Thread GitBox
AndreyBozhko commented on pull request #9413: URL: https://github.com/apache/kafka/pull/9413#issuecomment-707409947 Checks fail due to unrelated `kafka.server.DynamicBrokerConfigTest#testPasswordConfigEncoderSecretChange` test.

[GitHub] [kafka] hachikuji commented on a change in pull request #9352: KAFKA-10533; KafkaRaftClient should flush log after appends

2020-10-12 Thread GitBox
hachikuji commented on a change in pull request #9352: URL: https://github.com/apache/kafka/pull/9352#discussion_r503605087 ## File path: raft/src/main/java/org/apache/kafka/raft/KafkaRaftClient.java ## @@ -985,6 +986,8 @@ private boolean handleFetchResponse( R

[GitHub] [kafka] mjsax commented on pull request #9415: KAFKA-10494: eager handling of sending old values

2020-10-12 Thread GitBox
mjsax commented on pull request #9415: URL: https://github.com/apache/kafka/pull/9415#issuecomment-707425889 Thanks for the PR @big-andy-coates! -- The PR should be against `trunk` though -- I could not just update the base branch (would pull is other commits). Can you update the PR and op

[GitHub] [kafka] xvrl commented on a change in pull request #9367: KAFKA-10570 Rename JMXReporter configs for KIP-629

2020-10-12 Thread GitBox
xvrl commented on a change in pull request #9367: URL: https://github.com/apache/kafka/pull/9367#discussion_r503621422 ## File path: clients/src/main/java/org/apache/kafka/common/utils/ConfigUtils.java ## @@ -0,0 +1,92 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] [kafka] huxihx merged pull request #9218: MINOR: Fix shouldNotResetEpochHistoryHeadIfUndefinedPassed

2020-10-12 Thread GitBox
huxihx merged pull request #9218: URL: https://github.com/apache/kafka/pull/9218 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] huxihx commented on pull request #9218: MINOR: Fix shouldNotResetEpochHistoryHeadIfUndefinedPassed

2020-10-12 Thread GitBox
huxihx commented on pull request #9218: URL: https://github.com/apache/kafka/pull/9218#issuecomment-707439275 @ijuma Thanks for the review, merging to trunk. This is an automated message from the Apache Git Service. To respon

[jira] [Updated] (KAFKA-10603) Re-design KStream.process() and K*.transform*() operations

2020-10-12 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler updated KAFKA-10603: - Summary: Re-design KStream.process() and K*.transform*() operations (was: Re-design ) > Re-des

[jira] [Created] (KAFKA-10603) Re-design

2020-10-12 Thread John Roesler (Jira)
John Roesler created KAFKA-10603: Summary: Re-design Key: KAFKA-10603 URL: https://issues.apache.org/jira/browse/KAFKA-10603 Project: Kafka Issue Type: New Feature Reporter: John

[jira] [Updated] (KAFKA-10603) Re-design KStream.process() and K*.transform*() operations

2020-10-12 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler updated KAFKA-10603: - Description: After the implementation of KIP-478, we have the ability to reconsider all these A

[jira] [Updated] (KAFKA-10603) Re-design KStream.process() and K*.transform*() operations

2020-10-12 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler updated KAFKA-10603: - Labels: needs-kip (was: ) > Re-design KStream.process() and K*.transform*() operations > --

[jira] [Commented] (KAFKA-10536) KIP-478: Implement KStream changes

2020-10-12 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212807#comment-17212807 ] John Roesler commented on KAFKA-10536: -- Decided to make this future work instead:

[jira] [Resolved] (KAFKA-10536) KIP-478: Implement KStream changes

2020-10-12 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler resolved KAFKA-10536. -- Resolution: Fixed > KIP-478: Implement KStream changes > -- >

[GitHub] [kafka] splett2 commented on a change in pull request #9386: KAFKA-10024: Add dynamic configuration and enforce quota for per-IP connection rate limits

2020-10-12 Thread GitBox
splett2 commented on a change in pull request #9386: URL: https://github.com/apache/kafka/pull/9386#discussion_r503664955 ## File path: core/src/main/scala/kafka/network/SocketServer.scala ## @@ -1371,6 +1492,45 @@ class ConnectionQuotas(config: KafkaConfig, time: Time, metric

[GitHub] [kafka] dongjinleekr commented on pull request #9414: KAFKA-10585: Kafka Streams should clean up the state store directory from cleanup

2020-10-12 Thread GitBox
dongjinleekr commented on pull request #9414: URL: https://github.com/apache/kafka/pull/9414#issuecomment-707498871 Hi @vvcephei, 1. Sure. I added some validations in `StateDirectoryTest`. - If `StateDirectory#clean` is called, the empty `appDir` is also deleted. (see `State

[jira] [Commented] (KAFKA-8318) Session Window Aggregations generate an extra tombstone

2020-10-12 Thread Ilia Pasynkov (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212849#comment-17212849 ] Ilia Pasynkov commented on KAFKA-8318: -- [~mjsax], thank you for your help! > Sessio

[GitHub] [kafka] ning2008wisc commented on pull request #9224: KAFKA-10304: refactor MM2 integration tests

2020-10-12 Thread GitBox
ning2008wisc commented on pull request #9224: URL: https://github.com/apache/kafka/pull/9224#issuecomment-707526684 Hello @mimaison @ryannedolan this PR does not contain any functional change, it should be straightforward to review. Thanks for your time. --

[jira] [Updated] (KAFKA-10343) Remove 2.7 IBP for redirection enablement

2020-10-12 Thread Boyang Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Chen updated KAFKA-10343: Description: We need to add ApiVersion constraints test based on IBP to remind future developer bu

[jira] [Assigned] (KAFKA-10343) Remove 2.7 IBP for redirection enablement

2020-10-12 Thread Boyang Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Chen reassigned KAFKA-10343: --- Assignee: Boyang Chen > Remove 2.7 IBP for redirection enablement > ---

[jira] [Updated] (KAFKA-10343) Add IBP based ApiVersion constraint tests

2020-10-12 Thread Boyang Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Chen updated KAFKA-10343: Summary: Add IBP based ApiVersion constraint tests (was: Remove 2.7 IBP for redirection enablemen

[jira] [Updated] (KAFKA-9915) Throttle Create Topic, Create Partition and Delete Topic Operations

2020-10-12 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-9915: --- Component/s: core > Throttle Create Topic, Create Partition and Delete Topic Operations > ---

[jira] [Commented] (KAFKA-9915) Throttle Create Topic, Create Partition and Delete Topic Operations

2020-10-12 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212874#comment-17212874 ] David Jacot commented on KAFKA-9915: [~ijuma] Are you referring to [this one|https:/

[jira] [Updated] (KAFKA-9915) Throttle Create Topic, Create Partition and Delete Topic Operations

2020-10-12 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-9915: --- Fix Version/s: 2.7.0 > Throttle Create Topic, Create Partition and Delete Topic Operations >

[GitHub] [kafka] abbccdda opened a new pull request #9419: KAFKA-10343: Add IBP based ApiVersion tests

2020-10-12 Thread GitBox
abbccdda opened a new pull request #9419: URL: https://github.com/apache/kafka/pull/9419 Per requirement from KIP-590, we need to add IBP as part of the ApiVersionResponse consideration. All redirected RPCs need to take IBP into consideration when getting a future bump. This PR ensures to