[jira] [Commented] (KAFKA-13422) Even if the correct username and password are configured, when ClientBroker or KafkaClient tries to establish a SASL connection to ServerBroker, an exception is thrown

2021-11-03 Thread RivenSun (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437766#comment-17437766 ] RivenSun commented on KAFKA-13422: -- Hi [~guozhang] , [~showuon] For suggestion 2, I cr

[GitHub] [kafka] dajac commented on pull request #11368: KAFKA-13261: Add support for custom partitioners in foreign key joins

2021-11-03 Thread GitBox
dajac commented on pull request #11368: URL: https://github.com/apache/kafka/pull/11368#issuecomment-958704520 @mjsax Sounds reasonable to me. Please go ahead and cherry-pick it to the 3.1 branch as well. -- This is an automated message from the Apache Git Service. To respond to the mess

[GitHub] [kafka] shirenchuang commented on a change in pull request #11453: createTopic need sort brokerMetadata

2021-11-03 Thread GitBox
shirenchuang commented on a change in pull request #11453: URL: https://github.com/apache/kafka/pull/11453#discussion_r741666574 ## File path: core/src/main/scala/kafka/server/ZkAdminManager.scala ## @@ -152,7 +152,7 @@ class ZkAdminManager(val config: KafkaConfig,

[jira] [Commented] (KAFKA-6080) Transactional EoS for source connectors

2021-11-03 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-6080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437826#comment-17437826 ] Sönke Liebau commented on KAFKA-6080: - Thanks [~tombentley]!! I'll give that a read.

[GitHub] [kafka] cadonna merged pull request #11441: KAFKA-8941: Add RocksDB Metrics that Could not be Added due to RocksD…

2021-11-03 Thread GitBox
cadonna merged pull request #11441: URL: https://github.com/apache/kafka/pull/11441 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr.

[GitHub] [kafka] lkokhreidze commented on a change in pull request #10851: KAFKA-6718 / Rack aware standby task assignor

2021-11-03 Thread GitBox
lkokhreidze commented on a change in pull request #10851: URL: https://github.com/apache/kafka/pull/10851#discussion_r741840561 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/assignment/ClientTagAwareStandbyTaskAssignor.java ## @@ -0,0 +1,203

[jira] [Resolved] (KAFKA-6498) Add RocksDB statistics via Streams metrics

2021-11-03 Thread Bruno Cadonna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruno Cadonna resolved KAFKA-6498. -- Resolution: Done > Add RocksDB statistics via Streams metrics > ---

[jira] [Commented] (KAFKA-13373) ValueTransformerWithKeySupplier doesn't work with store()

2021-11-03 Thread Aleksandr Sorokoumov (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437950#comment-17437950 ] Aleksandr Sorokoumov commented on KAFKA-13373: -- Thank you for a quick respo

[jira] [Resolved] (KAFKA-13373) ValueTransformerWithKeySupplier doesn't work with store()

2021-11-03 Thread Aleksandr Sorokoumov (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aleksandr Sorokoumov resolved KAFKA-13373. -- Resolution: Cannot Reproduce > ValueTransformerWithKeySupplier doesn't work wi

[jira] [Updated] (KAFKA-8941) Add RocksDB Metrics that Could not be Added due to RocksDB Version

2021-11-03 Thread Bruno Cadonna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruno Cadonna updated KAFKA-8941: - Fix Version/s: 3.2.0 > Add RocksDB Metrics that Could not be Added due to RocksDB Version > -

[GitHub] [kafka] lkokhreidze commented on a change in pull request #10851: KAFKA-6718 / Rack aware standby task assignor

2021-11-03 Thread GitBox
lkokhreidze commented on a change in pull request #10851: URL: https://github.com/apache/kafka/pull/10851#discussion_r741896976 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/assignment/ClientTagAwareStandbyTaskAssignor.java ## @@ -0,0 +1,205

[GitHub] [kafka] lkokhreidze commented on a change in pull request #10851: KAFKA-6718 / Rack aware standby task assignor

2021-11-03 Thread GitBox
lkokhreidze commented on a change in pull request #10851: URL: https://github.com/apache/kafka/pull/10851#discussion_r741897677 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/assignment/ClientTagAwareStandbyTaskAssignor.java ## @@ -0,0 +1,203

[GitHub] [kafka] showuon commented on pull request #11451: [WIP] KAFKA-13419: resetStateAndRejoin when rebalanceInProgress in syncgroup

2021-11-03 Thread GitBox
showuon commented on pull request #11451: URL: https://github.com/apache/kafka/pull/11451#issuecomment-959028970 @guozhangwang , that's a good point. Yes, I was focusing on the fix 1) above only. For 2), yes, we should also fix that, but I need some time to think a good way to fix that iss

[GitHub] [kafka] showuon edited a comment on pull request #11451: [WIP] KAFKA-13419: resetStateAndRejoin when rebalanceInProgress in syncgroup

2021-11-03 Thread GitBox
showuon edited a comment on pull request #11451: URL: https://github.com/apache/kafka/pull/11451#issuecomment-959028970 @guozhangwang , that's a good point. Yes, I was focusing on the fix 1) above only. For 2), yes, we should also fix that, but I need some time to think a good way to fix t

[jira] [Commented] (KAFKA-13428) server hang on shutdown

2021-11-03 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17438045#comment-17438045 ] David Jacot commented on KAFKA-13428: - Thanks, [~yuhuo]. We can close this ticket as

[jira] [Resolved] (KAFKA-13428) server hang on shutdown

2021-11-03 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-13428. - Resolution: Duplicate > server hang on shutdown > --- > > Ke

[GitHub] [kafka] showuon edited a comment on pull request #11451: [WIP] KAFKA-13419: resetStateAndRejoin when rebalanceInProgress in syncgroup

2021-11-03 Thread GitBox
showuon edited a comment on pull request #11451: URL: https://github.com/apache/kafka/pull/11451#issuecomment-959028970 @guozhangwang , that's a good point. Yes, I was focusing on the fix 1) above only. For 2), yes, we should also fix that, but I need some time to think a good way to fix t

[GitHub] [kafka] showuon edited a comment on pull request #11451: [WIP] KAFKA-13419: resetStateAndRejoin when rebalanceInProgress in syncgroup

2021-11-03 Thread GitBox
showuon edited a comment on pull request #11451: URL: https://github.com/apache/kafka/pull/11451#issuecomment-959028970 @guozhangwang , that's a good point. Yes, I was focusing on the fix 1) above only. For 2), yes, we should also fix that, but I need some time to think a good way to fix t

[GitHub] [kafka] cadonna opened a new pull request #11462: MINOR: Set mock correctly in RocksDBMetricsRecorderTest

2021-11-03 Thread GitBox
cadonna opened a new pull request #11462: URL: https://github.com/apache/kafka/pull/11462 With a nice mock in `RocksDBMetricsRecorderTest#shouldCorrectlyHandleHitRatioRecordingsWithZeroHitsAndMisses()` and `RocksDBMetricsRecorderTest#shouldCorrectlyHandleAvgRecordingsWithZeroSumAndCount()

[GitHub] [kafka] lkokhreidze commented on a change in pull request #10851: KAFKA-6718 / Rack aware standby task assignor

2021-11-03 Thread GitBox
lkokhreidze commented on a change in pull request #10851: URL: https://github.com/apache/kafka/pull/10851#discussion_r741923941 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/assignment/ClientTagAwareStandbyTaskAssignor.java ## @@ -0,0 +1,205

[GitHub] [kafka] cadonna commented on pull request #11462: MINOR: Set mock correctly in RocksDBMetricsRecorderTest

2021-11-03 Thread GitBox
cadonna commented on pull request #11462: URL: https://github.com/apache/kafka/pull/11462#issuecomment-959048389 Call for review: @Luizfrf3 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] lkokhreidze commented on pull request #10851: KAFKA-6718 / Rack aware standby task assignor

2021-11-03 Thread GitBox
lkokhreidze commented on pull request #10851: URL: https://github.com/apache/kafka/pull/10851#issuecomment-959050366 Hi @cadonna Very sorry for disappearing, didn't find time to deal with this PR. I've addressed your comments. Please have another look when you got time. -- This is

[GitHub] [kafka] cadonna commented on a change in pull request #11462: MINOR: Set mock correctly in RocksDBMetricsRecorderTest

2021-11-03 Thread GitBox
cadonna commented on a change in pull request #11462: URL: https://github.com/apache/kafka/pull/11462#discussion_r741926434 ## File path: streams/src/test/java/org/apache/kafka/streams/state/internals/metrics/RocksDBMetricsRecorderTest.java ## @@ -557,10 +555,10 @@ public void

[GitHub] [kafka] showuon edited a comment on pull request #11451: [WIP] KAFKA-13419: resetStateAndRejoin when rebalanceInProgress in syncgroup

2021-11-03 Thread GitBox
showuon edited a comment on pull request #11451: URL: https://github.com/apache/kafka/pull/11451#issuecomment-959028970 @guozhangwang , that's a good point. Yes, I was focusing on the fix 1) above only. For 2), yes, we should also fix that, but I need some time to think a good way to fix t

[jira] [Commented] (KAFKA-13422) Even if the correct username and password are configured, when ClientBroker or KafkaClient tries to establish a SASL connection to ServerBroker, an exception is thrown

2021-11-03 Thread RivenSun (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17438056#comment-17438056 ] RivenSun commented on KAFKA-13422: -- And for Suggestion 1, the ideas I provided are feas

[GitHub] [kafka] cadonna merged pull request #10678: TRIVIAL: Fix type inconsistencies, unthrown exceptions, etc

2021-11-03 Thread GitBox
cadonna merged pull request #10678: URL: https://github.com/apache/kafka/pull/10678 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr.

[GitHub] [kafka] dajac commented on a change in pull request #11331: KAFKA-13111: Re-evaluate Fetch Sessions when using topic IDs

2021-11-03 Thread GitBox
dajac commented on a change in pull request #11331: URL: https://github.com/apache/kafka/pull/11331#discussion_r741789472 ## File path: clients/src/main/java/org/apache/kafka/clients/FetchSessionHandler.java ## @@ -285,52 +268,57 @@ public FetchRequestData build() {

[GitHub] [kafka] mimaison commented on a change in pull request #11401: KAFKA-13255: use exclude filter for new topics

2021-11-03 Thread GitBox
mimaison commented on a change in pull request #11401: URL: https://github.com/apache/kafka/pull/11401#discussion_r742002383 ## File path: connect/mirror/src/test/java/org/apache/kafka/connect/mirror/integration/MirrorConnectorsIntegrationBaseTest.java ## @@ -519,6 +521,47 @@

[GitHub] [kafka] dongjinleekr commented on pull request #10678: TRIVIAL: Fix type inconsistencies, unthrown exceptions, etc

2021-11-03 Thread GitBox
dongjinleekr commented on pull request #10678: URL: https://github.com/apache/kafka/pull/10678#issuecomment-959282035 @cadonna :bow::bow::bow::bow: -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[jira] [Created] (KAFKA-13430) Remove broker-wide quota properties from the documentation

2021-11-03 Thread Dongjin Lee (Jira)
Dongjin Lee created KAFKA-13430: --- Summary: Remove broker-wide quota properties from the documentation Key: KAFKA-13430 URL: https://issues.apache.org/jira/browse/KAFKA-13430 Project: Kafka Issu

[GitHub] [kafka] dongjinleekr opened a new pull request #11463: KAFKA-13430: Remove broker-wide quota properties from the documentation

2021-11-03 Thread GitBox
dongjinleekr opened a new pull request #11463: URL: https://github.com/apache/kafka/pull/11463 ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI build status - [ ] Verify documentation (including upgrade

[jira] [Updated] (KAFKA-13430) Remove broker-wide quota properties from the documentation

2021-11-03 Thread Dongjin Lee (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjin Lee updated KAFKA-13430: Description: I found this problem while working on [KAFKA-13341|https://issues.apache.org/jira/br

[jira] [Commented] (KAFKA-13430) Remove broker-wide quota properties from the documentation

2021-11-03 Thread Dongjin Lee (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17438118#comment-17438118 ] Dongjin Lee commented on KAFKA-13430: - [~dajac] Could you kindly have a look? It see

[GitHub] [kafka] mimaison commented on a change in pull request #11431: KAFKA-13397: Honor 'replication.policy.separator' configuration when creating MirrorMaker2 internal topics

2021-11-03 Thread GitBox
mimaison commented on a change in pull request #11431: URL: https://github.com/apache/kafka/pull/11431#discussion_r742038737 ## File path: connect/mirror/src/main/java/org/apache/kafka/connect/mirror/MirrorMakerConfig.java ## @@ -183,12 +187,18 @@ public MirrorClientConfig cli

[GitHub] [kafka] mimaison commented on a change in pull request #11431: KAFKA-13397: Honor 'replication.policy.separator' configuration when creating MirrorMaker2 internal topics

2021-11-03 Thread GitBox
mimaison commented on a change in pull request #11431: URL: https://github.com/apache/kafka/pull/11431#discussion_r742040313 ## File path: connect/mirror-client/src/main/java/org/apache/kafka/connect/mirror/MirrorClientConfig.java ## @@ -50,8 +50,7 @@ public static final

[GitHub] [kafka] mimaison commented on a change in pull request #11431: KAFKA-13397: Honor 'replication.policy.separator' configuration when creating MirrorMaker2 internal topics

2021-11-03 Thread GitBox
mimaison commented on a change in pull request #11431: URL: https://github.com/apache/kafka/pull/11431#discussion_r742038737 ## File path: connect/mirror/src/main/java/org/apache/kafka/connect/mirror/MirrorMakerConfig.java ## @@ -183,12 +187,18 @@ public MirrorClientConfig cli

[GitHub] [kafka] jolshan commented on a change in pull request #11331: KAFKA-13111: Re-evaluate Fetch Sessions when using topic IDs

2021-11-03 Thread GitBox
jolshan commented on a change in pull request #11331: URL: https://github.com/apache/kafka/pull/11331#discussion_r742113471 ## File path: clients/src/main/java/org/apache/kafka/clients/FetchSessionHandler.java ## @@ -285,52 +268,57 @@ public FetchRequestData build() {

[GitHub] [kafka] jolshan commented on a change in pull request #11331: KAFKA-13111: Re-evaluate Fetch Sessions when using topic IDs

2021-11-03 Thread GitBox
jolshan commented on a change in pull request #11331: URL: https://github.com/apache/kafka/pull/11331#discussion_r742114292 ## File path: clients/src/main/java/org/apache/kafka/clients/consumer/internals/Fetcher.java ## @@ -824,6 +823,14 @@ static boolean hasUsableOffsetForLe

[GitHub] [kafka] jolshan commented on a change in pull request #11331: KAFKA-13111: Re-evaluate Fetch Sessions when using topic IDs

2021-11-03 Thread GitBox
jolshan commented on a change in pull request #11331: URL: https://github.com/apache/kafka/pull/11331#discussion_r742116109 ## File path: core/src/main/scala/kafka/server/AbstractFetcherThread.scala ## @@ -374,7 +374,7 @@ abstract class AbstractFetcherThread(name: String,

[GitHub] [kafka] jolshan commented on a change in pull request #11331: KAFKA-13111: Re-evaluate Fetch Sessions when using topic IDs

2021-11-03 Thread GitBox
jolshan commented on a change in pull request #11331: URL: https://github.com/apache/kafka/pull/11331#discussion_r742119691 ## File path: core/src/main/scala/kafka/server/KafkaApis.scala ## @@ -708,40 +701,41 @@ class KafkaApis(val requestChannel: RequestChannel, None

[GitHub] [kafka] jolshan commented on a change in pull request #11331: KAFKA-13111: Re-evaluate Fetch Sessions when using topic IDs

2021-11-03 Thread GitBox
jolshan commented on a change in pull request #11331: URL: https://github.com/apache/kafka/pull/11331#discussion_r742121483 ## File path: core/src/main/scala/kafka/server/ReplicaManager.scala ## @@ -1021,17 +1018,17 @@ class ReplicaManager(val config: KafkaConfig, var byte

[GitHub] [kafka] mimaison commented on pull request #11371: KAFKA-13337: fix of possible java.nio.file.AccessDeniedException during Con…

2021-11-03 Thread GitBox
mimaison commented on pull request #11371: URL: https://github.com/apache/kafka/pull/11371#issuecomment-959671382 Sorry I'm still not quite sure I fully understand the issue you're describing. If the path is not readable, yes Connect won't load plugins in it. But it's printing an error

[GitHub] [kafka] akatona84 commented on pull request #11371: KAFKA-13337: fix of possible java.nio.file.AccessDeniedException during Con…

2021-11-03 Thread GitBox
akatona84 commented on pull request #11371: URL: https://github.com/apache/kafka/pull/11371#issuecomment-959759146 IMHO we could enhance the code to log those which are not eligible for the conditions (readable, directory or jar, whatever) if that helps. The problem is that if it's not r

[GitHub] [kafka] akatona84 edited a comment on pull request #11371: KAFKA-13337: fix of possible java.nio.file.AccessDeniedException during Con…

2021-11-03 Thread GitBox
akatona84 edited a comment on pull request #11371: URL: https://github.com/apache/kafka/pull/11371#issuecomment-959759146 IMHO we could enhance the code to log those which are not eligible for the conditions (readable, directory or jar, whatever) if that helps. The problem is that if it'

[jira] [Commented] (KAFKA-8541) Flakey test LeaderElectionCommandTest#testTopicPartition

2021-11-03 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17438217#comment-17438217 ] Matthias J. Sax commented on KAFKA-8541: Failed again (different test) {code:java

[GitHub] [kafka] mjsax merged pull request #11368: KAFKA-13261: Add support for custom partitioners in foreign key joins

2021-11-03 Thread GitBox
mjsax merged pull request #11368: URL: https://github.com/apache/kafka/pull/11368 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...

[GitHub] [kafka] mjsax commented on pull request #11368: KAFKA-13261: Add support for custom partitioners in foreign key joins

2021-11-03 Thread GitBox
mjsax commented on pull request #11368: URL: https://github.com/apache/kafka/pull/11368#issuecomment-959793533 Thanks. Merged to `trunk` and cherry-picked to `3.1` branch. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [kafka] guozhangwang commented on pull request #11451: [WIP] KAFKA-13419: resetStateAndRejoin when rebalanceInProgress in syncgroup

2021-11-03 Thread GitBox
guozhangwang commented on pull request #11451: URL: https://github.com/apache/kafka/pull/11451#issuecomment-959797459 @showuon Sounds good, let's just focus on 1) here then. The proposed fix looks reasonable to me. -- This is an automated message from the Apache Git Service. To respond t

[GitHub] [kafka] guozhangwang commented on pull request #11453: createTopic need sort brokerMetadata

2021-11-03 Thread GitBox
guozhangwang commented on pull request #11453: URL: https://github.com/apache/kafka/pull/11453#issuecomment-959799444 @shirenchuang Thanks. Let's just focus on the ZK path for this PR then. Please ping @junrao and myself after you've added the unit test: note it should verify that upon the

[GitHub] [kafka] junrao commented on a change in pull request #11453: createTopic need sort brokerMetadata

2021-11-03 Thread GitBox
junrao commented on a change in pull request #11453: URL: https://github.com/apache/kafka/pull/11453#discussion_r742217440 ## File path: core/src/main/scala/kafka/server/ZkAdminManager.scala ## @@ -152,7 +152,7 @@ class ZkAdminManager(val config: KafkaConfig,

[GitHub] [kafka] jolshan commented on a change in pull request #11331: KAFKA-13111: Re-evaluate Fetch Sessions when using topic IDs

2021-11-03 Thread GitBox
jolshan commented on a change in pull request #11331: URL: https://github.com/apache/kafka/pull/11331#discussion_r742232425 ## File path: clients/src/main/java/org/apache/kafka/common/requests/FetchRequest.java ## @@ -66,16 +69,28 @@ public PartitionData( int maxB

[GitHub] [kafka] guozhangwang commented on pull request #11211: KAFKA-12960: Enforcing strict retention time for WindowStore and Sess…

2021-11-03 Thread GitBox
guozhangwang commented on pull request #11211: URL: https://github.com/apache/kafka/pull/11211#issuecomment-959812833 > While InMemoryWindowStore does enable strict retention but when combined with the caching store, it breaks. That's where doing it on MeteredStore might be beneficial.

[jira] [Created] (KAFKA-13431) Sink Connectors: Support topic-mutating SMTs for async connectors (preCommit users)

2021-11-03 Thread Diego Erdody (Jira)
Diego Erdody created KAFKA-13431: Summary: Sink Connectors: Support topic-mutating SMTs for async connectors (preCommit users) Key: KAFKA-13431 URL: https://issues.apache.org/jira/browse/KAFKA-13431 P

[jira] [Updated] (KAFKA-13431) Sink Connectors: Support topic-mutating SMTs for async connectors (preCommit users)

2021-11-03 Thread Diego Erdody (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Diego Erdody updated KAFKA-13431: - Labels: needs-kip (was: ) > Sink Connectors: Support topic-mutating SMTs for async connectors (

[GitHub] [kafka] guozhangwang commented on pull request #11455: KAFKA-13423: GlobalThread should not log ERROR on clean shutdown

2021-11-03 Thread GitBox
guozhangwang commented on pull request #11455: URL: https://github.com/apache/kafka/pull/11455#issuecomment-959833451 @cadonna I had some discussions with @mjsax about this, and my main motivation comes from the old logic before the latest PR that modifies the instance level diagram and in

[jira] [Commented] (KAFKA-10457) JsonConverter.toConnectData trims BigInteger to Long for schema-less case

2021-11-03 Thread Arjun Satish (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17438256#comment-17438256 ] Arjun Satish commented on KAFKA-10457: -- looks like we would need a new [data type|

[GitHub] [kafka] erdody opened a new pull request #11464: KAFKA-13431: Sink Connectors: Add support for topic-mutating SMTs to async users

2021-11-03 Thread GitBox
erdody opened a new pull request #11464: URL: https://github.com/apache/kafka/pull/11464 *More detailed description of your change, if necessary. The PR title and PR message become the squashed commit message, so use a separate comment to ping reviewers.* *Summary of

[jira] [Commented] (KAFKA-12487) Sink connectors do not work with the cooperative consumer rebalance protocol

2021-11-03 Thread Konstantine Karantasis (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17438272#comment-17438272 ] Konstantine Karantasis commented on KAFKA-12487: Hi [~dajac]. I'd like t

[GitHub] [kafka] jolshan commented on a change in pull request #11331: KAFKA-13111: Re-evaluate Fetch Sessions when using topic IDs

2021-11-03 Thread GitBox
jolshan commented on a change in pull request #11331: URL: https://github.com/apache/kafka/pull/11331#discussion_r742285803 ## File path: core/src/main/scala/kafka/server/FetchSession.scala ## @@ -163,18 +173,35 @@ class CachedPartition(val topic: String, mustRespond }

[GitHub] [kafka] bdesert commented on a change in pull request #11401: KAFKA-13255: use exclude filter for new topics

2021-11-03 Thread GitBox
bdesert commented on a change in pull request #11401: URL: https://github.com/apache/kafka/pull/11401#discussion_r742290825 ## File path: connect/mirror/src/test/java/org/apache/kafka/connect/mirror/integration/MirrorConnectorsIntegrationBaseTest.java ## @@ -519,6 +521,47 @@ p

[jira] [Created] (KAFKA-13432) ApiException should provide a way to capture stacktrace

2021-11-03 Thread Vikas Singh (Jira)
Vikas Singh created KAFKA-13432: --- Summary: ApiException should provide a way to capture stacktrace Key: KAFKA-13432 URL: https://issues.apache.org/jira/browse/KAFKA-13432 Project: Kafka Issue T

[GitHub] [kafka] kirktrue opened a new pull request #11465: OAuth updates 1

2021-11-03 Thread GitBox
kirktrue opened a new pull request #11465: URL: https://github.com/apache/kafka/pull/11465 *More detailed description of your change, if necessary. The PR title and PR message become the squashed commit message, so use a separate comment to ping reviewers.* *Summary of testin

[GitHub] [kafka] guozhangwang commented on a change in pull request #11424: KAFKA-13152: Replace "buffered.records.per.partition" with "input.buffer.max.bytes"

2021-11-03 Thread GitBox
guozhangwang commented on a change in pull request #11424: URL: https://github.com/apache/kafka/pull/11424#discussion_r742366571 ## File path: streams/src/main/java/org/apache/kafka/streams/KafkaStreams.java ## @@ -1030,8 +1038,11 @@ private static Metrics getMetrics(final Stre

[jira] [Commented] (KAFKA-13432) ApiException should provide a way to capture stacktrace

2021-11-03 Thread Vikas Singh (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17438341#comment-17438341 ] Vikas Singh commented on KAFKA-13432: - One simple solution can be to fill in the sta

[GitHub] [kafka] mjsax commented on pull request #11368: KAFKA-13261: Add support for custom partitioners in foreign key joins

2021-11-03 Thread GitBox
mjsax commented on pull request #11368: URL: https://github.com/apache/kafka/pull/11368#issuecomment-958635275 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscrib

[GitHub] [kafka] mjsax commented on a change in pull request #11447: KAFKA-13024: Use not-null filter only in optimizable repartitions

2021-11-03 Thread GitBox
mjsax commented on a change in pull request #11447: URL: https://github.com/apache/kafka/pull/11447#discussion_r741604615 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/graph/GroupedTableOperationRepartitionNode.java ## @@ -119,5 +119,10 @@ publ

[GitHub] [kafka] dajac commented on pull request #11368: KAFKA-13261: Add support for custom partitioners in foreign key joins

2021-11-03 Thread GitBox
dajac commented on pull request #11368: URL: https://github.com/apache/kafka/pull/11368#issuecomment-958704520 @mjsax Sounds reasonable to me. Please go ahead and cherry-pick it to the 3.1 branch as well. -- This is an automated message from the Apache Git Service. To respond to the mess

[GitHub] [kafka] shirenchuang commented on a change in pull request #11453: createTopic need sort brokerMetadata

2021-11-03 Thread GitBox
shirenchuang commented on a change in pull request #11453: URL: https://github.com/apache/kafka/pull/11453#discussion_r741666574 ## File path: core/src/main/scala/kafka/server/ZkAdminManager.scala ## @@ -152,7 +152,7 @@ class ZkAdminManager(val config: KafkaConfig,

[GitHub] [kafka] cadonna commented on pull request #11462: MINOR: Set mock correctly in RocksDBMetricsRecorderTest

2021-11-03 Thread GitBox
cadonna commented on pull request #11462: URL: https://github.com/apache/kafka/pull/11462#issuecomment-959048389 Call for review: @Luizfrf3 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] akatona84 commented on pull request #11371: KAFKA-13337: fix of possible java.nio.file.AccessDeniedException during Con…

2021-11-03 Thread GitBox
akatona84 commented on pull request #11371: URL: https://github.com/apache/kafka/pull/11371#issuecomment-959759146 IMHO we could enhance the code to log those which are not eligible for the conditions (readable, directory or jar, whatever) if that helps. The problem is that if it's not r

[GitHub] [kafka] cadonna merged pull request #10678: TRIVIAL: Fix type inconsistencies, unthrown exceptions, etc

2021-11-03 Thread GitBox
cadonna merged pull request #10678: URL: https://github.com/apache/kafka/pull/10678 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...

[GitHub] [kafka] mimaison commented on a change in pull request #11431: KAFKA-13397: Honor 'replication.policy.separator' configuration when creating MirrorMaker2 internal topics

2021-11-03 Thread GitBox
mimaison commented on a change in pull request #11431: URL: https://github.com/apache/kafka/pull/11431#discussion_r742038737 ## File path: connect/mirror/src/main/java/org/apache/kafka/connect/mirror/MirrorMakerConfig.java ## @@ -183,12 +187,18 @@ public MirrorClientConfig cli

[GitHub] [kafka] showuon edited a comment on pull request #11451: [WIP] KAFKA-13419: resetStateAndRejoin when rebalanceInProgress in syncgroup

2021-11-03 Thread GitBox
showuon edited a comment on pull request #11451: URL: https://github.com/apache/kafka/pull/11451#issuecomment-959028970 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u

[GitHub] [kafka] guozhangwang commented on pull request #11451: [WIP] KAFKA-13419: resetStateAndRejoin when rebalanceInProgress in syncgroup

2021-11-03 Thread GitBox
guozhangwang commented on pull request #11451: URL: https://github.com/apache/kafka/pull/11451#issuecomment-959797459 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

[jira] [Commented] (KAFKA-13375) Kafka streams apps w/EOS unable to start at InitProducerId

2021-11-03 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17438376#comment-17438376 ] Guozhang Wang commented on KAFKA-13375: --- Hello [~Lerh] Thanks for reporting this i

[GitHub] [kafka] showuon commented on pull request #11451: [WIP] KAFKA-13419: resetStateAndRejoin when rebalanceInProgress in syncgroup

2021-11-03 Thread GitBox
showuon commented on pull request #11451: URL: https://github.com/apache/kafka/pull/11451#issuecomment-959028970 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscr

[GitHub] [kafka] cadonna commented on a change in pull request #11462: MINOR: Set mock correctly in RocksDBMetricsRecorderTest

2021-11-03 Thread GitBox
cadonna commented on a change in pull request #11462: URL: https://github.com/apache/kafka/pull/11462#discussion_r741926434 ## File path: streams/src/test/java/org/apache/kafka/streams/state/internals/metrics/RocksDBMetricsRecorderTest.java ## @@ -557,10 +555,10 @@ public void

[jira] [Updated] (KAFKA-13375) Kafka streams apps w/EOS unable to start at InitProducerId

2021-11-03 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-13375: -- Component/s: (was: streams) > Kafka streams apps w/EOS unable to start at InitProducerId >

[GitHub] [kafka] lkokhreidze commented on a change in pull request #10851: KAFKA-6718 / Rack aware standby task assignor

2021-11-03 Thread GitBox
lkokhreidze commented on a change in pull request #10851: URL: https://github.com/apache/kafka/pull/10851#discussion_r741840561 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/assignment/ClientTagAwareStandbyTaskAssignor.java ## @@ -0,0 +1,203

[GitHub] [kafka] lkokhreidze commented on pull request #10851: KAFKA-6718 / Rack aware standby task assignor

2021-11-03 Thread GitBox
lkokhreidze commented on pull request #10851: URL: https://github.com/apache/kafka/pull/10851#issuecomment-959050366 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsu

[GitHub] [kafka] mjsax merged pull request #11368: KAFKA-13261: Add support for custom partitioners in foreign key joins

2021-11-03 Thread GitBox
mjsax merged pull request #11368: URL: https://github.com/apache/kafka/pull/11368 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@k

[GitHub] [kafka] cadonna merged pull request #11441: KAFKA-8941: Add RocksDB Metrics that Could not be Added due to RocksD…

2021-11-03 Thread GitBox
cadonna merged pull request #11441: URL: https://github.com/apache/kafka/pull/11441 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...

[GitHub] [kafka] bdesert commented on a change in pull request #11401: KAFKA-13255: use exclude filter for new topics

2021-11-03 Thread GitBox
bdesert commented on a change in pull request #11401: URL: https://github.com/apache/kafka/pull/11401#discussion_r742290825 ## File path: connect/mirror/src/test/java/org/apache/kafka/connect/mirror/integration/MirrorConnectorsIntegrationBaseTest.java ## @@ -519,6 +521,47 @@ p

[GitHub] [kafka] akatona84 edited a comment on pull request #11371: KAFKA-13337: fix of possible java.nio.file.AccessDeniedException during Con…

2021-11-03 Thread GitBox
akatona84 edited a comment on pull request #11371: URL: https://github.com/apache/kafka/pull/11371#issuecomment-959759146 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [kafka] guozhangwang commented on a change in pull request #11424: KAFKA-13152: Replace "buffered.records.per.partition" with "input.buffer.max.bytes"

2021-11-03 Thread GitBox
guozhangwang commented on a change in pull request #11424: URL: https://github.com/apache/kafka/pull/11424#discussion_r742366571 ## File path: streams/src/main/java/org/apache/kafka/streams/KafkaStreams.java ## @@ -1030,8 +1038,11 @@ private static Metrics getMetrics(final Stre

[GitHub] [kafka] mimaison commented on pull request #11371: KAFKA-13337: fix of possible java.nio.file.AccessDeniedException during Con…

2021-11-03 Thread GitBox
mimaison commented on pull request #11371: URL: https://github.com/apache/kafka/pull/11371#issuecomment-959671382 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubsc

[GitHub] [kafka] guozhangwang commented on pull request #11453: createTopic need sort brokerMetadata

2021-11-03 Thread GitBox
guozhangwang commented on pull request #11453: URL: https://github.com/apache/kafka/pull/11453#issuecomment-959799444 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

[GitHub] [kafka] guozhangwang commented on pull request #11455: KAFKA-13423: GlobalThread should not log ERROR on clean shutdown

2021-11-03 Thread GitBox
guozhangwang commented on pull request #11455: URL: https://github.com/apache/kafka/pull/11455#issuecomment-959833451 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

[GitHub] [kafka] guozhangwang commented on pull request #11211: KAFKA-12960: Enforcing strict retention time for WindowStore and Sess…

2021-11-03 Thread GitBox
guozhangwang commented on pull request #11211: URL: https://github.com/apache/kafka/pull/11211#issuecomment-959812833 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

[GitHub] [kafka] junrao commented on a change in pull request #11453: createTopic need sort brokerMetadata

2021-11-03 Thread GitBox
junrao commented on a change in pull request #11453: URL: https://github.com/apache/kafka/pull/11453#discussion_r742217440 ## File path: core/src/main/scala/kafka/server/ZkAdminManager.scala ## @@ -152,7 +152,7 @@ class ZkAdminManager(val config: KafkaConfig,

[GitHub] [kafka] jolshan commented on a change in pull request #11331: KAFKA-13111: Re-evaluate Fetch Sessions when using topic IDs

2021-11-03 Thread GitBox
jolshan commented on a change in pull request #11331: URL: https://github.com/apache/kafka/pull/11331#discussion_r742113471 ## File path: clients/src/main/java/org/apache/kafka/clients/FetchSessionHandler.java ## @@ -285,52 +268,57 @@ public FetchRequestData build() {

[GitHub] [kafka] mimaison commented on a change in pull request #11401: KAFKA-13255: use exclude filter for new topics

2021-11-03 Thread GitBox
mimaison commented on a change in pull request #11401: URL: https://github.com/apache/kafka/pull/11401#discussion_r742002383 ## File path: connect/mirror/src/test/java/org/apache/kafka/connect/mirror/integration/MirrorConnectorsIntegrationBaseTest.java ## @@ -519,6 +521,47 @@

[GitHub] [kafka] dajac commented on a change in pull request #11331: KAFKA-13111: Re-evaluate Fetch Sessions when using topic IDs

2021-11-03 Thread GitBox
dajac commented on a change in pull request #11331: URL: https://github.com/apache/kafka/pull/11331#discussion_r741789472 ## File path: clients/src/main/java/org/apache/kafka/clients/FetchSessionHandler.java ## @@ -285,52 +268,57 @@ public FetchRequestData build() {

[GitHub] [kafka] dongjinleekr commented on pull request #10678: TRIVIAL: Fix type inconsistencies, unthrown exceptions, etc

2021-11-03 Thread GitBox
dongjinleekr commented on pull request #10678: URL: https://github.com/apache/kafka/pull/10678#issuecomment-959282035 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

[GitHub] [kafka] cadonna commented on pull request #11462: MINOR: Set mock correctly in RocksDBMetricsRecorderTest

2021-11-03 Thread GitBox
cadonna commented on pull request #11462: URL: https://github.com/apache/kafka/pull/11462#issuecomment-959048389 Call for review: @Luizfrf3 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] akatona84 commented on pull request #11371: KAFKA-13337: fix of possible java.nio.file.AccessDeniedException during Con…

2021-11-03 Thread GitBox
akatona84 commented on pull request #11371: URL: https://github.com/apache/kafka/pull/11371#issuecomment-959759146 IMHO we could enhance the code to log those which are not eligible for the conditions (readable, directory or jar, whatever) if that helps. The problem is that if it's not r

[GitHub] [kafka] mjsax commented on pull request #11368: KAFKA-13261: Add support for custom partitioners in foreign key joins

2021-11-03 Thread GitBox
mjsax commented on pull request #11368: URL: https://github.com/apache/kafka/pull/11368#issuecomment-958635275 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscrib

[GitHub] [kafka] mjsax commented on a change in pull request #11447: KAFKA-13024: Use not-null filter only in optimizable repartitions

2021-11-03 Thread GitBox
mjsax commented on a change in pull request #11447: URL: https://github.com/apache/kafka/pull/11447#discussion_r741604615 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/graph/GroupedTableOperationRepartitionNode.java ## @@ -119,5 +119,10 @@ publ

[GitHub] [kafka] dajac commented on pull request #11368: KAFKA-13261: Add support for custom partitioners in foreign key joins

2021-11-03 Thread GitBox
dajac commented on pull request #11368: URL: https://github.com/apache/kafka/pull/11368#issuecomment-958704520 @mjsax Sounds reasonable to me. Please go ahead and cherry-pick it to the 3.1 branch as well. -- This is an automated message from the Apache Git Service. To respond to the mess

[GitHub] [kafka] shirenchuang commented on a change in pull request #11453: createTopic need sort brokerMetadata

2021-11-03 Thread GitBox
shirenchuang commented on a change in pull request #11453: URL: https://github.com/apache/kafka/pull/11453#discussion_r741666574 ## File path: core/src/main/scala/kafka/server/ZkAdminManager.scala ## @@ -152,7 +152,7 @@ class ZkAdminManager(val config: KafkaConfig,

  1   2   >