Re: [DISCUSS] KIP-680: TopologyTestDriver should not require a Properties argument

2020-11-06 Thread Rohit Deshpande
Thanks John, I will go ahead and update the KIP with a randomized application id requirement. On Fri, Nov 6, 2020 at 3:12 PM John Roesler wrote: > Hi Rohit, > > Ah, indeed, that was my mistake. I made a bad assumption about the code. > > Since we are already cleaning up, then I’d suggest only th

Re: [DISCUSS] KIP-680: TopologyTestDriver should not require a Properties argument

2020-11-06 Thread John Roesler
Hi Rohit, Ah, indeed, that was my mistake. I made a bad assumption about the code. Since we are already cleaning up, then I’d suggest only that we might generate a randomized application id so that concurrent tests won’t interfere with each other. But this is sounding like a minor implementatio

Re: [VOTE] KIP-612: Ability to Limit Connection Creation Rate on Brokers

2020-11-06 Thread David Mao
Hi all, I updated the KIP with more details on per-IP connection rate limiting. Notable changes are the addition of metrics tracking per-IP connection rate acceptance and IP connection rate limiting throttling. In addition, I fleshed out details around the API we will use to describe and alter p

Re: [DISCUSS] KIP-680: TopologyTestDriver should not require a Properties argument

2020-11-06 Thread Rohit Deshpande
Hi John, Thank you for your review and the feedback. In existing method TTD.close(), stateDirectory.clean() method is getting called which is cleaning up task and g

Preview blog post for the Apache 2.7.0 release

2020-11-06 Thread Bill Bejeck
All, I've written an initial blog post about the upcoming Apache Kafka 2.7.0 release. Please take a look and let me know about any additions/modifications on this thread. https://blogs.apache.org/preview/kafka/?previewEntry=what-s-new-in-apache4 Thanks, Bill

[jira] [Created] (KAFKA-10693) Tests instantiate QuotaManagers without closing the managers in teardown

2020-11-06 Thread David Mao (Jira)
David Mao created KAFKA-10693: - Summary: Tests instantiate QuotaManagers without closing the managers in teardown Key: KAFKA-10693 URL: https://issues.apache.org/jira/browse/KAFKA-10693 Project: Kafka

Will Cache will get invalidated if i read lots of messages using random offsets and partitions

2020-11-06 Thread Rupesh Kumar
Hi Team, I understand that Kafka is meant for sequential access, but I have use case of accessing the messages from Kafka based on random offsets and partitions. For Example There is topic called “topic-A” some consumers are listening from this topic, it may happen that processing of these mes

Build failed in Jenkins: Kafka » kafka-2.7-jdk8 #55

2020-11-06 Thread Apache Jenkins Server
See Changes: [Bill Bejeck] MINOR: Add back section taken out by mistake (#9544) -- [...truncated 6.87 MB...] org.apache.kafka.streams.test.OutputVerifierTest >

Re: Confluence edit permissions

2020-11-06 Thread Jun Rao
Hi, David, Thanks for your interest. Just gave you the wiki permissions. Jun On Fri, Nov 6, 2020 at 11:03 AM David Mao wrote: > Hi all, > > I'd like to make an update to a KIP, can I get edit permissions for > Confluence? > > Thanks, > David >

Jenkins build is back to normal : Kafka » kafka-2.6-jdk8 #47

2020-11-06 Thread Apache Jenkins Server
See

Confluence edit permissions

2020-11-06 Thread David Mao
Hi all, I'd like to make an update to a KIP, can I get edit permissions for Confluence? Thanks, David

[jira] [Resolved] (KAFKA-10393) Message for fetch snapshot and fetch

2020-11-06 Thread Jose Armando Garcia Sancio (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jose Armando Garcia Sancio resolved KAFKA-10393. Resolution: Duplicate > Message for fetch snapshot and fetch > ---

Re: [DISCUSS] KIP-405: Kafka Tiered Storage

2020-11-06 Thread Kowshik Prakasam
Hi Satish, Thanks for your response. 5015. That makes sense, good point. 5019 and 5020. My 2 cents is that while you are implementing it, it will be useful to update the KIP with details about the RocksDB-based design that you envision. This will facilitate the discussions. Cheers, Kowshik

[DISCUSS] KIP-681: Rename master key in delegation token feature

2020-11-06 Thread Tom Bentley
Hi, I'd like to start discussion on KIP-681 which proposes to rename a broker config to use a more racially neutral term: https://cwiki.apache.org/confluence/display/KAFKA/KIP-681%3A+Rename+master+key+in+delegation+token+feature As always, I'd be grateful for any feedback. Kind regards, Tom

[jira] [Created] (KAFKA-10692) Rename broker master key config for KIP 681

2020-11-06 Thread Tom Bentley (Jira)
Tom Bentley created KAFKA-10692: --- Summary: Rename broker master key config for KIP 681 Key: KAFKA-10692 URL: https://issues.apache.org/jira/browse/KAFKA-10692 Project: Kafka Issue Type: Sub-tas

Re: [DISCUSS] KIP-680: TopologyTestDriver should not require a Properties argument

2020-11-06 Thread John Roesler
Hello Rohit, Thanks for picking this up! I think your KIP looks good. While I was doing some cleanup of our tests before, one thing I encountered is that, while most tests don’t semantically need to specify any configs, many tests actually do set the state directory config. They set it specific

Re: [DISCUSS] KIP-405: Kafka Tiered Storage

2020-11-06 Thread Satish Duggana
Hi Kowshik, Thanks for your comments. 5012. In the RemoteStorageManager interface, there is an API defined for each file type. For example, fetchOffsetIndex, fetchTimestampIndex etc. To avoid the duplication, I'd suggest we can instead have a FileType enum and a common get API based on the FileTyp

Jenkins build is back to normal : Kafka » kafka-trunk-jdk8 #207

2020-11-06 Thread Apache Jenkins Server
See

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #216

2020-11-06 Thread Apache Jenkins Server
See Changes: [github] MINOR: Always return partitions with diverging epochs in fetch response (#9567) -- [...truncated 3.46 MB...] org.apache.kafka.streams

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #215

2020-11-06 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10673: Cache inter broker listener name used in connection quotas (#9555) -- [...truncated 3.46 MB...] org.apache.kafka.streams.

[jira] [Resolved] (KAFKA-10673) ConnectionQuotas should cache interbroker listener name

2020-11-06 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-10673. - Resolution: Fixed > ConnectionQuotas should cache interbroker listener name > --