Re: [VOTE] KIP-578: Add configuration to limit number of partitions

2020-05-26 Thread Gokul Ramanan Subramanian
Hi. Any votes for this? Thanks. On Tue, May 12, 2020 at 11:36 AM Gokul Ramanan Subramanian < gokul24...@gmail.com> wrote: > Hello, > > I'd like to initialize voting on KIP-578: > https://cwiki.apache.org/confluence/display/KAFKA/KIP-578%3A+Add+configuration+to+limit+number+of+partitions > . > >

Broker dynmic ajustment max.partition.fetch.bytes

2020-05-26 Thread xinzhuxiansheng
step1 -> step2 -> step3 step1: HandleFetchRequest() in KafkaApis.Scala replicaManager.fetchMessages( fetchRequest.maxWait.toLong, fetchRequest.replicaId, fetchRequest.minBytes, fetchRequest.maxBytes, versionId <= 2, interesting, replication

Re: [VOTE] KIP-602: Change default value for client.dns.lookup

2020-05-26 Thread Rajini Sivaram
Hi Ismael, I think we resolve early to parse and verify bootstrap servers and use InetSocketAddress as a convenient way to propagate host:port. We also use the opportunity to handle `resolve_canonical_bootstrap_servers_only` since that is applied only to bootstrap servers. In other cases, even tho

Build failed in Jenkins: kafka-trunk-jdk8 #4570

2020-05-26 Thread Apache Jenkins Server
See Changes: [github] MINOR: avoid unnecessary list iteration in ApiVersion.lastVersion -- [...truncated 6.18 MB...] org.apache.kafka.streams.TopologyTestDriverTest > sho

Re: Contribute to kafka

2020-05-26 Thread Mickael Maison
I've added you to the contributors list. You can now assign tickets to yourself. Welcome to the community! On Tue, May 26, 2020 at 5:57 AM Kafka Shil wrote: > > Hi > My jira id is sshil. I want to contribute to kafka. Can you please add me > to the contributors list?

Re: [DISCUSS] KIP-614: Add Prefix Scan support for State Stores

2020-05-26 Thread Sagar
Hi John, Thanks for the detailed reply. I was a bit crammed with work last week so couldn't respond earlier so apologies for that. First of all, thanks for the context that both you and Adam have provided me on the issues faced previously. As I can clearly see, while I was able to cut some corner

Re: [VOTE] KIP-602: Change default value for client.dns.lookup

2020-05-26 Thread Ismael Juma
Hi Rajini, Good point, `getHostString()` actually returns the original host. The InetSocketAddress code is a bit confusing as it does: String host = null; try { addr = InetAddress.getByName(hostname); } catch(UnknownHostException e) { host = hostnam

Build failed in Jenkins: kafka-trunk-jdk11 #1499

2020-05-26 Thread Apache Jenkins Server
See Changes: [github] MINOR: avoid unnecessary list iteration in ApiVersion.lastVersion -- [...truncated 1.87 MB...] kafka.api.TransactionsTest > testDelayedFetchInclude

[jira] [Created] (KAFKA-10044) Deprecate ConsumerConfig#addDeserializerToConfig(Properties, Deserializer, Deserializer) and ProducerConfig#addSerializerToConfig(Properties, Serializer, Serializer)

2020-05-26 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-10044: -- Summary: Deprecate ConsumerConfig#addDeserializerToConfig(Properties, Deserializer, Deserializer) and ProducerConfig#addSerializerToConfig(Properties, Serializer, Serializer) Key: KAFKA-10044

Re: KIP-599: Throttle Create Topic, Create Partition and Delete Topic Operations

2020-05-26 Thread David Jacot
Hi folks, I have updated the KIP. As mentioned by Jun, I have made the quota per principal/clientid similarly to the other quotas. I have also explained how this will work in conjunction with the auto topics creation. Please, take a look at it. I plan to call a vote for it in the next few days if

Re: [VOTE] KIP-557: Add emit on change support for Kafka Streams

2020-05-26 Thread Randall Hauch
Just a quick note: I've changed https://cwiki.apache.org/confluence/display/KAFKA/KIP-557%3A+Add+emit+on+change+support+for+Kafka+Streams to denote that this KIP is still in voting, as it has only received 2 binding votes. I will also remove the KIP from the AK 2.6.0 release, since the KIP freeze (

Re: [VOTE] KIP-557: Add emit on change support for Kafka Streams

2020-05-26 Thread Randall Hauch
Sorry, I missed Matthias' +1 binding. I'll move the KIP back to "Adopted" and add it to the AK 2.6.0. Apologies for the noise. On Tue, May 26, 2020 at 12:14 PM Randall Hauch wrote: > Just a quick note: I've changed > https://cwiki.apache.org/confluence/display/KAFKA/KIP-557%3A+Add+emit+on+chang

[jira] [Resolved] (KAFKA-9898) Flaky Test StoreQueryIntegrationTest.shouldQueryAllStalePartitionStores

2020-05-26 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9898. -- Fix Version/s: 2.6.0 Resolution: Fixed > Flaky Test StoreQueryIntegrationTest.shouldQuer

[jira] [Created] (KAFKA-10045) Kafka Connect Connection leak to Kafka Brokers when using dead letter queue

2020-05-26 Thread rameshkrishnan muthusamy (Jira)
rameshkrishnan muthusamy created KAFKA-10045: Summary: Kafka Connect Connection leak to Kafka Brokers when using dead letter queue Key: KAFKA-10045 URL: https://issues.apache.org/jira/browse/KAFKA-1004

Re: KIP-560 Discuss

2020-05-26 Thread Boyang Chen
Hey Sang, unfortunately we couldn't make it in 2.6. Do you still plan to work on this KIP? On Thu, May 14, 2020 at 6:49 PM Boyang Chen wrote: > Hey Sang, seems this thread has been quiet, are you still working on this > KIP? > > On Sat, Mar 7, 2020 at 3:54 PM Matthias J. Sax > wrote: > >> Thank

Re: [DISCUSS] KIP-617: Allow Kafka Streams State Stores to be iterated backwards

2020-05-26 Thread Jorge Esteban Quilcate Otoya
If no additional comments, I will proceed to start the a vote thread. Thanks a lot for your feedback! On Fri, May 22, 2020 at 9:25 AM Jorge Esteban Quilcate Otoya < quilcate.jo...@gmail.com> wrote: > Thanks Sophie. I like the `reverseAll()` idea. > > I updated the KIP with your feedback. > > > >

[jira] [Created] (KAFKA-10046) Deprecated PartitionGrouper config is ignored

2020-05-26 Thread John Roesler (Jira)
John Roesler created KAFKA-10046: Summary: Deprecated PartitionGrouper config is ignored Key: KAFKA-10046 URL: https://issues.apache.org/jira/browse/KAFKA-10046 Project: Kafka Issue Type: Bug

[VOTE] KIP-617: Allow Kafka Streams State Stores to be iterated backwards

2020-05-26 Thread Jorge Quilcate
Hi everyone, I'd like to start a vote on KIP-617: Allow Kafka Streams State Stores to be iterated backwards. KIP wiki page: https://cwiki.apache.org/confluence/display/KAFKA/KIP-617%3A+Allow+Kafka+Streams+State+Stores+to+be+iterated+backwards Discussion thread is here as well: https://mail-archi

Build failed in Jenkins: kafka-trunk-jdk14 #129

2020-05-26 Thread Apache Jenkins Server
See Changes: [github] MINOR: Add reason to log message when incrementing the log start offset -- [...truncated 3.11 MB...] org.apache.kafka.streams.test.OutputVerifierTes

Build failed in Jenkins: kafka-trunk-jdk11 #1500

2020-05-26 Thread Apache Jenkins Server
See Changes: [github] MINOR: Add reason to log message when incrementing the log start offset -- [...truncated 3.12 MB...] org.apache.kafka.streams.TopologyTestDriverTe

Jenkins build is back to normal : kafka-trunk-jdk8 #4571

2020-05-26 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-606: Add Metadata Context to MetricsReporter

2020-05-26 Thread Xavier Léauté
Based on feedback during code review we made some minor adjustments to the KIP: - clarify that connect group id labels are only included in distributed mode - rename metadata() to contextLabels() in the MetricsContext interface - add context label configuration properties to kafka brokers as well

Build failed in Jenkins: kafka-trunk-jdk11 #1501

2020-05-26 Thread Apache Jenkins Server
See Changes: [github] MINOR: Added doc for KIP-535 and updated it for KIP-562 (#8395) -- [...truncated 3.11 MB...] org.apache.kafka.streams.TestTopicsTest > testWithHead

Build failed in Jenkins: kafka-trunk-jdk14 #130

2020-05-26 Thread Apache Jenkins Server
See Changes: [github] MINOR: Added doc for KIP-535 and updated it for KIP-562 (#8395) -- [...truncated 3.11 MB...] org.apache.kafka.streams.test.OutputVerifierTest > sh

[jira] [Created] (KAFKA-10047) Unnecessary widening of (int to long) scope in FloatSerializer

2020-05-26 Thread Guru Tahasildar (Jira)
Guru Tahasildar created KAFKA-10047: --- Summary: Unnecessary widening of (int to long) scope in FloatSerializer Key: KAFKA-10047 URL: https://issues.apache.org/jira/browse/KAFKA-10047 Project: Kafka

[GitHub] [kafka-site] mjsax commented on pull request #266: MINOR: Add more info in the "adding to contributor list" section

2020-05-26 Thread GitBox
mjsax commented on pull request #266: URL: https://github.com/apache/kafka-site/pull/266#issuecomment-634390804 Thanks a lot @showuon! This seems to be super helpful! This is an automated message from the Apache Git Service.

[GitHub] [kafka-site] showuon commented on pull request #266: MINOR: Add more info in the "adding to contributor list" section

2020-05-26 Thread GitBox
showuon commented on pull request #266: URL: https://github.com/apache/kafka-site/pull/266#issuecomment-634381918 hi @mjsax , I think you must love this PR because you won't have to handle the "requesting to be added into contributor list" but without JIRA ID provided issue. :) -

Re: [DISCUSS] KIP-617: Allow Kafka Streams State Stores to be iterated backwards

2020-05-26 Thread John Roesler
Sorry for my silence, Jorge, I've just taken another look, and I'm personally happy with the KIP. Thanks, -John On Tue, May 26, 2020, at 16:17, Jorge Esteban Quilcate Otoya wrote: > If no additional comments, I will proceed to start the a vote thread. > > Thanks a lot for your feedback! > > On

[GitHub] [kafka-site] mjsax merged pull request #266: MINOR: Add more info in the "adding to contributor list" section

2020-05-26 Thread GitBox
mjsax merged pull request #266: URL: https://github.com/apache/kafka-site/pull/266 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [kafka-site] showuon opened a new pull request #266: MINOR: Add more info in the "adding to contributor list" section

2020-05-26 Thread GitBox
showuon opened a new pull request #266: URL: https://github.com/apache/kafka-site/pull/266 We usually got this kind of email to request to be added into contributor list, but without JIRA username provided. That wasted the committer's or the existing contributor's time to do more explanati

[jira] [Resolved] (KAFKA-5295) Allow Kafka Connect source connectors to specify topic-specific settings for new topics

2020-05-26 Thread Konstantine Karantasis (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantine Karantasis resolved KAFKA-5295. --- Resolution: Fixed > Allow Kafka Connect source connectors to specify topic-sp

Build failed in Jenkins: kafka-2.3-jdk8 #206

2020-05-26 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-8557: system tests - add support for (optional) interbroker [jason] MINOR: Fix failing upgrade test by supporting both [jason] MINOR: Support listener config overrides in system tests (

Jenkins build is back to normal : kafka-2.5-jdk8 #133

2020-05-26 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-10048) Possible data gap for a consumer after a failover when using MM2

2020-05-26 Thread Andre Araujo (Jira)
Andre Araujo created KAFKA-10048: Summary: Possible data gap for a consumer after a failover when using MM2 Key: KAFKA-10048 URL: https://issues.apache.org/jira/browse/KAFKA-10048 Project: Kafka