[GitHub] [kafka-site] dongjinleekr opened a new pull request #380: KAFKA-13430: Remove broker-wide quota properties from the documentation

2021-11-03 Thread GitBox
dongjinleekr opened a new pull request #380: URL: https://github.com/apache/kafka-site/pull/380 A counterpart of [KAFKA-13430: Remove broker-wide quota properties from the documentation](https://github.com/apache/kafka/pull/11463). cc/ @dajac -- This is an automated message from t

Re: Request for permission to assign JIRA ticket (KAFKA-13403) to myself

2021-11-03 Thread Arun Mathew
Thanks Mickael. -- With Regards, Arun Mathew On Thu, Oct 28, 2021 at 8:30 PM Mickael Maison wrote: > Hi Arun, > > I granted you permissions. > Thanks > > On Thu, Oct 28, 2021 at 1:01 PM Arun Mathew > wrote: > > > > Ah! It is arunmathew88. > > Thank you. > > -- > > With Regards, > > Arun Mathew

Re: [DISCUSS] KIP-778 KRaft Upgrades

2021-11-03 Thread Colin McCabe
On Tue, Oct 12, 2021, at 10:34, Jun Rao wrote: > Hi, David, > > One more comment. > > 16. The main reason why KIP-584 requires finalizing a feature manually is > that in the ZK world, the controller doesn't know all brokers in a cluster. > A broker temporarily down is not registered in ZK. in the K

Re: [DISCUSS] KIP-778 KRaft Upgrades

2021-11-03 Thread Colin McCabe
Hi David, Thanks again for the KIP. David Arthur wrote: > 101. Change AllowDowngrade bool to DowngradeType int8 in > UpgradeFeatureRequest RPC. I'm wondering if we can kind of "cheat" on this > incompatible change since it's not currently in use and totally remove the > old field and leave th

Re: [DISCUSS] KIP-793: Sink Connectors: Support topic-mutating SMTs for async connectors (preCommit users)

2021-11-03 Thread Chris Egerton
Hi Diego, This is a long time coming and I'm glad to see someone's finally gotten around to filling in this feature gap for Connect. It looks like this KIP does not take the SinkTask::open and SinkTask::close methods into account ( https://kafka.apache.org/30/javadoc/org/apache/kafka/connect/sink

[DISCUSS] KIP-793: Sink Connectors: Support topic-mutating SMTs for async connectors (preCommit users)

2021-11-03 Thread Diego Erdody
Hello, I'd like to propose a small KIP to add a new field to SinkRecord in order to add support for topic-mutating SMTs (e.g. RegexRouter) to asynchronous Sink Connectors (the ones that override preCommit for internal offset tracking, like S3

[jira] [Created] (KAFKA-13432) ApiException should provide a way to capture stacktrace

2021-11-03 Thread Vikas Singh (Jira)
Vikas Singh created KAFKA-13432: --- Summary: ApiException should provide a way to capture stacktrace Key: KAFKA-13432 URL: https://issues.apache.org/jira/browse/KAFKA-13432 Project: Kafka Issue T

Re: [DISCUSS] KIP-791: Add Record Metadata to State Store Context

2021-11-03 Thread Guozhang Wang
Thanks Patrick, I looked at the KIP and it looks good to me overall. I think we need to double check whether the record metadata reflect the "last processed record" or the "currently processed record" where the latter may not have been completely processed. In `ProcessorContext#recordMetadata` it

[DISCUSS] KIP-791: Add Record Metadata to State Store Context

2021-11-03 Thread Patrick Stuedi
Hi everyone, I would like to start the discussion for KIP-791: Add Record Metadata to State Store Context. The KIP can be found here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-791:+Add+Record+Metadata+to+State+Store+Context Any feedback will be highly appreciated. Many thanks, Patr

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.1 #2

2021-11-03 Thread Apache Jenkins Server
See Changes: -- [...truncated 497588 lines...] [2021-11-03T20:20:35.219Z] [INFO] --- maven-site-plugin:3.5.1:attach-descriptor (attach-descriptor) @ streams-quickstart --- [202

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #551

2021-11-03 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-778 KRaft Upgrades

2021-11-03 Thread David Arthur
Hey folks, I just updated the KIP with details on proposed changes to the kafka-features.sh tool. It includes four proposed sub-commands which will provide the Basic and Advanced functions detailed in KIP-584. Please have a look, thanks! https://cwiki.apache.org/confluence/display/KAFKA/KIP-778%3A+

[jira] [Created] (KAFKA-13431) Sink Connectors: Support topic-mutating SMTs for async connectors (preCommit users)

2021-11-03 Thread Diego Erdody (Jira)
Diego Erdody created KAFKA-13431: Summary: Sink Connectors: Support topic-mutating SMTs for async connectors (preCommit users) Key: KAFKA-13431 URL: https://issues.apache.org/jira/browse/KAFKA-13431 P

Re: Wiki Permissions

2021-11-03 Thread Guozhang Wang
Hello Diego, I saw your id has already been in the contributors list. Cheers, Guozhang On Wed, Nov 3, 2021 at 10:02 AM Diego Erdody wrote: > Hello, > > Can I please have "permissions to contribute to Apache Kafka". > Context: propose a new KIP. > User (both jira and wiki): erdody. > Thanks! >

Re: Wiki Permissions

2021-11-03 Thread Bill Bejeck
Hi Diego, You're set up in both now. Thanks for your interest in Apache Kafka. -Bill On Wed, Nov 3, 2021 at 1:09 PM Diego Erdody wrote: > Hello, > > Can I please have "permissions to contribute to Apache Kafka". > Context: propose a new KIP. > User (both jira and wiki): erdody. > Thanks! > > D

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #550

2021-11-03 Thread Apache Jenkins Server
See Changes: -- [...truncated 494815 lines...] [2021-11-03T17:02:09.240Z] SaslSslAdminIntegrationTest > testLegacyAclOpsNeverAffectOrReturnPrefixed() PASSED [2021-11-03T17:

Wiki Permissions

2021-11-03 Thread Diego Erdody
Hello, Can I please have "permissions to contribute to Apache Kafka". Context: propose a new KIP. User (both jira and wiki): erdody. Thanks! Diego

Re: [DISCUSS] KIP-786: Emit Metric Client Quota Values

2021-11-03 Thread Mickael Maison
Hi Mason, Thanks for the KIP. I think it's a good idea to also emit quota limits as metrics. It certainly simplifies monitoring/graphing if all the data come from the same source. The KIP looks good overall, just a couple of questions: - Have you considered enabling the new metrics by default? -

[jira] [Created] (KAFKA-13430) Remove broker-wide quota properties from the documentation

2021-11-03 Thread Dongjin Lee (Jira)
Dongjin Lee created KAFKA-13430: --- Summary: Remove broker-wide quota properties from the documentation Key: KAFKA-13430 URL: https://issues.apache.org/jira/browse/KAFKA-13430 Project: Kafka Issu

Re: [DISCUSS] KIP-786: Use localhost:9092 as default bootstrap-server/broker-list in client tools

2021-11-03 Thread Mickael Maison
Hi, I suggest also starting a new DISCUSS thread on the mailing list to avoid any confusion. Thanks On Tue, Nov 2, 2021 at 3:24 AM deng ziming wrote: > > Thank you Maison > > I have update the KIP number to KIP-789, the url has been updated to: > https://cwiki.apache.org/confluence/pages/viewpa

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #549

2021-11-03 Thread Apache Jenkins Server
See Changes: -- [...truncated 497019 lines...] [2021-11-03T13:30:37.078Z] [2021-11-03T13:30:37.078Z] PlaintextConsumerTest > testConsumingWithNullGroupId() STARTED [2021-1

[jira] [Resolved] (KAFKA-13428) server hang on shutdown

2021-11-03 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-13428. - Resolution: Duplicate > server hang on shutdown > --- > > Ke

Re: [DISCUSS] KIP-788: Allow configuring num.network.threads per listener

2021-11-03 Thread Mickael Maison
Hi Israel, The notation used in this KIP to specify a listener already exists in Kafka. It will keep the same format and rules than for other configurations. For example, see the documentation of max.connections: https://kafka.apache.org/documentation/#brokerconfigs_max.connections I've updated t

[VOTE] KIP-788: Allow configuring num.network.threads per listener

2021-11-03 Thread Mickael Maison
Hi all, I'd like to start the vote on KIP-788. It will allow setting the number of network threads per listener. https://cwiki.apache.org/confluence/display/KAFKA/KIP-788%3A+Allow+configuring+num.network.threads+per+listener Please let me know if you have any feedback. Thanks

[jira] [Resolved] (KAFKA-13373) ValueTransformerWithKeySupplier doesn't work with store()

2021-11-03 Thread Aleksandr Sorokoumov (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aleksandr Sorokoumov resolved KAFKA-13373. -- Resolution: Cannot Reproduce > ValueTransformerWithKeySupplier doesn't work wi

[jira] [Resolved] (KAFKA-6498) Add RocksDB statistics via Streams metrics

2021-11-03 Thread Bruno Cadonna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruno Cadonna resolved KAFKA-6498. -- Resolution: Done > Add RocksDB statistics via Streams metrics > ---

Re: [VOTE] KIP-782: Expandable batch size in producer

2021-11-03 Thread Mickael Maison
Hi Luke, Thanks for the KIP. It looks like an interesting idea. I like the concept of dynamically adjusting settings to handle load. I wonder if other client settings could also benefit from a similar logic. Just a couple of questions: - When under load, the producer may allocate extra buffers. A

Re: [kafka-clients] [VOTE] 2.7.2 RC0

2021-11-03 Thread Manikumar
Hi, +1 (binding) - verified the signatures - verified the quickstart with binary Thanks for running the release! Thanks, Manikumar On Tue, Nov 2, 2021 at 11:16 PM Mickael Maison wrote: > Bumping the thread. > > Contributors, committers and PMC, please take some time to test this > release ca