[jira] [Created] (KAFKA-13592) Fix flaky test ControllerIntegrationTest.testTopicIdUpgradeAfterReassigningPartitions

2022-01-12 Thread David Jacot (Jira)
David Jacot created KAFKA-13592: --- Summary: Fix flaky test ControllerIntegrationTest.testTopicIdUpgradeAfterReassigningPartitions Key: KAFKA-13592 URL: https://issues.apache.org/jira/browse/KAFKA-13592 P

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #610

2022-01-12 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-810: Allow producing records with null values in Kafka Console Producer

2022-01-12 Thread Mickael Maison
Hi Tom, That's a good point. I agree, in case 5) it makes more sense to return an error. I've updated the KIP accordingly. Thanks, Mickael On Mon, Jan 10, 2022 at 5:19 PM Tom Bentley wrote: > > Hi Mickael, > > Thanks for the KIP. > > Case 5 in the KIP seems a bit weird to me: > > > > NULL:v0

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.1 #63

2022-01-12 Thread Apache Jenkins Server
See Changes: -- [...truncated 503432 lines...] [2022-01-12T10:16:33.644Z] [2022-01-12T10:16:33.644Z] > Task :streams:compileJava UP-TO-DATE [2022-01-12T10:16:33.644Z] > Task :

Re: [DISCUSS] KIP-719: Add Log4J2 Appender

2022-01-12 Thread Viktor Somogyi-Vass
Hi Dongjin, We're also looking into this matter as our stack was also affected by all the log4j hell and users increasingly pushing us to upgrade to log4j2 or logback because of the existing vulnerabilities in log4j1. Regarding the points raised by Haruki: a) In my opinion the best would be to ma

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #611

2022-01-12 Thread Apache Jenkins Server
See

Re: [VOTE] KIP-810: Allow producing records with null values in Kafka Console Producer

2022-01-12 Thread Tom Bentley
Hi Mickael, Thanks! +1 (binding). Tom On Mon, 10 Jan 2022 at 15:31, Chris Egerton wrote: > Hi Mickael, > > Happy new year! +1 non-binding. > > Cheers, > > Chris > > On Wed, Jan 5, 2022 at 3:08 PM John Roesler wrote: > > > Thanks Mickael! > > > > I’m +1 (binding) > > > > Thanks, > > John > >

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.0 #164

2022-01-12 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-811 Add separate delete.interval.ms to Kafka Streams

2022-01-12 Thread Bruno Cadonna
Hi Nick, Great! I think the KIP is ready for voting. I have just a couple of minor comments. a. In the config description, I would replace "Purging will occur after at least this value since the last purge, but may be delayed until later in order to meet the processing guarantee." with "Pu

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.1 #64

2022-01-12 Thread Apache Jenkins Server
See Changes: -- [...truncated 501908 lines...] [2022-01-12T12:18:38.643Z] > Task :connect:api:javadoc [2022-01-12T12:18:38.643Z] > Task :connect:api:copyDependantLibs UP-TO-DAT

[VOTE] 3.1.0 RC1

2022-01-12 Thread David Jacot
Hello Kafka users, developers and client-developers, This is the second candidate for release of Apache Kafka 3.1.0. * Apache Kafka supports Java 17 * The FetchRequest supports Topic IDs (KIP-516) * Extend SASL/OAUTHBEARER with support for OIDC (KIP-768) * Add broker count metrics (KIP-748) * Dif

[DISCUSS] KIP-812: Introduce another form of the `KafkaStreams.close()` API that forces the member to leave the consumer group

2022-01-12 Thread Seung-chan Ahn
Hi team, Here's the new KIP for this issue . The title says pretty

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.1 #65

2022-01-12 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-811 Add separate delete.interval.ms to Kafka Streams

2022-01-12 Thread Nick Telford
Thanks Bruno, I've made those changes. I'll call a vote on the KIP later today. Regards, Nick Telford On Wed, 12 Jan 2022 at 12:13, Bruno Cadonna wrote: > Hi Nick, > > Great! > > I think the KIP is ready for voting. I have just a couple of minor > comments. > > a. > In the config description,

[VOTE] KIP-811: Add config min.repartition.purge.interval.ms to Kafka Streams

2022-01-12 Thread Nick Telford
Hi everyone, I'd like to call a vote to adopt KIP-811: Add config min.repartition.purge.interval.ms to Kafka Streams . Regards Nick Telford

Re: [DISCUSS] KIP-808: Add support for unix epoch precision in TimestampConverter SMT

2022-01-12 Thread Mickael Maison
Hi Julien, Thanks for the KIP. I looks like a useful improvement to the TimestampConverter SMT. I'd suggest adding the documentation for the new setting to the KIP. I've had to go check your PR to fully understand how you want to use it, both for input and output. Apart from that, if you don't ge

Re: [DISCUSS] KIP-704: Send a hint to broker if it is an unclean leader

2022-01-12 Thread David Arthur
Jose, thanks for the KIP! 1) Does recovering from an unclean state bump the leader epoch? 2) The name of "NewIsUnclean" field in AlterIsrRequest is a little strange. >From the description, it sounds like this will be used to by the broker to indicate to the controller that it has recovered from u

Re: [VOTE] KIP-801: Implement an Authorizer that stores metadata in __cluster_metadata

2022-01-12 Thread Colin McCabe
bumping this thread On Mon, Dec 13, 2021, at 16:46, Colin McCabe wrote: > Hi all, > > I'd like to start the vote on KIP-801: Implement an Authorizer that > stores metadata in __cluster_metadata > > The KIP is here: https://cwiki.apache.org/confluence/x/h5KqCw > > The original DISCUSS thread is he

Re: [DISCUSS] KIP-801: Implement an Authorizer that stores metadata in __cluster_metadata

2022-01-12 Thread Colin McCabe
Hi David, On Wed, Dec 15, 2021, at 07:28, David Arthur wrote: > 5) Ok, gotcha. So will the StandardAuthorizer be replaying records > directly, or will it get an *Image like other metadata consumers on the > broker? > It reads the information out of the MetadataDelta, being careful to preserve th

Re: [DISCUSS] KIP-801: Implement an Authorizer that stores metadata in __cluster_metadata

2022-01-12 Thread David Arthur
Sounds good on the ordering, and yea I agree we can look at atomic ACL modifications in the future. Thanks! On Wed, Jan 12, 2022 at 3:53 PM Colin McCabe wrote: > Hi David, > > On Wed, Dec 15, 2021, at 07:28, David Arthur wrote: > > 5) Ok, gotcha. So will the StandardAuthorizer be replaying recor

Re: [VOTE] KIP-801: Implement an Authorizer that stores metadata in __cluster_metadata

2022-01-12 Thread David Arthur
+1 binding, thanks Colin! On Mon, Dec 13, 2021 at 7:47 PM Colin McCabe wrote: > Hi all, > > I'd like to start the vote on KIP-801: Implement an Authorizer that stores > metadata in __cluster_metadata > > The KIP is here: https://cwiki.apache.org/confluence/x/h5KqCw > > The original DISCUSS threa

Pls give me kafka jira and confluence permission

2022-01-12 Thread Yu Kvicii
Hi, I’d like to request permissions to contribute to Kafka to propose a KIP Wiki Id:Kvicii.Yu Jira Id: Kvicii.Yu Thx

[jira] [Created] (KAFKA-13593) ThrottledChannelReaper slows broker shutdown by multiple seconds

2022-01-12 Thread Steven Schlansker (Jira)
Steven Schlansker created KAFKA-13593: - Summary: ThrottledChannelReaper slows broker shutdown by multiple seconds Key: KAFKA-13593 URL: https://issues.apache.org/jira/browse/KAFKA-13593 Project: K

Re: Pls give me kafka jira and confluence permission

2022-01-12 Thread Matthias J. Sax
Done. On 1/12/22 3:05 PM, Yu Kvicii wrote: Hi, I’d like to request permissions to contribute to Kafka to propose a KIP Wiki Id:Kvicii.Yu Jira Id: Kvicii.Yu Thx

Re: [DISCUSS] KIP-811 Add separate delete.interval.ms to Kafka Streams

2022-01-12 Thread Matthias J. Sax
Thanks for the KIP! Very good discussion. I want to raise one point: I am not a fan of the `min.` prefix of the config, because all configs like this are _minimums_. We also use `commit.interval.ms` and not `min.commit.interval.ms` for example. I would suggest to strip the `min.` prefix. Fo

Re: [VOTE] KIP-810: Allow producing records with null values in Kafka Console Producer

2022-01-12 Thread Matthias J. Sax
Thanks for the KIP. Addresses a long standing gap! +1 (binding) On 1/12/22 2:53 AM, Tom Bentley wrote: Hi Mickael, Thanks! +1 (binding). Tom On Mon, 10 Jan 2022 at 15:31, Chris Egerton wrote: Hi Mickael, Happy new year! +1 non-binding. Cheers, Chris On Wed, Jan 5, 2022 at 3:08 PM Jo

Re: [DISCUSS] KIP-591: Add Kafka Streams config to set default state store

2022-01-12 Thread Matthias J. Sax
Thanks for the KIP! I think it's a good step forward for the DSL and it makes sense to exclude the PAPI and custom stores for now. About the config name, it seems to be overly complicated. Guozhang's argument about "store type" that is used to refer to kv, windowed, session stores make sense