Re: [DISCUSS] URIs on Producer and Consumer

I think this would be useful as a secondary way to configure. If others agree then you can write up a KIP and it can be discussed in more detail. On Tue, Oct 3, 2017 at 8:56 AM, Clebert Suconic wrote: > Maybe I didn't make the message clear enough... > > Would using an URI to the constructor (i

Re: [DISCUSS] KIP-127: Pluggable JAAS LoginModule configuration for SSL

Does anyone else have any comments or suggestions on this? On Tue, Feb 21, 2017 at 4:05 PM, Christopher Shannon < christopher.l.shan...@gmail.com> wrote: > I should mention another reason I went with adding this enhancement to the > SSL channel instead of SASL_SSL is that as you can

Re: [DISCUSS] KIP-127: Pluggable JAAS LoginModule configuration for SSL

s via > two separate listeners? username/password could be via a listener > configured to use SASL and certificate-based could be via a listener > configured to use TLS. > > Ismael > > On Tue, Feb 21, 2017 at 8:23 PM, Christopher Shannon < > christopher.l.shan...@gmai

Re: [DISCUSS] KIP-127: Pluggable JAAS LoginModule configuration for SSL

remains that SSL client auth is disabled for > SASL_SSL (which I believe is the common case), seems fine to me. > > Ismael > > On Fri, Feb 24, 2017 at 6:18 PM, Christopher Shannon < > christopher.l.shan...@gmail.com> wrote: > > > Rajini, If the override can be

Re: [DISCUSS] KIP-127: Pluggable JAAS LoginModule configuration for SSL

of the SSLSession for my purposes. So I went ahead and closed out the JIRA and moved my KIP to the discarded section now that I verified it will work. Thanks again for the help. Chris On Fri, Feb 24, 2017 at 1:54 PM, Christopher Shannon < christopher.l.shan...@gmail.com> wrote: > So

Request Wiki edit permission for cshannon

Hi, I would like to contribute a KIP. Can someone give me access to the wiki to create pages? Thanks, Chris

Re: Request Wiki edit permission for cshannon

Awesome, thanks. On Fri, Feb 17, 2017 at 2:30 PM, Guozhang Wang wrote: > Done. > > Guozhang > > On Fri, Feb 17, 2017 at 10:20 AM, Christopher Shannon < > christopher.l.shan...@gmail.com> wrote: > > > Hi, > > > > I would like to contribute a KIP.

[DISCUSS] KIP-127: Pluggable JAAS LoginModule configuration for SSL

Hi everyone I have just created KIP-127 to introduce custom JAAS configuration for the SSL channel: *https://cwiki.apache.org/confluence/display/KAFKA/KIP-127%3A+Pluggable+JAAS+LoginModule+configuration+for+SSL

Re: [DISCUSS] KIP-127: Pluggable JAAS LoginModule configuration for SSL

SSL. > I think we are providing too many options of authentication in SASL_SSL > mode and can be bit confusing. > > Thanks, > Harsha > > > On Tue, Feb 21, 2017 at 11:23 AM Christopher Shannon < > christopher.l.shan...@gmail.com> wrote: > > Hi everyone >

Re: [DISCUSS] KIP-127: Pluggable JAAS LoginModule configuration for SSL

can go either way on this, I can update my KIP to allow X509 authentication with SASL_SSL through the EXTERNAL mechanism or keep the proposal as is for the SSL channel based on what everyone thinks. On Tue, Feb 21, 2017 at 3:23 PM, Christopher Shannon < christopher.l.shan...@gmail.com>

Re: [DISCUSS] KIP-127: Pluggable JAAS LoginModule configuration for SSL

t the handshake being completed so this would require some refactoring to get to this to work properly and load at the right time. On Tue, Feb 21, 2017 at 3:44 PM, Christopher Shannon < christopher.l.shan...@gmail.com> wrote: > As a follow up to my previous post, EXTERNAL could be added

Re: [DISCUSS] Road to Kafka 4.0

I think JBOD definitely needs to be before 4.0. That has been a blocker issue this entire time for me and my team and I'm sure others. While Kraft has been technically "production ready" for a while, I haven't been able to upgrade because of missing JBOD support. On Wed, Oct 11, 2023 at 12:15 PM I

Re: [DISCUSS] KIP-1032: Upgrade to Jakarta and JavaEE 9 in Kafka 4.0

I just wanted to bump this and see if anyone had more feedback before trying to call a vote for this for 4.0? Chris On Mon, Apr 1, 2024 at 3:41 PM Christopher Shannon < christopher.l.shan...@gmail.com> wrote: > Greg, > > 1. Ok sounds good we can target JDK 17 in this KIP if we de

Re: [DISCUSS] KIP-1032: Upgrade to Jakarta and JavaEE 9 in Kafka 4.0

> > On Tue, May 14, 2024 at 9:07 AM Christopher Shannon < > christopher.l.shan...@gmail.com> wrote: > > > I just wanted to bump this and see if anyone had more feedback before > > trying to call a vote for this for 4.0? > > > > Chris > > > > On

[VOTE]: KIP-1032: Upgrade to Jakarta and JavaEE 10 in Kafka 4.0

Hi Everyone, I'd like to call a vote on https://cwiki.apache.org/confluence/display/KAFKA/KIP-1032%3A+Upgrade+to+Jakarta+and+JavaEE+10+in+Kafka+4.0 This KIP upgrades to the latest Jakarta API and newest version of Jetty 12 and removes the deprecated javax APIs. It also bumps the required version

Re: [DISCUSS] KIP-1032: Upgrade to Jakarta and JavaEE 9 in Kafka 4.0

to be used". This is a pretty big "if". My > understanding is that we will definitely be using Jetty 12.x; can we remove > the "if" or is it still up for debate whether we'll do that switch for > Connect? > > Cheers, > > Other Chris > > On Tue,

Re: [DISCUSS] KIP-1032: Upgrade to Jakarta and JavaEE 9 in Kafka 4.0

/apache/kafka/connect/rest/ConnectRestExtensionContext.java#L22 > > Cheers, > > Other Chris > > On Tue, Jul 9, 2024 at 3:40 PM Christopher Shannon < > christopher.l.shan...@gmail.com> wrote: > > > Hi Chris, > > > > I can make those changes. For number

Re: [DISCUSS] KIP-1032: Upgrade to Jakarta and JavaEE 9 in Kafka 4.0

The KIP has been updated to include the changes to the ConnectRestExtensionContext. On Tue, Jul 9, 2024 at 7:16 PM Christopher Shannon < christopher.l.shan...@gmail.com> wrote: > Thanks, I missed that, I can update the KIP tomorrow to include that. > > Chris > > On Tue, J

Re: [VOTE]: KIP-1032: Upgrade to Jakarta and JavaEE 10 in Kafka 4.0

is > unfortunately a > > way in which one of our dependencies "leaks through" our API, and makes > > this a necessity. > > Connect and MirrorMaker2 can follow the broker's lead on setting Java 17 > as > > the minimum version. > > > > +1 (bindin

Re: [VOTE]: KIP-1032: Upgrade to Jakarta and JavaEE 10 in Kafka 4.0

Hi Everyone, I forgot to add my explicit +1 (non-binding) as well. The vote passes with: * 3 binding votes (Chris Egerton, Mickael Maison, Greg Harris) * 1 non-binding vote (Christopher Shannon) I'll update the wiki. I should have some time coming up to work on a PR for this if no one

Re: New release branch 3.9

One option is to just have a separate 4.0 branch for development to not block work on new features. With Apache Accumulo we have a similar situation where we have a separate branch (ironically also 4.0) that we are calling "elasticity" that is a long running br

Re: [DISCUSS] Minimum constraint for segment.ms

I think it's a great idea to raise a KIP to look at adjusting defaults and minimum/maximum config values for version 4.0. As pointed out, the minimum values for segment.ms and segment.bytes don't make sense and would probably bring down a cluster pretty quickly if set that low, so version 4.0 is a

[DISCUSS] Jakarta and Java EE 9/10 support in Kafka 4.0

Is this already being planned for version 4.0? If not, I strongly thing it should be. Kafka is currently using the old long deprecated javax apis which is going to continue to cause issues [1] for people as more and more things are updated to use Jakarta. With the bump to require JDK 17 for versi

Re: [DISCUSS] Jakarta and Java EE 9/10 support in Kafka 4.0

and re-released for 4.0+ > > Can you explain how KIP-1013 and the Java version are relevant? > Connect is dependent on this namespace, but will still need to support > Java 11 in 4.0. > > Thanks! > Greg > > On Tue, Mar 26, 2024 at 5:04 AM Christopher Shannon > wrote

Re: [DISCUSS] Jakarta and Java EE 9/10 support in Kafka 4.0

r having 5.0 sooner rather than > later, and use the intervening time to properly notify downstream > users to upgrade their Java versions. > > Thanks, > Greg > > On Tue, Mar 26, 2024 at 9:04 AM Christopher Shannon > wrote: > > > > Hi Greg, > > > &

Re: [DISCUSS] Jakarta and Java EE 9/10 support in Kafka 4.0

> aware of is that ConnectRestExtensions will need to be migrated, > > > rebuilt, and re-released for 4.0+ > > > > > > Can you explain how KIP-1013 and the Java version are relevant? > > > Connect is dependent on this namespace, but will still need to support &g

[DISCUSS] KIP-1032: Upgrade to Jakarta and JavaEE 9 in Kafka 4.0

Hi, I'm proposing a KIP for Kafka 4.0 to upgrade to to Jakarta and JavaEE 9 APIs. This will also upgrade dependencies like Jetty and move away from the depcrated javax namespace to be in line with other libraries and frameworks. There was some initial

Re: [DISCUSS] KIP-1032: Upgrade to Jakarta and JavaEE 9 in Kafka 4.0

900d9f85e6acd9a09bd04969afa46261/src/main/java/com/loobpack/data/kafka/connect/healthcheck/extension/HealthCheckConnectRestExtension.java#L9 > > > > I figure that adopting this KIP would mean that the Debezium project > > would be forced to bump their major version 3.0 to be comp

Re: [DISCUSS] KIP-1032: Upgrade to Jakarta and JavaEE 9 in Kafka 4.0

need to be mentioned in the KIP itself. I > have seen people adopt changes from un-merged PRs after the original > contributor has lost interest, while still crediting the original > contributor for their portion of the changes. If you're doing this, > then it's ultimate

Re: [DISCUSS] Apache Kafka 3.2.1 release

HI, I think I found a memory leak that was introduced in 3.2.0 in a Connector SourceTask. I created a JIRA: https://issues.apache.org/jira/browse/KAFKA-14079 and small PR with a fix: https://github.com/apache/kafka/pull/12412 I think this should be included in 3.2.1. It should also go into 3.3.0

Re: [DISCUSS] Apache Kafka 3.3.0 Release

There is a bug I found that I think is worthwhile fixing in 3.3.0 (I also sent a note to 3.2.1 thread): https://issues.apache.org/jira/browse/KAFKA-14079 On Thu, Jul 14, 2022 at 7:56 PM Jason Gustafson wrote: > Hey Jose, > > Thanks for volunteering to manage the release! KIP-833 is currently slo

Re: [DISCUSS] Apache Kafka 3.2.1 release

uot;all". > > Cheers, > > Chris > > On Sat, Jul 16, 2022 at 12:26 PM Christopher Shannon < > christopher.l.shan...@gmail.com> wrote: > > > HI, > > > > I think I found a memory leak that was introduced in 3.2.0 in a Connector > > SourceTask.

Re: [DISCUSS] Apache Kafka 3.3.0 Release

s coming up soon (the release > doc currently has it at July 20th), it'd be nice if we could get some eyes > on the PR for 3.2.1 and, if that looks good, a PR for trunk and 3.3.0. > > Cheers, > > Chris > > On Sat, Jul 16, 2022 at 12:31 PM Christopher Shannon < &g

Re: [VOTE] 3.2.1 RC3

+1 (non binding) I built from source and ran through some of the tests including all the connect runtime tests. I verified that KAFKA-14079 was included and the fix looked good in my tests. On Thu, Jul 21, 2022 at 9:15 PM David Arthur wrote: > Hello Kafka users, developers and client-developers

Re: Kafka Advisory Topic

Hi, I am on the ActiveMQ PMC and I think this is a very good idea to have a way to do advisories/notifications/events (whatever you want to call it). In ActiveMQ classic you have advisories and in Artemis you have notifications. Having management messages that can be subscribed to in real time is

Re: Kafka Advisory Topic

; > themselves. I hope the proposal can include a few example scenarios to > > help us reason about the experience. > > > > Knowlton, is this something you want to pick up? > > > > Gwen > > > > On Thu, Jan 21, 2021 at 6:05 AM Christopher Shanno

[DISCUSS] KIP-755: Add new AUTO_CREATE ACL for auto topic creation

Hi Everyone, I'd like to propose KIP-755: Add new AUTO_CREATE ACL for auto topic creation The KIP can be found here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-755%3A+Add+new+AUTO_CREATE+ACL+for+auto+topic+creation I submitted the following PR: https://github.com/apache/kafka/pull/108

Re: [DISCUSS] KIP-755: Add new AUTO_CREATE ACL for auto topic creation

Does anyone have any thoughts or feedback on this KIP? On Tue, Jun 8, 2021 at 2:09 PM Christopher Shannon < christopher.l.shan...@gmail.com> wrote: > Hi Everyone, > > I'd like to propose KIP-755: Add new AUTO_CREATE ACL for auto topic > creation > > The K

Re: [DISCUSS] KIP-755: Add new AUTO_CREATE ACL for auto topic creation

opher Shannon < christopher.l.shan...@gmail.com> wrote: > Does anyone have any thoughts or feedback on this KIP? > > On Tue, Jun 8, 2021 at 2:09 PM Christopher Shannon < > christopher.l.shan...@gmail.com> wrote: > >> Hi Everyone, >> >> I'd like to

Re: [DISCUSS] KIP-755: Add new AUTO_CREATE ACL for auto topic creation

> since it's the recommended way to create topics. > > Ismael > > On Tue, Jun 8, 2021, 11:09 AM Christopher Shannon < > christopher.l.shan...@gmail.com> wrote: > > > Hi Everyone, > > > > I'd like to propose KIP-755: Add new AUTO_CREAT

Re: [DISCUSS] KIP-755: Add new AUTO_CREATE ACL for auto topic creation

if it's a super user or not which is better but not perfect. On Wed, Jun 23, 2021 at 8:49 AM Christopher Shannon < christopher.l.shan...@gmail.com> wrote: > Hi Ismael, > > Thanks for the response. > > I initially tried to use a create topic policy but the issue with the >

Re: [DISCUSS] KIP-729 Custom validation of records on the broker prior to log append

I would find this feature very useful as well as adding custom validation to incoming records would be nice to prevent bad data from making it to the topic. On Wed, Apr 7, 2021 at 7:03 PM Soumyajit Sahu wrote: > Thanks Colin! Good call on the ApiRecordError. We could use > InvalidRecordException

Re: Ensuring that Kafka message is persisted after acknowledgement

You can control fsync with two properties: https://kafka.apache.org/documentation/#topicconfigs_flush.messages https://kafka.apache.org/documentation/#topicconfigs_flush.ms On Wed, Aug 25, 2021 at 10:39 AM Kunal Goyal wrote: > Hello, > > We are exploring using Kafka for our application. Our re

Re: [DISCUSS] KIP-779: Allow Source Tasks to Handle Producer Exceptions

I also would find this feature useful to handle errors better, does anyone have any comments or feedback? On Mon, Oct 11, 2021 at 8:52 AM Knowles Atchison Jr wrote: > Good morning, > > Bumping this for visibility. I would like this to go into the next release. > KIP freeze is Friday. > > Any co

Re: [VOTE] KIP-779: Allow Source Tasks to Handle Producer Exceptions

+1 (non-binding). This looks good to me and will be useful as a way to handle producer errors. On Mon, Nov 8, 2021 at 8:55 AM Knowles Atchison Jr wrote: > Good morning, > > I'd like to start a vote for KIP-779: Allow Source Tasks to Handle Producer > Exceptions: > > > https://cwiki.apache.org/co

Re: [DISCUSS] KIP-729 Custom validation of records on the broker prior to log append

ation of this API. > >>>> > >>>> I’m ready to drive the implementation of this API. > >>>> It seems very useful to me. > >>>> > >>>>> 30 июня 2021 г., в 18:04, Nikolay Izhikov > >>>> написал(а): > >>

PR review request for KIP-1032

Can someone review https://github.com/apache/kafka/pull/16754 when they get a chance? It's for KIP-1032 and upgrades to Jakarta, JavaEE 10 and Jetty 12. With Kafka 3.9.0 being voted on, Kafka 4.0 should not be too much longer so it would be good to get this merged in. Thanks, Chris

Re: PR review request for KIP-1032

dress it > quickly. > Best, > Chia-Ping > > > Christopher Shannon 於 2024年10月16日 週三 > 下午11:00寫道： > > > Can someone review https://github.com/apache/kafka/pull/16754 when they > > get > > a chance? > > > > It's for KIP-1032 and upgrades to Jaka

KIPs being posted to the wrong section on the wiki

Hey Everyone, Recently I've noticed a trend of new KIPs that are under discussion or still being worked on (in draft) being posted to the "adopted" section at the top of the page which is very confusing. This seems to be getting worse and worse. I hesitate to modify the wiki page and move someone

Re: KIPs being posted to the wrong section on the wiki

Ok, sounds good, thanks. I went ahead and cleaned things up and moved those KIPs to the right section. On Wed, Jan 15, 2025 at 8:21 PM Chris Egerton wrote: > Hi Chris, > > Yes, this is fine--have at it. > > Cheers, > > Other Chris > > On Wed, Jan 15, 2025

Re: [VOTE] 4.0.0 RC0

If the purpose of this is not to vote but just to evaluate the RC then I think it would be better to not use the [VOTE] tag for the subject as that is super confusing. On Mon, Feb 24, 2025 at 10:45 AM Ismael Juma wrote: > Hi Mickael, > > This was addressed in the original message: > > "This is t