Re: Custom Kafka Connect REST Extension for Token Authentication

Hi All,  Has anyone managed to get a REST extension working with multiple connect instances / workers? Many Thanks,  Jamie On Wednesday 16 April 2025 at 10:57:01 BST, Jamie wrote: Hi All,  I'm trying to implement a custom REST extension for Kafka Connect that allows a token

Re: Kafka tags on repo

Thank you for looking into this. The fetch --tags worked for checking out the 4.0.0 tag from git. Cheers, Jamie On 2025/04/17 01:25:58 David Arthur wrote: > Matthias pointed out to me that there are indeed some orphaned tags for > recent releases. This appears to be a bug in our r

Custom Kafka Connect REST Extension for Token Authentication

nyone been able to get either the basic authentication or another custom authentication extension working with Kafka connect when using more than one instance / worker?  I'm using version 2.7.1 of Kafka and Kafka connect.  Many Thanks,  Jamie.

Re: [jira] [Created] (KAFKA-16861) Don't convert to group to classic if the size is larger than group max size

unsubscribe On Wed, May 29, 2024 at 12:55 PM Chia-Ping Tsai (Jira) wrote: > Chia-Ping Tsai created KAFKA-16861: > -- > > Summary: Don't convert to group to classic if the size is > larger than group max size > Key: KAFKA-16861 >

Re: MM2 - Overriding MirrorSourceConnector Consumer & Producer values

Hi All,  Has anyone been able to override the producer and consumer values of the MM2 MirrorSourceConnector as described below? Many Thanks,  Jamie -Original Message- From: Jamie To: us...@kafka.apache.org Sent: Thu, 16 Sep 2021 15:52 Subject: MM2 - Overriding MirrorSourceConnector

Mirror Maker 2 - High Throughput Identity Mirroring

essing the data only for the MM2 producer to then re-compress it again. Has this feature been implemented yet in MM2? Many Thanks, Jamie 

[jira] [Resolved] (KAFKA-12608) Simple identity pipeline sometimes loses data

[ https://issues.apache.org/jira/browse/KAFKA-12608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jamie Brandon resolved KAFKA-12608. --- Resolution: Invalid > Simple identity pipeline sometimes loses d

[jira] [Created] (KAFKA-12608) Simple identity pipeline sometimes loses data

Jamie Brandon created KAFKA-12608: - Summary: Simple identity pipeline sometimes loses data Key: KAFKA-12608 URL: https://issues.apache.org/jira/browse/KAFKA-12608 Project: Kafka Issue Type

[jira] [Created] (KAFKA-12594) Self-join produces no ouput, and prevents other streams from producing output

Jamie Brandon created KAFKA-12594: - Summary: Self-join produces no ouput, and prevents other streams from producing output Key: KAFKA-12594 URL: https://issues.apache.org/jira/browse/KAFKA-12594

Re: MM2 Message Handlers

Hi Ryanne, Great, thanks  Jamie Sent from AOL Mobile Mail Get the new AOL app: mail.mobile.aol.com On Monday, 18 May 2020, Ryanne Dolan  wrote: Jamie, MM2 uses Connect, so you can use Connect's SMTs for the same effect. Ryanne On Mon, May 18, 2020, 6:17 AM Jamie wrote: > Hi All, &g

MM2 Message Handlers

Hi All, Does MM2 currently support message handlers, the same way MM1 did? If not, are there any plans to support this in future? Many Thanks,  Jamie

Re: Preferred Partition Leaders

Hi All,  There is a KIP which might be of interest to you:  https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=120736982 - it sounds like you want to blacklist brokers in DC3?  Thanks,  Jamie -Original Message- From: Michael K. Edwards To: dev@kafka.apache.org Sent: Tue

Kafka 2.4.0 & Mirror Maker 2.0 Error

isolation.DelegatingClassLoader@187eb9a8 (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader) I've checked the jar file containing these class file is in the class path.  Is there anything I need to add to plugin.path for the connect properties when running mirror maker? Many Thanks,  Jamie

Re: Broker Startup Time (Prolonged URPs)

Hi All,  Does anyone have any thoughts on this? Many Thanks,  Jamie -Original Message- From: Jamie To: dev ; users Sent: Mon, 8 Jul 2019 18:38 Subject: Broker Startup Time (Prolonged URPs) Hi All, I'm currently doing some work into investigating why our Kafka deployment

Broker Startup Time (Prolonged URPs)

you have more replica fetcher threads then each thread is responsible for setting up less partitions?  Any help with the above would be greatly appreciated.  Many Thanks,  Jamie 

Permission to Create Content

Hi All,  Could you please grant me permission to create content so that I can create a KIP?  Many Thanks,  Jamie

NotCoordinatorForGroupException in a long loop

Hi, org.apache.kafka.common.errors.NotCoordinatorForGroupException: This is not the correct coordinator for this group. When there is an under-replication partition, it causes our stream-application to stall with NotCoorindatorForGroupException. This retriableException goes on in a loop for a l

dev and prod cluster consumption rate are different

Hi, I have a kafka stream application that processes 250K events per minute in our dev kafka cluster but in production using the same binary, the performance degrades dramatically to a few thousands per minute. What could possibly be wrong? 1. server.properties in dev and prod, kafka brokers are

Consumer group record fetch rate

Hi I am puzzled on this consumer group behavior. I have 40 consumers within a single consumer group with large lags. We are looking to increase partitions and number of consumers as lags indicate our records are produced faster than this consumer group can consume. However I observed thi

consistent consumption rate

Hi, I am developing Kafka stream-application using low level processor API. I am consuming records from multiple topics, applying some joining logics, and then sending them off another topics. 1) How can I make sure my application consume records at consistent rate across different topics? If

Re: [ANNOUNCE] New Kafka Committer Ewen Cheslack-Postava

Congrats, Ewen! On Tue, Dec 8, 2015 at 11:39 AM, Edward Ribeiro wrote: > Congratulations, Ewen! :) > > Cheers, > Eddie > Em 08/12/2015 17:37, "Neha Narkhede" escreveu: > > > I am pleased to announce that the Apache Kafka PMC has voted to > > invite Ewen Cheslack-Postava as a committer and Ewen