I don’t think KStreams is a good option just by itself for inter site
replication.
How about using a replication technology like MM2 to first replicate to a topic
in the destination cluster and then run KStreams client there in the
destination cluster to consume, transform and then produce to y
We have similar usecase and we use flink for transformation. Flink reads from
kafka , does the transformation and writes back to kafka.
Thanks,
Prince
> On Nov 14, 2024, at 8:22 PM, Neeraj Vaidya
> wrote:
>
> I don’t think KStreams is a good option just by itself for inter site
> replication
-- Forwarded message -
From: Sharma, Atul
Date: Fri, Nov 15, 2024, 12:16 PM
Subject: Query on MM2 Compatibility for Kafka Versions
To: Atul Sharma
Hi Team,
I have a question regarding MM2 compatibility. Since MM2 comes bundled with
the Apache Kafka code and utilizes the Conne
Can Kafka Connect be used to read messages from one Kafka Cluster, apply
some basic transformation and write messages to another Kafka Cluster? I
did not find a Kafka Connect Connector in the list of connectors provided
by Confluence[1]. I only found a Replicator[2] but for my use-case I want
to ap
Hey Kafka fam,
What’s the correct way to set task-level overrides to producer settings in a
Kafka Connect task? For example, with MirrorMaker2, I’d expect the following
“producer.override.*” based configs to work based on the documentation, but in
in reality this does not change any of the produ
