RE: Messages streaming from topic to topic

2023-11-21 Thread Alexander Shapiro (ashapiro)
On Tue, Nov 21, 2023 at 11:55 AM Alexander Shapiro (ashapiro) wrote: > Thanks for instant reply > > Yes, I did > > I have checked till now the below: > Apache Storm > Apache Heron > Apache Samza > Apache Spark > Apache Flink > Apache NiFi > Confl

RE: Messages streaming from topic to topic

2023-11-21 Thread Alexander Shapiro (ashapiro)
lease don't open any unknown links or attachments. Hi Alexander, Have you explored Spark or Flink? Thanks, Megh On Tue, Nov 21, 2023, 15:50 Alexander Shapiro (ashapiro) wrote: > Hi team! > > > I am looking for an open-source Tool with capability to stream Kafka > messag

Messages streaming from topic to topic

2023-11-21 Thread Alexander Shapiro (ashapiro)
Hi team! I am looking for an open-source Tool with capability to stream Kafka message from topic A to topic B with bellow conditions: a. A and B can be on same cluster. b. A and B can be on different clusters. c. Aggregation of messages

Re: Mirror Maker 2 - offset sync from source to target

2023-10-23 Thread Alexander Shapiro (ashapiro)
g On Mon, Oct 23, 2023 at 1:22 PM Greg Harris wrote: > > Andrew, > > Yes, there isn't an explicit "create consumer group" operation, it > should be created when MM2 emits a sync for it. > > Best, > Greg > > On Mon, Oct 23, 2023 at 1:15 PM Alexande

RE: Mirror Maker 2 - offset sync from source to target

2023-10-23 Thread Alexander Shapiro (ashapiro)
not restart, it should be able to perform translation. So if your MirrorMaker2 is restarting frequently, that may prevent consistent translation. Thanks, Greg On Mon, Oct 23, 2023 at 10:46 AM Alexander Shapiro (ashapiro) wrote: > > Hi Greg, > Thank you very much, > it is the most det

RE: Mirror Maker 2 - offset sync from source to target

2023-10-23 Thread Alexander Shapiro (ashapiro)
onnector/Task may be malfunctioning and you'll need to inspect the logs to debug it. Best, Greg Harris On Sun, Oct 22, 2023 at 5:36 AM Alexander Shapiro (ashapiro) wrote: > > Hi > Can someone advise please > if sync.group.offsets.enabled : true to sync offset from source to > t

Mirror Maker 2 - offset sync from source to target

2023-10-22 Thread Alexander Shapiro (ashapiro)
Hi Can someone advise please if sync.group.offsets.enabled : true to sync offset from source to target for particular consumer group That group must be created on target, even if no actual consumption will be done ? This email and the information contained herein is proprietary and confidentia