Re: Mirror Maker 2 with different Avro Schema Registries

2022-12-29 Thread andreasvdber...@avathar.be
hi, I guess this would mean a deserialisation error, meaning he data you're trying to read, is not as expected by the Confluent Avro deserializer. https://www.youtube.com/watch?v=GWBk9LIzy-A > On 29 Dec 2022, at 16:47, Дмитрий Лушников wrote: >

Re: Mirror Maker 2 with different Avro Schema Registries

2021-09-16 Thread Anders Engström
Quick informal update: Plugging in an SMT works like a charm 👍. Thanks for pointing me in the right direction. Took some time to understand that the MirrorSinkConnector mentioned in the KIP doesn't actually exist in Kafka. When running MM2 as a "pure" MirrorSourceConnector I need to point the conne

Re: Mirror Maker 2 with different Avro Schema Registries

2021-09-14 Thread Ryanne Dolan
Yes it's a consequence of Connect, which has its own serde model. mirror-makers hard-coded ByteArraySerialization for > consumers/producers

Re: Mirror Maker 2 with different Avro Schema Registries

2021-09-14 Thread Anders Engström
Thanks Ryanne! I'll look into that. I was hoping for an "easier" solution, not having to write custom code for this. But that's probably where we'll end up. Does anyone know if mirror-makers hard-coded ByteArraySerialization for consumers/producers is by design? /Anders On Tue, Sep 14, 2021 at 3:5

Re: Mirror Maker 2 with different Avro Schema Registries

2021-09-14 Thread Ryanne Dolan
Hey Anders, take a look at Connect's serdes and SMTs. MirrorMaker can be configured to use them. Ryanne On Tue, Sep 14, 2021, 3:13 AM Anders Engström wrote: > Hi! > I'm trying to replicate a few topics using Mirror Maker 2 (2.8). > > Both the source and the target cluster use Schema Registry (K