Re: Send several Serialized Java objects under one Kafka Topic

2021-01-31 Thread Peter Penzov
Thanks you all for the answer, >Use Avro and a discriminated union / sum type to combine all the types. Can you share a bit more about this approach, plase? BR, Pater On Mon, Feb 1, 2021 at 12:54 AM Christopher Smith wrote: > > Use Avro and a discriminated union / sum type to combine all the typ

Re: Send several Serialized Java objects under one Kafka Topic

2021-01-31 Thread Christopher Smith
Use Avro and a discriminated union / sum type to combine all the types. On Sun, Jan 31, 2021, 6:49 AM Peter Penzov wrote: > Hello All, > I'm working on proof of concept for sending several Java Objects > under one Kafka Topic. More about the requirements: > > https://stackoverflow.com/quest

Re: Send several Serialized Java objects under one Kafka Topic

2021-01-31 Thread Liam Clarke-Hutchinson
Hi Peter, The biggest issue with Java serialization has always been compatibility between versions of the classes between producer and consumer, it can be avoided via very careful management, but it's a lot more painful (IMO) than other serialisation formats. If you're looking to avoid JSON, I re

Re: Send several Serialized Java objects under one Kafka Topic

2021-01-31 Thread Nicolas Carlot
" I want to use a serialized Java object, not JSON because I think it's more optimized for performance." => Bad assumption. https://www.robert-franz.com/2013/12/09/comparing-serialization-performance/ Avro and protobuf are oflently used, Json is easier https://blog.softwaremill.com/the-best-serial

Send several Serialized Java objects under one Kafka Topic

2021-01-31 Thread Peter Penzov
Hello All, I'm working on proof of concept for sending several Java Objects under one Kafka Topic. More about the requirements: https://stackoverflow.com/questions/65811681/design-kafka-consumers-and-producers-for-scalability I managed to implement this working concept: https://github.com/rcb