Re: Magic byte error when trying to consume Avro data with Kafka Connect

2018-12-07 Thread Robin Moffatt
> However, we can't figure out a way to turn off key deserialization (if that is what is causing this) on the kafka connect/connector side. Set *key.converter* to the correct value for the source message. https://www.confluent.io/blog/kafka-connect-deep-dive-converters-serialization-explained -

Re: Magic byte error when trying to consume Avro data with Kafka Connect

2018-12-06 Thread Patrick Plaatje
Hi Marco, We've seen this issue when the actual message is not encoded with a schema. In our case we had to refactor our producer slightly, as it wasn't including the magic byte in the messages. Cheers, Patrick On Thu, 6 Dec 2018, 19:30 Marcos Juarez, wrote: > We're trying to use Kafka Connec

Magic byte error when trying to consume Avro data with Kafka Connect

2018-12-06 Thread Marcos Juarez
We're trying to use Kafka Connect to pull down data from Kafka, but we're having issues with the Avro deserialization. When we attempt to consume data using the kafka-avro-console-consumer, we can consume it, and deserialize it correctly. Our command is similar to the following: *./kafka-avro-co