Hello,

I have a .Net client (Microsoft KafkaNet) putting serialized Avro messages onto 
Kafka.  I started up the Kafka Connect HDFS connector but it fails with a "No 
magic byte!" error.  After some research it appears that I need to do the 
following:


1.       Register my avro schema with the Schema Registry

2.       When adding my message I need to prepend my data with:

a.       A null byte (byte 0)

b.      32 bit schema id

Does that seem right?  I don't think the KafkaNet library will do this for me.

-Dave

Dave Tauzell | Senior Software Engineer | Surescripts
O: 651.855.3042 | www.surescripts.com<http://www.surescripts.com/> |   
dave.tauz...@surescripts.com<mailto:dave.tauz...@surescripts.com>
Connect with us: Twitter<https://twitter.com/Surescripts> I 
LinkedIn<https://www.linkedin.com/company/surescripts-llc> I 
Facebook<https://www.facebook.com/Surescripts> I 
YouTube<http://www.youtube.com/SurescriptsTV>


This e-mail and any files transmitted with it are confidential, may contain 
sensitive information, and are intended solely for the use of the individual or 
entity to whom they are addressed. If you have received this e-mail in error, 
please notify the sender by reply e-mail immediately and destroy all copies of 
the e-mail and any attachments.

Reply via email to