Kafka 0.9 client producer compatibility with Kafka 0.8.2 broker

[Rajiv Kurian]

We just upgraded one of our Kafka client producers from 0.8.2 to 0.9. Our
broker is still running 0.8.2. I knew that the new 0.9 consumer requires
the new broker and I was under the impression that the new producer would
still work with the old broker. However this doesn't seem to be the case.

I kept getting this error on my client:

 ERROR [roducer-network-thread | producer-5]
[s.o.a.k.c.producer.internals.Sender ] {}: Uncaught error in kafka producer
I/O thread:

org.apache.kafka.common.protocol.types.SchemaException: Error reading field
'throttle_time_ms': java.nio.BufferUnderflowException

        at
org.apache.kafka.common.protocol.types.Schema.read(Schema.java:71)

        at
org.apache.kafka.clients.NetworkClient.handleCompletedReceives(NetworkClient.java:464)

        at
org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:279)

        at
org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:216)

        at
org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:128)

        at java.lang.Thread.run(Thread.java:745) [na:1.8.0_66]


Is this a known problem. My 0.9 client jar is from Maven.


Thanks,

Rajiv