Kafka: writing custom Encoder/Serializer

2014-05-20 Thread Kumar Pradeep
I am trying to build a POC with Kafka 0.8.1. I am using my own java class as a Kafka message which has a bunch of String data types. For serializer.class property in my producer, I cannot use the default serializer class or the String serializer class that comes with Kafka library. I guess I nee

Re: Kafka: writing custom Encoder/Serializer

2014-05-20 Thread Kumar Pradeep
priyadarshi 5/20/2014 5:11 PM >>> you can send byte[] that you get by using your own serializer ; through kafka ().On the reciving side u can deseraialize from the byte[] and read back your object.for using this you will have to supply serializer.class=kafka.serializer.DefaultEncoder in

Geeting Payload back from Kafka message

2014-05-28 Thread Kumar Pradeep
Hi, I am having trouble in getting my payload message back from the Kafka Message in my consumer. My producer is passing a byte[] stream Kafka. If someone has an examle of how do I get the payload back, please share with me. Really appreciate. After iterating through the Kafka stream, I am trying

CreateMessageStream API

2014-06-02 Thread Kumar Pradeep
Hi, I need to create a single partition from a single topic in Kafka. I am doing this because the order of messages coming from my Kafka producer is very important to me (if I tried to have multiple partition with multiple threads doing I/O, my ordering of messages is not guaranteed; at least th