Re: Getting java.lang.Exception when try to fetch data from Kafka

2016-04-28 Thread Robert Metzger
voke(StreamTask.java:225) >>>>> at org.apache.flink.runtime.taskmanager.Task.run(Task.java:559) >>>>> at java.lang.Thread.run(Thread.java:745) >>>>> Caused by: java.io.EOFException >>>>> at >>>>> >>>>>

Re: Getting java.lang.Exception when try to fetch data from Kafka

2016-04-27 Thread prateekarora
ue.readString(StringValue.java:771) >>>> at >>>> >>>> org.apache.flink.api.common.typeutils.base.StringSerializer.deserialize(StringSerializer.java:69) >>>> at >>>> >>>> or

Re: Getting java.lang.Exception when try to fetch data from Kafka

2016-04-26 Thread Robert Metzger
Hi Prateek, sorry for the late response. Can you try implementing your own DeserializationSchema, where you deserialize the String key manually (just call the "new String(byte[]) constructor). The TypeInformationKeyValueSerializationSchema[String, byte] is generating deserializers with Flink's in

Re: Getting java.lang.Exception when try to fetch data from Kafka

2016-04-26 Thread prateek arora
Hi Robert , Hi I have java program to send data into kafka topic. below is code for this : private Producer producer = null Serializer keySerializer = new StringSerializer(); Serializer valueSerializer = new ByteArraySerializer(); producer = new KafkaProducer(props, keySerializer, valueSerializ

Re: Getting java.lang.Exception when try to fetch data from Kafka

2016-04-25 Thread prateekarora
Hi I have java program to send data into kafka topic. below is code for this : private Producer producer = null Serializer keySerializer = new StringSerializer(); Serializer valueSerializer = new ByteArraySerializer(); producer = new KafkaProducer(props, keySerializer, valueSerializer); Produce

Re: Getting java.lang.Exception when try to fetch data from Kafka

2016-04-25 Thread prateekarora
Hi I have java program that sending data into kafka topic using kafa client API (0.8.2) here is sample to code using to send data in kafka topic : import org.apache.kafka.clients.producer.Producer; import org.apache.kafka.clients.producer.ProducerConfig; import org.apache.kafka.clients.producer

Re: Getting java.lang.Exception when try to fetch data from Kafka

2016-04-25 Thread Robert Metzger
Hi Prateek, were the messages written to the Kafka topic by Flink, using the TypeInformationKeyValueSerializationSchema ? If not, maybe the Flink deserializers expect a different data format of the messages in the topic. How are the messages written into the topic? On Fri, Apr 22, 2016 at 10:21

Getting java.lang.Exception when try to fetch data from Kafka

2016-04-22 Thread prateekarora
Hi I am sending data using kafkaProducer API imageRecord = new ProducerRecord(topic,messageKey, imageData); producer.send(imageRecord); And in flink program try to fect data using FlinkKafkaConsumer08 . below are the sample code . def main(a