access to key in sink

2016-12-24 Thread Telco Phone
I am trying to access the keyBy value in the "open" method in a RichSink Is there a way to access the actual keyBy value in the RichSink ? DataStream stream = env.addSource(new FlinkKafkaConsumer08<>("test", schema, properties) ).setParallelism(1).keyBy("partition");

Re: Problem with JodaTime

2016-12-24 Thread Robert Metzger
Hi Stephan, Can you post the list of fields in the POJO and the full exception (so that I can see which serializer is being used). In general, to fix such an issue, you have to implement a custom serializer for the field that is causing the issues. On Thu, Dec 22, 2016 at 3:44 PM, Stephan Epping

Re: Can I see the kafka header information in the Flink connector?

2016-12-24 Thread Robert Metzger
Hi Ron, there is a KeyedDeserializationSchema for the Kafka connector, that exposes the source partition, offset and topic. Is that what you are looking for? On Thu, Dec 22, 2016 at 5:33 PM, Ron Crocker wrote: > Looking at the Kafka 0.8 connector API, my deserializer definitely gets > the messa