Re: Accessing kafka message key from a KafkaSource

2022-12-08 Thread Noel OConnor
Thanks, I'll try that. On Wed, Dec 7, 2022 at 7:19 PM Yaroslav Tkachenko wrote: > > Hi Noel, > > It's definitely possible. You need to implement a custom > KafkaRecordDeserializationSchema: its "deserialize" method gives you a > ConsumerRecord as an argument so that you can extract Kafka messag

Re: Accessing kafka message key from a KafkaSource

2022-12-07 Thread Yaroslav Tkachenko
Hi Noel, It's definitely possible. You need to implement a custom KafkaRecordDeserializationSchema: its "deserialize" method gives you a ConsumerRecord as an argument so that you can extract Kafka message key, headers, timestamp, etc. Then pass that when you create a KafkaSource via "setDeseriali

Accessing kafka message key from a KafkaSource

2022-12-07 Thread Noel OConnor
Hi, I'm using a kafka source to read in messages from kafka into a datastream. However I can't seem to access the key of the kafka message in the datastream. Is this even possible ? cheers Noel