Re: Reading from Kafka kafkarecorddeserializationschema

2022-02-08 Thread Roman Khachatryan
Hi, You can use other (de)serialization methods besides ByteBuffer as well. Endianness is set explicitly to have the same byte order during serialization and deserialization. Regards, Roman On Fri, Feb 4, 2022 at 2:43 PM Dawid Wysakowicz wrote: > > Hi, > > You can use DeserializationSchema with

Re: Reading from Kafka kafkarecorddeserializationschema

2022-02-07 Thread HG
Hi Dawid I am a little bit worried by the code because of the ByteBuffer and the endianness? Do I really need to worry about them and determine them too? Or was it just convenient to use ByteBuffer and the endianness here? Regards Hans public Event deserialize(byte[] message) throws IOException

Re: Reading from Kafka kafkarecorddeserializationschema

2022-02-04 Thread Dawid Wysakowicz
Hi, You can use DeserializationSchema with KafkaSource as well. You can pass it to the KafkaSource.builder():     KafkaSource.<...>builder()     .setDeserializer(...) You can also take a look at the StateMachineExample[1], where KafkaSource is used.

Reading from Kafka kafkarecorddeserializationschema

2022-02-03 Thread HG
Hello Most examples available still use the FlinkKafkaConsumer unfortunately. I need to consume events from Kafka. The format is Long,Timestamp,String,String. Do I need to create a custom deserializer? What also confuses me is KafkaSource** source = KafkaSource How does it relate to the de