Re: Possible way to avoid unnecessary serialization calls.

2021-05-12 Thread Dawid Wysakowicz
Hi Alex, I cannot reproduce the issue. Do you mind checking if it is not an issue on your side? P.S. It would be nice if you could reply to the ML as well. That way other people can benefit from the answers. Moreover there will be more people who could help answering your question. Best, Dawid

Re: Possible way to avoid unnecessary serialization calls.

2021-05-10 Thread Dawid Wysakowicz
Hi Alex, If you are sure that the operations in between do not change the partitioning of the data and keep the key constant for the whole pipeline you could use the reinterpretAsKeyedStream[1]. I guess this answers your questions 1 & 2. As for the third question, first of all you should look int

Possible way to avoid unnecessary serialization calls.

2021-05-09 Thread Alex Drobinsky
Dear entity that represents Flink user community, In order to formulate the question itself, I would need to describe the problem in many details, hence please bear with me for a while. I have following execution graph: KafkaSource -> Message parser -> keyBy -> TCP assembly -> keyBy -> Storage -