Re: Parallel execution but keep order of kafka messages

Hi Gordon, Thank you for your explanation! It has helped a lot. Just for learning completeness: Here in the docs it says “the parallelism of a stream is always that of its producing op

Re: Parallel execution but keep order of kafka messages

Hi Benjamin, In your case, the tumbling window subtasks would each have 3 input streams, 1 for each of the 3 FlinkKafkaConsumer operator subtasks. I thought that each subtask of the window would get only elements from one partition and therefore the watermarks would be calculated independently

Re: Parallel execution but keep order of kafka messages

Hi, So I have been rearranging my architecture to where I only have one input and one output topic, each with 3 partitions and in my flink job I have one consumer and one producer running with parallelism of 3. To run in parallel, I extract the partition from the metadata information per kafka mes