Hi all,

The problem you are seeing Lars is somewhat intended behaviour, unfortunately. 
With the batch/stream unification every Kafka partition is treated 
as kind of workload assignment. If one subtask receives a signal that there is 
no workload anymore it goes into the FINISHED state.
As already pointed this restriction will lift in the near future.

I went through the code and I think in your case you can configure the 
following configuration [1] which should show an equal behaviour than the
old source. This will prevent the enumerator from sending a final signal to the 
subtasks and they will not go into finished state.

May I ask why you have less partitions than the parallelism? I would be happy 
to learn more about your use-case to better understand the
motivation.

Best,
Fabian

[1] 
https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/connectors/datastream/kafka/#dynamic-partition-discovery

Reply via email to