Re: Question about relationship between operator instances and keys

2021-12-02 Thread David Morávek
Hi haocheng, in short it works as follows: - Each parallel instance of an operator is responsible for one to N key groups. - Each parallel instance belongs to a slot, which is tied with a single thread (slot may actually introduce multiple subtasks) - # of keygroups for each operator = max parall

Question about relationship between operator instances and keys

2021-12-02 Thread haocheng
Hi community! So many keys are computed separately in each operator parallel, how does Flink achieve this? Let an operator instance processes 100 keys, is there 100 thread that are managed by the operator instance thread? I know that 1. an operator many have many parallel instances at the same