Re: How to achieve co-location constraints in Flink 1.9.1

2020-11-19 Thread Arvid Heise
Hi Si-li, slot sharing is indeed the way that Flink performs co-location. It's actually enabled by default. It should work as expected if upstream and downstream operators have the same parallelism. In certain cases, two operators can be even chained into one task where no serialization/network t

How to achieve co-location constraints in Flink 1.9.1

2020-11-19 Thread Si-li Liu
Hi Flink only have slotSharingGroup API on DataStream class, I can't find any public API to achieve co-location constraints. Could anyone provide me an example? Another question is that if I use slotSharing group, Flink will schedule two sub tasks to same slot is possible. I think such schedule w