On 2021/01/05 17:27, Arvid Heise wrote:
For your question: will there ever be intermediate operators that should be running that are not connected to at least once source? I think there are plenty of examples if you go beyond chained operators and fully connected exchanges. Think of any fan-in, let's assume you have source S1...S4, with S1+S2->M1, and S3+S4->M2. If S1 is finished, S2 and M1 is still running. Or I didn't get your question ;).
I was referring to the case where intermediate operators don't have any active upstream (input) operators. In that case, they basically become the "source" of that part of the graph. In your example, M1 is still connected to a "real" source.
Best, Aljoscha