Re: Understanding Operator Chaining

2016-06-28 Thread Maximilian Michels
Hi Marius, The current chaining code assumes there will never be too complex chains. Which is probably true for most jobs but could become in issue in some cases. If you want to make sure the chain is broken, you can start a new chain using `startNewChain()` on all single output operators. Cheer

Re: Understanding Operator Chaining

2016-06-27 Thread Aljoscha Krettek
Hi Marius, the chaining code is still somewhat fragile and some stuff in there are leftovers. For example, StreamGroupedFold can only be used on a KeyedStream, which means that it can never be within a chain because the shuffle always breaks a chain. Specifying HEAD here is therefore redundant. I t