Re: Testing iterative data flows

2016-10-27 Thread Ufuk Celebi
Hey Ken! Unfortunately, no. But Paris just posted a proposal to improve this: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-13-Consistent-Processing-with-Loops-tt14149.html On Wed, Oct 26, 2016 at 11:10 PM, Ken Krugler wrote: > Hi all, > > What’s the recommended way

Testing iterative data flows

2016-10-26 Thread Ken Krugler
Hi all, What’s the recommended way currently to test a streaming data flow that has iterations? I know that using timeouts in tests (which FLINK-2390 also discusses) isn’t reliable, and it’s hard to know when a job with iterations is really “d