Re: Async IO Question

2017-05-23 Thread Till Rohrmann
Hi Frank, yes it could be related to the bug we have fixed in 1.3. Could you try it out with Flink 1.3 to see if it fixes your problem? If not, then I would like to take a look at your code to exactly see what is happening there. Cheers, Till On Tue, May 23, 2017 at 4:28 PM, Frank Xue wrote: >

Re: Async IO Question

2017-05-23 Thread Frank Xue
Thanks for the reply Till! I am using Flink 1.2.1 so it could be an issue with the bug you mentioned that looks to be fixed in 1.3. The restart strategy is a fixed delay restart and I have tried various checkpoint and restart intervals and the behavior remains the same. Pretty much inside the async

Re: Async IO Question

2017-05-23 Thread Till Rohrmann
Hi Frank, which version of Flink are you using? There was a problem with correctly recognizing failed asynchronous operations, see FLINK-6435 [1]. In general, if an exception occurs within AsyncFunction#asyncInvoke, then the job should fail. Depending on which restart strategy you have chosen, th

Async IO Question

2017-05-22 Thread Frank Xue
Hi, I have a question related to async io for Flink. I found that when running unordered (AsyncDataStream.unorderedWait) failures within each individual asyncInvoke is added back to be retried, but when I run it ordered (AsyncDataStream.orderedWait) and an exception is thrown within asyncInvoke, i