Re: Apache Flink - Retries for async processing

2019-12-11 Thread M Singh
Thanks Zhu for your advice.  Mans On Tuesday, December 10, 2019, 09:32:01 PM EST, Zhu Zhu wrote: Hi M Singh, I think you would be able to know the request failure cause and whether it is recoverable or not.You can handle the error as you like. For example, if you think the error is un

Re: Apache Flink - Retries for async processing

2019-12-10 Thread Zhu Zhu
Hi M Singh, I think you would be able to know the request failure cause and whether it is recoverable or not. You can handle the error as you like. For example, if you think the error is unrecoverable, you can complete the ResultFuture exceptionally to expose this failure to Flink framework. If th

Re: Apache Flink - Retries for async processing

2019-12-10 Thread M Singh
Thanks Jingsong for sharing your solution. Since both refreshing the token and the actual API request can fail with either recoverable and unrecoverable exceptions, are there any patterns for retrying both and making the code robust to failures. Thanks again. On Monday, December 9, 2019, 10:

Re: Apache Flink - Retries for async processing

2019-12-09 Thread Jingsong Li
Hi M Singh, Our internal has this scenario too, as far as I know, Flink does not have this internal mechanism in 1.9 too. I can share my solution: - In async function, start a thread factory. - Send the call to thread factory when this call has failed. Do refresh security token too. Actually, deal

Apache Flink - Retries for async processing

2019-12-09 Thread M Singh
Hi Folks: I am working on a project where I will be using Flink's async processing capabilities.  The job has to make http request using a token.  The token expires periodically and needs to be refreshed. So, I was looking for patterns for handling async call failures and retries when the token