Re: Flink restart strategy on specific exception

2020-05-14 Thread Zhu Zhu
Ticket FLINK-17714 is created to track this requirement. Thanks, Zhu Zhu Till Rohrmann 于2020年5月13日周三 下午8:30写道: > Yes, you are right Zhu Zhu. Extending > the RestartBackoffTimeStrategyFactoryLoader to also load custom > RestartBackoffTimeStrategies sound like a good improvement for the future. >

Re: Flink restart strategy on specific exception

2020-05-13 Thread Till Rohrmann
Yes, you are right Zhu Zhu. Extending the RestartBackoffTimeStrategyFactoryLoader to also load custom RestartBackoffTimeStrategies sound like a good improvement for the future. @Ken Krugler , the old RestartStrategy interface did not provide the cause of the failure, unfortunately. Cheers, Till

Re: Flink restart strategy on specific exception

2020-05-12 Thread Zhu Zhu
Hi Ken, Custom restart-strategy was an experimental feature and was deprecated since 1.10. [1] That's why you cannot find any documentation for it. The old RestartStrategy was deprecated and replaced by RestartBackoffTimeStrategy since 1.10 (unless you are using the legacy scheduler which was als

Re: Flink restart strategy on specific exception

2020-05-12 Thread Ken Krugler
Hi Til, Sorry, missed the key question…in the RestartStrategy.restart() method, I don’t see any good way to get at the underlying exception. I can cast the RestartCallback to an ExecutionGraphRestartCallback, but I still need access to the private execGraph to be able to get at the failure info

Re: Flink restart strategy on specific exception

2020-05-12 Thread Ken Krugler
Hi Til, Sorry to resurface an ancient question, but is there a working example anywhere of setting a custom restart strategy? Asking because I’ve been wandering through the Flink 1.9 code base for a while, and the restart strategy implementation is…pretty tangled. From what I’ve been able to f

Re: Flink restart strategy on specific exception

2018-11-22 Thread Till Rohrmann
Hi Kasif, I think in this situation it is best if you defined your own custom RestartStrategy by specifying a class which has a `RestartStrategyFactory createFactory(Configuration configuration)` method as `restart-strategy: MyRestartStrategyFactoryFactory` in `flink-conf.yaml`. Cheers, Till On

Flink restart strategy on specific exception

2018-11-21 Thread Ali, Kasif
Hello, Looking at existing restart strategies they are kind of generic. We have a requirement to restart the job only in case of specific exception/issues. What would be the best way to have a re start strategy which is based on few rules like looking at particular type of exception or some extr