Re: Production readiness of Flink Job Stop Service

2018-07-22 Thread vino yang
Hi Chirag, Actually, if you want to use "stop/resume/pause" pattern, you can trigger a savepoint before stopping job, then you can resume your job with specify this savepoint. The savepoint does not bind with cancel command, although you can only invoke "cancel with savepoint" now. Now you mentio

Re: Production readiness of Flink Job Stop Service

2018-07-22 Thread Chirag Dewan
Thanks a lot Fabian and Vino. Is there anyway I can do that without stop? Although the plan should be to use a Two Phase commit sink so that there are no duplicates, I am looking for stopping the sources before the savepoint is triggered. Thanks, Chirag Sent from Yahoo Mail on Android On Th

Re: Production readiness of Flink Job Stop Service

2018-07-19 Thread Fabian Hueske
Hi Chirag, Stop with savepoint is not mentioned in the 1.5.0 release notes [1]. Since its a frequently requested feature, I'm pretty sure that it would have been mentioned if it was added. Best, Fabian [1] http://flink.apache.org/news/2018/05/25/release-1.5.0.html 2018-07-19 8:39 GMT+02:00 vin

Re: Production readiness of Flink Job Stop Service

2018-07-18 Thread vino yang
Hi Chirag, Did you read the latest stable Flink documentation about Savepoint[1] and Cancel with savepoint[2] and Upgrade application[3]? [1]: https://ci.apache.org/projects/flink/flink-docs-release-1.5/ops/state/savepoints.html#resuming-from-savepoints [2]: https://ci.apache.org/projects/flink/f

Production readiness of Flink Job Stop Service

2018-07-18 Thread Chirag Dewan
Hi, I am planning to use the Stop Service for stopping/resuming/pausing my Flink Job. My intention is to stop sources before we take the savepoint i.e. stop with savepoint.  I know that since Flink 1.4.2, Stop is not stable/not production ready.  With Flink 1.5 can it be used for stopping jobs? R