Re: Automatic deployment of new version of streaming stateful job

2019-07-17 Thread Maxim Parkachov
Hi Marc, thanks a lot for the tool. Unfortunately, I could not direcly use it, but I will take couple of ideas and will implement my own script. Nevertherless, I'm really surprised that such functionality doesn't exist out of the box. Regards, Maxim. On Tue, Jul 16, 2019 at 9:22 AM Marc Rooding

Re: Automatic deployment of new version of streaming stateful job

2019-07-16 Thread Marc Rooding
Hi Maxim You could write a script yourself which triggers the cancel with savepoint and then starts a new version using the savepoint that was created during the cancel. However, I’ve built a tool that allows you to perform these steps more easily:  https://github.com/ing-bank/flink-deployer. T

Automatic deployment of new version of streaming stateful job

2019-07-15 Thread Maxim Parkachov
Hi, I'm trying to bring my first stateful streaming Flink job to production and have trouble understanding how to integrate it with CI/CD pipeline. I can cancel the job with savepoint, but in order to start new version of application I need to specify savepoint path manually ? So, basically my qu