Re: Streaming job software update

2016-05-10 Thread Maciek Próchniak
Hi, in our more-or-less development environment we're doing sth like that in our main method: val processName = name_of_our_stream val configuration = GlobalConfiguration.getConfiguration val system = JobClient.startJobClientActorSystem(configuration) val timeout = FiniteDura

Re: Streaming job software update

2016-05-09 Thread Aljoscha Krettek
Hi Bruce, you're right, taking down the job and restarting (from a savepoint) with the updated software is the only way of doing it. I'm not aware of any work being done in this area right now but it is an important topic that we certainly have to tackle in the not-so-far future. Cheer, Aljoscha

Streaming job software update

2016-05-04 Thread Hanson, Bruce
Hi all, I’m working on using Flink to do a variety of streaming jobs that will be processing very high-volume streams. I want to be able to update a job’s software with an absolute minimum impact on the processing of the data. What I don’t understand the best way to update the software running