Re: Adding and removing operations after execute

2016-07-08 Thread Aljoscha Krettek
This Blog post goes into the direction of what Jamie suggested: https://techblog.king.com/rbea-scalable-real-time-analytics-king/ The folks at King developed a system where users can dynamically inject scripts written in Groovy into a running general-purpose Flink job. On Thu, 7 Jul 2016 at 20:34

Re: Adding and removing operations after execute

2016-07-07 Thread Jamie Grier
Hi Adam, Another way to do this, depending on your exact requirements, could be to consume a second stream that essentially "configures" the operators that make up the Flink job thus dynamically altering the behavior of the job at runtime. Whether or not this approach is feasible really depends o

Re: Adding and removing operations after execute

2016-07-07 Thread Kostas Kloudas
Hi, The best way to do so is to use a Flink feature called savepoints. You can find more here: https://ci.apache.org/projects/flink/flink-docs-master/apis/streaming/savepoints.html In a nutshell, savepoint