Re: partial upgrade

2017-10-03 Thread Chen Qin
Hi Timo, Thanks for update. Flink pipeline deployment is very ad hoc and hard to maintain as a service platform. Each team may update their pipeline frequently which was completely blackbox and managed. Idea situation would be have a repo where all code lives and mapped to running pipelines in con

Re: partial upgrade

2017-10-02 Thread Timo Walther
Hi Chen, I think in a long-term perspective it makes sense to support things like this. The next big step is dynamic scaling without stopping the execution. Partial upgrades could be addressed afterwards, but I'm not aware of any plans. Until then, I would recommend a different architecture