Re: support launch more than one pipeline in a yarn session

2016-06-28 Thread Till Rohrmann
Hi Chen, I'm not sure what you mean with a pipeline but Flink supports the submission of multiple jobs to the same cluster (in standalone as well as Yarn session mode). You simply have to make sure that there are enough slots for all jobs to be executed at the same time. Cheers, Till On Jun 28, 2

support launch more than one pipeline in a yarn session

2016-06-27 Thread Chen Qin
Hi there, We are researching launch more than one pipeline in a flink yarn session. It's sort of like cluster mode where user pick off multiple pipelines on a job manager. Is there any plan to support this use case? If not, why not? Is it because of better isolation per pipeline or some implementa