Re: Flink's multi-user support

2015-05-13 Thread Maximilian Michels
You can > > > still > > > > run an interactive session with many jobs one after another. > > > > > > > > > > > > On Wed, Apr 29, 2015 at 7:07 PM, Maximilian Michels > > > > wrote: > > > > > > > > >

Re: Flink's multi-user support

2015-05-13 Thread Stephan Ewen
ed, Apr 29, 2015 at 7:07 PM, Maximilian Michels > > > wrote: > > > > > > > > > > > > > However, dropping it completely instead of improving it would make > > > Flink > > > > > setups on dedicated clusters quite useless, right

Re: Flink's multi-user support

2015-05-13 Thread Maximilian Michels
> > > setups on dedicated clusters quite useless, right? > > > > > > > > > > Not really, because you could also use YARN on dedicated clusters for > > > proper multi-user support. > > > > > > On Wed, Apr 29, 2015 at 5:51 PM, Fabian Hue

Re: Flink's multi-user support

2015-04-30 Thread Flavio Pompermaier
t; > > > > > However, dropping it completely instead of improving it would make > Flink > > > setups on dedicated clusters quite useless, right? > > > > > > > Not really, because you could also use YARN on dedicated clusters for > > proper multi-user s

Re: Flink's multi-user support

2015-04-30 Thread Maximilian Michels
dedicated clusters quite useless, right? > > > > > > > Not really, because you could also use YARN on dedicated clusters for > > proper multi-user support. > > > > On Wed, Apr 29, 2015 at 5:51 PM, Fabian Hueske > wrote: > > > > > I agree t

Re: Flink's multi-user support

2015-04-30 Thread Stephan Ewen
nstead of improving it would make Flink > > setups on dedicated clusters quite useless, right? > > > > Not really, because you could also use YARN on dedicated clusters for > proper multi-user support. > > On Wed, Apr 29, 2015 at 5:51 PM, Fabian Hueske wrote: > > > I

Re: Flink's multi-user support

2015-04-29 Thread Maximilian Michels
: > I agree that Flink's multi-user support is not very good at the moment. > However, dropping it completely instead of improving it would make Flink > setups on dedicated clusters quite useless, right? > > > 2015-04-29 17:33 GMT+02:00 Maximilian Michels : > > > Hi ev

Re: Flink's multi-user support

2015-04-29 Thread Fabian Hueske
at 5:51 PM, Fabian Hueske wrote: > > > I agree that Flink's multi-user support is not very good at the moment. > > However, dropping it completely instead of improving it would make Flink > > setups on dedicated clusters quite useless, right? > &g

Re: Flink's multi-user support

2015-04-29 Thread Stephan Ewen
Tough question. I'd actually rather go for "single user" and "multi user" through YARN, than a not really thought through multi-user version. On Wed, Apr 29, 2015 at 5:51 PM, Fabian Hueske wrote: > I agree that Flink's multi-user support is not very good at t

Re: Flink's multi-user support

2015-04-29 Thread Fabian Hueske
I agree that Flink's multi-user support is not very good at the moment. However, dropping it completely instead of improving it would make Flink setups on dedicated clusters quite useless, right? 2015-04-29 17:33 GMT+02:00 Maximilian Michels : > Hi everyone, > > Currently Flin

Flink's multi-user support

2015-04-29 Thread Maximilian Michels
Hi everyone, Currently Flink accepts jobs from multiple clients and executes them concurrently if the resource limits are not exceeded. However, the multi-user support is very poor. We don't support queuing of jobs and concurrent jobs have to share resources in a nice way. Otherwise, jobs will fai