Re: Resource overallocation

2017-04-30 Thread Luis Alves
Hi Till, Thanks for your answer. It did helped me validating some of my thoughts. Cheers, Luís On Sat, 29 Apr 2017 at 09:26 Till Rohrmann < mailto:Till Rohrmann > wrote: a, pre, code, a:link, body { word-wrap: break-word !important; } Hi Luis, let me try to answer some of your questions:

Re: Resource overallocation

2017-04-29 Thread Till Rohrmann
Hi Luis, let me try to answer some of your questions: Usually we recommend to reserve for each slot at least one CPU core. One reason why you would want to reserve more slots than cores is that you execute blocking operations in your operators. That way you can keep all of your cores busy. If yo

Resource overallocation

2017-04-22 Thread Luis Alves
Hi, Regarding the features on Flink that allow to optimize resource usage in the cluster (+ latency, throughput ...), i.e. slot sharing, task chaining, async i/o and dynamic scaling, I would like to ask the following questions (all in the stream processing context):  In which cases would someo