You can control the resource sharing of tasks pretty fine grained.
The packing heuristic makes it simpler to initially configure and balance
clusters, because you need not to task-math to compute the resources.
On Thu, Sep 1, 2016 at 1:27 PM, Bhupesh Chawda
wrote:
> Thanks Stephan for your re
Thanks Stephan for your reply.
If I understand correctly, if my parallelism is 1, then all of the
operators, not matter how many (say 20), will still run on just one task
manager.
What happens in case the resources on that task manager are not sufficient
for all of these operators?
~ Bhupesh
On
In the default configuration, the job uses as many slots as the parallelism
of the operators states. I assume you run with a parallelism of 2, so it
occupies two slots.
if you run 5 taskmanagers with each one slot, you should set the
parallelism to 5 as well.
On Mon, Aug 29, 2016 at 4:04 PM, Bhup
Hi,
I am running Flink on a cluster of 5 nodes.
Here is my config:
*taskmanager.numberOfTaskSlots: 1parallelism.default: 1*
My Flink dashboard shows the following:
*Task Managers: 5*
*Task Slots: 5*
*Available Task Slots: 5*
I have the following questions:
1. Why does a job with 8 tasks
