Re: TaskManager & task slots

2018-11-21 Thread yinhua.dai
OK, thanks. -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: TaskManager & task slots

2018-11-21 Thread Fabian Hueske
Yes, this hasn't changed. Best, Fabain Am Mi., 21. Nov. 2018 um 08:18 Uhr schrieb yinhua.dai < yinhua.2...@outlook.com>: > Hi Fabian, > > Is below description still remain the same in Flink 1.6? > > Slots do not guard CPU time, IO, or JVM memory. At the moment they only > isolate managed memory

Re: TaskManager & task slots

2018-11-20 Thread yinhua.dai
Hi Fabian, Is below description still remain the same in Flink 1.6? Slots do not guard CPU time, IO, or JVM memory. At the moment they only isolate managed memory which is only used for batch processing. For streaming applications their only purpose is to limit the number of parallel threads that

RE: TaskManager & task slots

2016-09-27 Thread Ramanan, Buvana (Nokia - US)
52 AM To: user@flink.apache.org Subject: Re: TaskManager & task slots On Mon, Sep 26, 2016 at 9:46 PM, Ramanan, Buvana (Nokia - US) wrote: > When the operators (including source / sink) are chained, what is the method > of communication between them? In general, when operators are chained

Re: TaskManager & task slots

2016-09-27 Thread Ufuk Celebi
On Mon, Sep 26, 2016 at 9:46 PM, Ramanan, Buvana (Nokia - US) wrote: > When the operators (including source / sink) are chained, what is the method > of communication between them? In general, when operators are chained they execute in the same "physical" task and records are passed directly to t

RE: TaskManager & task slots

2016-09-26 Thread Ramanan, Buvana (Nokia - US)
your explanation in this regard. Thanks, Buvana From: Fabian Hueske [mailto:fhue...@gmail.com] Sent: Monday, September 26, 2016 2:41 PM To: user@flink.apache.org Subject: Re: TaskManager & task slots Hi Buvana, A TaskManager runs as a single JVM process. A TaskManager provides a certain n

Re: TaskManager & task slots

2016-09-26 Thread Fabian Hueske
Hi Buvana, A TaskManager runs as a single JVM process. A TaskManager provides a certain number of processing slots. Slots do not guard CPU time, IO, or JVM memory. At the moment they only isolate managed memory which is only used for batch processing. For streaming applications their only purpose

TaskManager & task slots

2016-09-26 Thread Ramanan, Buvana (Nokia - US)
Hello, I would like to understand the following better: https://ci.apache.org/projects/flink/flink-docs-release-1.1/setup/config.html#configuring-taskmanager-processing-slots Fundamental question - what is the notion of Task Slot? Does it correspond to one JVM? Or the Task Manager itself corres