Re: Scheduling of Flink jobs

2016-09-01 Thread Bhupesh Chawda
should set the > parallelism to 5 as well. > > On Mon, Aug 29, 2016 at 4:04 PM, Bhupesh Chawda > wrote: > > > Hi, > > > > I am running Flink on a cluster of 5 nodes. > > Here is my config: > > > > > > > > *taskmanager.numberOf

Scheduling of Flink jobs

2016-08-29 Thread Bhupesh Chawda
Hi, I am running Flink on a cluster of 5 nodes. Here is my config: *taskmanager.numberOfTaskSlots: 1parallelism.default: 1* My Flink dashboard shows the following: *Task Managers: 5* *Task Slots: 5* *Available Task Slots: 5* I have the following questions: 1. Why does a job with 8 tasks

Re: Check-pointing configuration

2016-08-29 Thread Bhupesh Chawda
Hi! > > Right now, you would have to activate it on the StreamExecutionEnvironment. > We did not at a global setting for that, because each job may choose > different settings (like checkpointing interval). > > Can you intercept the job anywhere? > > Stephan > > > On M

Check-pointing configuration

2016-08-28 Thread Bhupesh Chawda
Hi, I have a question on enabling checkpointing for one of my Flink jobs. I understand that I can call *enableCheckpointing* on the *StreamExecutionEnvironment* to enable it. In my case, I don't have access to the source code; Is there also an option to enable it through configuration? Thanks. ~