Re: Custom scheduler in Flink

2018-11-30 Thread Felipe Gutierrez
a custom Scheduler, i.e., >>> > something where can just plug in your scheduler in a nice way. For this >>> > you'll have to directly modify the source of Flink. >>> > >>> > The work in https://issues.apache.org/jira/browse/FLINK-8886 may also >

Re: Custom scheduler in Flink

2018-11-30 Thread Felipe Gutierrez
>> > >> > The work in https://issues.apache.org/jira/browse/FLINK-8886 may also >> be >> > of interest, but is still in the design phase. >> > >> > On 28.11.2018 10:21, Felipe Gutierrez wrote: >> > >> > Hi, >> > >> >

Re: Custom scheduler in Flink

2018-11-30 Thread Till Rohrmann
ache.org/jira/browse/FLINK-8886 may also be > > of interest, but is still in the design phase. > > > > On 28.11.2018 10:21, Felipe Gutierrez wrote: > > > > Hi, > > > > I want to develop a custom scheduler in Flink to be aware for which host > > Flink must proc

Re: Custom scheduler in Flink

2018-11-28 Thread Felipe Gutierrez
t; > On 28.11.2018 10:21, Felipe Gutierrez wrote: > > Hi, > > I want to develop a custom scheduler in Flink to be aware for which host > Flink must process some task. This post shows (using Apache Storm) the kind > of example I want to build > (https://inside.edited.com/tak

Re: Custom scheduler in Flink

2018-11-28 Thread Chesnay Schepler
s still in the design phase. On 28.11.2018 10:21, Felipe Gutierrez wrote: Hi, I want to develop a custom scheduler in Flink to be aware for which host Flink must process some task. This post shows (using Apache Storm) the kind of example I want to build ( https://inside.edited.com/taking-contr

Custom scheduler in Flink

2018-11-28 Thread Felipe Gutierrez
Hi, I want to develop a custom scheduler in Flink to be aware for which host Flink must process some task. This post shows (using Apache Storm) the kind of example I want to build ( https://inside.edited.com/taking-control-of-your-apache-storm-cluster-with-tag-aware-scheduling-b605e37e ). I

Re: custom scheduler in Flink?

2016-07-13 Thread Aljoscha Krettek
Hi, I'm afraid there is no documentation about schedulers, especially at this low level. Maybe this new design proposal would of interest for you, though: https://cwiki.apache.org/confluence/display/FLINK/FLIP-1+%3A+Fine+Grained+Recovery+from+Task+Failures In there is a link to the mailing list dis

custom scheduler in Flink?

2016-07-04 Thread #ZHANG SHUHAO#
Hi everyone, I want to develop a custom task scheduler in Flink, specifically, I want to control the scheduling of components of an topology into specific hosts, where should I start with? Is there an example program or tutorial about this? Thanks! Thanks. Best regards. Shuhao Zhang (Tony) +65-