Re: [DISCUSS] Task speculative execution for Flink batch

2018-11-18 Thread Tao Yangyu
4:29 AM zhijiang > >> .invalid> > > >> > wrote: > > >> > > > >> >> Thanks yangyu for launching this discussion. > > >> >> > > >> >> I really like this proposal. We ever found this scene frequently > that > > >&g

Re: [DISCUSS] Task speculative execution for Flink batch

2018-11-17 Thread Xiaowei Jiang
e frequently that > >> some > >> >> long tail tasks to delay the total batch job execution time in > >> production. > >> >> We also have some thoughts for bringing this mechanism. Looking > >> forward to > >> >> your detail design d

Re: [DISCUSS] Task speculative execution for Flink batch

2018-11-17 Thread Tao Yangyu
>> long tail tasks to delay the total batch job execution time in >> production. >> >> We also have some thoughts for bringing this mechanism. Looking >> forward to >> >> your detail design doc, then we can discussion further. >> >> >> >> Best, >> >> Zhijiang >> >>

Re: [DISCUSS] Task speculative execution for Flink batch

2018-11-07 Thread Tao Yangyu
sion further. > >> > >> Best, > >> Zhijiang > >> -- > >> 发件人:Tao Yangyu > >> 发送时间:2018年11月6日(星期二) 11:01 > >> 收件人:dev > >> 主 题:[DISCUSS] Task speculative execution

Re: [DISCUSS] Task speculative execution for Flink batch

2018-11-06 Thread Becket Qin
l batch job execution time in > > > production. > > > >> We also have some thoughts for bringing this mechanism. Looking > > forward > > > to > > > >> your detail design doc, then we can discussion further. > > > >> > > >

Re: [DISCUSS] Task speculative execution for Flink batch

2018-11-06 Thread SHI Xiaogang
ringing this mechanism. Looking > forward > > to > > >> your detail design doc, then we can discussion further. > > >> > > >> Best, > > >> Zhijiang > > >> -- >

Re: [DISCUSS] Task speculative execution for Flink batch

2018-11-06 Thread Jeff Zhang
t;> long tail tasks to delay the total batch job execution time in > production. > >> We also have some thoughts for bringing this mechanism. Looking forward > to > >> your detail design doc, then we can discussion further. > >> > >> Best, > >> Zhijia

Re: [DISCUSS] Task speculative execution for Flink batch

2018-11-06 Thread Jin Sun
n production. >> We also have some thoughts for bringing this mechanism. Looking forward to >> your detail design doc, then we can discussion further. >> >> Best, >> Zhijiang >> -------------- >> 发件人:Tao Yangyu

Re: [DISCUSS] Task speculative execution for Flink batch

2018-11-06 Thread Till Rohrmann
ail design doc, then we can discussion further. > > Best, > Zhijiang > -- > 发件人:Tao Yangyu > 发送时间:2018年11月6日(星期二) 11:01 > 收件人:dev > 主 题:[DISCUSS] Task speculative execution for Flink batch > > Hi everyone

回复:[DISCUSS] Task speculative execution for Flink batch

2018-11-05 Thread zhijiang
, then we can discussion further. Best, Zhijiang -- 发件人:Tao Yangyu 发送时间:2018年11月6日(星期二) 11:01 收件人:dev 主 题:[DISCUSS] Task speculative execution for Flink batch Hi everyone, We propose task speculative execution for Flink batch in this

[DISCUSS] Task speculative execution for Flink batch

2018-11-05 Thread Tao Yangyu
Hi everyone, We propose task speculative execution for Flink batch in this message as follows. In the batch mode, the job is usually divided into multiple parallel tasks executed cross many nodes in the cluster. It is common to encounter the performance degradation on some nodes due to hardware p