Re: Adaptive Watermarks Generator

2020-05-22 Thread
rk generator. > I'm also not sure if we would integrate it directory into the main Flink > repository. What I could see is this generator being maintained in a public > GitHub repository, linked from flink-packages.org > > Best, > Robert > > On Sat, May 9, 2020 at 8:4

Adaptive Watermarks Generator

2020-05-08 Thread
Hi , I noticed there is a paper describe about adaptive watermark generator on top of Apache Flink v1.6.2 : https://www.dfki.de/fileadmin/user_upload/import/10260_awad-adaptive-watermarks.pdf This looks like a more precise generator with much less data drop . Does anybody know more detail about th

The mapping relationship between Checkpoint subtask id and Task subtask id

2020-02-13 Thread
Hi, I'm trying to figure out the different end2end duration for each subtask id in checkpoint. In flink web ui I noticed for job task subtask id it start from 0 and for checkpoint subtask id it start from number 1,. How can I find out which checkpoint subtask id belongs to which job task subtask

Re: How can I find out which key group belongs to which subtask

2020-01-10 Thread
gt; Best, >> Zhijiang >> >> -- >> From:杨东晓 >> Send Time:2020 Jan. 10 (Fri.) 02:10 >> To:Congxian Qiu >> Cc:user >> Subject:Re: How can I find out which key group belongs to which subtas

Re: How can I find out which key group belongs to which subtask

2020-01-10 Thread
> > Best, > Zhijiang > > ------ > From:杨东晓 > Send Time:2020 Jan. 10 (Fri.) 02:10 > To:Congxian Qiu > Cc:user > Subject:Re: How can I find out which key group belongs to which subtask > > Thanks Congxian! > My

Re: How can I find out which key group belongs to which subtask

2020-01-09 Thread
te/KeyGroupRangeAssignment.java > [3] > https://ci.apache.org/projects/flink/flink-docs-stable/dev/parallel.html#setting-the-maximum-parallelism > > Best, > Congxian > > > 杨东晓 于2020年1月9日周四 上午7:47写道: > >> Hi , I'm trying to do some optimize about Flink 'keyb

How can I find out which key group belongs to which subtask

2020-01-08 Thread
Hi , I'm trying to do some optimize about Flink 'keyby' processfunction. Is there any possible I can find out one key belongs to which key-group and essentially find out one key-group belongs to which subtask. The motivation I want to know that is we want to force the data records from upstream st