Re: two phase aggregation

2020-06-22 Thread Jark Wu
AFAIK, this is not on the roadmap. The problem is that it doesn't get much improvement for over window aggregates. If we support two-phase for over window aggregate, the local over operator doesn't reduce any data, it has to emit the same number of records it received, and can't reduce pressure of

Re: two phase aggregation

2020-06-22 Thread Fanbin Bu
Jark, thanks for the reply. Do you know whether it's on the roadmap or what's the plan? On Mon, Jun 22, 2020 at 9:36 PM Jark Wu wrote: > Hi Fanbin, > > Currently, over window aggregation doesn't support two-phase optimization. > > Best, > Jark > > On Tue, 23 Jun 2020 at 12:14, Fanbin Bu wrote:

Re: two phase aggregation

2020-06-22 Thread Jark Wu
Hi Fanbin, Currently, over window aggregation doesn't support two-phase optimization. Best, Jark On Tue, 23 Jun 2020 at 12:14, Fanbin Bu wrote: > Hi, > > Does over window aggregation support two-phase mode? > > https://ci.apache.org/projects/flink/flink-docs-stable/dev/table/config.html#table-