[
https://issues.apache.org/jira/browse/FLINK-18523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Congxian Qiu(klion26) updated FLINK-18523:
------------------------------------------
Description:
In the case of window calculations and eventTime scenarios, watermark cannot
update because the source does not have data for some reason, and the last
Windows cannot trigger the calculations.
One parameter, table.exec.source. Idle -timeout, can only solve the problem of
ignoring parallelism of watermark alignment that does not occur.But when there
is no watermark in each parallel degree, you still cannot update the watermark.
Is it possible to add a lock-timeout parameter (which should be larger than
maxOutOfOrderness with default of "-1 ms") and if the watermark is not updated
beyond this time (i.e., there is no data), then the current time is taken and
sent downstream as the watermark.
thanks!
was:
In the case of window calculations and eventTime scenarios, watermar cannot
update because the source does not have data for some reason, and the last
Windows cannot trigger the calculations.
One parameter, table.exec.source. Idle -timeout, can only solve the problem of
ignoring parallelism of watermark alignment that does not occur.But when there
is no watermark in each parallel degree, you still cannot update the watermark.
Is it possible to add a lock-timeout parameter (which should be larger than
maxOutOfOrderness with default of "-1 ms") and if the watermark is not updated
beyond this time (i.e., there is no data), then the current time is taken and
sent downstream as the watermark.
thanks!
> Advance watermark if there is no data in all of the partitions after some time
> ------------------------------------------------------------------------------
>
> Key: FLINK-18523
> URL: https://issues.apache.org/jira/browse/FLINK-18523
> Project: Flink
> Issue Type: New Feature
> Components: Table SQL / API
> Affects Versions: 1.11.0
> Reporter: chen yong
> Priority: Major
>
> In the case of window calculations and eventTime scenarios, watermark cannot
> update because the source does not have data for some reason, and the last
> Windows cannot trigger the calculations.
> One parameter, table.exec.source. Idle -timeout, can only solve the problem
> of ignoring parallelism of watermark alignment that does not occur.But when
> there is no watermark in each parallel degree, you still cannot update the
> watermark.
> Is it possible to add a lock-timeout parameter (which should be larger than
> maxOutOfOrderness with default of "-1 ms") and if the watermark is not
> updated beyond this time (i.e., there is no data), then the current time is
> taken and sent downstream as the watermark.
>
> thanks!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
