[ 
https://issues.apache.org/jira/browse/FLINK-17012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17079409#comment-17079409
 ] 

Wenlong Lyu commented on FLINK-17012:
-------------------------------------

[~chesnay] I think it is not a good choice to treat processing first record as 
the signal of finishing initialization: when there is a filter in a job which 
filters most of the records or there is no input for long time, we will make a 
wrong decision. IMO, it would be perfect if we can add a new stage(state) for 
task such as Initializing which can be easily visualized but it can hurt 
compatibility, a separate metric maybe  a good compromise?

> Expose stage of task initialization
> -----------------------------------
>
>                 Key: FLINK-17012
>                 URL: https://issues.apache.org/jira/browse/FLINK-17012
>             Project: Flink
>          Issue Type: Improvement
>          Components: Runtime / Metrics, Runtime / Task
>            Reporter: Wenlong Lyu
>            Priority: Major
>
> Currently a task switches to running before fully initialized, does not take 
> state initialization and operator initialization(#open ) in to account, which 
> may take long time to finish. As a result, there would be a weird phenomenon 
> that all tasks are running but throughput is 0. 
> I think it could be good if we can expose the initialization stage of tasks. 
> What to you think?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to