回复: How to use pipeline.jobvertex-parallelism-overrides property.

2023-08-26 Thread Chen Zhanghao
Hi Krzysztof, I agree with you that sometimes one may want to break chains so there's value in supporting overriding parallelisms for individual operators. However, the config pipeline.jobvertex-parallelism-overrides is added in the context of support Flink autoscaling. For autoscaling, we don'

回复: Stoping a Job Without killing Task Manager

2023-08-26 Thread Chen Zhanghao
Hi Kenan, Flink introduces the watchdog mechanism that makes TM suicide as the final safety net for properly cancel a task that got stuck in the cancellation phase for too long. The mechanism is necessary as there's no other alternatives to force killing a stuck task other than killing the proc

How to trigger process function when no event in eventTimeWindow ?

2023-08-26 Thread longfeng Xu
Hello, The issue I’m encountering revolves about 1、 aggregating products sales for each minute. Sale data from Kafka with eventtime. 2、If there is no data in that minute, program should produces default zero. 3、all time I mention are eventtime. No using process time is consider of rerun situation.