Re: Investigating use of Custom Trigger to smooth CPU usage

2023-08-08 Thread Tucker Harvey via user
Hi David and Xiangyu, For more context, We have a job running on our cluster aggregating StatsD metrics in tumbling window, which causes CPU usage spikes due to concurrent executions. While staggering the windows using StaggerWindow could help this will impact the job's accuracy. Instead, we

Re: Investigating use of Custom Trigger to smooth CPU usage

2023-08-03 Thread David Anderson
There's already a built-in concept of WindowStagger that provides an interface for accomplishing this. It's not as well integrated (or documented) as it might be, but the basic mechanism exists. To use it, I believe you would do something like this: assigner = new TumblingEventTimeWindows(Time.se

Re: Investigating use of Custom Trigger to smooth CPU usage

2023-08-02 Thread xiangyu feng
Hi Tucker, Can you describe more about your running job and how the trigger timer is configured? Also it would be better if you can attach a FlameGraph to show the CPU usage when the timer is triggered. Best, Xiangyu Tucker Harvey via user 于2023年8月1日周二 05:51写道: > Hello Flink community! My team