Re: Monitoring backpressure

Hello Alan, the backpressure information can be retrieved from the web ui's REST API . |/jobs//vertices//backpressure This will give you a JSON object that looks something like this: { | |status:"ok"|"d

Re: Monitoring backpressure

Hey Stephan, My company (OpsClarity) is building monitoring integration for flink, and being that backpressure is one of the most critical concepts in a streaming system, we need a way to expose backpressure state to a monitoring system (such as ours). I see that the flink-ui has a way to sample

Re: Monitoring backpressure

Thanks Stephan, I will try with the profiler for now. Gyula Stephan Ewen ezt írta (időpont: 2015. dec. 7., H, 10:51): > I discussed about this quite a bit with other people. > > It is not totally straightforward. One could try and measure exhaustion of > the output buffer pools, but that fluct

Re: Monitoring backpressure

I discussed about this quite a bit with other people. It is not totally straightforward. One could try and measure exhaustion of the output buffer pools, but that fluctuates a lot - it would need some work to get a stable metric from that... If you have a profiler that you can attach to the proce