RE: Re: Re: inputQueueSize metric

2023-11-29 Thread Dimitris Banelas via user
Thank you for your previous response Feng. It clears things up a little. Regarding the inputQueueSize metric. What does it express after all? Observing the inputQueueSize and inPoolUsage metrics in Prometheus, I found that when the inPoolUsage is high, the inputQueueSize is low. This observati

Re: Re: inputQueueSize metric

2023-11-28 Thread Feng Jin
Hi Dimitris Yes, the inputQueueLength metric can only represent the number of buffers, and cannot obtain the actual size of the messages. Regarding the inputQueueSize metric, it ignores the LocalChannel. Therefore, when tasks are connected through the Forward partition strategy, it will consisten

RE: Re: inputQueueSize metric

2023-11-27 Thread Dimitris Banelas via user
As per the docs, the `inputQueueLength` metric refers to the number of queued input buffers, and cannot be used on its own in order to determine buffered records. For instance, if I know that there are 5 queued input buffers, I cannot conclude anything regarding buffered records if the size of