Re: kafka metric to monitor for consumer FETCH using disk caching and not going to disk

2021-05-16 Thread Alexandre Dupriez
Not that I know of - but others may advise otherwise. The change from KIP-551 is fairly self-contained and can be backported well though. Thanks, Alexandre Le dim. 16 mai 2021 à 14:51, Pushkar Deole a écrit : > > thanks Alexandre... currently we are using kafka 2.5.0, so is there any > metric th

Re: kafka metric to monitor for consumer FETCH using disk caching and not going to disk

2021-05-16 Thread Pushkar Deole
thanks Alexandre... currently we are using kafka 2.5.0, so is there any metric that can be used from 2.5.0? On Sun, May 16, 2021 at 6:02 PM Alexandre Dupriez < alexandre.dupr...@gmail.com> wrote: > Hi Pushkar, > > If you are using Linux and Kafka 2.6.0+, the closest metric to what > you are looki

Re: kafka metric to monitor for consumer FETCH using disk caching and not going to disk

2021-05-16 Thread Alexandre Dupriez
Hi Pushkar, If you are using Linux and Kafka 2.6.0+, the closest metric to what you are looking for is TotalDiskReadBytes [1], which measures data transfer at the block layer. Assuming your consumers are doing tail reads and there is no other activity which requires loading pages from the disk on