Re: metric for total volume of messages per topic over a period of time

2019-02-04 Thread Amitav Mohanty
Hi Stanislav, Thanks for the suggestions. I am looking for exactly what you suggested. My final objective: get the volume of data ingested in a day (or any such time frame). My approach: collect the bytes in per sec value and run an aggregate (sum) on the collected data to get the volume Probl

Re: metric for total volume of messages per topic over a period of time

2019-01-17 Thread Stanislav Kozlovski
Hey there Amitav, thanks for the proposal. Just to be a bit more concrete on the proposed metrics, you would like to be able to see what the total bytes-in amount was for a given time period (e.g 60 seconds)? Do you mind sharing what the use case of such a metric is? This would require opening up

metric for total volume of messages per topic over a period of time

2019-01-17 Thread Amitav Mohanty
Hi I have a small proposal for improvement of Kafka that I would like to discuss with you. Kafka currently has rate metrics exposed per topic for the number of bytes ingested. I am interested in a volume metric. I would like to have direct answer to the question how much data is ingested in a top