Hey there Amitav, thanks for the proposal. Just to be a bit more concrete on the proposed metrics, you would like to be able to see what the total bytes-in amount was for a given time period (e.g 60 seconds)? Do you mind sharing what the use case of such a metric is? This would require opening up a KIP and the more examples we can give to its usefulness the better the chance of it being accepted
Best, Stanislav On Thu, Jan 17, 2019 at 12:46 PM Amitav Mohanty <amitavmohant...@gmail.com> wrote: > Hi > > I have a small proposal for improvement of Kafka that I would like to > discuss with you. Kafka currently has rate metrics exposed per topic for > the number of bytes ingested. I am interested in a volume metric. > > I would like to have direct answer to the question how much data is > ingested in a topic over a period of time. Disk usage does not suffice for > the following reasons: > - Disk allocation will be done in chunks which will be filled by ingested > messages over time > - The disk can be cleared based on retention period but this metric can > potentially track volume ingestion over a period longer than the retention > period. For example, I might have an 8 hour retention period but I might > want to find out how much data was ingested on a topic in a day. > > Do you see any concerns over having such a metric? > > Regards, > Amitav > -- Best, Stanislav
