Re: Metrics in new producer

2014-02-22 Thread Martin Kleppmann
Not sure if you want yet another opinion added to the pile -- but since I had a similar problem on another project recently, I thought I'd weigh in. (On that project we were originally using Coda's library, but then switched to rolling our own metrics implementation because we needed to do a few

Re: Metrics in new producer

2014-02-22 Thread Clark Breyman
Jay - I was thinking of a pure stub rather than just wrapping Kafka metrics in a Coda gauge. I'd like the Timers, Meters etc to still be Coda meters - that way the windows, exponential decays, etc are comparable to the rest of the Coda metrics in our applications. At the same time, I don't want to

Re: Metrics in new producer

2014-02-22 Thread Jay Kreps
Hey Martin, Thanks for the great feedback. 1. I agree with the problems of mixing moving window statistics with fixed window statistics. That was one of my rationales. The other is that weighted statistics are very unintuitive for people compared to simple things like averages and percentiles so