Quoting Steve Loughran <ste...@hortonworks.com>:

On 8 May 2013 21:20, <st...@stevendyates.com> wrote:

Hi Harsh,

Thanks for responding,

I would be interested in what the dev group had in mind for this and I
also have a couple of additional queries ;

I can see that a quick win for this would be to expose the existing Jetty
statistics metrics within the jetty-management api/

Existing metrics which can be exposed include without much effort include;

statsOnMs: Time in milliseconds stats have been collected for.
statsReset(): Reset statistics.
requests: Number of requests since statsReset() called.
requestsActive: Number of requests currently active.
requestsActiveMin: Minimum number of active requests since statsReset()
called.
requestsActiveMax: Maximum number of active requests since statsReset()
called.
requestsDurationAve: Average duration of request handling in milliseconds
since statsReset() called.
requestsDurationMin: Get minimum duration in milliseconds of request
handling since statsReset() called.
requestsDurationMax: Get maximum duration in milliseconds of request
handling since statsReset() called.
requestsDurationTotal: Get total duration in milliseconds of all request
handling since statsReset() called.


I have some code on a not-yet-merged fork to create duruations, build
rolling average and variance, that variance being a key one if you are
trying to serve end users; ave can hide problems. There's Duration,
DurationStats to aggregate stats, and a DurationTable to map to duration
stats by name, e.g. "POST", and whether the op passed or failed

Unless there are existing bits of this stuff lurking somewhere in the
Hadoop codebase that I haven't noticed, these could be copied into hadoop
core. Reviewing the code as it is would be welcome

https://github.com/steveloughran/hadoop-trunk/tree/stevel/HADOOP-8545-swift/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/util


Thank you Steve, if you don't mind me taking a look at and possibly using your stats classes with this issue that would be great.

I will review and get back in touch

Regards
S


Reply via email to