GitHub user rayman7718 opened a pull request:
https://github.com/apache/samza/pull/543
Populating ListGauge metric using DiagnosticsAppender for exceptions
This PR shows how the ListGauge can be used to emit exceptions using a
DiagnosticsAppender.
1. DiagnosticsAppender is enabled using a config
(diagnostics.appender.enable)
2. DiagnosticsAppender adds exception-events to a listgauge which is a
samza container metric
2. This ListGauge uses a time-and-count based eviction policy, so that
exception-events are not emitted to Kafka(SnapshotReporter) forever.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/rayman7718/samza diagnosticsappender
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/samza/pull/543.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #543
----
commit 5ae1df9203342e65ea97fbb9471046e036bde74c
Author: Ray Matharu <rmatharu@...>
Date: 2018-05-10T23:31:07Z
Added exception metric (as string-guage), to be emitted using the snapshot
reporter.
Switched producer-shutdown logic to ensure metric-flush at shutdown-time
commit 5a3ef7bc09a5ace726c1dcb61d66e036b972e210
Author: Ray Matharu <rmatharu@...>
Date: 2018-05-30T05:56:02Z
Adding ListGauge and integration with SamzaContainerMetric
commit 75ef5d20aedf7f2dd0972ff9ddcc3101e28b095d
Author: Ray Matharu <rmatharu@...>
Date: 2018-05-31T22:33:07Z
Typifying ListGauge to ListGauge<T>, adding an eviction policy, default
policy to retain last N
commit 1efed5a861fe2079827d81781041d1bebb52374d
Author: Ray Matharu <rmatharu@...>
Date: 2018-05-10T23:31:07Z
Adding metric type ListGauge
Added exception metric (as string-guage), to be emitted using the snapshot
reporter.
Switched producer-shutdown logic to ensure metric-flush at shutdown-time
Adding ListGauge and integration with SamzaContainerMetric
Typifying ListGauge to ListGauge<T>, adding an eviction policy, default
policy to retain last N
commit d2922c56dafb49c40885512760b58ce9528e9ac7
Author: Ray Matharu <rmatharu@...>
Date: 2018-05-31T22:51:28Z
Merge branch 'listgauge' of https://github.com/rayman7718/samza into
listgauge
commit 6602fa08b119df50022a7eaf56c5ad9be22f656d
Author: Ray Matharu <rmatharu@...>
Date: 2018-06-01T22:22:34Z
Adding DiagnosticsAppender, Populating ListGauge exception metric (samza
container metric) using DiagnosticsAppender
commit 054d5078ad3ecbd98a85eaa67eeb57c78e2a0f70
Author: Ray Matharu <rmatharu@...>
Date: 2018-06-02T01:01:27Z
Adding DiagnosticsExceptionEventEvictionPolicy to evict stale events from
ListGauge
----
---
