[
https://issues.apache.org/jira/browse/HADOOP-12360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16036925#comment-16036925
]
Michael Moss edited comment on HADOOP-12360 at 6/5/17 3:54 PM:
---------------------------------------------------------------
Dave, thanks for the (fast) response.
Here's what we were seeing for the following configuration:
ubuntu@foo:~$ cat /etc/hadoop/conf/hadoop-metrics2.properties
datanode.sink.statsd.class=org.apache.hadoop.metrics2.sink.StatsDSink
datanode.sink.statsd.server.host=localhost
datanode.sink.statsd.server.port=8125
datanode.sink.statsd.skip.hostname=true
datanode.sink.statsd.service.name=our.prefix
rpc and datanode contexts look good for example:
our.prefix.rpc.rpc.RpcQueueTimeNumOps:4|c
our.prefix.dfs.datanode.BlockReportsNumOps:79|
but the jvm context renders as:
DataNode.jvm.JvmMetrics.MemNonHeapUsedM:41.624916|g
losing our prefix (overrides the 'sn' variable, per above)
We need a consistent prefix to properly namespace our metrics.
Seemed like a bug, but wasn't sure.
was (Author: michaelmoss):
Dave, thanks for the (fast) response.
Here's what we were seeing for the following configuration:
ubuntu@alphab-bvlt-r1n87:~$ cat /etc/hadoop/conf/hadoop-metrics2.properties
# generated by Chef for alphab-bvlt-r1n87, changes will be overwritten
datanode.sink.statsd.class=org.apache.hadoop.metrics2.sink.StatsDSink
datanode.sink.statsd.server.host=localhost
datanode.sink.statsd.server.port=8125
datanode.sink.statsd.skip.hostname=true
datanode.sink.statsd.service.name=our.prefix
rpc and datanode contexts look good for example:
our.prefix.rpc.rpc.RpcQueueTimeNumOps:4|c
our.prefix.dfs.datanode.BlockReportsNumOps:79|
but the jvm context renders as:
DataNode.jvm.JvmMetrics.MemNonHeapUsedM:41.624916|g
losing our prefix (overrides the 'sn' variable, per above)
We need a consistent prefix to properly namespace our metrics.
Seemed like a bug, but wasn't sure.
> Create StatsD metrics2 sink
> ---------------------------
>
> Key: HADOOP-12360
> URL: https://issues.apache.org/jira/browse/HADOOP-12360
> Project: Hadoop Common
> Issue Type: New Feature
> Components: metrics
> Affects Versions: 2.7.1
> Reporter: Dave Marion
> Assignee: Dave Marion
> Priority: Minor
> Fix For: 2.8.0, 3.0.0-alpha1
>
> Attachments: HADOOP-12360.001.patch, HADOOP-12360.002.patch,
> HADOOP-12360.003.patch, HADOOP-12360.004.patch, HADOOP-12360.005.patch,
> HADOOP-12360.006.patch, HADOOP-12360.007.patch, HADOOP-12360.008.patch,
> HADOOP-12360.009.patch, HADOOP-12360.010.patch
>
>
> Create a metrics sink that pushes to a StatsD daemon.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
