metrics.reporter.grph.class:
org.apache.flink.metrics.graphite.GraphiteReporter
https://ci.apache.org/projects/flink/flink-docs-release-1.10/monitoring/metrics.html#graphite-orgapacheflinkmetricsgraphitegraphitereporter
On 26/08/2020 16:40, Vijayendra Yadav wrote:
Hi Dawid,
I have 1.10.0 version of flink. What is alternative for this version ?
Regards,
Vijay
On Aug 25, 2020, at 11:44 PM, Dawid Wysakowicz
<dwysakow...@apache.org> wrote:
Hi Vijay,
I think the problem might be that you are using a wrong version of
the reporter.
You say you used flink-metrics-graphite-1.10.0.jar from 1.10 as a
plugin, but it was migrated to plugins in 1.11 only[1].
I'd recommend trying it out with the same 1.11 version of Flink and
Graphite reporter.
Best,
Dawid
[1] https://issues.apache.org/jira/browse/FLINK-16965
On 26/08/2020 08:04, Vijayendra Yadav wrote:
Hi Nikola,
To rule out any other cluster issues, I have tried it in my local
now. Steps as follows, but don't see any metrics yet.
1) Set up local Graphite
|docker run -d\ --name graphite\ --restart=always\ -p 80:80\ -p
2003-2004:2003-2004\ -p 2023-2024:2023-2024\ -p 8125:8125/udp\ -p
8126:8126\ graphiteapp/graphite-statsd|
Mapped Ports
Host Container Service
80 80 nginx <https://www.nginx.com/resources/admin-guide/>
2003 2003 carbon receiver - plaintext
<http://graphite.readthedocs.io/en/latest/feeding-carbon.html#the-plaintext-protocol>
2004 2004 carbon receiver - pickle
<http://graphite.readthedocs.io/en/latest/feeding-carbon.html#the-pickle-protocol>
2023 2023 carbon aggregator - plaintext
<http://graphite.readthedocs.io/en/latest/carbon-daemons.html#carbon-aggregator-py>
2024 2024 carbon aggregator - pickle
<http://graphite.readthedocs.io/en/latest/carbon-daemons.html#carbon-aggregator-py>
8080 8080 Graphite internal gunicorn port (without Nginx proxying).
8125 8125 statsd
<https://github.com/etsy/statsd/blob/master/docs/server.md>
8126 8126 statsd admin
<https://github.com/etsy/statsd/blob/master/docs/admin_interface.md>
2) WebUI:
<image.png>
3) Run Flink example Job.
./bin/flink run
./examples/flink-examples-streaming_2.11-1.11-SNAPSHOT-SocketWindowWordCount.jar
--port 9999
with conf/flink-conf.yaml set as:
metrics.reporter.grph.factory.class:
org.apache.flink.metrics.graphite.GraphiteReporterFactory
metrics.reporter.grph.host: localhost
metrics.reporter.grph.port: 2003
metrics.reporter.grph.protocol: TCP
metrics.reporter.grph.interval: 1 SECONDS
and graphite jar:
plugins/flink-metrics-graphite/flink-metrics-graphite-1.10.0.jar
4) Can't see any activity in webui graphite.
Could you review and let me know what is wrong here ? any other way
you suggest to be able to view the raw metrics data ?
Also, do you have sample metrics raw format, you can share from any
other project.
Regards,
Vijay
On Sun, Aug 23, 2020 at 9:26 PM Nikola Hrusov <n.hru...@gmail.com
<mailto:n.hru...@gmail.com>> wrote:
Hi Vijay,
Your steps look correct to me.
Perhaps you can double check that the graphite port you are
sending is correct? THe default carbon port is 2003 and if you
use the aggregator it is 2023.
You should be able to see in both flink jobmanager and
taskmanager that the metrics have been initialized with the
config you have pasted.
Regards
,
Nikola Hrusov
On Mon, Aug 24, 2020 at 5:00 AM Vijayendra Yadav
<contact....@gmail.com <mailto:contact....@gmail.com>> wrote:
Hi Team,
I am trying to export Flink stream default metrics using
Graphite, but I can't find it in the Graphite metrics
console. Could you confirm the steps below are correct?
*1) Updated flink-conf.yaml*
metrics.reporter.grph.factory.class:
org.apache.flink.metrics.graphite.GraphiteReporterFactory
metrics.reporter.grph.host: port
metrics.reporter.grph.port: 9109
metrics.reporter.grph.protocol: TCP
metrics.reporter.grph.interval: 30 SECONDS
2) Added Graphite jar in plugin folder :
ll */usr/lib/flink/plugins/metric/*
*flink-metrics-graphite-1.10.0.jar*
3) Looking metrics in graphite server:
http://port:8080/metrics <http://10.108.58.63:8080/metrics>
Note: No code change is done.
Regards,
Vijay
