Hi Nikola, To rule out any other cluster issues, I have tried it in my local now. Steps as follows, but don't see any metrics yet.
1) Set up local Graphite docker run -d\ --name graphite\ --restart=always\ -p 80:80\ -p 2003-2004:2003-2004\ -p 2023-2024:2023-2024\ -p 8125:8125/udp\ -p 8126:8126\ graphiteapp/graphite-statsd Mapped Ports HostContainerService 80 80 nginx <https://www.nginx.com/resources/admin-guide/> 2003 2003 carbon receiver - plaintext <http://graphite.readthedocs.io/en/latest/feeding-carbon.html#the-plaintext-protocol> 2004 2004 carbon receiver - pickle <http://graphite.readthedocs.io/en/latest/feeding-carbon.html#the-pickle-protocol> 2023 2023 carbon aggregator - plaintext <http://graphite.readthedocs.io/en/latest/carbon-daemons.html#carbon-aggregator-py> 2024 2024 carbon aggregator - pickle <http://graphite.readthedocs.io/en/latest/carbon-daemons.html#carbon-aggregator-py> 8080 8080 Graphite internal gunicorn port (without Nginx proxying). 8125 8125 statsd <https://github.com/etsy/statsd/blob/master/docs/server.md> 8126 8126 statsd admin <https://github.com/etsy/statsd/blob/master/docs/admin_interface.md> 2) WebUI: [image: image.png] 3) Run Flink example Job. ./bin/flink run ./examples/flink-examples-streaming_2.11-1.11-SNAPSHOT-SocketWindowWordCount.jar --port 9999 with conf/flink-conf.yaml set as: metrics.reporter.grph.factory.class: org.apache.flink.metrics.graphite.GraphiteReporterFactory metrics.reporter.grph.host: localhost metrics.reporter.grph.port: 2003 metrics.reporter.grph.protocol: TCP metrics.reporter.grph.interval: 1 SECONDS and graphite jar: plugins/flink-metrics-graphite/flink-metrics-graphite-1.10.0.jar 4) Can't see any activity in webui graphite. Could you review and let me know what is wrong here ? any other way you suggest to be able to view the raw metrics data ? Also, do you have sample metrics raw format, you can share from any other project. Regards, Vijay On Sun, Aug 23, 2020 at 9:26 PM Nikola Hrusov <n.hru...@gmail.com> wrote: > Hi Vijay, > > Your steps look correct to me. > Perhaps you can double check that the graphite port you are sending is > correct? THe default carbon port is 2003 and if you use the aggregator it > is 2023. > > You should be able to see in both flink jobmanager and taskmanager that > the metrics have been initialized with the config you have pasted. > > Regards > , > Nikola Hrusov > > > On Mon, Aug 24, 2020 at 5:00 AM Vijayendra Yadav <contact....@gmail.com> > wrote: > >> Hi Team, >> >> I am trying to export Flink stream default metrics using Graphite, but I >> can't find it in the Graphite metrics console. Could you confirm the steps >> below are correct? >> >> *1) Updated flink-conf.yaml* >> >> metrics.reporter.grph.factory.class: >> org.apache.flink.metrics.graphite.GraphiteReporterFactory >> metrics.reporter.grph.host: port >> metrics.reporter.grph.port: 9109 >> metrics.reporter.grph.protocol: TCP >> metrics.reporter.grph.interval: 30 SECONDS >> >> 2) Added Graphite jar in plugin folder : >> >> ll */usr/lib/flink/plugins/metric/* >> *flink-metrics-graphite-1.10.0.jar* >> >> 3) Looking metrics in graphite server: >> >> http://port:8080/metrics <http://10.108.58.63:8080/metrics> >> >> Note: No code change is done. >> >> Regards, >> Vijay >> >> >>
