Hi Vijay, I think the problem might be that you are using a wrong version of the reporter.
You say you used flink-metrics-graphite-1.10.0.jar from 1.10 as a plugin, but it was migrated to plugins in 1.11 only[1]. I'd recommend trying it out with the same 1.11 version of Flink and Graphite reporter. Best, Dawid [1] https://issues.apache.org/jira/browse/FLINK-16965 On 26/08/2020 08:04, Vijayendra Yadav wrote: > Hi Nikola, > > To rule out any other cluster issues, I have tried it in my local now. > Steps as follows, but don't see any metrics yet. > > 1) Set up local Graphite > > |docker run -d\ --name graphite\ --restart=always\ -p 80:80\ -p > 2003-2004:2003-2004\ -p 2023-2024:2023-2024\ -p 8125:8125/udp\ -p > 8126:8126\ graphiteapp/graphite-statsd| > > > Mapped Ports > > Host Container Service > 80 80 nginx <https://www.nginx.com/resources/admin-guide/> > 2003 2003 carbon receiver - plaintext > <http://graphite.readthedocs.io/en/latest/feeding-carbon.html#the-plaintext-protocol> > > 2004 2004 carbon receiver - pickle > <http://graphite.readthedocs.io/en/latest/feeding-carbon.html#the-pickle-protocol> > > 2023 2023 carbon aggregator - plaintext > <http://graphite.readthedocs.io/en/latest/carbon-daemons.html#carbon-aggregator-py> > > 2024 2024 carbon aggregator - pickle > <http://graphite.readthedocs.io/en/latest/carbon-daemons.html#carbon-aggregator-py> > > 8080 8080 Graphite internal gunicorn port (without Nginx proxying). > 8125 8125 statsd > <https://github.com/etsy/statsd/blob/master/docs/server.md> > 8126 8126 statsd admin > <https://github.com/etsy/statsd/blob/master/docs/admin_interface.md> > > 2) WebUI: > > image.png > > > 3) Run Flink example Job. > ./bin/flink run > ./examples/flink-examples-streaming_2.11-1.11-SNAPSHOT-SocketWindowWordCount.jar > --port 9999 > > with conf/flink-conf.yaml set as: > > metrics.reporter.grph.factory.class: > org.apache.flink.metrics.graphite.GraphiteReporterFactory > metrics.reporter.grph.host: localhost > metrics.reporter.grph.port: 2003 > metrics.reporter.grph.protocol: TCP > metrics.reporter.grph.interval: 1 SECONDS > > and graphite jar: > > plugins/flink-metrics-graphite/flink-metrics-graphite-1.10.0.jar > > > 4) Can't see any activity in webui graphite. > > > Could you review and let me know what is wrong here ? any other way > you suggest to be able to view the raw metrics data ? > Also, do you have sample metrics raw format, you can share from any > other project. > > Regards, > Vijay > > > > > On Sun, Aug 23, 2020 at 9:26 PM Nikola Hrusov <n.hru...@gmail.com > <mailto:n.hru...@gmail.com>> wrote: > > Hi Vijay, > > Your steps look correct to me. > Perhaps you can double check that the graphite port you are > sending is correct? THe default carbon port is 2003 and if you use > the aggregator it is 2023. > > You should be able to see in both flink jobmanager and taskmanager > that the metrics have been initialized with the config you have > pasted. > > Regards > , > Nikola Hrusov > > > On Mon, Aug 24, 2020 at 5:00 AM Vijayendra Yadav > <contact....@gmail.com <mailto:contact....@gmail.com>> wrote: > > Hi Team, > > I am trying to export Flink stream default metrics using > Graphite, but I can't find it in the Graphite metrics > console. Could you confirm the steps below are correct? > > *1) Updated flink-conf.yaml* > > metrics.reporter.grph.factory.class: > org.apache.flink.metrics.graphite.GraphiteReporterFactory > metrics.reporter.grph.host: port > metrics.reporter.grph.port: 9109 > metrics.reporter.grph.protocol: TCP > metrics.reporter.grph.interval: 30 SECONDS > > 2) Added Graphite jar in plugin folder : > > ll */usr/lib/flink/plugins/metric/* > *flink-metrics-graphite-1.10.0.jar* > > 3) Looking metrics in graphite server: > > http://port:8080/metrics <http://10.108.58.63:8080/metrics> > > Note: No code change is done. > > Regards, > Vijay > >
signature.asc
Description: OpenPGP digital signature
