I'd recommend then following this instruction from older docs[1] The difference are that you should set:
|metrics.reporter.grph.class: org.apache.flink.metrics.graphite.GraphiteReporter| and put the reporter jar to the /lib folder: In order to use this reporter you must copy |/opt/flink-metrics-graphite-1.10.0.jar| into the |/lib| folder of your Flink distribution. [1] https://ci.apache.org/projects/flink/flink-docs-release-1.10/monitoring/metrics.html#graphite-orgapacheflinkmetricsgraphitegraphitereporter Best, Dawid On 26/08/2020 16:40, Vijayendra Yadav wrote: > Hi Dawid, > > I have 1.10.0 version of flink. What is alternative for this version ? > > Regards, > Vijay > >> >> On Aug 25, 2020, at 11:44 PM, Dawid Wysakowicz >> <dwysakow...@apache.org> wrote: >> >> >> >> Hi Vijay, >> >> I think the problem might be that you are using a wrong version of >> the reporter. >> >> You say you used flink-metrics-graphite-1.10.0.jar from 1.10 as a >> plugin, but it was migrated to plugins in 1.11 only[1]. >> >> I'd recommend trying it out with the same 1.11 version of Flink and >> Graphite reporter. >> >> Best, >> >> Dawid >> >> [1] https://issues.apache.org/jira/browse/FLINK-16965 >> >> On 26/08/2020 08:04, Vijayendra Yadav wrote: >>> Hi Nikola, >>> >>> To rule out any other cluster issues, I have tried it in my local >>> now. Steps as follows, but don't see any metrics yet. >>> >>> 1) Set up local Graphite >>> >>> |docker run -d\ --name graphite\ --restart=always\ -p 80:80\ -p >>> 2003-2004:2003-2004\ -p 2023-2024:2023-2024\ -p 8125:8125/udp\ -p >>> 8126:8126\ graphiteapp/graphite-statsd| >>> >>> >>> Mapped Ports >>> >>> Host Container Service >>> 80 80 nginx <https://www.nginx.com/resources/admin-guide/> >>> 2003 2003 carbon receiver - plaintext >>> <http://graphite.readthedocs.io/en/latest/feeding-carbon.html#the-plaintext-protocol> >>> >>> 2004 2004 carbon receiver - pickle >>> <http://graphite.readthedocs.io/en/latest/feeding-carbon.html#the-pickle-protocol> >>> >>> 2023 2023 carbon aggregator - plaintext >>> <http://graphite.readthedocs.io/en/latest/carbon-daemons.html#carbon-aggregator-py> >>> >>> 2024 2024 carbon aggregator - pickle >>> <http://graphite.readthedocs.io/en/latest/carbon-daemons.html#carbon-aggregator-py> >>> >>> 8080 8080 Graphite internal gunicorn port (without Nginx >>> proxying). >>> 8125 8125 statsd >>> <https://github.com/etsy/statsd/blob/master/docs/server.md> >>> 8126 8126 statsd admin >>> <https://github.com/etsy/statsd/blob/master/docs/admin_interface.md> >>> >>> 2) WebUI: >>> >>> <image.png> >>> >>> >>> >>> 3) Run Flink example Job. >>> ./bin/flink run >>> ./examples/flink-examples-streaming_2.11-1.11-SNAPSHOT-SocketWindowWordCount.jar >>> --port 9999 >>> >>> with conf/flink-conf.yaml set as: >>> >>> metrics.reporter.grph.factory.class: >>> org.apache.flink.metrics.graphite.GraphiteReporterFactory >>> metrics.reporter.grph.host: localhost >>> metrics.reporter.grph.port: 2003 >>> metrics.reporter.grph.protocol: TCP >>> metrics.reporter.grph.interval: 1 SECONDS >>> >>> and graphite jar: >>> >>> plugins/flink-metrics-graphite/flink-metrics-graphite-1.10.0.jar >>> >>> >>> 4) Can't see any activity in webui graphite. >>> >>> >>> Could you review and let me know what is wrong here ? any other way >>> you suggest to be able to view the raw metrics data ? >>> Also, do you have sample metrics raw format, you can share from any >>> other project. >>> >>> Regards, >>> Vijay >>> >>> >>> >>> >>> On Sun, Aug 23, 2020 at 9:26 PM Nikola Hrusov <n.hru...@gmail.com >>> <mailto:n.hru...@gmail.com>> wrote: >>> >>> Hi Vijay, >>> >>> Your steps look correct to me. >>> Perhaps you can double check that the graphite port you are >>> sending is correct? THe default carbon port is 2003 and if you >>> use the aggregator it is 2023. >>> >>> You should be able to see in both flink jobmanager and >>> taskmanager that the metrics have been initialized with the >>> config you have pasted. >>> >>> Regards >>> , >>> Nikola Hrusov >>> >>> >>> On Mon, Aug 24, 2020 at 5:00 AM Vijayendra Yadav >>> <contact....@gmail.com <mailto:contact....@gmail.com>> wrote: >>> >>> Hi Team, >>> >>> I am trying to export Flink stream default metrics using >>> Graphite, but I can't find it in the Graphite metrics >>> console. Could you confirm the steps below are correct? >>> >>> *1) Updated flink-conf.yaml* >>> >>> metrics.reporter.grph.factory.class: >>> org.apache.flink.metrics.graphite.GraphiteReporterFactory >>> metrics.reporter.grph.host: port >>> metrics.reporter.grph.port: 9109 >>> metrics.reporter.grph.protocol: TCP >>> metrics.reporter.grph.interval: 30 SECONDS >>> >>> 2) Added Graphite jar in plugin folder : >>> >>> ll */usr/lib/flink/plugins/metric/* >>> *flink-metrics-graphite-1.10.0.jar* >>> >>> 3) Looking metrics in graphite server: >>> >>> http://port:8080/metrics <http://10.108.58.63:8080/metrics> >>> >>> Note: No code change is done. >>> >>> Regards, >>> Vijay >>> >>>
signature.asc
Description: OpenPGP digital signature