Re: FLINK 1.11 Graphite Metrics

Thank You for help, Let's raise a case with AWS. On Tue, Oct 27, 2020 at 1:58 PM Chesnay Schepler wrote: > In the normal Flink distribution these jars were moved from opt/ to > plugins/ so that they are available by default without having to mess > around with any jars. > I don't think anyone wa

Re: FLINK 1.11 Graphite Metrics

In the normal Flink distribution these jars were moved from opt/ to plugins/ so that they are available by default without having to mess around with any jars. I don't think anyone was aware that the plugin directory is not populated on EMR. On 10/27/2020 9:53 PM, Vijayendra Yadav wrote: Perfe

Re: FLINK 1.11 Graphite Metrics

Perfect after downloading it into the plugin, it is working well. I am wondering why these jars have been removed from opt/ folder, earlier I was able to copy from opt/ to lib/ folder for 1.10. For now I just downloaded from Maven for 1.11 and copied in plugin/. Regards, Vijay On Tue, Oct 27, 202

Re: FLINK 1.11 Graphite Metrics

So the plugins directory is completely empty? In that case, please download the flink-metrics-graphite jar and also copy it into the plugins directory. On 10/27/2020 7:04 PM, Vijayendra Yadav wrote: Also, you

Re: FLINK 1.11 Graphite Metrics

Also, you are right that the plugin did not have anything by default when we created EMR 5.31 with Flink 1.11. In opt/ I see: [hadoop@ip-10-223-71-70 flink]$ pwd /usr/lib/flink [hadoop@ip-10-223-71-70 flink]$ ll opt/ total 172860 -rw-r--r-- 1 root root 24029243 Sep 19 03:08 flink-azure-fs-hadoop-

Re: FLINK 1.11 Graphite Metrics

Hi Chesnay, Steps to upgrade are as follows: 1) Created EMR 5.31 Cluster which comes with Flink 1.11 2) Copied flink-s3-fs-hadoop-1.11.0.jar to plugin folder for application. cd /usr/lib/flink/ mkdir -p ./plugins/s3-fs-hadoop cp ./opt/flink-s3-fs-hadoop-1.11.0.jar ./plugins/s3

Re: FLINK 1.11 Graphite Metrics

How exactly did you do the upgrade? Did you copy some files from 1.11 into an existing 1.10 distribution? The configuration is correct, but it appears as if the entire plugins directory is either a) empty or b) not shipped. On 10/27/2020 5:22 PM, Vijayendra Yadav wrote: Hi Robert and Chesnay

Re: FLINK 1.11 Graphite Metrics

Are you writing a test? (otherwise the ReporterSetupTest reporters wouldn't be around) Do you have a dependency on the graphite reporter? On 10/27/2020 8:27 AM, Robert Metzger wrote: Hi Vijayendra, can you post or upload the entire logs, so that we can see the Classpath logged on startup, as w

Re: FLINK 1.11 Graphite Metrics

Hi Vijayendra, can you post or upload the entire logs, so that we can see the Classpath logged on startup, as well as the effective configuration parameters? On Tue, Oct 27, 2020 at 12:49 AM Vijayendra Yadav wrote: > Hi Chesnay, > > Another log message: > > 2020-10-26 23:33:08,516 WARN > org.apa

Re: FLINK 1.11 Graphite Metrics

Hi Chesnay, Another log message: 2020-10-26 23:33:08,516 WARN org.apache.flink.runtime.metrics.ReporterSetup - The reporter factory (org.apache.flink.metrics.graphite.GraphiteReporterFactory) could not be found for reporter grph. Available factories: [org.apache.flink.runtime.metrics.ReporterSetu

Re: FLINK 1.11 Graphite Metrics

Hi Chesnay, I have the same, and I am exporting the flinkconf like below, where i have flink-conf.yaml with configuration you have given.What else can I try ? export FLINK_CONF_DIR=${app_install_path}/flinkconf/ regards, Vijay On Sun, Oct 25, 2020 at 8:03 AM Chesnay Schepler wrote: > Ah wait,

Re: FLINK 1.11 Graphite Metrics

Ah wait, in 1.11 it should not longer be necessary to explicitly copy the reporter jar. Please update your reporter configuration to this: |metrics.reporter.grph.factory.class: org.apache.flink.metrics.graphite.GraphiteReporterFactory| On 10/25/2020 4:00 PM, Chesnay Schepler wrote: Have you

Re: FLINK 1.11 Graphite Metrics

Have you followed the documentation, specifically this bit? > In order to use this reporter you must copy |/opt/flink-metrics-influxdb-1.11.2.jar| into the |plugins/influxdb| folder of your Flink distribution. On 10/24/2020 12:17 AM, Vijayendra Yadav wrote: Hi Team, for Flink 1.11 Graphite