Re: Flink exported metrics scope configuration

2021-06-04 Thread Kai Fu
Hi Mason, Thank you for the advice, as I tried, it works and reduces a lot in size. On Fri, Jun 4, 2021 at 11:45 AM Mason Chen wrote: > Hi Kai, > > You can use the excluded variables config for the reporter. > >- metrics.reporter..scope.variables.excludes: (optional) A >semi-colon (;) s

Re: Flink exported metrics scope configuration

2021-06-03 Thread Mason Chen
Hi Kai, You can use the excluded variables config for the reporter. metrics.reporter..scope.variables.excludes: (optional) A semi-colon (;) separate list of variables that should be ignored by tag-based reporters (e.g., Prometheus, InfluxDB). https://ci.apache.org/projects/flink/flink-docs-rel

Flink exported metrics scope configuration

2021-06-03 Thread Kai Fu
Hi team, We noticed that Prometheus metrics exporter exports all of the metrics at the most fine-grained level, which is tremendous for the prometheus server especially when the parallelism is high. The metrics volume crawled from a single host(parallelism 8) is around 40MB for us currently. This