Re: Query on Metrics | Cumulative Metrics via Prometheus Reporter

2021-08-26 Thread Chesnay Schepler
So you want the scrape intervals to be synced, i.e., so that metrics are gathered in each process at roughly the same time? Could you clarify whether you use the PrometheusReporter or the PrometheusPushGatewayReporter? If it is the former, then this is something you'd need to fix on the Promet

Re: Query on Metrics | Cumulative Metrics via Prometheus Reporter

2021-08-26 Thread bhawana gupta
Hi Chesnay, Elaborating the use case, for example I have 3 operators : Operator A(parallelism 1, running on taskmanager1) --> Operator B(parallelism 3, running on taskmanager1, taskmanager2) --> Operator C(Parallelism 1, running on taskmanager1). Suppose there are 10 records in process since Op

Re: Query on Metrics | Cumulative Metrics via Prometheus Reporter

2021-08-26 Thread Chesnay Schepler
I'm not sure I understand what the desired behavior would be. Is it that you want metrics on each TM to be scraped in a well-defined order? I.e., first all metrics of Operator A, then all metrics of Operator B and so on? Maybe you could provide an example to make things clear. On 26/08/2021

Re: Query on Metrics | Cumulative Metrics via Prometheus Reporter

2021-08-25 Thread bhawana gupta
Hello, Please suggest. Regards, Bhawana On Wed, Aug 25, 2021 at 5:07 PM bhawana gupta wrote: > Hi, > > We are using prometheus reporter to fetch metrics (flink 1.12.1 on k8s > environment). We were facing an issue since the prometheus reporter has > various targets corresponding to each job &