Re: Flink and Datadog metrics question

2021-12-29 Thread David Morávek
Hi Adrian, for accessing metrics in your UDFs (user defined functions), you need access to the runtime context, unless you're using lower level APIs that directly extend stream operator. There are "rich" versions of most of the higher level functions (map, flatmap, group combine, ...). Can you el

Flink and Datadog metrics question

2021-12-29 Thread Adrian Schtivelmager
Hi, I'm using flink version 1.12.1, batch jobs in an application cluster and Datadog to expose metrics. I want to know if someone know how to send metrics from non-extended RichMapFunction class. At this moment we can expose all the metrics from each operator that extends from RichMapFunction bu

Re: datadog metrics

2020-03-18 Thread Steve Whelan
Hi Fanbin, I have commented on the ticket: https://issues.apache.org/jira/browse/FLINK-16611. - Steve On Mon, Mar 16, 2020 at 6:39 PM Fanbin Bu wrote: > Hi Steve, > > could you please share your work around solution in more detail in the > above ticket? > > Thanks, > Fanbin > > On Mon, Mar 16,

Re: datadog metrics

2020-03-16 Thread Fanbin Bu
Hi Steve, could you please share your work around solution in more detail in the above ticket? Thanks, Fanbin On Mon, Mar 16, 2020 at 2:50 AM Chesnay Schepler wrote: > I've created https://issues.apache.org/jira/browse/FLINK-16611. > > @Steva Any chance you could contribute your changes, or so

Re: datadog metrics

2020-03-16 Thread Chesnay Schepler
I've created https://issues.apache.org/jira/browse/FLINK-16611. @Steva Any chance you could contribute your changes, or some insight on what would need to be changed? On 11/03/2020 23:16, Steve Whelan wrote: Hi Fabian, We ran into the same issue. We modified the reporter to emit the metrics

Re: datadog metrics

2020-03-11 Thread Steve Whelan
Hi Fabian, We ran into the same issue. We modified the reporter to emit the metrics in chunks and it worked fine after. Would be interested in seeing a ticket on this as well. - Steve On Wed, Mar 11, 2020 at 5:13 AM Chesnay Schepler wrote: > Please open a JIRA; we may have to split the datatog

Re: datadog metrics

2020-03-11 Thread Chesnay Schepler
Please open a JIRA; we may have to split the datatog report into several chunks. On 09/03/2020 07:47, Fanbin Bu wrote: quote from the following link: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/SQL-Query-named-operator-exceeds-80-characters-td24807.html#a24818 "This is

Re: datadog metrics

2020-03-08 Thread Fanbin Bu
quote from the following link: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/SQL-Query-named-operator-exceeds-80-characters-td24807.html#a24818 "This is a safeguard in the metric system to prevent extremely long names (as these could cause the reporting to fail); so long as t

datadog metrics

2020-03-08 Thread Fanbin Bu
Hi, Has anybody seen this error before and what is the suggested way to solve it? 2020-03-07 02:54:34,100 WARN org.apache.flink.metrics.datadog.DatadogHttpClient- Failed to send request to Datadog (response was Response{protocol=http/1.1, code=413, message=Request Entity Too Large, u