Re: Monitoring and alerting mechanisms for Flink on YARN

2016-04-15 Thread Stephan Ewen
There is also quite an ongoing effort to create and expose more Metrics via JMX. Parts of that is in the JIRA below, but there will be an additional proposal and design pubshished in the next days. https://issues.apache.org/jira/browse/FLINK-1502 On Fri, Apr 15, 2016 at 11:04 AM, Flavio Pompermai

Re: Monitoring and alerting mechanisms for Flink on YARN

2016-04-15 Thread Flavio Pompermaier
Very interesting! Could you please provide more details about its usage in your deployment? Thanks, Flavio On Thu, Apr 14, 2016 at 11:25 PM, Christian Kreutzfeldt wrote: > Hi Soumya, > > we are using a StatsD / Graphite setup to extract metrics from our running > Flink applications. At least fo

Re: Monitoring and alerting mechanisms for Flink on YARN

2016-04-14 Thread Christian Kreutzfeldt
Hi Soumya, we are using a StatsD / Graphite setup to extract metrics from our running Flink applications. At least for alerting and monitoring based on time series it works perfectly well. Just take a look at https://github.com/tim-group/java-statsd-client which is widely deployed in our source co