Yes it appears that the skipped-max-spout metric is only in 1.0.0 as part of the automatic back pressure fixes ( https://issues.apache.org/jira/browse/STORM-886)
On Tue, Apr 19, 2016 at 9:21 PM, Kevin Conaway <[email protected]> wrote: > We are already sending our metrics to graphite but I don't see > __skipped-max-spout being logged. Was that added after 0.10? I don't even > see a reference to it in the codebase. > > We are capturing the queue metrics for each component (send_queue and > receive_queue) and the population for each is very low, like 0.01% of > capacity (< 10 entries at any given time) so I'm not sure that items are > sitting in those particular disruptor queues > > On Tue, Apr 19, 2016 at 8:54 PM, Jungtaek Lim <[email protected]> wrote: > >> Hi Kevin, >> >> You can attach metrics consumer to log additional informations for that >> topology like disruptor queue metrics, __skipped-max-spout for spout, and >> etc. >> Please refer >> https://github.com/apache/storm/blob/master/storm-core/src/jvm/org/apache/storm/metric/LoggingMetricsConsumer.java >> to >> how to set up. >> >> Please note that it may affect whole throughput (I guess it would be >> relatively small) so you may want to attach when only testing / debugging >> performance issue. >> >> Thanks, >> Jungtaek Lim (HeartSaVioR) >> >> >> 2016년 4월 20일 (수) 오전 9:41, Kevin Conaway <[email protected]>님이 작성: >> >>> In Storm 0.10, is there a way to monitor the _maxSpoutPending_ value? I >>> don' see it exposed in any of the metrics that storm publishes but I'd like >>> to be able to see how much time each tuple spends waiting and how big the >>> pending queue size is for each spout task. Is this possible? >>> >>> Our topology has one spout and one bolt. The average bolt execute >>> latency is ~20ms but the overall spout latency is ~60ms. I'd like to know >>> where those other 40ms are being spent. >>> >>> Thank you >>> >>> >>> -- >>> Kevin Conaway >>> http://www.linkedin.com/pub/kevin-conaway/7/107/580/ >>> https://github.com/kevinconaway >>> >> > > > -- > Kevin Conaway > http://www.linkedin.com/pub/kevin-conaway/7/107/580/ > https://github.com/kevinconaway > -- Kevin Conaway http://www.linkedin.com/pub/kevin-conaway/7/107/580/ https://github.com/kevinconaway
