Re: Total metrics are broken in Kafka streams 2.0.0

2018-08-03 Thread Guozhang Wang
Thank you Sam! On Wed, Aug 1, 2018 at 11:39 PM, Sam Lendle wrote: > The problem is that the total metrics in streams are implemented using a > Count, which is a SampledStat, so the value it reports is the count over > recent time windows, not all of time. The behavior I was seeing was when a > w

Re: Total metrics are broken in Kafka streams 2.0.0

2018-08-01 Thread Sam Lendle
The problem is that the total metrics in streams are implemented using a Count, which is a SampledStat, so the value it reports is the count over recent time windows, not all of time. The behavior I was seeing was when a window is purged, the reported total decreases. I’ll open a JIRA tomorrow.

Re: Total metrics are broken in Kafka streams 2.0.0

2018-08-01 Thread Sam Lendle
Thought that might happen: https://i.imgur.com/eDV9CIM.png On 8/1/18, 4:50 PM, "Guozhang Wang" wrote: Hello Sam, Your uploaded snapshot was rejected by apache mailing list, could you upload it somewhere else, and share the link with us? Guozhang On We

Re: Total metrics are broken in Kafka streams 2.0.0

2018-08-01 Thread Guozhang Wang
Hello Sam, Your uploaded snapshot was rejected by apache mailing list, could you upload it somewhere else, and share the link with us? Guozhang On Wed, Aug 1, 2018 at 4:37 PM, Sam Lendle wrote: > Is this a known issue? If not I can create a JIRA. > > > > For example, here’s a screenshot of t

Total metrics are broken in Kafka streams 2.0.0

2018-08-01 Thread Sam Lendle
Is this a known issue? If not I can create a JIRA. For example, here’s a screenshot of the process-total metric for one processor node and task under stream-processor-node-metrics. Processor-total goes down over time when it shouldn’t. Same thing for total metrics under stream-metrics, stream-*