Thank you Sam! On Wed, Aug 1, 2018 at 11:39 PM, Sam Lendle <slen...@pandora.com> wrote:
> The problem is that the total metrics in streams are implemented using a > Count, which is a SampledStat, so the value it reports is the count over > recent time windows, not all of time. The behavior I was seeing was when a > window is purged, the reported total decreases. I’ll open a JIRA tomorrow. > > On 8/1/18, 4:50 PM, "Guozhang Wang" <wangg...@gmail.com> wrote: > > Hello Sam, > > Your uploaded snapshot was rejected by apache mailing list, could you > upload it somewhere else, and share the link with us? > > > Guozhang > > > On Wed, Aug 1, 2018 at 4:37 PM, Sam Lendle <slen...@pandora.com> > wrote: > > > Is this a known issue? If not I can create a JIRA. > > > > > > > > For example, here’s a screenshot of the process-total metric for one > > processor node and task under stream-processor-node-metrics. > > Processor-total goes down over time when it shouldn’t. Same thing > for total > > metrics under stream-metrics, stream-*-state-metrics, > stream-task-metrics. > > Total metrics look okay for producer and consumers that I’ve looked > at. > > > > > > > > Technically most streams total metrics aren’t documented ( > > https://urldefense.proofpoint.com/v2/url?u=https-3A__docs. > confluent.io_current_streams_monitoring.html&d=DwIFaQ&c= > gFTBenQ7Vj71sUi1A4CkFnmPzqwDo07QsHw-JRepxyw&r= > BNCekDhngyXB6C2Ag7PIfHotiuqjAVwLOZLQHB7fyOM&m=zq-Fk2clMlUfF7RbFuEZnUqnn4o_ > 8U0Jlz0X8RLkWEQ&s=dOQW97fklwzcYf8pBFafKmtiKkbDUwkKa9gL2eXfvLM&e=), so > maybe > > they’re not officially supported but they are mentioned in KIP 187 > > https://urldefense.proofpoint.com/v2/url?u=https-3A__cwiki. > apache.org_confluence_display_KAFKA_KIP-2D&d=DwIFaQ&c= > gFTBenQ7Vj71sUi1A4CkFnmPzqwDo07QsHw-JRepxyw&r= > BNCekDhngyXB6C2Ag7PIfHotiuqjAVwLOZLQHB7fyOM&m=zq-Fk2clMlUfF7RbFuEZnUqnn4o_ > 8U0Jlz0X8RLkWEQ&s=VxM4uo16_sukXVcW8ztzNnydCzoK568paxsrxfhPkEY&e= > > 187+-+Add+cumulative+count+metric+for+all+Kafka+rate+metrics. > > > > > > > > [image: cid:image001.png@01D429B1.2CED5AD0] > > > > > > -- > -- Guozhang > > > -- -- Guozhang