Re: Total metrics are broken in Kafka streams 2.0.0

. On 8/1/18, 4:50 PM, "Guozhang Wang" wrote: Hello Sam, Your uploaded snapshot was rejected by apache mailing list, could you upload it somewhere else, and share the link with us? Guozhang On Wed, Aug 1, 2018 at 4:37 PM, Sam Len

Re: Total metrics are broken in Kafka streams 2.0.0

On Wed, Aug 1, 2018 at 4:37 PM, Sam Lendle wrote: > Is this a known issue? If not I can create a JIRA. > > > > For example, here’s a screenshot of the process-total metric for one > processor node and task under stream-processor-node-metrics.

Total metrics are broken in Kafka streams 2.0.0

Is this a known issue? If not I can create a JIRA. For example, here’s a screenshot of the process-total metric for one processor node and task under stream-processor-node-metrics. Processor-total goes down over time when it shouldn’t. Same thing for total metrics under stream-metrics, stream-*

Re: Kafka Streams processor node metrics process rate with multiple stream threads

r those tasks has been cleaned. Is this also fixed, or a separate issue? This may be an issue that is not yet resolved, I'd need to double check. At the mean time, could you create a JIRA for it? Guozhang On Thu, Jul 12, 2018 at 4:04 PM,

Re: Kafka Streams processor node metrics process rate with multiple stream threads

Do07QsHw-JRepxyw&r=BNCekDhngyXB6C2Ag7PIfHotiuqjAVwLOZLQHB7fyOM&m=-PxNeRIE8RN79eewJpZdqKjdn7hBegA5u-pJ208prdA&s=gJdWWHIgT-uqkFvjwFCQNXvC4C6fvar7pHqXXcHg2KE&e= Guozhang On Wed, Jul 11, 2018 at 11:42 AM, Sam Lendle wrote: > Hello! > > Using kafka-stre

Kafka Streams processor node metrics process rate with multiple stream threads

Hello! Using kafka-streams 1.1.0, I noticed when I sum the process rate metric for a given processor node, the rate is many times higher than the number of incoming messages. Digging further, it looks like the rate metric associated with each thread in a given application instance is always the

Streams task assignment

Please correct me if I’m wrong, but I’m under the impression that the task_id in streams metrics is formatted as _, and topicGroupId corresponds to a particular subtopology in the streams topology. I assume that’s true for the rest of this message. I have a streams app with multiple sub topolog

Kafka Streams Session store fetch latency very high with caching turned on

I am using a session store in a kafka streams application. With caching turned on, average fetch latency was very high, about 200 ms after running for about 1 hour. With caching turned off, it was about 100 μs. We seem to be running fine without caching, but I am very curious as to why caching p

Re: Some Total and Rate metrics are not consistent

> Thanks for reporting this Sam, could you check and confirm if this issue is > fixed in trunk? If not, we should file a JIRA. > > > Guozhang > > On Wed, Jun 20, 2018 at 6:41 PM, Sam Lendle wrote: > > > It looks like there is indee

Re: Some Total and Rate metrics are not consistent

e any commit messages mentioning this particular issue, but hopefully the change fixes it. From: Sam Lendle Sent: Wednesday, June 20, 2018 6:10:03 PM To: users@kafka.apache.org Subject: Some Total and Rate metrics are not consistent I’m trying to use the total me

Some Total and Rate metrics are not consistent

I’m trying to use the total metrics introduced in KIP-187 (https://cwiki.apache.org/confluence/display/KAFKA/KIP-187+-+Add+cumulative+count+metric+for+all+Kafka+rate+metrics) For some metrics, the total and rates are not consistent. In particular, for stream-processor-node-metrics, I’m seeing