I have a document with some of the metrics. I had gathered these around last summer, so they may be out-of-date. I have attached the document to this email. Hope it can help.
> On Feb 24, 2016, at 7:10 AM, Milinda Pathirage <mpath...@umail.iu.edu> wrote: > > Hi David and Xinyu, > > If you want to get the number of messages processed, "process-envelopes" is > the correct metrics. "process-calls" gives measure the number of times > RunLoop#process method is called. So "process-calls" get updated even > without processing any messages (This happens when no new messages in input > stream). "process-ns" can be used as the average time taken to process a > message. But this average also includes time taken to process null > messages. So I don't trust the accuracy of that metric. > > Each metric emitted by Samza contains a header which includes job name, job > id, container name and metric timestamp. You can use it to calculate > messages per second values. > > If you are using KV store, KeyValueStoreMetrics contains metrics such as > bytes read, bytes write, puts and gets for each store. > > Thanks > Milinda > > On Tue, Feb 23, 2016 at 8:26 PM, xinyu liu <xinyuliu...@gmail.com> wrote: > >> Hi, David, >> >> I didn't find a wiki page that contains the descriptions of all Samza >> metrics. You can find the basic metrics by googling the following classes: >> SamzaContainerMetrics, TaskInstanceMetrics, SystemConsumersMetrics and >> SystemProducersMetrics. For your example, you can use the "process-calls" >> in SamzaContainerMetrics to get the processed message count, and divide the >> delta by time to get the messages processed per sec. In practice, you can >> either use JConsole to connect to the running Samza container or consume >> the MetricsSnapshot topic to get the detailed metrics. >> >> Thanks, >> Xinyu >> >> On Tue, Feb 23, 2016 at 4:51 PM, David Yu <david...@optimizely.com> wrote: >> >>> Hi, >>> >>> Where can I find the detailed descriptions of the out of the box metrics >>> provided by MetricsSnapshotReporterFactory and JmxReporterFactory? >>> >>> I'm interested in seeing the basic metrics of the my samza job (e.g. >>> messages_processed_per_sec). But it's hard to ping point to the specific >>> metric that shows me that. >>> >>> Thanks, >>> David >>> >> > > > > -- > Milinda Pathirage > > PhD Student | Research Assistant > School of Informatics and Computing | Data to Insight Center > Indiana University > > twitter: milindalakmal > skype: milinda.pathirage > blog: http://milinda.pathirage.org
