Re: Understand Samza default metrics

2016-02-24 Thread David Yu
Thanks guys. This is really helpful! I assume we have a plan to publish these docs on the samza wiki. -David On Wed, Feb 24, 2016 at 10:34 AM, Xinyu Liu wrote: > Thanks, Shadi. The doc is really useful! > > @Milinda: thanks for pointing it out. Process-calls includes both > process-envelopes an

Re: Understand Samza default metrics

2016-02-24 Thread Xinyu Liu
Thanks, Shadi. The doc is really useful! @Milinda: thanks for pointing it out. Process-calls includes both process-envelopes and process-null-envelopes, so it should be process-envelopes in David's example. Thanks, Xinyu On Wed, Feb 24, 2016 at 9:52 AM, Abdollahian Noghabi, Shadi < abdol...@illi

Re: Understand Samza default metrics

2016-02-24 Thread Abdollahian Noghabi, Shadi
I have attached the document to SAMZA-702. On Feb 24, 2016, at 9:33 AM, Milinda Pathirage mailto:mpath...@umail.iu.edu>> wrote: Hi Shadi, Attachment is not there in your mail. I think mailing list dropped the attachment. IMHO, we should create

Re: Understand Samza default metrics

2016-02-24 Thread Milinda Pathirage
Hi Shadi, Attachment is not there in your mail. I think mailing list dropped the attachment. IMHO, we should create a JIRA issue and attach the doc to the issue so that we can move it to Samza docs. On Wed, Feb 24, 2016 at 12:27 PM, Abdollahian Noghabi, Shadi < abdol...@illinois.edu> wrote: > I

Re: Understand Samza default metrics

2016-02-24 Thread Jagadish Venkatraman
Not sure if this mail server strips attachments. Could you upload the doc to jira and link it here? On Wednesday, February 24, 2016, Abdollahian Noghabi, Shadi < abdol...@illinois.edu> wrote: > I have a document with some of the metrics. I had gathered these around > last summer, so they may be o

Re: Understand Samza default metrics

2016-02-24 Thread Abdollahian Noghabi, Shadi
I have a document with some of the metrics. I had gathered these around last summer, so they may be out-of-date. I have attached the document to this email. Hope it can help. > On Feb 24, 2016, at 7:10 AM, Milinda Pathirage wrote: > > Hi David and Xinyu, > > If you want to get the number o

Re: Understand Samza default metrics

2016-02-24 Thread Milinda Pathirage
Hi David and Xinyu, If you want to get the number of messages processed, "process-envelopes" is the correct metrics. "process-calls" gives measure the number of times RunLoop#process method is called. So "process-calls" get updated even without processing any messages (This happens when no new mes

Re: Understand Samza default metrics

2016-02-23 Thread xinyu liu
Hi, David, I didn't find a wiki page that contains the descriptions of all Samza metrics. You can find the basic metrics by googling the following classes: SamzaContainerMetrics, TaskInstanceMetrics, SystemConsumersMetrics and SystemProducersMetrics. For your example, you can use the "process-call