Port issue with running hello-samza on HDP managed by Ambari

2016-02-24 Thread Jack Huang
Hi all, I am having trouble running the hello-samza example ( http://samza.apache.org/learn/tutorials/0.10/run-in-multi-node-yarn.html) on our HDP cluster, which is set up with Ambari. Upon running *deploy/samza/bin/run-job.sh --config-factory=org.apache.samza.config.factories.PropertiesConfigFa

Re: Review Request 43766: SAMZA-872: little change in Logging docs

2016-02-24 Thread Boris Shkolnik
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/43766/#review120637 --- Ship it! after addressing Jagadish's comment. - Boris Shkolnik

Re: [DISCUSS] Moving to github/pull-request for code review and check-in

2016-02-24 Thread Boris Shkolnik
+1 for pull requests. On Thu, Feb 18, 2016 at 3:53 PM, Yi Pan wrote: > Hi, all, > > I want to start the discussion on our code review/commit process. > > I felt that our code review and check-in process is a little bit > cumbersome: > - developers need to create RBs and attach diff to JIRA > - c

Re: Upgrading Samza from 0.9.1 to 0.10.0

2016-02-24 Thread José Barrueta
Hi all, Just to let you know, we already figured it out the problem, issue was that we had a dependency version conflict that result in a mixed of 0.9.1 and 0.10.0 samza libraries in the same classpath. Thanks, Jose L Barrueta On Wed, Feb 24, 2016 at 1:24 PM, José Barrueta wrote: > Hi all, >

Re: Understand Samza default metrics

2016-02-24 Thread David Yu
Thanks guys. This is really helpful! I assume we have a plan to publish these docs on the samza wiki. -David On Wed, Feb 24, 2016 at 10:34 AM, Xinyu Liu wrote: > Thanks, Shadi. The doc is really useful! > > @Milinda: thanks for pointing it out. Process-calls includes both > process-envelopes an

Upgrading Samza from 0.9.1 to 0.10.0

2016-02-24 Thread José Barrueta
Hi all, Currently we have some Jobs working with Samza v0.9.1 (kafka running on v0.9.0) for a couple of those Jobs we'd like to upgrade them to Samza v0.10.0, is there a documents that details the path for upgrading the Job to latest version? We already applied the new coordinator property: *job.

Re: Understand Samza default metrics

2016-02-24 Thread Xinyu Liu
Thanks, Shadi. The doc is really useful! @Milinda: thanks for pointing it out. Process-calls includes both process-envelopes and process-null-envelopes, so it should be process-envelopes in David's example. Thanks, Xinyu On Wed, Feb 24, 2016 at 9:52 AM, Abdollahian Noghabi, Shadi < abdol...@illi

Re: Understand Samza default metrics

2016-02-24 Thread Abdollahian Noghabi, Shadi
I have attached the document to SAMZA-702. On Feb 24, 2016, at 9:33 AM, Milinda Pathirage mailto:mpath...@umail.iu.edu>> wrote: Hi Shadi, Attachment is not there in your mail. I think mailing list dropped the attachment. IMHO, we should create

Re: Understand Samza default metrics

2016-02-24 Thread Milinda Pathirage
Hi Shadi, Attachment is not there in your mail. I think mailing list dropped the attachment. IMHO, we should create a JIRA issue and attach the doc to the issue so that we can move it to Samza docs. On Wed, Feb 24, 2016 at 12:27 PM, Abdollahian Noghabi, Shadi < abdol...@illinois.edu> wrote: > I

Re: Understand Samza default metrics

2016-02-24 Thread Jagadish Venkatraman
Not sure if this mail server strips attachments. Could you upload the doc to jira and link it here? On Wednesday, February 24, 2016, Abdollahian Noghabi, Shadi < abdol...@illinois.edu> wrote: > I have a document with some of the metrics. I had gathered these around > last summer, so they may be o

Re: Understand Samza default metrics

2016-02-24 Thread Abdollahian Noghabi, Shadi
I have a document with some of the metrics. I had gathered these around last summer, so they may be out-of-date. I have attached the document to this email. Hope it can help. > On Feb 24, 2016, at 7:10 AM, Milinda Pathirage wrote: > > Hi David and Xinyu, > > If you want to get the number o

Re: Understand Samza default metrics

2016-02-24 Thread Milinda Pathirage
Hi David and Xinyu, If you want to get the number of messages processed, "process-envelopes" is the correct metrics. "process-calls" gives measure the number of times RunLoop#process method is called. So "process-calls" get updated even without processing any messages (This happens when no new mes