Re: Review Request 43350: SAMZA-867 Fix job restart/shutdown in the event of a node outage.

2016-02-23 Thread Jake Maes
> On Feb. 23, 2016, 10:26 p.m., Xinyu Liu wrote: > > samza-core/src/main/scala/org/apache/samza/config/TaskConfig.scala, line 97 > > > > > > Usually this is done in Scala using option.getOrElse. So instead of > > add

Re: Review Request 43350: SAMZA-867 Fix job restart/shutdown in the event of a node outage.

2016-02-23 Thread Jake Maes
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/43350/ --- (Updated Feb. 24, 2016, 2:05 a.m.) Review request for samza, Navina Ramesh, Jag

Re: Understand Samza default metrics

2016-02-23 Thread xinyu liu
Hi, David, I didn't find a wiki page that contains the descriptions of all Samza metrics. You can find the basic metrics by googling the following classes: SamzaContainerMetrics, TaskInstanceMetrics, SystemConsumersMetrics and SystemProducersMetrics. For your example, you can use the "process-call

Understand Samza default metrics

2016-02-23 Thread David Yu
Hi, Where can I find the detailed descriptions of the out of the box metrics provided by MetricsSnapshotReporterFactory and JmxReporterFactory? I'm interested in seeing the basic metrics of the my samza job (e.g. messages_processed_per_sec). But it's hard to ping point to the specific metric that

Re: Review Request 43350: SAMZA-867 Fix job restart/shutdown in the event of a node outage.

2016-02-23 Thread Xinyu Liu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/43350/#review120393 --- Fix it, then Ship it! Looks good to me. A few minor suggestions

Re: Review Request 43350: SAMZA-867 Fix job restart/shutdown in the event of a node outage.

2016-02-23 Thread Jake Maes
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/43350/ --- (Updated Feb. 23, 2016, 9:43 p.m.) Review request for samza, Navina Ramesh, Jag

Re: Review Request 43732: Implemented AvroDataFileHdfsWriter and exposed several RocksDb config

2016-02-23 Thread Yi Pan (Data Infrastructure)
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/43732/#review120357 --- Thanks for the contribution! I added a few comments below. Thanks

Re: Question about Stream-Stream join

2016-02-23 Thread Yi Pan
Hi, Chad, The following code will let you find the stream name: {code} envelope.getSystemStreamPartition().getSystemStream().getStream(); {code} Thanks! -Yi On Tue, Feb 23, 2016 at 8:14 AM, Chad Scribner wrote: > Hi All, > > First time emailing the list. I just had a question about doing a >

Question about Stream-Stream join

2016-02-23 Thread Chad Scribner
Hi All, First time emailing the list. I just had a question about doing a Stream-Stream join in Samza. What I'm attempting to do is have a Load stream which contains events of when an object was loaded and an Action stream which contains events that are taken on the objects in the Load stream