RE: checkpoint on flush of system producer

Kx Systems aka Q or KDB -Original Message- From: Yi Pan [mailto:nickpa...@gmail.com] Sent: 06 September 2016 17:40 To: dev@samza.apache.org Subject: Re: checkpoint on flush of system producer Hi, Jarrad, Yes! You have found your answer! Looking forward to your implementation of SystemP

Question about Samza Metrcis

Hi, My samza job has following metrics configuration: serializers.registry.metrics.class=org.apache.samza.serializers.MetricsSnapshotSerdeFactory systems.kafka.samza.factory=org.apache.samza.system.kafka.KafkaSystemFactory systems.kafka.consumer.zookeeper.connect=zk11:3181,zk12:3181,zk13:3181 sy

Review Request 51689: Fix SAMZA-1012 - Generated changelog mappings are not consistent

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/51689/ --- Review request for samza. Repository: samza Description --- Fix SAMZA-10

Re: Question about Samza Metrcis

Can you run your program in DEBUG log-level? Does sending the metric to the producer fail? Is the metric reporter thread showing an exception? (check the stderr file too) Producing to a kafka topic should usually auto-create it. On Wed, Sep 7, 2016 at 2:09 AM, 舒琦 wrote: > Hi, > > My samza job h

Re: Review Request 50174: SAMZA-977: User doc for samza multithreading

> On Aug. 31, 2016, 12:54 a.m., Navina Ramesh wrote: > > docs/learn/documentation/versioned/api/overview.md, line 49 > > > > > > // fire callback after process complete > > >> Is the user expected to invoke the c

Re: [DISCUSS] End of Stream Feature in Samza

Hi Navina, *>> after it has exhausted all messages from the source, it will generate a special SENTINEL envelope that will not have any key or message and only contain a special offset. Is that a valid understanding?* The table in the doc already specifies how the sentinel envelope is constructed

Re: Review Request 50174: SAMZA-977: User doc for samza multithreading

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/50174/ --- (Updated Sept. 7, 2016, 5:16 p.m.) Review request for samza, Chris Pettitt, Nav

Re: Review Request 51126: SAMZA 998: Documentation updates for refactored Job Coordinator

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/51126/#review148030 --- Fix it, then Ship it! Overall lgtm. Just one comment on the "so

Re: Review Request 50174: SAMZA-977: User doc for samza multithreading

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/50174/#review148041 --- Thanks for the detailed doc. I mainly have question regarding to t

Review Request 51703: Enable passing of Configs and MetricsRegistry into Monitor objects.

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/51703/ --- Review request for samza. Repository: samza Description --- This patch a

Re: Review Request 51142: SAMZA-967: HDFS System Consumer

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/51142/ --- (Updated Sept. 7, 2016, 11:44 p.m.) Review request for samza, Chris Pettitt, Yi

Re: Review Request 51142: SAMZA-967: HDFS System Consumer

> On Sept. 1, 2016, 9:21 p.m., Navina Ramesh wrote: > > @lhaiesp: Your patch looks awesome. Happy to review again once you have > > addressed the comments. It will be great if you can add some unit test for > > HdfsSystemConsumer. Some of the documentation that you will have to include > > for

Re: Review Request 51142: SAMZA-967: HDFS System Consumer

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/51142/ --- (Updated Sept. 7, 2016, 11:49 p.m.) Review request for samza, Chris Pettitt, Yi

Re: Question about Samza Metrcis

Hi, Thanks for your help. I think checkpoint stream and coordinate stream will be auto-create per job if using kaka, but not metrics. After I manually created metrics stream in Kafka, the metrics is written into the stream. ShuQi > 在 2016年9月7日，23:15，Jagadish Venkatraman 写道： > > Can you ru