Re: Samza container hang on exception

If you cannot see the attachment, please try http://note.youdao.com/noteshare?id=56b826c24af47a9fdb600490ce788710 On Thu, Sep 1, 2016 at 1:50 AM, Chinmay Soman wrote: > Sorry dont see anything in the attachment. Can you please re-attach and > re-send ? > > On Wed, Aug 31, 2016 at 3:27 AM, 李斯宁 w

Re: Review Request 51346: SAMZA-974 - Support finite datasources in Samza that have a notion of End-Of-Stream

> On Aug. 26, 2016, 7:51 p.m., Chris Pettitt wrote: > > samza-api/src/main/java/org/apache/samza/system/IncomingMessageEnvelope.java, > > line 31 > > > > > > How likely are we to collide with this? Thats the problem

Re: Review Request 51516: SAMZA-702: Document the significance of all the different metrics emitted by Samza out of the box

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/51516/#review147523 --- Fix it, then Ship it! Overall, the patch looks pretty good! The

Re: Review Request 51516: SAMZA-702: Document the significance of all the different metrics emitted by Samza out of the box

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/51516/#review147518 --- docs/learn/documentation/versioned/container/metrics-table.html (

Re: Review Request 51516: SAMZA-702: Document the significance of all the different metrics emitted by Samza out of the box

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/51516/#review147506 --- Still going through the list. Thanks for compiling this. This is a

Re: [DISCUSS] End of Stream Feature in Samza

Thanks for reviewing and the comments. Please find my replies inline. *"The offset in the partition that the message was received from. Ifthis is the last message in the SSP, this field is set to END_OF_STREAM.Such a message is not delivered to the actual StreamTask implementation."Does thi

Re: Samza Mesos

Hi, Sriram, Yes, that's the correct direction to go. Cheers! -Yi On Wed, Aug 31, 2016 at 12:39 PM, Sriram Ramachandrasekaran < sri.ram...@gmail.com> wrote: > Thanks Jagadish. > So, in essence, I should be looking at samza-11 branch for the final API > against which I would have to write the Me

Re: [DISCUSS] End of Stream Feature in Samza

Hi Jagadish, Thanks for sharing the design with the community. I have a couple of questions that were not very clear from the design document. 1. Under mechanism for indicating the end-of-stream to Samza, you mention "The offset in the partition that the message was received from. If this is the l

Re: Samza Mesos

Thanks Jagadish. So, in essence, I should be looking at samza-11 branch for the final API against which I would have to write the Mesos integration pieces? On Thu, Sep 1, 2016 at 12:56 AM, Jagadish Venkatraman < jagadish1...@gmail.com> wrote: > Hi Sriram, > > I had started prototyping it (purely

Re: Samza Mesos

Hi Sriram, I had started prototyping it (purely to ensure that the Samza API makes sense with Mesos). The exact API on the Samza-11 trunk is slightly different, but hopefully there're similarities - https://github.com/apache/samza/blob/master/samza-core/src/main/java/org/apache/samza/clustermanage

Re: Review Request 51563: SAMZA-1010: API won't compile: CheckStyle violation in org.apache.samza.storage.StorageEngineFactory

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/51563/ --- (Updated Aug. 31, 2016, 7:19 p.m.) Review request for samza. Bugs: SAMZA-1010

Re: Samza container hang on exception

Sorry dont see anything in the attachment. Can you please re-attach and re-send ? On Wed, Aug 31, 2016 at 3:27 AM, 李斯宁 wrote: > It seems upgrading does not solve the problem. All task hang in today's > "rush hour". > I attached log and jstack. > > The SAMZA-911 want to fix by stopping the proces

Re: Samza Mesos

Yi, That's a good amount of history to know. I will take a look at 680 and then see if I can implement something as well. If there's some stuff that's already done, would be glad to re-use it too. Thanks again On Wed, Aug 31, 2016 at 10:58 PM, Yi Pan wrote: > Hi, Sriram, > > The story behind del

Re: Samza Mesos

Hi, Sriram, The story behind delaying the integration of SAMZA-375 is that there are tons of repeated code in SamzaAppMaster that exist in both samza-yarn and Mesos. W/o the change we recently made in SAMZA-680, we are going to copy the SamzaAppMaster code for every distributed execution system th

Re: Samza container hang on exception

It seems upgrading does not solve the problem. All task hang in today's "rush hour". I attached log and jstack. The SAMZA-911 want to fix by stopping the process if failed too much times. But the process is still there and hanging. On Mon, Aug 22, 2016 at 1:14 PM, 李斯宁 wrote: > Thanks so much,

Re: Review Request 51142: SAMZA-967: HDFS System Consumer

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/51142/#review147414 --- Still reviewing. Will continue tomorrow. Thanks! gradle/dependen