Samza stops processing

2016-06-09 Thread Shekar Tippur
I have a strange issue. We just replaced failed zookeeper server. We killed the job in the interim and resubmitted the job to yarn. The events were getting processed but at some point, the events stopped processing. I have checked RM and application logs but they seem to be fine. We then restarte

Samza stops processing

2016-06-09 Thread Shekar Tippur
I have a strange issue. We just replaced failed zookeeper server. We killed the job in the interim and resubmitted the job to yarn. The events were getting processed but at some point, the events stopped processing. I have checked RM and application logs but they seem to be fine. We then restarte

Re: Samza stops processing

2016-06-09 Thread Jagadish Venkatraman
Hi Shekar, When you say 'stopped' do you mean the container is is running and is stalled/ hanged? Or do you mean the job failed? Were you able to use the Kafka console consumer to consume messages from the same topics that your job is also consuming from? ie, does the topic have 'upcoming' messa

Re: Review Request 48356: RFC: Samza as a library

2016-06-09 Thread Chris Pettitt
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/48356/#review136871 --- Thoughts below. A more general thought: the builders don't seem to

Re: Review Request 48213: SAMZA-960: Make system producer thread safe

2016-06-09 Thread Chris Pettitt
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/48213/#review136875 --- Ship it! Ship It! - Chris Pettitt On June 8, 2016, 11:53 p.m

Re: Review Request 48182: SAMZA-958: Make store/cache thread safe

2016-06-09 Thread Chris Pettitt
> On June 9, 2016, 12:28 a.m., Yi Pan (Data Infrastructure) wrote: > > samza-kv-rocksdb/src/test/scala/org/apache/samza/storage/kv/TestRocksDbKeyValueStore.scala, > > line 90 > > > > > > This is a test that Xinyu por

Re: Review Request 48182: SAMZA-958: Make store/cache thread safe

2016-06-09 Thread Chris Pettitt
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/48182/#review136879 --- Ship it! Ship It! - Chris Pettitt On June 9, 2016, 12:33 a.m

Re: Review Request 48243: SAMZA-961: Async tasks and multithreading model

2016-06-09 Thread Xinyu Liu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/48243/ --- (Updated June 9, 2016, 7:49 p.m.) Review request for samza, Chris Pettitt, Navi

Re: Review Request 48243: SAMZA-961: Async tasks and multithreading model

2016-06-09 Thread Xinyu Liu
> On June 8, 2016, 8:08 p.m., Chris Pettitt wrote: > > samza-core/src/main/java/org/apache/samza/container/RunLoopFactory.java, > > line 73 > > > > > > It's been a while and I'm not sure if we discussed: is the goal