Re: Review Request 41365: SAMZA-838: negative rocksdb.ttl.ms is not handled correctly

2015-12-15 Thread Tao Feng
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/41365/ --- (Updated Dec. 15, 2015, 11:58 p.m.) Review request for samza. Repository: sam

Re: Review Request 41365: SAMZA-838: negative rocksdb.ttl.ms is not handled correctly

2015-12-15 Thread Tao Feng
> On Dec. 15, 2015, 7:59 p.m., Navina Ramesh wrote: > > samza-kv-rocksdb/src/main/scala/org/apache/samza/storage/kv/RocksDbKeyValueStore.scala, > > line 54 > > > > > > I don't think mentioning RocksDB wiki is necessa

Review Request 41416: SAMZA-449 Expose RocksDB statistic

2015-12-15 Thread Gustavo Anatoly F . V . Solís
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/41416/ --- Review request for samza. Repository: samza Description --- RocksDb expo

Re: Random connection errors

2015-12-15 Thread Kishore N C
The first log was from a time when there was quite a bit of load on the Kafka servers. But in the second link I shared you, will notice that the task did not even start - this was when the traffic was very light on the Kafka cluster. I enable debug mode to see if that uncovers more. On Dec 16, 201

Re: Review Request 41365: SAMZA-838: negative rocksdb.ttl.ms is not handled correctly

2015-12-15 Thread Navina Ramesh
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/41365/#review110553 --- Ship it! One nit. Otherwise, looks good! samza-kv-rocksdb/src/ma

Re: Random connection errors

2015-12-15 Thread Yi Pan
Hi, Kishore, I saw a lot of NOT_LEADER_FOR_PARTITION errors in the first log. It seems like your job is running for a while and started to lose the leader broker for the topic in Kafka and the problem was not resolved by re-try. Are you pumping through a lot of traffic to the broker? Can you try t

Re: Random connection errors

2015-12-15 Thread Kishore N C
I did manage to locate a task which was blocked without starting as I had described earlier. The log for that task is here: https://gist.githubusercontent.com/kishorenc/ef806e85478378ce2203/raw/8537d3d3644eea7cdd9efc9fa8749c0840092f3c/gistfile1.txt Thanks, Kishore. On Tue, Dec 15, 2015 at 4:30

Re: Random connection errors

2015-12-15 Thread Kishore N C
Hi Yi Pan, I'm using Samza 0.9.1 and Kafka 0.8.2.1. Here's an example of a full task log: https://gist.githubusercontent.com/kishorenc/5d65f114a50b9ef6a6b3/raw/5b9ecffdd1af831f713e8b41e5b77e5b881e8173/gistfile1.txt You will find "java.nio.channels.ClosedChannelException" towards the end. One ad