Review Request 42485: SAMZA-857: Missing break in RocksDbOptionsHelper#options()

2016-01-18 Thread Tao Feng
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/42485/ --- Review request for samza. Repository: samza Description --- SAMZA-857: M

Re: Custom System Consumer filling up memory

2016-01-18 Thread Yi Pan
Hi, Marcelo, Sorry to get back to you late. I remember that Jagadish has some conversation w/ you on the implementation earlier. Did that include some hints to solve this problem as well? Generally, customized system consumers would need to be responsible for the memory usage in the customized cod

Re: Review Request 42484: hello-samza 0.10.0 changes for CDH 5.4 distribution

2016-01-18 Thread Yi Pan (Data Infrastructure)
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/42484/#review115107 --- pom.xml (line 289)

Re: Review Request 42484: hello-samza 0.10.0 changes for CDH 5.4 distribution

2016-01-18 Thread Yi Pan (Data Infrastructure)
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/42484/#review115105 --- pom.xml (line 146)

Re: Review Request 42483: Minor doc fixes

2016-01-18 Thread Randall Britten
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/42483/ --- (Updated Jan. 19, 2016, 4:16 a.m.) Review request for samza. Changes ---

Review Request 42484: hello-samza 0.10.0 changes for CDH 5.4 distribution

2016-01-18 Thread Yi Pan (Data Infrastructure)
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/42484/ --- Review request for samza. Bugs: SAMZA-851 https://issues.apache.org/jira/br

Review Request 42483: Minor doc fixes

2016-01-18 Thread Randall Britten
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/42483/ --- Review request for samza. Bugs: SAMZA-858 https://issues.apache.org/jira/br

Re: Data consistency and check-pointing

2016-01-18 Thread Yi Pan
Hi, Michael, Your use case sounds much like a "customized checkpointing" to me. We have similar cases in LinkedIn and the following are the solution in production: 1) disable Samza auto-checkpoint by setting the commit_ms to -1 2) explicitly calling TaskCoordinator.commit() in sync with closing th