Re: Review Request 49212: RFC: SAMZA-855: Update kafka client to 0.10.0.0

2016-07-05 Thread Robert Crim
consumer. - Robert --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/49212/#review139920 --- On June 24, 2016, 7:45 p.

Review Request 49212: RFC: SAMZA-855: Update kafka client to 0.10.0.0

2016-06-24 Thread Robert Crim
to run the integration tests (on any branch) but will do that next! Thanks, Robert Crim

Re: Kafka dependency

2016-05-10 Thread Robert Crim
Just want to chime in to add we'd like to use some of the new security features in Kafka 0.9, ACLs and TLS in particular. On Tue, May 10, 2016 at 11:24 AM, Nick Quinn wrote: > Thanks Yi! > > One more question, if I may: I saw that you dropped a 0.10.0 in December > of 2015, but the version in G

Re: Exactly once processing

2016-04-15 Thread Robert Crim
Looking at: https://github.com/apache/samza/blob/f02386464d31b5a496bb0578838f51a0331bfffa/samza-core/src/main/scala/org/apache/samza/container/TaskInstance.scala#L171 The commit function, in order, does: 1. Flushes metrics 2. Flushes stores 3. Produces messages from the collectors 4. Write offset

Re: ThreadJobFactory in production

2016-03-02 Thread Robert Crim
an interesting thread a while back from I believe the netflix > > guys about running ThreadJobFactory in production. > > > > > > > On Mar 2, 2016, at 4:20 PM, Robert Crim wrote: > > > > > > Hi, > > > > > > We're currently working

ThreadJobFactory in production

2016-03-02 Thread Robert Crim
Hi, We're currently working on a solution that allows us to run Samza jobs on Mesos. This seems to be going well, and something we'd like to move away from when native Mesos support is added to Samza. While we're developing and testing our scheduler, I'm wondering about the implications of runnin