Hi, Jeremiah, Samza does support manual checkpointing. You can following the steps below: 1) turn off auto-commit by setting task.commit.ms=-1 2) in your code, call TaskContext.commit() whenever you are ready to checkpoint.
We have applications in LinkedIn using this pattern to successfully implement user-controlled checkpointing. Best, -Yi On Tue, Jun 14, 2016 at 10:16 AM, Jeremiah Adams <jad...@helixeducation.com> wrote: > We need to send messages to a remote service. I need to implement a > circuit breaker to address the scenario in which the remote system is > unavailable. I need to change the current offset to reprocess the current > offset while the remote system is down. These concerns are similar to those > outlined here: https://issues.apache.org/jira/browse/SAMZA-794?< > https://issues.apache.org/jira/browse/SAMZA-794> > > It looks like Samza's Checkpointing mechanism replaces kafka's auto-commit > feature and there is no API for manually manipulating the Checkpointing? > > Can someone point me in the right direction? > > Thanks in advance. > > > > Jeremiah Adams > Software Engineer > www.helixeducation.com<http://www.helixeducation.com/> > Blog<http://www.helixeducation.com/blog/> | Twitter< > https://twitter.com/HelixEducation> | Facebook< > https://www.facebook.com/HelixEducation> | LinkedIn< > http://www.linkedin.com/company/3609946> >
