I would say follow Sparkngin and you'll be able to use the "Log persistence if the log producer connection is down". functionality when it's complete.
On Thu, Nov 28, 2013 at 8:36 AM, Demian Berjman <dberj...@despegar.com>wrote: > Steve, our use case is very simple. There are many reasons for a cluster to > go down. If that the case, what we do with the producers? Hopefully it will > be a time window of a couple of hours. If your concern are the queued > messages, we have only a few thousands per day. > > Thanks, > > > On Thu, Nov 28, 2013 at 1:12 PM, Steve Morin <st...@stevemorin.com> wrote: > > > What I mean by that is that your looking to have the Kafka cluster able > to > > be down for like 5 minutes or upto a day. The problem is estimating how > > long it will take to recover. > > > > Is this work your doing for a consulting project? Or are you doing > > something on behalf of an employer. Basically would like to know more > > about the use-case. You can email me directly at steve@stevemorin.comso > > we don't clog the message board. > > > > > > On Thu, Nov 28, 2013 at 8:05 AM, Demian Berjman <dberj...@despegar.com > > >wrote: > > > > > Steve, thanks for the response! I don't understand what you mean by > "what > > > kind of window?" > > > > > > I am looking for something like, i think you did it in Sparkngin: "Log > > > persistence if the log producer connection is down". > > > > > >
