Right Tool

2014-09-12 Thread Patrick Barker
Hey, I'm new to kafka and I'm trying to get a handle on how it all works. I want to integrate polyglot persistence into my application. Kafka looks like exactly what I want just on a smaller scale. I am currently only dealing with about 2,000 users, which may grow, but is kafka a good use case her

Re: Right Tool

2014-09-12 Thread Patrick Barker
ed yet?) > In > > any case you might try out Kafka - given its highly performant, > scalable, > > and flexible backbone. After that you will have little worry about > scale > > - given Kafka's use within massive web scale deployments. > > > > 2014-0

Re: Right Tool

2014-09-12 Thread Patrick Barker
publishing out to my databases. I'm not sure what format I would write it in yet, I guess json On Fri, Sep 12, 2014 at 7:00 PM, Steve Morin wrote: > What record format are you writing to Kafka with? > > > On Sep 12, 2014, at 17:45, Patrick Barker > wrote: > > > > O

Re: Right Tool

2014-09-12 Thread Patrick Barker
gt; On Fri, Sep 12, 2014 at 7:35 PM, Patrick Barker > > wrote: > > > I'm just getting familiar with kafka, currently I just save everything to > > all my db's in a single transaction, if any of them fail I roll them all > > back. However, this is slowing my app do