Like I said, Im a bit confused. I see the terms "events", "messages" and "logs" and not quite sure what to make of it.
We are trying to determine the best way to aggregate all of our logs for processing in Hadoop. Kafka seems to fit this bill nicely however I want to know If its suited for other types of messages as well. Are there certain determine factors on why one would choose Kafka over RabbitMQ? Is it mostly scale or is it the type of messages/events/logs being produced/consumed? On Jun 7, 2013, at 5:21 PM, Alexis Richardson <alexis.richard...@gmail.com> wrote: > On Sat, Jun 8, 2013 at 1:08 AM, Mark <static.void....@gmail.com> wrote: >> Im a bit confused on the concept of a "message" in Kafka. How does this >> differ, if at all, from a message in RabbitMQ? It seems to me that Kafka is >> better suited for very write intensive "messages" like log data but RabbitMQ >> may be a better fit for traditional "messages"… i.e. "Product Purchased" or >> "User Registered" message. > > I'm not sure why you think this, or how to distinguish between a 'log' > message and some other kind. > > Messages = data, annotated with metadata. The latter is typically a > protocol-specific envelope. Kafka and Rabbit certainly have different > envelopes, eg for mapping data to subscribers/queries. > > alexis
