r...@gmail.com]
Sent: 10 February 2014 17:47
To: users@kafka.apache.org
Subject: Re: Building a producer/consumer supporting exactly-once messaging
The out-of-the-box support for this in Kafka isn't great right now.
Exactly once semantics has two parts: avoiding duplication during data
production and
Ack, nice, should have thought of doing that...
-Jay
On Mon, Feb 10, 2014 at 10:12 AM, Neha Narkhede wrote:
> Added this to our FAQ -
>
> https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ-HowdoIgetexactlyonemessagingfromKafka
> ?
>
>
>
> On Mon, Feb 10, 2014 at 9:46 AM, Jay Kreps wrote
Added this to our FAQ -
https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ-HowdoIgetexactlyonemessagingfromKafka
?
On Mon, Feb 10, 2014 at 9:46 AM, Jay Kreps wrote:
> The out-of-the-box support for this in Kafka isn't great right now.
>
> Exactly once semantics has two parts: avoiding d
The out-of-the-box support for this in Kafka isn't great right now.
Exactly once semantics has two parts: avoiding duplication during data
production and avoiding duplicates during data consumption.
There are two approaches to getting exactly once semantics during data
production.
1. Use a singl
Have you read this part of the documentation?
http://kafka.apache.org/documentation.html#semantics
Just wondering if that solves your use case.
On Mon, Feb 10, 2014 at 9:11 AM, Garry Turkington <
g.turking...@improvedigital.com> wrote:
> Hi,
>
> I've been doing some prototyping on Kafka for a f
Hi,
I've been doing some prototyping on Kafka for a few months now and like what I
see. It's a good fit for some of my use cases in the areas of data distribution
but also for processing - liking a lot of what I see in Samza. I'm now working
through some of the operational issues and have a que
