On 4/27/15 2:59 PM, "Gwen Shapira" <gshap...@cloudera.com> wrote:

>@Roshan - if the data was already written to Kafka, your approach will
>generate LOTS of duplicates. I'm not convinced its ideal.


Only if the delivery failure rate is very high (i.e. short lived but very
frequent).  This batch semantics is not uncommon
also since Kafka had sync-batching in the past, it would not be new to
Kafka either.

But, like I had mentioned, there is an alternative to mitigate this
duplication... Return value could indicate failed messages.



Wanted to add.. That these failures typically assume that we got an
"error" back from Kafka Broker. There are other modes of failure (like
network glitches) which will means you only get some (potentially not very
informative) exception.



>
>What's wrong with callbacks?


The complexities of fine grained tracking  .. that I described in prev
email.


Reply via email to