> article, benchmark, and other think on the subject
> reaching this conclusion.
>
> After that you can, you can ask someone else another opinion on the
> subject.
>
> regards,
>
> Adrien
>
>
> De : Wim Van Leuven
> Envoyé : vendred
Hello Wim,
Thanks for your explanations, it makes more sense to me know. I think your
scenario may be better described as a "re-processing" case than a "delayed
processing" case, since you are effectively processing the un-anonymised
data once, sending results to the topic
Van Leuven
Envoyé : vendredi 9 mars 2018 08:03:15
À : users@kafka.apache.org
Objet : Re: Delayed processing
Hey Adrien,
thank you for the elaborate explanation!
We are ingesting call data records here, which due to the nature of a telco
network might not arrive in absolute logical order.
If I
that make the problem/idea more clear?
--
wim
On Fri, 9 Mar 2018 at 00:47 Guozhang Wang wrote:
> Hello Wim,
>
> Not sure if I understand your motivations for delayed processing, could you
> elaborate a bit more? Do you want to process raw messages, or do you want
> to pr
ly
> after make your job for each message (or commit several processed messages
> at one time and kept in a local memory buffer)
>
>
> I hope, these previous suggestions help you 😊
>
>
> Best regards,
>
> Adrien
>
>
> De : Wim Van Leuv
Hello Wim,
Not sure if I understand your motivations for delayed processing, could you
elaborate a bit more? Do you want to process raw messages, or do you want
to process anonymised messages?
Guozhang
On Thu, Mar 8, 2018 at 12:35 PM, Wim Van Leuven <
wim.vanleu...@highestpoint.biz>
pt
in a local memory buffer)
I hope, these previous suggestions help you 😊
Best regards,
Adrien
De : Wim Van Leuven
Envoyé : jeudi 8 mars 2018 21:35:13
À : users@kafka.apache.org
Objet : Delayed processing
Hello,
I'm wondering how to design a KStreams or
Hello,
I'm wondering how to design a KStreams or regular Kafka application that
can hold of processing of messages until a future time.
This related to EU's data protection regulation: we can store raw messages
for a given time; afterwards we have to store the anonymised message. So, I
was thinki
