Hi,
I've created PIP 102 to introduce the concept of watermarking into Pulsar,
to improve the correctness of stream processing applications that use
Pulsar topics as a source and/or sink.

https://github.com/apache/pulsar/issues/12267

Some initial efforts were made during the 2021 Apache Pulsar Hackathon to
demonstrate the value proposition.  Here's some relevant links:

https://github.com/EronWright/pulsar-hackathon-2021-projects-watermarking

https://streamnative.io/blog/community/2021-06-22-pulsar-hackathon-2021-winners-announced/

I'm giving a talk at Pulsar Summit Europe on this idea, and will post more
materials as they become available:
https://pulsar-summit.org/en/event/europe-2021/sessions/pulsar-watermarking

Looking forward to discussing this idea with the Pulsar community!
Eron Wright
StreamNative

Reply via email to