Re: Enhancing the Pulsar Client with some a Shared State API

2021-11-29 Thread Enrico Olivelli
I am going to put up a PIP this week or the week after Enrico Il giorno lun 15 nov 2021 alle ore 13:00 Enrico Olivelli < eolive...@gmail.com> ha scritto: > Jack, > > Il giorno lun 15 nov 2021 alle ore 10:37 Jack Vanlightly > ha scritto: > >> Hi Enrico, >> >> This is interesting. I'm thinking of

Re: Enhancing the Pulsar Client with some a Shared State API

2021-11-15 Thread Enrico Olivelli
Jack, Il giorno lun 15 nov 2021 alle ore 10:37 Jack Vanlightly ha scritto: > Hi Enrico, > > This is interesting. I'm thinking of the KTables part of Kafka Streams and > also Raft state machines. > > You could build something equivalent to a Raft state machine on top of > Pulsar where WaitForExcl

Re: Enhancing the Pulsar Client with some a Shared State API

2021-11-15 Thread Jack Vanlightly
Hi Enrico, This is interesting. I'm thinking of the KTables part of Kafka Streams and also Raft state machines. You could build something equivalent to a Raft state machine on top of Pulsar where WaitForExclusive acts as leader election and the topic as the log. I would be interested in a PIP, th

Enhancing the Pulsar Client with some a Shared State API

2021-11-10 Thread Enrico Olivelli
Hello, With Pulsar 2.8.0 we have the Exclusive Producer, which allows you to use Pulsar as a consistent write-ahead-log for replicated state machines. It already happened to me a couple of times to need to build some replicated state storage on top of Pulsar and I would like to share some thoughts