Re: PIP-26 - Delayed Messages and Exclusive subcriptions

2021-04-21 Thread Sijie Guo
> My main problem is that when you use some subscription types the feature does not work and there is no error or any kind of feedback on the consumer side. If the problem is "there is no error or any kind of feedback on the consumer side", we should fix the error message. But I don't think we sh

Re: PIP-26 - Delayed Messages and Exclusive subcriptions

2021-04-20 Thread Enrico Olivelli
Il giorno mar 20 apr 2021 alle ore 19:01 Devin Bost ha scritto: > > We've handled this with a function by just putting a sleep on incoming > messages. > For any flow that needs the pattern, we just drop the function into the > flow. So, Matteo has a good point. > > -- > Devin G. Bost > > On Tue, A

Re: PIP-26 - Delayed Messages and Exclusive subcriptions

2021-04-20 Thread Devin Bost
We've handled this with a function by just putting a sleep on incoming messages. For any flow that needs the pattern, we just drop the function into the flow. So, Matteo has a good point. -- Devin G. Bost On Tue, Apr 20, 2021, 10:55 AM Matteo Merli wrote: > The main point of the delayed deliver

Re: PIP-26 - Delayed Messages and Exclusive subcriptions

2021-04-20 Thread Matteo Merli
The main point of the delayed delivery feature is to get messages out of order. That's why you can impose a per-message delay (as opposed to a per-producer delay). That also includes that different producers can have different settings and produce messages with different delays. Implementing an or

Re: PIP-26 - Delayed Messages and Exclusive subcriptions

2021-04-20 Thread Enrico Olivelli
Il giorno mar 20 apr 2021 alle ore 06:37 Yuva raj ha scritto: > > On Tue, 20 Apr 2021 at 07:40, Sijie Guo wrote: > > > Delayed delivery indicates out-of-order delivery. I am not sure how you can > > preserve ordering with delayed delivery. Probably the best option is to simply stop dispatching m

Re: PIP-26 - Delayed Messages and Exclusive subcriptions

2021-04-19 Thread Yuva raj
On Tue, 20 Apr 2021 at 07:40, Sijie Guo wrote: > Delayed delivery indicates out-of-order delivery. I am not sure how you can > preserve ordering with delayed delivery. It would be good to clarify the > semantic before stepping into implementations. > > - Sijie > > +1 > On Mon, Apr 19, 2021 at 6:

Re: PIP-26 - Delayed Messages and Exclusive subcriptions

2021-04-19 Thread Sijie Guo
Delayed delivery indicates out-of-order delivery. I am not sure how you can preserve ordering with delayed delivery. It would be good to clarify the semantic before stepping into implementations. - Sijie On Mon, Apr 19, 2021 at 6:42 AM Enrico Olivelli wrote: > Penghui > > Il giorno lun 19 apr 2

Re: PIP-26 - Delayed Messages and Exclusive subcriptions

2021-04-19 Thread Devin Bost
I like the idea of doing this in the broker if it's feasible. -- Devin G. Bost On Mon, Apr 19, 2021, 7:42 AM Enrico Olivelli wrote: > Penghui > > Il giorno lun 19 apr 2021 alle ore 15:11 PengHui Li > ha scritto: > > > > Hi enrico, > > > > The delayed message feature is to support messages that

Re: PIP-26 - Delayed Messages and Exclusive subcriptions

2021-04-19 Thread Enrico Olivelli
Penghui Il giorno lun 19 apr 2021 alle ore 15:11 PengHui Li ha scritto: > > Hi enrico, > > The delayed message feature is to support messages that can have any delay in > a single partition. > So, if the broker dispatches the messages based on the available time of the > message, this will brea

Re: PIP-26 - Delayed Messages and Exclusive subcriptions

2021-04-19 Thread PengHui Li
Hi enrico, The delayed message feature is to support messages that can have any delay in a single partition. So, if the broker dispatches the messages based on the available time of the message, this will break the FIFO order. So, if I understand correctly, "the behaviour of delayed messages ev

PIP-26 - Delayed Messages and Exclusive subcriptions

2021-04-19 Thread Enrico Olivelli
Hi, I came across this great feature, Delayed Messages https://github.com/apache/pulsar/wiki/PIP-26:-Delayed-Message-Delivery And I see that this feature does not work with Exclusive and Failover subscriptions. The reason explained in the PIP is that this is because we want to guarantee FIFO order