Re: [DISCUSSION] Event time based compaction

2024-05-06 Thread Lari Hotari
Hi Marek, I think that this is a good proposal. Thanks for driving this change. Please go ahead and create a PIP to document this change and bring it to voting. You can see in https://github.com/apache/pulsar/tree/master/pip how proposals are documented in PIP documents. There's a template avail

[DISCUSSION] Event time based compaction

2024-04-16 Thread Marek Czajkowski
Hello everyone, I'd like to initiate a discussion regarding the compaction feature in Pulsar topics. Currently, there are two types of compactors available: `TwoPhaseCompactor` and `StrategicTwoPhaseCompactor`. The latter is specifically utilized for internal load balancing purposes and is not empl