Re: Compress ReorderBuffer spill files using LZ4

Hi Tomas, Le lun. 23 sept. 2024 à 18:13, Tomas Vondra a écrit : > > Hi, > > I've spent a bit more time on this, mostly running tests to get a better > idea of the practical benefits. Thank you for your code review and testing! > Firstly, I think there's a bug in ReorderBufferCompress() - it's l

Re: Compress ReorderBuffer spill files using LZ4

Le lun. 15 juil. 2024 à 12:28, Tomas Vondra a écrit : > > On 7/15/24 20:50, Julien Tachoires wrote: > > The last patch of this set is still in WIP, it adds the machinery > > required for setting the compression methods as a subscription option: > > CREATE SUBSCRIPTION ...

Re: Compress ReorderBuffer spill files using LZ4

Le ven. 7 juin 2024 à 05:59, Tomas Vondra a écrit : > > On 6/6/24 12:58, Julien Tachoires wrote: > > ... > > > > When compiled with LZ4 support (--with-lz4), this patch enables data > > compression/decompression of these temporary files. Each transaction > >

Re: Compress ReorderBuffer spill files using LZ4

Le jeu. 6 juin 2024 à 07:24, Alvaro Herrera a écrit : > > On 2024-Jun-06, Amit Kapila wrote: > > > On Thu, Jun 6, 2024 at 4:28 PM Julien Tachoires wrote: > > > > > > When the content of a large transaction (size exceeding > > > logical_decoding_wo

Re: Compress ReorderBuffer spill files using LZ4

Le jeu. 6 juin 2024 à 06:40, Amit Kapila a écrit : > > On Thu, Jun 6, 2024 at 6:22 PM Julien Tachoires wrote: > > > > Le jeu. 6 juin 2024 à 04:13, Amit Kapila a écrit : > > > > > > On Thu, Jun 6, 2024 at 4:28 PM Julien Tachoires wrote: > > > >

Re: Compress ReorderBuffer spill files using LZ4

Le jeu. 6 juin 2024 à 04:13, Amit Kapila a écrit : > > On Thu, Jun 6, 2024 at 4:28 PM Julien Tachoires wrote: > > > > When the content of a large transaction (size exceeding > > logical_decoding_work_mem) and its sub-transactions has to be > > reordered during l

Compress ReorderBuffer spill files using LZ4

Hi, When the content of a large transaction (size exceeding logical_decoding_work_mem) and its sub-transactions has to be reordered during logical decoding, then, all the changes are written on disk in temporary files located in pg_replslot/. Decoding very large transactions by multiple replicatio

Re: SUBTRANS: Minimizing calls to SubTransSetParent()

he test and > not just a chart. The scripts have been attached to this thread with the initial performance results. Anyway, re-sending those (including a minor fix). -- Julien Tachoires EDB subtrans-benchmark.tar.gz Description: GNU Zip compressed data

Re: SUBTRANS: Minimizing calls to SubTransSetParent()

Hi, Le mar. 1 nov. 2022 à 09:39, Dilip Kumar a écrit : > > On Fri, Oct 28, 2022 at 10:55 PM Julien Tachoires wrote: > > > > Hi, > > > > Le lun. 26 sept. 2022 à 15:57, Simon Riggs > > a écrit : > > > > > > On Fri, 16 Sept 2022 at 13:20, Sim