Re: PATCH: Attempt to make dbsize a bit more consistent

2021-02-19 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Monday, February 1, 2021 1:18 PM, Masahiko Sawada wrote: > On Thu, Nov 12, 2020 at 2:54 AM Soumyadeep Chakraborty > soumyadeep2...@gmail.com wrote: > > > Hey Georgios, > > On Tue, Nov 10, 2020 at 6:20 AM gkokola...@pm.me wrote: > > > > > ‐‐‐ Original

Re: PATCH: Attempt to make dbsize a bit more consistent

2021-02-24 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Friday, February 19, 2021 4:57 PM, wrote: > > > ‐‐‐ Original Message ‐‐‐ > On Monday, February 1, 2021 1:18 PM, Masahiko Sawada sawada.m...@gmail.com > wrote: > > > On Thu, Nov 12, 2020 at 2:54 AM Soumyadeep Chakraborty > > soumyadeep2...@gmail.c

Re: PATCH: Attempt to make dbsize a bit more consistent

2021-02-24 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Wednesday, February 24, 2021 3:34 PM, wrote: > > > ‐‐‐ Original Message ‐‐‐ > On Friday, February 19, 2021 4:57 PM, gkokola...@pm.me wrote: > > > ‐‐‐ Original Message ‐‐‐ > > On Monday, February 1, 2021 1:18 PM, Masahiko Sawada sawada.m...@

Re: New default role- 'pg_read_all_data'

2021-03-04 Thread gkokolatos
Hi, ‐‐‐ Original Message ‐‐‐ On Monday, November 23, 2020 11:31 PM, Stephen Frost wrote: > Greetings, > > - Anastasia Lubennikova (a.lubennik...@postgrespro.ru) wrote: > > > On 29.10.2020 17:19, Stephen Frost wrote: > > > > > - Georgios Kokolatos (gkokola...@protonmail.com) wrote:

Re: Allow batched insert during cross-partition updates

2021-03-11 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Thursday, March 11, 2021 9:42 AM, Amit Langote wrote: > Hi Georgios, > > On Wed, Mar 10, 2021 at 9:30 PM Georgios gkokola...@protonmail.com wrote: > > > I continued looking a bit at the patch, yet I am either failing to see fix > > or I am > > looking a

Re: Allow batched insert during cross-partition updates

2021-03-12 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Friday, March 12, 2021 3:45 AM, Amit Langote wrote: > On Thu, Mar 11, 2021 at 8:36 PM gkokola...@pm.me wrote: > > > On Thursday, March 11, 2021 9:42 AM, Amit Langote amitlangot...@gmail.com > > wrote: > > > > > On Wed, Mar 10, 2021 at 9:30 PM Georgios gko

Re: PATCH: Attempt to make dbsize a bit more consistent

2021-03-15 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Monday, March 15, 2021 7:10 AM, Michael Paquier wrote: > On Wed, Feb 24, 2021 at 02:35:51PM +, gkokola...@pm.me wrote: > > > Now with attachment. Apologies for the chatter. > > The patch has no documentation for the two new functions, so it is a > bit

Re: Allow batched insert during cross-partition updates

2021-03-16 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Tuesday, March 16, 2021 6:13 AM, Amit Langote wrote: > Hi Georgios, > > On Fri, Mar 12, 2021 at 7:59 PM gkokola...@pm.me wrote: > > > On Friday, March 12, 2021 3:45 AM, Amit Langote amitlangot...@gmail.com > > wrote: > > > > > On Thu, Mar 11, 2021 at 8:

Re: Allow batched insert during cross-partition updates

2021-03-16 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Tuesday, March 16, 2021 9:59 AM, Amit Langote wrote: > Hi Georgios, > > On Tue, Mar 16, 2021 at 5:12 PM gkokola...@pm.me wrote: > > > On Tuesday, March 16, 2021 6:13 AM, Amit Langote amitlangot...@gmail.com > > wrote: > > > > > On Fri, Mar 12, 2021 at 7

Re: Commitfest manager 2020-11

2020-10-27 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Sunday, October 25, 2020 8:01 PM, Anastasia Lubennikova wrote: > On 20.10.2020 10:30, gkokola...@pm.me wrote: > > > ‐‐‐ Original Message ‐‐‐ > > > > > [snip] > > > Wow, that was well in advance) I am willing to assist if you need any > > > help.

Re: PATCH: Attempt to make dbsize a bit more consistent

2020-11-10 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Monday, November 9, 2020 7:50 PM, Soumyadeep Chakraborty wrote: > Hey Georgios, > > Thanks for looking for more avenues to invoke tableAM APIS! Please find > my review below: A great review Soumyadeep, it is much appreciated. Please remember to add your

Re: Refactoring of compression options in pg_basebackup

2022-01-03 Thread gkokolatos
Hi, ‐‐‐ Original Message ‐‐‐ On Saturday, December 18th, 2021 at 12:29 PM, Michael Paquier wrote: >Hi all, >(Added Georgios in CC.) thank you for the shout out. >When working on the support of LZ4 for pg_receivewal, walmethods.c has >gained an extra parameter for the compression metho

Re: Refactoring of compression options in pg_basebackup

2022-01-05 Thread gkokolatos
On Wednesday, January 5th, 2022 at 9:00 AM, Michael Paquier wrote: > On Mon, Jan 03, 2022 at 03:35:57PM +, gkokola...@pm.me wrote: > > I propose to initialize streamer to NULL when declared at the top of > > CreateBackupStreamer(). > > Yes, that may be noisy. Done this way. Great. > > You

Re: psql tab completion for \h with IMPORT FOREIGN SCHEMA

2021-03-18 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Thursday, March 18, 2021 8:13 AM, Julien Rouhaud wrote: > On Thu, Mar 18, 2021 at 03:58:46PM +0900, Michael Paquier wrote: > > > Well, as $subject tells, I just found confusing that \h does not > > complete the so-said command, the only one using IMPORT a

Re: PATCH: Attempt to make dbsize a bit more consistent

2021-03-23 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Wednesday, March 17, 2021 6:35 AM, Michael Paquier wrote: > On Mon, Mar 15, 2021 at 03:10:59PM +0900, Michael Paquier wrote: > > > Anyway, as mentioned by other people upthread, I am not really > > convinced either that we should have more flavors of siz

Commitfest manager 2020-11

2020-08-24 Thread gkokolatos
Hi all, Admittedly quite ahead of time, I would like to volunteer as Commitfest manager for 2020-11. If the role is not filled and there are no objections, I can reach out again in October for confirmation. //Georgios

PATCH: Attempt to make dbsize a bit more consistent

2020-08-27 Thread gkokolatos
Hi all, this minor patch is attempting to force the use of the tableam api in dbsize where ever it is required. Apparently something similar was introduced for toast relations only. Intuitively it seems that the distinction between a table and a toast table is not needed. This patch treats tab

Re: [PATCH] Explicit null dereferenced (src/backend/access/heap/heaptoast.c)

2020-08-28 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Friday, 28 August 2020 03:22, Ranier Vilela wrote: > Hi, > > Per Coverity. > > When "Prepare for toasting", it is necessary to turn off the flag > TOAST_NEEDS_DELETE_OLD, > if there is no need to delete external values from the old tuple, otherwise, > th

Re: New default role- 'pg_read_all_data'

2020-08-28 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Friday, 28 August 2020 15:43, Stephen Frost wrote: > Greetings, > > - Georgios Kokolatos (gkokola...@protonmail.com) wrote: > > > The patch seems to be implementing a useful and requested feature. > > The patch applies cleanly and passes the basic regre

Re: v13: show extended stats target in \d

2020-08-31 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Monday, 31 August 2020 08:00, Justin Pryzby wrote: > The stats target can be set since commit d06215d03, but wasn't shown by psql. > ALTER STATISISTICS .. SET STATISTICS n. > > Normal (1-D) stats targets are shown in \d+ table. > Stats objects are shown i

Re: New default role- 'pg_read_all_data'

2020-08-31 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Monday, 31 August 2020 02:20, Stephen Frost wrote: > Greetings, > > - Stephen Frost (sfr...@snowman.net) wrote: > > > - Magnus Hagander (mag...@hagander.net) wrote: > > > > > On Fri, Aug 28, 2020 at 2:38 PM Stephen Frost sfr...@snowman.net wrote: > > >

Re: Reloptions for table access methods

2020-09-01 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Tuesday, 1 September 2020 09:18, Jeff Davis wrote: > A custom table access method might want to add a new reloption to > control something specific to that table access method. Unfortunately, > if you add a new option of type RELOPT_KIND_HEAP, it will imm

Re: Reloptions for table access methods

2020-09-03 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Tuesday, 1 September 2020 20:21, Jeff Davis wrote: > > I'm fine removing the "validate" parameter completely for the sake of > consistency. FWIW, the more I think about this, I would agree with the removal. However, isn't this mechanism used for other t

Re: Strange behavior with polygon and NaN

2020-09-07 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Thursday, 27 August 2020 14:24, Kyotaro Horiguchi wrote: > At Wed, 26 Aug 2020 08:18:49 -0400, Tom Lane t...@sss.pgh.pa.us wrote in > > > Kyotaro Horiguchi horikyota@gmail.com writes: > > > > > At Tue, 25 Aug 2020 19:03:50 -0400, Bruce Momjian br...@m

Re: PATCH: Attempt to make dbsize a bit more consistent

2020-09-09 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Tuesday, 8 September 2020 16:49, John Naylor wrote: > On Thu, Aug 27, 2020 at 9:39 AM gkokola...@pm.me wrote: > > > Hi all, > > this minor patch is attempting to force the use of the tableam api in > > dbsize where ever it is required. > > Apparently so

Re: PATCH: Attempt to make dbsize a bit more consistent

2020-09-09 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Tuesday, 8 September 2020 22:26, David Zhang wrote: > > > I found the function "table_relation_size" is only used by buffer > manager for "RELKIND_RELATION", "RELKIND_TOASTVALUE" and > "RELKIND_MATVIEW", i.e. > >         case RELKIND_RELATION: >         c

Re: Teach pg_receivewal to use lz4 compression

2021-10-29 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Saturday, September 18th, 2021 at 8:18 AM, Michael Paquier wrote: > On Fri, Sep 17, 2021 at 08:12:42AM +, gkokola...@pm.me wrote: > > I have been digging into the issue I saw in the TAP tests when closing > a segment, and found the problem. The way you

Re: Teach pg_receivewal to use lz4 compression

2021-11-01 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Monday, November 1st, 2021 at 9:09 AM, Michael Paquier wrote: > On Fri, Oct 29, 2021 at 08:38:33PM +0900, Michael Paquier wrote: > > It would be good to test with many segments, but could we think about > just relying on LZ4F_decompress() with a frame and

Re: Teach pg_receivewal to use lz4 compression

2021-11-02 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Tuesday, November 2nd, 2021 at 9:51 AM, Michael Paquier wrote: > On Tue, Nov 02, 2021 at 07:27:50AM +0900, Michael Paquier wrote: > > On Mon, Nov 01, 2021 at 08:39:59AM +, gkokola...@pm.me wrote: > > > Agreed. > > > > > > I have already started on v8 of

Re: Teach pg_receivewal to use lz4 compression

2021-11-03 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Wednesday, November 3rd, 2021 at 12:23 AM, Michael Paquier wrote: > On Tue, Nov 02, 2021 at 12:31:47PM -0400, Robert Haas wrote: >> On Tue, Nov 2, 2021 at 8:17 AM Magnus Hagander mag...@hagander.net wrote: >>> I think for the end user, it is strictly bette

Re: Teach pg_receivewal to use lz4 compression

2021-11-03 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Wednesday, November 3rd, 2021 at 9:05 AM, wrote: > ‐‐‐ Original Message ‐‐‐ > > On Wednesday, November 3rd, 2021 at 12:23 AM, Michael Paquier > mich...@paquier.xyz wrote: > > On Tue, Nov 02, 2021 at 12:31:47PM -0400, Robert Haas wrote: > > > On Tue,

Re: Teach pg_receivewal to use lz4 compression

2021-11-04 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Thursday, November 4th, 2021 at 9:21 AM, Michael Paquier wrote: > On Thu, Nov 04, 2021 at 04:31:48PM +0900, Michael Paquier wrote: > Thanks. I have looked at 0001 today, and applied it after fixing a > couple of issues. Great! Thank you very much. > Fro

Re: Teach pg_receivewal to use lz4 compression

2021-11-04 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Thursday, November 4th, 2021 at 9:21 AM, Michael Paquier wrote: > > +#ifdef HAVE_LIBLZ4 > > +while (readp < readend) > > +{ > > +size_tread_size = 1; > > +size_tout_size = 1; > > + > > +status = LZ4F_decompress

Re: Teach pg_receivewal to use lz4 compression

2021-11-05 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Friday, November 5th, 2021 at 3:47 AM, Michael Paquier wrote: > > I have spent an extra couple of hours staring at the code, and the > whole looked fine, so applied. While on it, I have tested the new TAP > tests with all the possible combinations of --wit

Re: Teach pg_receivewal to use lz4 compression

2021-11-19 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Friday, November 19th, 2021 at 3:07 AM, Michael Paquier wrote: > On Thu, Nov 18, 2021 at 07:54:37PM +0530, Jeevan Ladhe wrote: > > > In dir_open_for_write() I observe that we are writing the header > > and then calling LZ4F_compressEnd() in case there is an e

Re: Add LZ4 compression in pg_dump

2023-02-24 Thread gkokolatos
--- Original Message --- On Friday, February 24th, 2023 at 5:35 AM, Michael Paquier wrote: > > > On Thu, Feb 23, 2023 at 07:51:16PM -0600, Justin Pryzby wrote: > > > On Thu, Feb 23, 2023 at 09:24:46PM +0100, Tomas Vondra wrote: > > > > > I've now pushed 0002 and 0003, after mi

Re: Add LZ4 compression in pg_dump

2023-02-27 Thread gkokolatos
--- Original Message --- On Sunday, February 26th, 2023 at 3:59 PM, Tomas Vondra wrote: > > > > > On 2/25/23 06:02, Justin Pryzby wrote: > > > I have some fixes (attached) and questions while polishing the patch for > > zstd compression. The fixes are small and could be integ

Re: Add LZ4 compression in pg_dump

2023-02-27 Thread gkokolatos
--- Original Message --- On Saturday, February 25th, 2023 at 3:05 PM, Justin Pryzby wrote: > > > On Fri, Feb 24, 2023 at 11:02:14PM -0600, Justin Pryzby wrote: > > > I have some fixes (attached) and questions while polishing the patch for > > zstd compression. The fixes are sma

Re: Add LZ4 compression in pg_dump

2023-03-01 Thread gkokolatos
--- Original Message --- On Wednesday, March 1st, 2023 at 12:58 AM, Justin Pryzby wrote: > I found that e9960732a broke writing of empty gzip-compressed data, > specifically LOs. pg_dump succeeds, but then the restore fails: > > postgres=# SELECT lo_create(1234); > lo_create | 12

Re: Add LZ4 compression in pg_dump

2023-03-02 Thread gkokolatos
--- Original Message --- On Wednesday, March 1st, 2023 at 5:20 PM, Tomas Vondra wrote: > > > > > On 2/25/23 15:05, Justin Pryzby wrote: > > > On Fri, Feb 24, 2023 at 11:02:14PM -0600, Justin Pryzby wrote: > > > > > I have some fixes (attached) and questions while polishing th

Re: Add LZ4 compression in pg_dump

2023-03-11 Thread gkokolatos
--- Original Message --- On Saturday, March 11th, 2023 at 7:00 AM, Alexander Lakhin wrote: > Hello, > 23.02.2023 23:24, Tomas Vondra wrote: > > > On 2/23/23 16:26, Tomas Vondra wrote: > > > > > Thanks for v30 with the updated commit messages. I've pushed 0001 after > > > fixing a comme

Re: Add LZ4 compression in pg_dump

2023-03-14 Thread gkokolatos
--- Original Message --- On Monday, March 13th, 2023 at 10:47 PM, Tomas Vondra wrote: > > > Change pg_fatal() to an assertion+comment; > > > Yeah, that's reasonable. I'd even ditch the assert/comment, TBH. We > could add such protections against "impossible" stuff to a zillion ot

Re: Add LZ4 compression in pg_dump

2023-03-14 Thread gkokolatos
--- Original Message --- On Monday, March 13th, 2023 at 9:21 PM, Tomas Vondra wrote: > > > > > On 3/11/23 11:50, gkokola...@pm.me wrote: > > > --- Original Message --- > > On Saturday, March 11th, 2023 at 7:00 AM, Alexander Lakhin > > exclus...@gmail.com wrote: > > > > >

Re: Add LZ4 compression in pg_dump

2023-03-16 Thread gkokolatos
--- Original Message --- On Tuesday, March 14th, 2023 at 4:32 PM, Tomas Vondra wrote: > > > > > On 3/14/23 16:18, gkokola...@pm.me wrote: > > > ...> Would you mind me trying to come with a patch to address your points? > > > That'd be great, thanks. Please keep it split into sm

Re: Add LZ4 compression in pg_dump

2023-03-17 Thread gkokolatos
--- Original Message --- On Thursday, March 16th, 2023 at 10:20 PM, Tomas Vondra wrote: > > > > > On 3/16/23 18:04, gkokola...@pm.me wrote: > > > --- Original Message --- > > On Tuesday, March 14th, 2023 at 4:32 PM, Tomas Vondra > > tomas.von...@enterprisedb.com wrote

Re: Add LZ4 compression in pg_dump

2023-03-24 Thread gkokolatos
--- Original Message --- On Thursday, March 23rd, 2023 at 6:10 PM, Tomas Vondra wrote: > > So pushed all three parts, after updating the commit messages a bit. Thank you very much. > > This leaves the empty-data issue (which we have a fix for) and the > switch to LZ4F. And th

Re: Add LZ4 compression in pg_dump

2022-12-20 Thread gkokolatos
--- Original Message --- On Monday, December 19th, 2022 at 6:27 PM, Justin Pryzby wrote: > > > On Mon, Dec 19, 2022 at 05:03:21PM +, gkokola...@pm.me wrote: > > > > > 001 still doesn't compile on freebsd, and 002 doesn't compile on > > > > windows. Have you checked test res

Re: Add LZ4 compression in pg_dump

2023-01-15 Thread gkokolatos
Oh, I didn’t realize you took over Justin? Why? After almost a year of work? This is rather disheartening. On Mon, Jan 16, 2023 at 02:56, Justin Pryzby wrote: > On Mon, Jan 16, 2023 at 10:28:50AM +0900, Michael Paquier wrote: >> On Sat, Jan 14, 2023 at 03:43:09PM -0600, Justin Pryzby wrote: >>

Re: Add LZ4 compression in pg_dump

2023-03-27 Thread gkokolatos
--- Original Message --- On Thursday, March 16th, 2023 at 11:30 PM, Tomas Vondra wrote: > > > > > On 3/16/23 01:20, Justin Pryzby wrote: > > > On Mon, Mar 13, 2023 at 10:47:12PM +0100, Tomas Vondra wrote: > > > > > > > > Thanks. I don't want to annoy you too much, but could

Re: Add LZ4 compression in pg_dump

2023-03-28 Thread gkokolatos
--- Original Message --- On Friday, March 24th, 2023 at 10:30 AM, gkokola...@pm.me wrote: > > --- Original Message --- > On Thursday, March 23rd, 2023 at 6:10 PM, Tomas Vondra > tomas.von...@enterprisedb.com wrote: > > > This leaves the empty-data issue (which we have a f

Re: Add LZ4 compression in pg_dump

2023-03-31 Thread gkokolatos
--- Original Message --- On Wednesday, March 29th, 2023 at 12:02 AM, Tomas Vondra wrote: > > > On 3/28/23 18:07, gkokola...@pm.me wrote: > > > --- Original Message --- > > On Friday, March 24th, 2023 at 10:30 AM, gkokola...@pm.me gkokola...@pm.me > > wrote: > > > > > -

Re: Add LZ4 compression in pg_dump

2023-04-26 Thread gkokolatos
--- Original Message --- On Tuesday, April 25th, 2023 at 8:02 AM, Michael Paquier wrote: > > > On Wed, Apr 12, 2023 at 07:53:53PM -0500, Justin Pryzby wrote: > > > I doubt it - in the !HAVE_LIBZ case, it's currently an "if" statement > > with nothing but a comment, which isn't

Re: Add LZ4 compression in pg_dump

2023-05-05 Thread gkokolatos
--- Original Message --- On Friday, May 5th, 2023 at 8:00 AM, Alexander Lakhin wrote: > > > 23.03.2023 20:10, Tomas Vondra wrote: > > > So pushed all three parts, after updating the commit messages a bit. > > > > This leaves the empty-data issue (which we have a fix for) and th

Re: Add LZ4 compression in pg_dump

2023-05-05 Thread gkokolatos
--- Original Message --- On Friday, May 5th, 2023 at 3:23 PM, Andrew Dunstan wrote: > On 2023-05-05 Fr 06:02, gkokola...@pm.me wrote: > >> --- Original Message --- >> On Friday, May 5th, 2023 at 8:00 AM, Alexander Lakhin >> [](mailto:exclus...@gmail.com) >> wrote: >> >>> 23.03.202

Re: Add LZ4 compression in pg_dump

2023-05-07 Thread gkokolatos
On Sat, May 6, 2023 at 04:51, Michael Paquier <[mich...@paquier.xyz](mailto:On Sat, May 6, 2023 at 04:51, Michael Paquier < wrote: > On Fri, May 05, 2023 at 02:13:28PM +, gkokola...@pm.me wrote: >> Good point. I thought about it before submitting the patch. I >> concluded that given the compl

Re: Add LZ4 compression in pg_dump

2023-05-08 Thread gkokolatos
--- Original Message --- On Monday, May 8th, 2023 at 3:16 AM, Tom Lane wrote: > > > I wrote: > > > Michael Paquier mich...@paquier.xyz writes: > > > > > While testing this patch, I have triggered an error pointing out that > > > the decompression path of LZ4 is broken for table

Re: Add LZ4 compression in pg_dump

2023-05-08 Thread gkokolatos
--- Original Message --- On Monday, May 8th, 2023 at 8:20 PM, Tomas Vondra wrote: > > > > > On 5/8/23 18:19, gkokola...@pm.me wrote: > > > --- Original Message --- > > On Monday, May 8th, 2023 at 3:16 AM, Tom Lane t...@sss.pgh.pa.us wrote: > > > > > I wrote: > > > >

Re: Add LZ4 compression in pg_dump

2023-05-09 Thread gkokolatos
--- Original Message --- On Tuesday, May 9th, 2023 at 2:54 PM, Tomas Vondra wrote: > > > On 5/9/23 00:10, Michael Paquier wrote: > > > On Mon, May 08, 2023 at 08:00:39PM +0200, Tomas Vondra wrote: > > > > > The LZ4Stream_write() forgot to move the pointer to the next chunk, so

Re: Add LZ4 compression in pg_dump

2022-03-25 Thread gkokolatos
--- Original Message --- On Saturday, March 26th, 2022 at 12:13 AM, Rachel Heaton wrote: > On Fri, Mar 25, 2022 at 6:22 AM Justin Pryzby pry...@telsasoft.com wrote: > > > On Fri, Mar 25, 2022 at 01:20:47AM -0400, Greg Stark wrote: > > > > > It seems development on this has stalled. I

Re: Add LZ4 compression in pg_dump

2022-04-01 Thread gkokolatos
On Thursday, March 31st, 2022 at 4:34 AM, Michael Paquier wrote: > On Wed, Mar 30, 2022 at 03:32:55PM +, gkokola...@pm.me wrote: > > On Wednesday, March 30th, 2022 at 7:54 AM, Michael Paquier > > mich...@paquier.xyz wrote: > > Okay. 0002 looks fine as-is, and I don't mind the extra fatal() >

Re: Add LZ4 compression in pg_dump

2022-04-05 Thread gkokolatos
--- Original Message --- On Tuesday, April 5th, 2022 at 3:34 AM, Michael Paquier wrote: > On Fri, Apr 01, 2022 at 03:06:40PM +, gkokola...@pm.me wrote: > Splitting the program and its arguments makes sense. Great. > At the end I am finishing with the attached. I also saw an ove

Re: Add LZ4 compression in pg_dump

2022-04-05 Thread gkokolatos
--- Original Message --- On Tuesday, April 5th, 2022 at 12:55 PM, Michael Paquier wrote: > On Tue, Apr 05, 2022 at 07:13:35AM +, gkokola...@pm.me wrote: > No need to carry it forward anymore, I think ;) Thank you for committing! Cheers, //Georgios > -- > Michael

Re: Fixes for compression options of pg_receivewal and refactoring of backup_compression.{c,h}

2022-04-11 Thread gkokolatos
On Monday, April 11th, 2022 at 8:52 AM, Michael Paquier wrote: > This is something I think we had better fix before beta1, because now > we have binaries that use an inconsistent set of options. So, > attached is a patch set aimed at rework this option set from the > ground, taking advantage of

Re: Fixes for compression options of pg_receivewal and refactoring of backup_compression.{c,h}

2022-04-13 Thread gkokolatos
--- Original Message --- On Wednesday, April 13th, 2022 at 7:25 AM, Michael Paquier wrote: > > > On Tue, Apr 12, 2022 at 06:22:48PM +0900, Michael Paquier wrote: > > > On Mon, Apr 11, 2022 at 12:46:02PM +, gkokola...@pm.me wrote: > > > > > It looks good. If you choose to discard

Plug minor memleak in pg_dump

2022-02-01 Thread gkokolatos
Hi, I noticed a minor memleak in pg_dump. ReadStr() returns a malloc'ed pointer which should then be freed. While reading the Table of Contents, it was called as an argument within a function call, leading to a memleak. Please accept the attached as a proposed fix. Cheers, //GeorgiosFrom 9473

Re: Add LZ4 compression in pg_dump

2022-11-06 Thread gkokolatos
On Wed, Nov 2, 2022 at 14:28, Justin Pryzby wrote: > Checking if you'll be able to submit new patches soon ? Thank you for checking up. Expect new versions within this commitfest cycle.

Re: Add LZ4 compression in pg_dump

2022-11-22 Thread gkokolatos
--- Original Message --- On Monday, November 21st, 2022 at 12:13 AM, Michael Paquier wrote: > > > On Sun, Nov 20, 2022 at 11:26:11AM -0600, Justin Pryzby wrote: > > > I think this patch record should be closed for now. You can re-open the > > existing patch record once a patch

Re: Add LZ4 compression in pg_dump

2022-12-01 Thread gkokolatos
--- Original Message --- On Thursday, December 1st, 2022 at 3:05 AM, Michael Paquier wrote: > > > On Wed, Nov 30, 2022 at 05:11:44PM +, gkokola...@pm.me wrote: > > > Fair enough. The atteched v11 does that. 0001 introduces compression > > specification and is using it throug

Re: Add LZ4 compression in pg_dump

2023-01-19 Thread gkokolatos
--- Original Message --- On Thursday, January 19th, 2023 at 4:45 PM, Tomas Vondra wrote: > > > On 1/18/23 20:05, gkokola...@pm.me wrote: > > > --- Original Message --- > > On Wednesday, January 18th, 2023 at 3:00 PM, Tomas Vondra > > tomas.von...@enterprisedb.com wrote:

Re: Add LZ4 compression in pg_dump

2023-01-20 Thread gkokolatos
--- Original Message --- On Friday, January 20th, 2023 at 12:34 AM, Tomas Vondra wrote: > > > On 1/19/23 18:55, Tomas Vondra wrote: > > > Hi, > > > > On 1/19/23 17:42, gkokola...@pm.me wrote: > > > > > ... > > > > > > Agreed. It was initially submitted as one patch. Then it

Re: Add LZ4 compression in pg_dump

2023-01-25 Thread gkokolatos
--- Original Message --- On Wednesday, January 25th, 2023 at 6:28 PM, Tomas Vondra wrote: > > > > On 1/25/23 16:37, gkokola...@pm.me wrote: > > > --- Original Message --- > > On Wednesday, January 25th, 2023 at 2:42 AM, Justin Pryzby > > pry...@telsasoft.com wrote: >

Re: Add LZ4 compression in pg_dump

2023-01-25 Thread gkokolatos
--- Original Message --- On Wednesday, January 25th, 2023 at 7:00 PM, Justin Pryzby wrote: > > > On Wed, Jan 25, 2023 at 03:37:12PM +, gkokola...@pm.me wrote: > > While looking at this, I realized that commit 5e73a6048 introduced a > regression: > > @@ -3740,19 +3762,24 @

Re: Add LZ4 compression in pg_dump

2023-01-31 Thread gkokolatos
--- Original Message --- On Friday, January 27th, 2023 at 6:23 PM, Justin Pryzby wrote: > > > On Thu, Jan 26, 2023 at 12:22:45PM -0600, Justin Pryzby wrote: > > > That commit also added this to pg-dump.c: > > > > + case PG_COMPRESSION_ZSTD: > > + pg_fatal("compression with %s

Teach pg_receivewal to use lz4 compression

2021-06-29 Thread gkokolatos
Hi, The program pg_receivewal can use gzip compression to store the received WAL. This patch teaches it to be able to use lz4 compression if the binary is build using the -llz4 flag. Previously, the user had to use the option --compress with a value between [0-9] to denote that gzip compression w

Re: Teach pg_receivewal to use lz4 compression

2021-07-01 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Thursday, July 1st, 2021 at 12:28, Magnus Hagander wrote: > On Wed, Jun 30, 2021 at 8:34 AM Dilip Kumar dilipbal...@gmail.com wrote: > > > On Tue, Jun 29, 2021 at 8:15 PM gkokola...@pm.me wrote: > > > > > Hi, > > > > > > The program pg_receivewal can use g

Re: Teach pg_receivewal to use lz4 compression

2021-07-01 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Thursday, July 1st, 2021 at 15:58, Magnus Hagander wrote: > On Thu, Jul 1, 2021 at 3:39 PM gkokola...@pm.me wrote: > > > ‐‐‐ Original Message ‐‐‐ > > > > On Thursday, July 1st, 2021 at 12:28, Magnus Hagander mag...@hagander.net > > wrote: > > > >

Re: Teach pg_receivewal to use lz4 compression

2021-07-02 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Friday, July 2nd, 2021 at 03:10, Michael Paquier wrote: > On Thu, Jul 01, 2021 at 02:10:17PM +, gkokola...@pm.me wrote: > > > Micheal suggested on the same thread to move my entry in the help output so > > that > > > > the output remains ordered. I wou

Re: Teach pg_receivewal to use lz4 compression

2021-07-08 Thread gkokolatos
Hi, please find v2 of the patch which tries to address the commends received so far. Thank you all for your comments. Michael Paquier wrote: > Documentation is missing from the patch. > It has now been added. > + LZ4F_compressionContext_t ctx; > + size_t outbufCapacity; > + void

Re: Teach pg_receivewal to use lz4 compression

2021-07-09 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Friday, July 9th, 2021 at 04:49, Michael Paquier wrote: > On Thu, Jul 08, 2021 at 02:18:40PM +, gkokola...@pm.me wrote: > > > please find v2 of the patch which tries to address the commends > > > > received so far. > > Thanks! > > > Michael Paquier wrot

Re: Teach pg_receivewal to use lz4 compression

2021-07-12 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Monday, July 12th, 2021 at 07:56, Michael Paquier wrote: > On Mon, Jul 12, 2021 at 11:10:24AM +0530, Dilip Kumar wrote: > > > On Thu, Jul 8, 2021 at 7:48 PM gkokola...@pm.me wrote: > > > > > We can, though I am not in favour of doing so. There is seemingly

Re: Introduce pg_receivewal gzip compression tests

2021-07-12 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Monday, July 12th, 2021 at 08:42, Michael Paquier wrote: > On Fri, Jul 09, 2021 at 11:26:58AM +, Georgios wrote: > > > As suggested on a different thread [1], pg_receivewal can increase it's test > > > > coverage. There exists a non trivial amount of c

Re: Introduce pg_receivewal gzip compression tests

2021-07-12 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Monday, July 12th, 2021 at 11:42, wrote: > ‐‐‐ Original Message ‐‐‐ > > On Monday, July 12th, 2021 at 08:42, Michael Paquier mich...@paquier.xyz > wrote: > > > On Fri, Jul 09, 2021 at 11:26:58AM +, Georgios wrote: > > > > > As suggested on a di

Re: Introduce pg_receivewal gzip compression tests

2021-07-12 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Monday, July 12th, 2021 at 11:56, wrote: > ‐‐‐ Original Message ‐‐‐ > > On Monday, July 12th, 2021 at 11:42, gkokola...@pm.me wrote: > > > ‐‐‐ Original Message ‐‐‐ > > > > On Monday, July 12th, 2021 at 08:42, Michael Paquier mich...@paquier.x

Re: Introduce pg_receivewal gzip compression tests

2021-07-12 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Monday, July 12th, 2021 at 13:00, Gilles Darold wrote: > Le 12/07/2021 à 12:27, gkokola...@pm.me a écrit : > > > > > > Shouldn't this be coded as a loop going through @gzip_wals? > > > > > > > > > > I would hope that there is only one gz file created. There

Re: Introduce pg_receivewal gzip compression tests

2021-07-12 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Monday, July 12th, 2021 at 13:04, Michael Paquier wrote: > On Mon, Jul 12, 2021 at 09:42:32AM +, gkokola...@pm.me wrote: > > > This to my understanding means that gzip is expected to exist. > > > > If this is correct, then simply checking for the header

Re: Introduce pg_receivewal gzip compression tests

2021-07-12 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Monday, July 12th, 2021 at 17:07, wrote: > ‐‐‐ Original Message ‐‐‐ > > On Monday, July 12th, 2021 at 13:04, Michael Paquier mich...@paquier.xyz > wrote: > > > On Mon, Jul 12, 2021 at 09:42:32AM +, gkokola...@pm.me wrote: > > > > > This to my un

Re: Add LZ4 compression in pg_dump

2022-06-28 Thread gkokolatos
--- Original Message --- On Sunday, June 26th, 2022 at 5:55 PM, Justin Pryzby wrote: > > > Hi, > > Will you be able to send a rebased patch for the next CF ? Thank you for taking an interest in the PR. The plan is indeed to sent a new version. > If you update for the review comm

Re: psql: \dl+ to list large objects privileges

2021-09-06 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Sunday, September 5th, 2021 at 21:47, Pavel Luzanov wrote: Hi, > Hi, > > On 03.09.2021 15:25, Georgios Kokolatos wrote: > > > On a high level I will recommend the addition of tests. There are similar > > tests > > Tests added. Thanks! The tests look good. A

Re: Showing I/O timings spent reading/writing temp buffers in EXPLAIN

2021-09-06 Thread gkokolatos
Hi, ‐‐‐ Original Message ‐‐‐ On Tuesday, August 24th, 2021 at 13:20, Ranier Vilela wrote: > Em ter., 24 de ago. de 2021 às 03:11, Masahiko Sawada > escreveu: > > > On Mon, Aug 23, 2021 at 10:46 AM Masahiko Sawada > > wrote: > > > > > > > > On Thu, Aug 19, 2021 at 10:52 PM Ranier Vil

Re: Teach pg_receivewal to use lz4 compression

2021-09-10 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Friday, July 9th, 2021 at 04:49, Michael Paquier wrote: Hi, please find v3 of the patch attached, rebased to the current head. > > Michael Paquier wrote: > > > > * http://www.zlib.org/rfc-gzip.html. > > - - For lz4 compressed segments > */ >

Re: Teach pg_receivewal to use lz4 compression

2021-09-13 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Saturday, September 11th, 2021 at 07:02, Jian Guo wrote: Hi, thank you for looking at the patch. > - LZ4F_decompressionContext_t ctx = NULL; > - snprintf(fullpath, sizeof(fullpath), "%s/%s", basedir, > dirent->d_name); > -

Re: Teach pg_receivewal to use lz4 compression

2021-09-16 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Wednesday, September 15th, 2021 at 08:46, Michael Paquier mich...@paquier.xyz wrote: Hi, thank you for the review. > On Fri, Sep 10, 2021 at 08:21:51AM +, gkokola...@pm.me wrote: > > > Agreed. A default value of 5, which is in the middle point of options

Re: Teach pg_receivewal to use lz4 compression

2021-09-17 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Friday, September 17th, 2021 at 09:39, Michael Paquier wrote: > On Thu, Sep 16, 2021 at 03:17:15PM +, gkokola...@pm.me wrote: > > > Hopefully fixed. > > Thanks for the new version. I have put my hands on the patch, and > began reviewing its internals w

Re: Introduce pg_receivewal gzip compression tests

2021-07-12 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Tuesday, July 13th, 2021 at 03:53, Michael Paquier wrote: > On Mon, Jul 12, 2021 at 04:46:29PM +, gkokola...@pm.me wrote: > > > On Monday, July 12th, 2021 at 17:07, gkokola...@pm.me wrote: > > > > > ‐‐‐ Original Message ‐‐‐ > > Are you using ou

Re: Introduce pg_receivewal gzip compression tests

2021-07-13 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Tuesday, July 13th, 2021 at 09:37, Michael Paquier wrote: > On Tue, Jul 13, 2021 at 06:36:59AM +, gkokola...@pm.me wrote: > > > I am sorry this was not so clear. It is indeed running twice the binary > > with different flags. However the goal is not to

Re: Introduce pg_receivewal gzip compression tests

2021-07-13 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Tuesday, July 13th, 2021 at 10:14, Michael Paquier wrote: > On Tue, Jul 13, 2021 at 04:37:53PM +0900, Michael Paquier wrote: > > Poking at this problem, I partially take this statement back as this > requires an initial run of pg_receivewal --endpos to ens

Re: Introduce pg_receivewal gzip compression tests

2021-07-13 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Tuesday, July 13th, 2021 at 12:26, Michael Paquier wrote: > On Tue, Jul 13, 2021 at 08:28:44AM +, gkokola...@pm.me wrote: > > Sounds great. Let me cook up v6 for this. > > Thanks. Could you use v5 I posted upthread as a base? There were > some improvem

Re: Introduce pg_receivewal gzip compression tests

2021-07-14 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Wednesday, July 14th, 2021 at 04:17, Michael Paquier wrote: > On Tue, Jul 13, 2021 at 11:16:06AM +, gkokola...@pm.me wrote: > > Agreed. For the record that is why I said v6 :) > Okay, thanks. Please find v6 attached. Cheers, //Georgios >

Re: Introduce pg_receivewal gzip compression tests

2021-07-15 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Thursday, July 15th, 2021 at 09:00, Michael Paquier wrote: > On Wed, Jul 14, 2021 at 02:11:09PM +, gkokola...@pm.me wrote: > > > Please find v6 attached. > > Thanks. I have spent some time checking this stuff in details, and > I did some tests on Windo

Re: Introduce pg_receivewal gzip compression tests

2021-07-15 Thread gkokolatos
‐‐‐ Original Message ‐‐‐ On Thursday, July 15th, 2021 at 14:35, Michael Paquier wrote: > On Thu, Jul 15, 2021 at 08:35:27PM +0900, Michael Paquier wrote: > > > 2. curculio: > > Looking at the OpenBSD code (usr.bin/compress/main.c), long options > > are supported, where --version do

  1   2   >