Re: PG DOCS - logical replication filtering

2022-03-03 Thread Peter Smith
PSA patch v3 to address all comments received so far. -- Kind Regards, Peter Smith. Fujitsu Australia v3-0001-Update-the-documentation-for-logical-replication.patch Description: Binary data

Re: PG DOCS - logical replication filtering

2022-03-03 Thread Peter Smith
On Thu, Mar 3, 2022 at 2:15 PM Amit Kapila wrote: > > On Wed, Mar 2, 2022 at 8:00 PM Peter Eisentraut > wrote: > > > > On 02.03.22 05:47, Peter Smith wrote: > > > This patch introduces a new "Filtering" page to give a common place > > > where all kinds of logical replication filtering can be desc

Re: Doc about how to set max_wal_senders when setting minimal wal_level

2022-03-03 Thread Japin Li
On Thu, 03 Mar 2022 at 12:10, Japin Li wrote: > On Thu, 03 Mar 2022 at 11:25, David G. Johnston > wrote: >> I would suggest a wording more like: >> >> "A precondition for using minimal WAL is to disable WAL archiving and >> streaming replication by setting max_wal_senders to 0, and archive_mode

Re: Proposal: Support custom authentication methods using hooks,Re: Proposal: Support custom authentication methods using hooks

2022-03-03 Thread Tatsuo Ishii
>> So, dropping plaintext password authentication support from libpq will >> make it impossible for users to use the former method. > > Yes, just like dropping support for md5 would make it impossible for > users to have their passwords be hashed with md5, which is an altogether > good thing consi

Re: standby recovery fails (tablespace related) (tentative patch and discussion)

2022-03-03 Thread Michael Paquier
On Fri, Mar 04, 2022 at 09:10:48AM +0900, Kyotaro Horiguchi wrote: > And same function contained a maybe-should-have-been-removed line > which makes Windows build unhappy. > > This should make all platforms in the CI happy. d6d317d as solved the issue of tablespace paths across multiple nodes wit

Re: Adding CI to our tree (ccache)

2022-03-03 Thread Justin Pryzby
On Sun, Feb 20, 2022 at 12:47:31PM -0800, Andres Freund wrote: > On 2022-02-20 13:36:55 -0600, Justin Pryzby wrote: > > Have you tried to use the yet-to-be-released ccache with MSVC ? > > Yes, it doesn't work, because it requires cl.exe to be used in a specific way > (only a single input file, spe

Re: Add checkpoint and redo LSN to LogCheckpointEnd log message

2022-03-03 Thread Kyotaro Horiguchi
At Mon, 14 Feb 2022 14:52:15 +0900 (JST), Kyotaro Horiguchi wrote in > In this version , 0001 gets one fix and two comment updates. While the disucssion on back-patching of 0001 proceeding on another branch, the main patch iself gets looks like as if rotten on CF-App. So I rebased v10 on the cu

Re: Add the replication origin name and commit-LSN to logical replication worker errcontext

2022-03-03 Thread Masahiko Sawada
On Fri, Mar 4, 2022 at 11:27 AM osumi.takami...@fujitsu.com wrote: > > On Friday, March 4, 2022 10:09 AM Masahiko Sawada > wrote: > > On Thu, Mar 3, 2022 at 10:02 PM Masahiko Sawada > > wrote: > > > > > > > > > I'm updating the patches and will submit them. > > > > Attached updated version patc

Re: Add the replication origin name and commit-LSN to logical replication worker errcontext

2022-03-03 Thread Amit Kapila
On Fri, Mar 4, 2022 at 6:40 AM Masahiko Sawada wrote: > > Attached updated version patches. > The patch looks mostly good to me. Few minor comments: 1. I think we can have an Assert for errarg->origin_name in apply_error_callback after checking the command as this function assumes that it will al

Re: Add the replication origin name and commit-LSN to logical replication worker errcontext

2022-03-03 Thread Amit Kapila
On Fri, Mar 4, 2022 at 10:53 AM Masahiko Sawada wrote: > > On Fri, Mar 4, 2022 at 11:27 AM osumi.takami...@fujitsu.com > wrote: > > > > (4) one confirmation > > > > We don't have a TAP test of pg_replication_origin_advance() > > for v3, that utilizes this new log in a logical replication setup. >

Re: Doc about how to set max_wal_senders when setting minimal wal_level

2022-03-03 Thread Kyotaro Horiguchi
At Fri, 04 Mar 2022 12:18:29 +0800, Japin Li wrote in > > On Thu, 03 Mar 2022 at 12:10, Japin Li wrote: > > Attach v3 patch to fix missing close varname tag. +A precondition for using minimal WAL is to disable WAL archiving and +streaming replication by setting +to 0,

RE: Add the replication origin name and commit-LSN to logical replication worker errcontext

2022-03-03 Thread osumi.takami...@fujitsu.com
On Friday, March 4, 2022 2:23 PM Masahiko Sawada wrote: > I've attached updated patches. Hi, thank you for updating the patch. One comment on v4. In v4-0002, we introduce 'commit_lsn' in the ApplyErrorCallbackArg. This member is set for prepare, rollback prepared and stream_abort as well. The ne

RE: [Proposal] Add foreign-server health checks infrastructure

2022-03-03 Thread kuroda.hay...@fujitsu.com
Hi Hackers, > It's not happy, but I'm not sure about a good solution. I made a timer > reschedule > if connection lost had detected. But if queries in the transaction are quite > short, > catching SIGINT may be fail. Attached uses another way: sets pending flags again if DoingCommandRead is tru

Re: Add the replication origin name and commit-LSN to logical replication worker errcontext

2022-03-03 Thread Amit Kapila
On Fri, Mar 4, 2022 at 11:45 AM osumi.takami...@fujitsu.com wrote: > > On Friday, March 4, 2022 2:23 PM Masahiko Sawada > wrote: > > I've attached updated patches. > Hi, thank you for updating the patch. > > One comment on v4. > > In v4-0002, we introduce 'commit_lsn' in the ApplyErrorCallbackAr

Re: standby recovery fails (tablespace related) (tentative patch and discussion)

2022-03-03 Thread Kyotaro Horiguchi
Thanks to look this! At Fri, 4 Mar 2022 13:51:12 +0900, Michael Paquier wrote i n > On Fri, Mar 04, 2022 at 09:10:48AM +0900, Kyotaro Horiguchi wrote: > > And same function contained a maybe-should-have-been-removed line > > which makes Windows build unhappy. > > > > This should make all platfo

pg_tablespace_location() failure with allow_in_place_tablespaces

2022-03-03 Thread Michael Paquier
Hi all, While playing with tablespaces and recovery in a TAP test, I have noticed that retrieving the location of a tablespace created with allow_in_place_tablespaces enabled fails in pg_tablespace_location(), because readlink() sees a directory in this case. The use may be limited to any automat

Re: Optionally automatically disable logical replication subscriptions on error

2022-03-03 Thread Masahiko Sawada
On Wed, Mar 2, 2022 at 6:38 PM osumi.takami...@fujitsu.com wrote: > > On Wednesday, March 2, 2022 12:47 PM Masahiko Sawada > wrote: > > After more thoughts, should we do both AbortOutOfAnyTransaction() and error > > message handling while holding interrupts? That is, > > > > HOLD_INTERRUPTS(); >

Re: wal_compression=zstd

2022-03-03 Thread Michael Paquier
On Tue, Feb 22, 2022 at 05:19:48PM -0600, Justin Pryzby wrote: > I am not claiming that zstd is generally better for WAL. Rather, if we're > going to support alternate compression methods, it's nice to give a couple > options (in addition to pglz). Some use cases would certainly suffer from > slo

Re: logical replication empty transactions

2022-03-03 Thread Peter Smith
On Fri, Mar 4, 2022 at 12:41 PM Ajin Cherian wrote: > > I have split the patch into two. I have kept the logic of skipping > streaming changes in the second patch. > I will work on the second patch once we can figure out a solution for > the COMMIT PREPARED after restart problem. > Please see bel

Re: pg_tablespace_location() failure with allow_in_place_tablespaces

2022-03-03 Thread Kyotaro Horiguchi
At Fri, 4 Mar 2022 15:44:22 +0900, Michael Paquier wrote in > Hi all, > > While playing with tablespaces and recovery in a TAP test, I have > noticed that retrieving the location of a tablespace created with > allow_in_place_tablespaces enabled fails in pg_tablespace_location(), > because readl

Re: pg_tablespace_location() failure with allow_in_place_tablespaces

2022-03-03 Thread Kyotaro Horiguchi
At Fri, 04 Mar 2022 16:41:03 +0900 (JST), Kyotaro Horiguchi wrote in > At Fri, 4 Mar 2022 15:44:22 +0900, Michael Paquier > wrote in > > The use may be limited to any automated testing and > > allow_in_place_tablespaces is a developer GUC, still it seems to me > > that there is an argument to

<    1   2