Re: Questions on logical replication

On Thu, Jun 13, 2024 at 6:01 AM Koen De Groote wrote: > > Why? what benefit does this provide you?? Add all the tables when > creating the publication and be done with it... I get this when trying to > understand how this all works on test boxes, but for production NO idea > what you're tryin

Re: Questions on logical replication

> Why? what benefit does this provide you?? Add all the tables when creating the publication and be done with it... I get this when trying to understand how this all works on test boxes, but for production NO idea what you're trying to accomplish Adding all tables at once means adding the giga

Re: Questions on logical replication

On Tue, Jun 11, 2024 at 5:43 PM Koen De Groote wrote: > > If there are any errors during the replay of WAL such as missing indexes > for Replica Identities during an Update or Delete this will cause the main > subscriber worker slot on the publisher to start backing up WAL files > > And also if

Re: Questions on logical replication

> If there are any errors during the replay of WAL such as missing indexes for Replica Identities during an Update or Delete this will cause the main subscriber worker slot on the publisher to start backing up WAL files And also if the connection breaks, from what I understand, is that correct? A

Re: Questions on logical replication

> Have you looked at pg_upgrade?: I have, but I want to keep downtime to a minimum and from my understanding the switching of a fully synced logical replica only requires updating your sequences. Which should be possible in less than 60 seconds. > 1 GB each? Yes, each. Roughly around there. On

Re: Questions on logical replication

On Sat, Jun 8, 2024 at 1:41 PM Koen De Groote wrote: > What I'm trying to do is upgrade a PG11 database to PG16, using logical > replication. > > The PG11 has an active and a standby, there are a handful of databases. On > particular one has a few tables just over 100GB, then a few 100 tables nea

Re: Questions on logical replication

On 6/8/24 10:40, Koen De Groote wrote: What I'm trying to do is upgrade a PG11 database to PG16, using logical replication. Have you looked at pg_upgrade?: https://www.postgresql.org/docs/current/pgupgrade.html The PG11 has an active and a standby, there are a handful of databases. On part

Re: Questions on logical replication

What I'm trying to do is upgrade a PG11 database to PG16, using logical replication. The PG11 has an active and a standby, there are a handful of databases. On particular one has a few tables just over 100GB, then a few 100 tables near 1GB. What I'd do is start a publication with no tables and ad

Re: Questions on logical replication

On 6/6/24 15:19, Koen De Groote wrote: I'll give them a read, though it might take a few weekends Meanwhile, this seems to be what I'm looking for: From https://www.postgresql.org/docs/current/warm-standby.html#STREAMING-REPLICATION-SLOTS

Re: Questions on logical replication

On Fri, Jun 7, 2024 at 3:19 AM Koen De Groote wrote: > I'll give them a read, though it might take a few weekends > > Meanwhile, this seems to be what I'm looking for: > > From > https://www.postgresql.org/docs/current/warm-standby.html#STREAMING-REPLICATION-SLOTS > > " Replication slots provide

Re: Questions on logical replication

I'll give them a read, though it might take a few weekends Meanwhile, this seems to be what I'm looking for: From https://www.postgresql.org/docs/current/warm-standby.html#STREAMING-REPLICATION-SLOTS " Replication slots provide an automated way to ensure that the primary does not remove WAL segm

Re: Questions on logical replication

On 6/5/24 14:54, Koen De Groote wrote: https://www.postgresql.org/docs/current/wal-configuration.html "Checkpoints are points in the sequence of transactions at which it is guaranteed that the heap and index data fi

Re: Questions on logical replication

> > https://www.postgresql.org/docs/current/wal-configuration.html > > "Checkpoints are points in the sequence of transactions at which it is > guaranteed that the heap and index data files have been updated with all > information written before that checkpoint. At checkpoint time, all > dirty data

Re: Questions on logical replication

On 6/4/24 15:55, Koen De Groote wrote: I recently read the entire documentation on logical replication, but am left with a question on the buildup of WAL On this page: https://www.postgresql.org/docs/current/logical-replication-subscription.html#LOGICAL-REPLICATION-SUBSCRIPTION-SLOT

Re: Questions on logical replication

Reading this: https://www.postgresql.org/docs/current/warm-standby.html#STREAMING-REPLICATION-SLOTS " Replication slots provide an automated way to ensure that the primary does not remove WAL segments until they have been received by all standbys, and that the primary does not remove rows which co