Re: PostgreSQL logical replication

On Tue, Nov 12, 2024 at 7:47 PM Ron Johnson wrote: > The documentation tells you, down in the Notes section. > > https://www.postgresql.org/docs/16/sql-createpublication.html > Thank you.

Re: PostgreSQL logical replication

The documentation tells you, down in the Notes section. https://www.postgresql.org/docs/16/sql-createpublication.html On Tue, Nov 12, 2024 at 5:46 AM Jayadevan M wrote: > Hello all, > > I am using PostgreSQL 16.4. I tried to set up logical replication with > "postgres" user and all worked fine.

PostgreSQL logical replication

Hello all, I am using PostgreSQL 16.4. I tried to set up logical replication with "postgres" user and all worked fine. Then I created a new user (my_replication) to be used for the purpose and couldn't figure out which privileges are necessary. Initially I got an error like "ERROR: permission de

Failed to increase the restart LSN of PostgreSQL logical replication slot

Hi,When I tried to update the flush LSN position of the logical replication slot for my 11.3 database, using the command select pg_replication_slot_advance(, )I get the error:user=cdcpsqlsrc,db=db_dsn_test03,app=PostgreSQL JDBC Driver,client=172.24.42.236 DEBUG: failed to increase restart lsn: prop

Re: PostgreSQL logical replication slot LSN values

feedback mechanism right? Thanks, Rashmi -"Rashmi V Bharadwaj" wrote: - To: Andres Freund From: "Rashmi V Bharadwaj" Date: 13/03/2019 10:59AM Cc: pgsql-gene...@postgresql.org Subject: Re: PostgreSQL logical replication slot LSN values Hi, > Well, did you consum

Re: PostgreSQL logical replication slot LSN values

mi V Bharadwaj From: Andres Freund Date: 12/03/2019 09:07PM Cc: pgsql-gene...@postgresql.org Subject: Re: PostgreSQL logical replication slot LSN values Hi, (please don't send HTML only emails to this list) On 2019-03-12 11:08:56 +, Rashmi V Bharadwaj wrote: > We have an applicatio

Re: PostgreSQL logical replication slot LSN values

Hi, (please don't send HTML only emails to this list) On 2019-03-12 11:08:56 +, Rashmi V Bharadwaj wrote: > We have an application that uses the PostgreSQL logical replication API to > read > the changes made to the PostgreSQL database and applies it to a different > datab

PostgreSQL logical replication slot LSN values

Hi,We have an application that uses the PostgreSQL logical replication API to read the changes made to the PostgreSQL database and applies it to a different database (like Db2 etc). We are using logical replication slots for this. Currently I am facing an issue where the replication slot is

Re: PostgreSQL logical replication depends on WAL segments?

Thanks, I see... So if I understand it correctly - since I have quite big >> partitions like ~30 GB each in one parent table and from ~1GB to ~5 GB in >> several others I presume I had to set wal_keep_segments to some really high >> number and stop our security cronjob cleaning old WAL segments (be

Re: PostgreSQL logical replication depends on WAL segments?

Hi guys, thank you very much for all information. I learned my lesson regarding cronjob cleaning old WAL logs... There is one other interesting problem I have found today and I would like to ask you about you opinion. On logical master I found this morning big flood of these messages in postgresql

Re: PostgreSQL logical replication depends on WAL segments?

On 23/1/19 5:26 π.μ., Jeremy Finzel wrote: On Tue, Jan 22, 2019 at 8:19 PM Achilleas Mantzios mailto:ach...@matrix.gatewaynet.com>> wrote: On 22/1/19 10:18 μ.μ., Jeremy Finzel wrote: On Tue, Jan 22, 2019 at 2:16 PM Jeremy Finzel mailto:finz...@gmail.com>> wrote: any one of

Re: PostgreSQL logical replication depends on WAL segments?

On Tue, Jan 22, 2019 at 8:19 PM Achilleas Mantzios < ach...@matrix.gatewaynet.com> wrote: > > On 22/1/19 10:18 μ.μ., Jeremy Finzel wrote: > > On Tue, Jan 22, 2019 at 2:16 PM Jeremy Finzel wrote: > >> any one of those WAL files will not be archived and recycled as long as >>> it no longer needed b

Re: PostgreSQL logical replication depends on WAL segments?

On 22/1/19 10:18 μ.μ., Jeremy Finzel wrote: On Tue, Jan 22, 2019 at 2:16 PM Jeremy Finzel > wrote: any one of those WAL files will not be archived and recycled as long as it no longer needed by a replication slot :(.  s/no longer/still.  I meant to sa

Re: PostgreSQL logical replication depends on WAL segments?

On Tue, Jan 22, 2019 at 2:16 PM Jeremy Finzel wrote: > any one of those WAL files will not be archived and recycled as long as it >> no longer needed by a replication slot >> > :(. s/no longer/still. I meant to say any one of those WAL files will not be archived and recycled as long as it still

Re: PostgreSQL logical replication depends on WAL segments?

> > wal retention in pg_wal and wal archiving are different things. The OP got > problems cause he deliberately went on to delete files in pg_wal which > means he used the wrong method to address a wrong situation. > > However, if the OP has still those WAL files archived he can use them to > bring

Re: PostgreSQL logical replication depends on WAL segments?

On 22/1/19 8:59 μ.μ., Jeremy Finzel wrote: On Tue, Jan 22, 2019 at 12:52 PM Andres Freund > wrote: Hi, On 2019-01-22 11:10:27 -0600, Jeremy Finzel wrote: > P.S. do heed the advice of the others and get more familiar with the docs > around WAL arch

Re: PostgreSQL logical replication depends on WAL segments?

> > Note replication slots only prevent old *catalog* rows from being > removed, not old row versions in user created tables. > Thank you for that clarification. I can see this is noted clearly in the CAUTION statement here: https://www.postgresql.org/docs/current/logicaldecoding-explanation.html

Re: PostgreSQL logical replication depends on WAL segments?

On Tue, Jan 22, 2019 at 12:52 PM Andres Freund wrote: > Hi, > > On 2019-01-22 11:10:27 -0600, Jeremy Finzel wrote: > > P.S. do heed the advice of the others and get more familiar with the docs > > around WAL archiving. > > Logical replication doesn't normally interact with WAL archiving in any >

Re: PostgreSQL logical replication depends on WAL segments?

Hi, On 2019-01-22 11:57:00 -0600, Jeremy Finzel wrote: > > > > That is news to me. Can you provide a citation for this? > > > > I can see the confusion in what I said. To clarify, I really meant that in > order to retrieve that data that you need in really old WAL segments, you > need to keep yo

Re: PostgreSQL logical replication depends on WAL segments?

Hi, On 2019-01-22 11:10:27 -0600, Jeremy Finzel wrote: > P.S. do heed the advice of the others and get more familiar with the docs > around WAL archiving. Logical replication doesn't normally interact with WAL archiving in any way, so that seems orthogonal. Greetings, Andres Freund

Re: PostgreSQL logical replication depends on WAL segments?

Hi, On 2019-01-22 14:18:12 +0100, Josef Machytka wrote: > Hello, I already tried to ask on stackoverflow but so far without success. > ( > https://stackoverflow.com/questions/54292816/postgresql-logical-replication-depends-on-wal-segments > ) > > Could someone help me please? &

Re: PostgreSQL logical replication depends on WAL segments?

> > That is news to me. Can you provide a citation for this? > I can see the confusion in what I said. To clarify, I really meant that in order to retrieve that data that you need in really old WAL segments, you need to keep your replication slot in a position that will hold that WAL in place. A

Re: PostgreSQL logical replication depends on WAL segments?

On 1/22/19 9:10 AM, Jeremy Finzel wrote: Thanks, I see... So if I understand it correctly - since I have quite big partitions like ~30 GB each in one parent table and from ~1GB to ~5 GB in several others I presume I had to set wal_keep_segments to some really high number and stop

Re: PostgreSQL logical replication depends on WAL segments?

> > Thanks, I see... So if I understand it correctly - since I have quite big > partitions like ~30 GB each in one parent table and from ~1GB to ~5 GB in > several others I presume I had to set wal_keep_segments to some really high > number and stop our security cronjob cleaning old WAL segments (b

Re: PostgreSQL logical replication depends on WAL segments?

On 22/1/19 6:01 μ.μ., Josef Machytka wrote: https://www.postgresql.org/docs/11/logical-replication-architecture.html Thanks, I see... So if I understand it correctly - since I have quite big partitions like ~30 GB each in one parent table and from ~1GB to ~5 GB in several others I presume

Re: PostgreSQL logical replication depends on WAL segments?

> https://www.postgresql.org/docs/11/logical-replication-architecture.html > > Thanks, I see... So if I understand it correctly - since I have quite big partitions like ~30 GB each in one parent table and from ~1GB to ~5 GB in several others I presume I had to set wal_keep_segments to some really h

Re: PostgreSQL logical replication depends on WAL segments?

On 1/22/19 5:18 AM, Josef Machytka wrote: Hello, I already tried to ask on stackoverflow but so far without success. (https://stackoverflow.com/questions/54292816/postgresql-logical-replication-depends-on-wal-segments) Could someone help me please? I am successfully using logical

Re: PostgreSQL logical replication depends on WAL segments?

On 22/1/19 3:18 μ.μ., Josef Machytka wrote: Hello, I already tried to ask on stackoverflow but so far without success. (https://stackoverflow.com/questions/54292816/postgresql-logical-replication-depends-on-wal-segments) Could someone help me please? I am successfully using logical

PostgreSQL logical replication depends on WAL segments?

Hello, I already tried to ask on stackoverflow but so far without success. ( https://stackoverflow.com/questions/54292816/postgresql-logical-replication-depends-on-wal-segments ) Could someone help me please? I am successfully using logical replication between 2 PG 11 cloud VMs for latest