Re: Force the old transactions logs cleanup even if checkpoint is skipped

2023-11-10 Thread Andres Freund
Hi, On 2023-11-09 11:50:10 +, Zakhlystov, Daniil (Nebius) wrote: > > On 9 Nov 2023, at 01:30, Michael Paquier wrote: > > > > I am not really convinced that this is worth complicating the skipped > > path for this goal. In my experience, I've seen complaints where WAL > > archiving bloat was

Re: Force the old transactions logs cleanup even if checkpoint is skipped

2023-11-09 Thread Zakhlystov, Daniil (Nebius)
Hello, > On 9 Nov 2023, at 01:30, Michael Paquier wrote: > > I am not really convinced that this is worth complicating the skipped > path for this goal. In my experience, I've seen complaints where WAL > archiving bloat was coming from the archive command not able to keep > up with the amount g

Re: Force the old transactions logs cleanup even if checkpoint is skipped

2023-11-08 Thread Michael Paquier
On Wed, Nov 08, 2023 at 12:44:09PM +, Zakhlystov, Daniil (Nebius) wrote: >> I am not sure to understand your last sentence here. Once the >> archiver is back up, you mean that the WAL segments that were not >> previously archived still are still not archived? Or do you mean that >> because of

Re: Force the old transactions logs cleanup even if checkpoint is skipped

2023-11-08 Thread Zakhlystov, Daniil (Nebius)
Hi! Thanks for your review. > I am not sure to understand your last sentence here. Once the > archiver is back up, you mean that the WAL segments that were not > previously archived still are still not archived? Or do you mean that > because of a succession of checkpoint skipped we are just ena

Re: Force the old transactions logs cleanup even if checkpoint is skipped

2023-11-07 Thread Michael Paquier
On Tue, Oct 17, 2023 at 02:09:21PM +, Zakhlystov, Daniil (Nebius) wrote: > I've stumbled into an interesting problem. Currently, if Postgres > has nothing to write, it would skip the checkpoint creation defined > by the checkpoint timeout setting. However, we might face a > temporary archiving

Re: Force the old transactions logs cleanup even if checkpoint is skipped

2023-11-07 Thread Zakhlystov, Daniil (Nebius)
ce the old transactions logs cleanup even if checkpoint is skipped CAUTION: This email originated from outside mail organization. Do not click links or open attachments unless you recognize the sender. Hi, I went through the Cfbot and saw that some test are failing for it (link: https://cirrus-c

Re: Force the old transactions logs cleanup even if checkpoint is skipped

2023-11-02 Thread Shlok Kyal
Hi, I went through the Cfbot and saw that some test are failing for it (link: https://cirrus-ci.com/task/4631357628874752): test: postgresql:recovery / recovery/019_replslot_limit # test failed --- stderr --- # poll_query_un

Force the old transactions logs cleanup even if checkpoint is skipped

2023-10-17 Thread Zakhlystov, Daniil (Nebius)
Hi, hackers! I've stumbled into an interesting problem. Currently, if Postgres has nothing to write, it would skip the checkpoint creation defined by the checkpoint timeout setting. However, we might face a temporary archiving problem (for example, some network issues) that might lead to a pi