Re: Issues with 2PC at recovery: CLOG lookups and GlobalTransactionData

2025-06-06 Thread Noah Misch
On Thu, Jun 05, 2025 at 04:22:48PM +0900, Michael Paquier wrote: > On Mon, Jun 02, 2025 at 06:48:46PM -0700, Noah Misch wrote: > > The wasShutdown case reaches consistency from the beginning, so I don't see > > that as an example of a time we benefit from reading pg_twophase before > > reaching con

Re: Issues with 2PC at recovery: CLOG lookups and GlobalTransactionData

2025-06-05 Thread Michael Paquier
On Mon, Jun 02, 2025 at 06:48:46PM -0700, Noah Misch wrote: > The wasShutdown case reaches consistency from the beginning, so I don't see > that as an example of a time we benefit from reading pg_twophase before > reaching consistency. Can you elaborate on that? > > What's the benefit you're tryi

Re: Issues with 2PC at recovery: CLOG lookups and GlobalTransactionData

2025-06-02 Thread Noah Misch
On Fri, May 09, 2025 at 02:08:26PM +0900, Michael Paquier wrote: > On Tue, Feb 18, 2025 at 04:57:47PM -0800, Noah Misch wrote: > > As I wrote in [1], "By the time we reach consistency, every file in > > pg_twophase will be applicable (not committed or aborted)." If we find > > otherwise, the user

Re: Issues with 2PC at recovery: CLOG lookups and GlobalTransactionData

2025-05-21 Thread Michael Paquier
On Fri, May 09, 2025 at 02:08:26PM +0900, Michael Paquier wrote: > One extra thing that I have mentioned is that we could replace the > CLOG safeguards based on what we know from the checkpoint record based > on the oldest XID horizon of the checkpoint record and its next XID: > - If we have a 2PC

Re: Issues with 2PC at recovery: CLOG lookups and GlobalTransactionData

2025-05-08 Thread Michael Paquier
On Tue, Feb 18, 2025 at 04:57:47PM -0800, Noah Misch wrote: > As I wrote in [1], "By the time we reach consistency, every file in > pg_twophase will be applicable (not committed or aborted)." If we find > otherwise, the user didn't follow the backup protocol (or there's another > bug). Hence, long

Re: Issues with 2PC at recovery: CLOG lookups and GlobalTransactionData

2025-02-18 Thread Noah Misch
On Thu, Jan 30, 2025 at 03:36:20PM +0900, Michael Paquier wrote: > And I am beginning a new thread about going through an issue that Noah > has mentioned at [1], which is that the 2PC code may attempt to do > CLOG lookups at very early stage of recovery, where the cluster is not > in a consistent s

Re: Issues with 2PC at recovery: CLOG lookups and GlobalTransactionData

2025-02-02 Thread Michael Paquier
On Fri, Jan 31, 2025 at 04:54:17PM +0300, Vitaly Davydov wrote: > I'm looking at the v13 patch. I see, there is the only file for v13: > v2-0002-Fix-issues-with-2PC-file-handling-at-recovery-13.txt Yes. The fixes in 13~16 are simpler. There are so many conflicts across all the branches that I'm

Re: Issues with 2PC at recovery: CLOG lookups and GlobalTransactionData

2025-01-31 Thread Vitaly Davydov
On Friday, January 31, 2025 03:21 MSK, Michael Paquier wrote: > > Thoughts and comments are welcome. I'm looking at the v13 patch. I see, there is the only file for v13: v2-0002-Fix-issues-with-2PC-file-handling-at-recovery-13.txt There are two points I would like to highlight: #1. In Recover