Re: [BUGS] BUG #6661: out-of-order XID insertion in KnownAssignedXids

2012-06-08 Thread Simon Riggs
On 8 June 2012 12:40, Andres Freund wrote: > Hi All, > > On Friday, June 08, 2012 12:42:00 PM Andres Freund wrote: >> On Friday, June 08, 2012 12:25:25 PM Valentine Gogichashvili wrote: >> > unfortunately I did not manage to keep the snapshot of the database, that >> > had this issue. > Ok, after

Re: [BUGS] BUG #6661: out-of-order XID insertion in KnownAssignedXids

2012-06-08 Thread Andres Freund
Hi All, On Friday, June 08, 2012 12:42:00 PM Andres Freund wrote: > On Friday, June 08, 2012 12:25:25 PM Valentine Gogichashvili wrote: > > unfortunately I did not manage to keep the snapshot of the database, that > > had this issue. Ok, after some playing I could reproduce the issue: master: S1:

Re: [BUGS] BUG #6661: out-of-order XID insertion in KnownAssignedXids

2012-06-08 Thread Andres Freund
Hi Valentine, On Friday, June 08, 2012 12:25:25 PM Valentine Gogichashvili wrote: > unfortunately I did not manage to keep the snapshot of the database, that > had this issue. Too bad. Let me try if I can reproduce it manually. > Can that be, that this issue only happens when the recovering from

Re: [BUGS] BUG #6661: out-of-order XID insertion in KnownAssignedXids

2012-06-08 Thread Valentine Gogichashvili
Hi Andres, unfortunately I did not manage to keep the snapshot of the database, that had this issue. Can that be, that this issue only happens when the recovering from the WAL files and not over the steaming replication? On other standbys, having no WAL delay, we did not see this problem yet. Wh

Re: [BUGS] BUG #6661: out-of-order XID insertion in KnownAssignedXids

2012-06-08 Thread Simon Riggs
On 7 June 2012 17:49, Andres Freund wrote: > A patch implementing that is attached. Unfortunately not really tested yet > because its kinda hard to hit that code-path. > > Valentine, can you test that patch? Patch looks good, so as soon as we confirm it we can apply. --  Simon Riggs   

Re: [BUGS] BUG #6661: out-of-order XID insertion in KnownAssignedXids

2012-06-07 Thread Andres Freund
On Thursday, June 07, 2012 03:58:24 PM Andres Freund wrote: > Hi, > > On Thursday, June 07, 2012 12:44:08 PM Valentine Gogichashvili wrote: > > I have the situation again, one of 3 slaves was slow to play all the WAL > > files and being about 10GB late it crashed with the same error again. > > >

Re: [BUGS] BUG #6661: out-of-order XID insertion in KnownAssignedXids

2012-06-07 Thread Andres Freund
Hi, On Thursday, June 07, 2012 12:44:08 PM Valentine Gogichashvili wrote: > I have the situation again, one of 3 slaves was slow to play all the WAL > files and being about 10GB late it crashed with the same error again. > > I collected DEBUG4 output in this time: > https://docs.google.com/open?i

Re: [BUGS] BUG #6661: out-of-order XID insertion in KnownAssignedXids

2012-06-07 Thread Valentine Gogichashvili
Hallo again, I have the situation again, one of 3 slaves was slow to play all the WAL files and being about 10GB late it crashed with the same error again. I collected DEBUG4 output in this time: https://docs.google.com/open?id=0B2NMMrfiBQcLZjNDbU0xQ3lvWms I hope it will be helpful, Regards, -

Re: [BUGS] BUG #6661: out-of-order XID insertion in KnownAssignedXids

2012-05-23 Thread Valentine Gogichashvili
Hello Andres, Do you have both, longrunning transactions and transactions with many > subtransactions? > > Yes long running plane SQL queries as well as many short SQL queries running one after another in one long spanning transaction (we are working on eliminating this kind of behavior, but it is

Re: [BUGS] BUG #6661: out-of-order XID insertion in KnownAssignedXids

2012-05-23 Thread Andres Freund
On Wednesday, May 23, 2012 12:30:31 PM Valentine Gogichashvili wrote: > > > 2012-05-22 21:20:27.868 CEST,,,23804,,4fbbe69e.5cfc,130,,2012-05-22 > > > 21:18:54 CEST,1/0,0,FATAL,XX000,"out-of-order XID insertion in > > > KnownAssignedXids","xlog redo running xacts: nextXid 3674728633 > > > lates

Re: [BUGS] BUG #6661: out-of-order XID insertion in KnownAssignedXids

2012-05-23 Thread Andres Freund
On Wednesday, May 23, 2012 06:27:48 PM Andres Freund wrote: > On Wednesday, May 23, 2012 12:30:31 PM Valentine Gogichashvili wrote: > > > > CEST,,0,LOG,0,"startup process (PID 23804) exited with exit code > > > > 1","" > > > > 2012-05-22 21:20:27.939 CEST,,,23793,,4fbbe69e.5cf1,2,,2012-

Re: [BUGS] BUG #6661: out-of-order XID insertion in KnownAssignedXids

2012-05-23 Thread Andres Freund
On Wednesday, May 23, 2012 12:30:31 PM Valentine Gogichashvili wrote: > > > CEST,,0,LOG,0,"startup process (PID 23804) exited with exit code > > > 1","" > > > 2012-05-22 21:20:27.939 CEST,,,23793,,4fbbe69e.5cf1,2,,2012-05-22 > > > 21:18:54 CEST,,0,LOG,0,"terminating any other activ

Re: [BUGS] BUG #6661: out-of-order XID insertion in KnownAssignedXids

2012-05-23 Thread Valentine Gogichashvili
> > > 2012-05-22 21:20:27.868 CEST,,,23804,,4fbbe69e.5cfc,130,,2012-05-22 > > 21:18:54 CEST,1/0,0,FATAL,XX000,"out-of-order XID insertion in > > KnownAssignedXids","xlog redo running xacts: nextXid 3674728633 > > latestCompletedXid 3674728632 oldestRunningXid 3674726497; 4 xacts: > > 367472704

Re: [BUGS] BUG #6661: out-of-order XID insertion in KnownAssignedXids

2012-05-22 Thread Andres Freund
Hi Valentine, On Tuesday, May 22, 2012 11:36:23 PM val...@gmail.com wrote: > 2012-05-22 21:20:27.868 CEST,,,23804,,4fbbe69e.5cfc,129,,2012-05-22 > 21:18:54 CEST,1/0,0,LOG,0,"4 KnownAssignedXids (num=4 tail=0 head=916) > [0]=3674726497 [1]=3674727041 [2]=3674727042 [3]=3674727128 ","xlog >

Re: [BUGS] BUG #6661: out-of-order XID insertion in KnownAssignedXids

2012-05-22 Thread Valentine Gogichashvili
Oh, that is not good, I am getting the same error after rebuilding hot-standby from master. 2012-05-23 02:08:36.960 CEST,,,21080,,4fbc2a84.5258,1,,2012-05-23 02:08:36 CEST,,0,LOG,0,"database system was interrupted while in recovery at log time 2012-05-22 21:33:49 CEST",,"If this has occurred

[BUGS] BUG #6661: out-of-order XID insertion in KnownAssignedXids

2012-05-22 Thread valgog
The following bug has been logged on the website: Bug reference: 6661 Logged by: Valentine Gogichashvili Email address: val...@gmail.com PostgreSQL version: 9.0.7 Operating system: Linux version 2.6.32-5-amd64 (Debian 2.6.32-41sque Description: Hello, today when tryi