Re: [GENERAL] Corrupt indexes on slave when using pg_bulkload on master

2013-01-03 Thread James Cowell
ot; Cc: Jeff Janes Sent: Wednesday, 19 December 2012, 13:11 Subject: Re: [GENERAL] Corrupt indexes on slave when using pg_bulkload on master Actually, scratch that.  The difference in behaviour seems to be on the optimiser which now table scans the 10 row table (which I guess it should alw

Re: [GENERAL] Corrupt indexes on slave when using pg_bulkload on master

2012-12-19 Thread James Cowell
org" Sent: Thursday, 13 December 2012, 12:26 Subject: Re: [GENERAL] Corrupt indexes on slave when using pg_bulkload on master Hi Jeff,   Thanks again for your reply.   >If there are no constraint violations, do you still see the problem?   Yes, I've stripped it down to an empty tabl

Re: [GENERAL] Corrupt indexes on slave when using pg_bulkload on master

2012-12-17 Thread James Cowell
012, 12:26 Subject: Re: [GENERAL] Corrupt indexes on slave when using pg_bulkload on master Hi Jeff,   Thanks again for your reply.   >If there are no constraint violations, do you still see the problem?   Yes, I've stripped it down to an empty table with a 10 row load and the pk index on

Re: [GENERAL] Corrupt indexes on slave when using pg_bulkload on master

2012-12-13 Thread wd
We encounter the same problem, and have to change to use copy command On Wed, Dec 5, 2012 at 9:17 PM, James Cowell wrote: > I'm using pg_bulkload to load large amounts of CSV data into a postgres > database hourly. > > This database is replicated to a second node. > > Whenever a bulk load happe

Re: [GENERAL] Corrupt indexes on slave when using pg_bulkload on master

2012-12-13 Thread James Cowell
've attached a text file with details for table, load config file etc, is that everything you would need?   Cheers,   James From: Jeff Janes To: James Cowell Cc: "pgsql-general@postgresql.org" Sent: Monday, 10 December 2012, 16:53 Subject: Re:

Re: [GENERAL] Corrupt indexes on slave when using pg_bulkload on master

2012-12-10 Thread Jeff Janes
On Wed, Dec 5, 2012 at 5:17 AM, James Cowell wrote: > I'm using pg_bulkload to load large amounts of CSV data into a postgres > database hourly. > > This database is replicated to a second node. > > Whenever a bulk load happens the indexes on the updated tables on the > secondary node corrupt and

Re: [GENERAL] Corrupt indexes on slave when using pg_bulkload on master

2012-12-10 Thread James Cowell
licated without issue.   Thanks,   James  From: James Cowell To: 'Jeff Janes' Cc: pgsql-general@postgresql.org Sent: Wednesday, 5 December 2012, 18:56 Subject: Re: [GENERAL] Corrupt indexes on slave when using pg_bulkload on master Hi Jeff, Than

Re: [GENERAL] Corrupt indexes on slave when using pg_bulkload on master

2012-12-05 Thread James Cowell
er 2012 18:02 To: James Cowell Cc: pgsql-general@postgresql.org Subject: Re: [GENERAL] Corrupt indexes on slave when using pg_bulkload on master On Wed, Dec 5, 2012 at 5:17 AM, James Cowell wrote: > I'm using pg_bulkload to load large amounts of CSV data into a > postgres database hourl

Re: [GENERAL] Corrupt indexes on slave when using pg_bulkload on master

2012-12-05 Thread Jeff Janes
On Wed, Dec 5, 2012 at 5:17 AM, James Cowell wrote: > I'm using pg_bulkload to load large amounts of CSV data into a postgres > database hourly. > > This database is replicated to a second node. pg_bulkload is fundamentally incompatible with PITR, streaming, and forms of replication that depend o

[GENERAL] Corrupt indexes on slave when using pg_bulkload on master

2012-12-05 Thread James Cowell
I'm using pg_bulkload to load large amounts of CSV data into a postgres database hourly.   This database is replicated to a second node.   Whenever a bulk load happens the indexes on the updated tables on the secondary node corrupt and are unusable until a reindex is run on the primary node.  I