Re: [PERFORM] bulk insert performance problem

2008-04-08 Thread PFC
I have a performance problem with a script that does massive bulk insert in 6 tables. When the script starts the performance is really good but will degrade minute after minute and take almost a day to finish! Looks like foreign key checks slow you down. - Batch INSERTS in trans

Re: [PERFORM] bulk insert performance problem

2008-04-08 Thread Matthew
On Tue, 8 Apr 2008, Mark Stosberg wrote: Any idea? Is there any other improvements I could do? Are you using the "COPY" syntax in the import script or individual insert statements? Using COPY will always be *much* faster. PostgreSQL (latest versions at least) has an optimisation if you creat

Re: [PERFORM] bulk insert performance problem

2008-04-08 Thread Mark Stosberg
Christian Bourque wrote: Any idea? Is there any other improvements I could do? Are you using the "COPY" syntax in the import script or individual insert statements? Using COPY will always be *much* faster. I believe COPY always appends to tables rather than replacing the contents, you can

Re: [PERFORM] bulk insert performance problem

2008-04-08 Thread hubert depesz lubaczewski
On Mon, Apr 07, 2008 at 11:01:18PM -0400, Christian Bourque wrote: > I have a performance problem with a script that does massive bulk > insert in 6 tables. When the script starts the performance is really > good but will degrade minute after minute and take almost a day to > finish! how do you do

Re: [PERFORM] bulk insert performance problem

2008-04-07 Thread bitaoxiao
I use 1 rows,have big blob 2008-04-08 bitaoxiao 发件人: Chris 发送时间: 2008-04-08 11:35:57 收件人: Christian Bourque 抄送: pgsql-performance@postgresql.org 主题: Re: [PERFORM] bulk insert performance problem Craig Ringer wrote: > Christian Bourque wrote: >> Hi, >> >>

Re: [PERFORM] bulk insert performance problem

2008-04-07 Thread Chris
Craig Ringer wrote: Christian Bourque wrote: Hi, I have a performance problem with a script that does massive bulk insert in 6 tables. When the script starts the performance is really good but will degrade minute after minute and take almost a day to finish! Would I be correct in guessing th

Re: [PERFORM] bulk insert performance problem

2008-04-07 Thread Craig Ringer
Christian Bourque wrote: Hi, I have a performance problem with a script that does massive bulk insert in 6 tables. When the script starts the performance is really good but will degrade minute after minute and take almost a day to finish! Would I be correct in guessing that there are foreign

[PERFORM] bulk insert performance problem

2008-04-07 Thread Christian Bourque
Hi, I have a performance problem with a script that does massive bulk insert in 6 tables. When the script starts the performance is really good but will degrade minute after minute and take almost a day to finish! I almost tried everything suggested on this list, changed our external raid array f