Re: [PERFORM] database slowdown while a lot of inserts occur

2012-03-29 Thread Scott Marlowe
On Thu, Mar 29, 2012 at 12:02 PM, Campbell, Lance wrote: > I forgot to mention that the slowdown in particular for other applications > is when they are trying to insert or update tables unrelated to the > application mentioned in my prior application that does the massive small > inserts. It sou

Re: [PERFORM] database slowdown while a lot of inserts occur

2012-03-29 Thread Shrirang Chitnis
Lance, Have faced the same issue with thousands of small inserts (actually they were inserts/updates) causing the database to slowdown. You have received good suggestions from the list, but listing them as points will make the issue clearer: 1) Disk configuration: RAID 5 was killing the perfor

Re: [PERFORM] database slowdown while a lot of inserts occur

2012-03-29 Thread Andrew Dunstan
On 03/29/2012 03:27 PM, Bob Lunney wrote: Lance, May small inserts cause frequent fsyncs. Is there any way those small inserts can be batched into some larger sets of inserts that use copy to perform the load? Or possibly a prepared statement called many times in a single transaction,

Re: [PERFORM] database slowdown while a lot of inserts occur

2012-03-29 Thread Bob Lunney
Lance, May small inserts cause frequent fsyncs.  Is there any way those small inserts can be batched into some larger sets of inserts that use copy to perform the load? Bob Lunney From: "Campbell, Lance" To: "Campbell, Lance" ; "pgsql-performance@postgresql.

Re: [PERFORM] database slowdown while a lot of inserts occur

2012-03-29 Thread Deron
On a Linux system you can use tools like "sar" and "iostat" to watch disk activity and view the writes/second or I am sure there are other tools you can use. Watch CPU and memory with "top" If it does appear to be an I/O issue there are some things you can do in either hardware or software, or if

Re: [PERFORM] database slowdown while a lot of inserts occur

2012-03-29 Thread Filippos Kalamidas
can you post all the configuration parameters related to the I/O activity? plus, could you post some stats from 'iostat' when this is happening? thx On Thu, Mar 29, 2012 at 9:02 PM, Campbell, Lance wrote: > I forgot to mention that the slowdown in particular for other > applications is when the

Re: [PERFORM] database slowdown while a lot of inserts occur

2012-03-29 Thread Campbell, Lance
I forgot to mention that the slowdown in particular for other applications is when they are trying to insert or update tables unrelated to the application mentioned in my prior application that does the massive small inserts. Thanks, Lance Campbell Software Architect Web Services at Public Aff

[PERFORM] database slowdown while a lot of inserts occur

2012-03-29 Thread Campbell, Lance
PostgreSQL 9.0.x We have around ten different applications that use the same database. When one particular application is active it does an enormous number of inserts. Each insert is very small. During this time the database seems to slow down in general. The application in question is inser