Re: [PERFORM] performance for high-volume log insertion

2009-04-26 Thread Kris Jurka
Scott Marlowe wrote: On Sun, Apr 26, 2009 at 11:07 AM, Kris Jurka wrote: As a note for non-JDBC users, the JDBC driver's batch interface allows executing multiple statements in a single network roundtrip. This is something you can't get in libpq, so beware of this for comparison's sake.. Re

Re: [PERFORM] performance for high-volume log insertion

2009-04-26 Thread Scott Marlowe
On Sun, Apr 26, 2009 at 11:07 AM, Kris Jurka wrote: > > > On Thu, 23 Apr 2009, Thomas Kellerer wrote: > >> Out of curiosity I did some tests through JDBC. >> >> Using a single-column (integer) table, re-using a prepared statement took >> about 7 seconds to insert 10 rows with JDBC's batch inte

Re: [PERFORM] Using IOZone to simulate DB access patterns

2009-04-26 Thread Mark Wong
On Sat, Apr 11, 2009 at 7:00 PM, Scott Carey wrote: > > > On 4/11/09 11:44 AM, "Mark Wong" wrote: > >> On Fri, Apr 10, 2009 at 11:01 AM, Greg Smith wrote: >>> On Fri, 10 Apr 2009, Scott Carey wrote: >>> FIO with profiles such as the below samples are easy to set up >>> >>> There are some mo

Re: [PERFORM] Using IOZone to simulate DB access patterns

2009-04-26 Thread Mark Wong
On Sat, Apr 11, 2009 at 11:44 AM, Mark Wong wrote: > On Fri, Apr 10, 2009 at 11:01 AM, Greg Smith wrote: >> On Fri, 10 Apr 2009, Scott Carey wrote: >> >>> FIO with profiles such as the below samples are easy to set up >> >> There are some more sample FIO profiles with results from various >> file

Re: [PERFORM] performance for high-volume log insertion

2009-04-26 Thread Thomas
Kris Jurka wrote on 26.04.2009 19:07: Despite the size of the batch passed to the JDBC driver, the driver breaks it up into internal sub-batch sizes of 256 to send to the server. It does this to avoid network deadlocks from sending too much data to the server without reading any in return. If

Re: [PERFORM] performance for high-volume log insertion

2009-04-26 Thread Kris Jurka
On Thu, 23 Apr 2009, Thomas Kellerer wrote: Out of curiosity I did some tests through JDBC. Using a single-column (integer) table, re-using a prepared statement took about 7 seconds to insert 10 rows with JDBC's batch interface and a batch size of 1000 As a note for non-JDBC users,