Re: [PERFORM] 8.4.1 ubuntu karmic slow createdb

2009-12-28 Thread Thomas Kellerer
Michael Clemmons wrote on 11.12.2009 23:52: Thanks all this has been a good help. I don't have control(or easy control) over unit tests creating/deleting databases since Im using the django framework for this job. Createdb takes 12secs on my system(9.10 pg8.4 and ext4) which is impossibly slow

Re: [PERFORM] 8.4.1 ubuntu karmic slow createdb

2009-12-12 Thread Robert Haas
On Fri, Dec 11, 2009 at 5:12 PM, Scott Marlowe wrote: > On Fri, Dec 11, 2009 at 2:59 PM, Scott Mead > wrote: >> On Fri, Dec 11, 2009 at 4:39 PM, Nikolas Everett wrote: >>> >>> >>> >>> Fair enough.  I'm of the opinion that developers need to have their unit >>> tests run fast.  If they aren't fas

Re: [PERFORM] 8.4.1 ubuntu karmic slow createdb

2009-12-12 Thread Andres Freund
On Saturday 12 December 2009 21:36:27 Michael Clemmons wrote: > If ppl think its worth it I'll create a ticket Thanks, no need. I will post a patch tomorrow or so. Andres -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://ww

Re: [PERFORM] 8.4.1 ubuntu karmic slow createdb

2009-12-12 Thread Michael Clemmons
If ppl think its worth it I'll create a ticket On Sat, Dec 12, 2009 at 6:09 AM, Hannu Krosing wrote: > On Sat, 2009-12-12 at 01:19 +0100, Andres Freund wrote: > > Hi, > > > > On Saturday 12 December 2009 00:59:13 Scott Marlowe wrote: > > > On Fri, Dec 11, 2009 at 3:52 PM, Michael Clemmons > > > >

Re: [PERFORM] 8.4.1 ubuntu karmic slow createdb

2009-12-11 Thread Andres Freund
Hi, On Saturday 12 December 2009 00:59:13 Scott Marlowe wrote: > On Fri, Dec 11, 2009 at 3:52 PM, Michael Clemmons > > Createdb takes > > 12secs on my system(9.10 pg8.4 and ext4) which is impossibly slow for > > running 200unittests. > > Fsync got it to .2secs or so which is blazing but > > als

Re: [PERFORM] 8.4.1 ubuntu karmic slow createdb

2009-12-11 Thread Scott Marlowe
On Fri, Dec 11, 2009 at 3:52 PM, Michael Clemmons wrote: > Thanks all this has been a good help. > I don't have control(or easy control) over unit tests creating/deleting > databases since Im using the django framework for this job. Reminds of the issues we had with Ruby on Rails and it's (at the

Re: [PERFORM] 8.4.1 ubuntu karmic slow createdb

2009-12-11 Thread Michael Clemmons
Thanks all this has been a good help. I don't have control(or easy control) over unit tests creating/deleting databases since Im using the django framework for this job. Createdb takes 12secs on my system(9.10 pg8.4 and ext4) which is impossibly slow for running 200unittests. Fsync got it to .2s

Re: [PERFORM] 8.4.1 ubuntu karmic slow createdb

2009-12-11 Thread Greg Smith
Scott Mead wrote: The other common issue is that developers running with something like 'fsync=off' means that they have completely unrealistic expectations of the performance surrounding something. Right, but the flip side here is that often the production server will have hardware such as a c

Re: [PERFORM] 8.4.1 ubuntu karmic slow createdb

2009-12-11 Thread Scott Marlowe
On Fri, Dec 11, 2009 at 3:12 PM, Scott Carey wrote: > > On 12/11/09 1:57 PM, "Scott Marlowe" wrote: > >> >> This is my big issue.  dropping / creating databases for unit tests is >> overkill.  Running any DDL at all for a unit test seems wrong to me >> too.  Insert a row if you need it, MAYBE.  U

Re: [PERFORM] 8.4.1 ubuntu karmic slow createdb

2009-12-11 Thread Scott Carey
On 12/11/09 1:57 PM, "Scott Marlowe" wrote: > > This is my big issue. dropping / creating databases for unit tests is > overkill. Running any DDL at all for a unit test seems wrong to me > too. Insert a row if you need it, MAYBE. Unit tests should work with > a test database that HAS the st

Re: [PERFORM] 8.4.1 ubuntu karmic slow createdb

2009-12-11 Thread Scott Marlowe
On Fri, Dec 11, 2009 at 2:59 PM, Scott Mead wrote: > On Fri, Dec 11, 2009 at 4:39 PM, Nikolas Everett wrote: >> >> >> >> Fair enough.  I'm of the opinion that developers need to have their unit >> tests run fast.  If they aren't fast then your just not going to test as >> much as you should.  If

Re: [PERFORM] 8.4.1 ubuntu karmic slow createdb

2009-12-11 Thread Scott Mead
On Fri, Dec 11, 2009 at 4:39 PM, Nikolas Everett wrote: > > > > Fair enough. I'm of the opinion that developers need to have their unit > tests run fast. If they aren't fast then your just not going to test as > much as you should. If your unit tests *have* to createdb then you have to > do wh

Re: [PERFORM] 8.4.1 ubuntu karmic slow createdb

2009-12-11 Thread Scott Marlowe
On Fri, Dec 11, 2009 at 2:39 PM, Nikolas Everett wrote: > > > On Fri, Dec 11, 2009 at 3:50 PM, Joshua D. Drake > wrote: >> >> On Fri, 2009-12-11 at 15:43 -0500, Nikolas Everett wrote: >> > Turning fsync off on a dev database is a bad idea?  Sure you might >> > kill it and have to start over, but

Re: [PERFORM] 8.4.1 ubuntu karmic slow createdb

2009-12-11 Thread Nikolas Everett
On Fri, Dec 11, 2009 at 3:50 PM, Joshua D. Drake wrote: > On Fri, 2009-12-11 at 15:43 -0500, Nikolas Everett wrote: > > Turning fsync off on a dev database is a bad idea? Sure you might > > kill it and have to start over, but thats kind of the point in a dev > > database. > > My experience is tha

Re: [PERFORM] 8.4.1 ubuntu karmic slow createdb

2009-12-11 Thread Joshua D. Drake
On Fri, 2009-12-11 at 15:43 -0500, Nikolas Everett wrote: > Turning fsync off on a dev database is a bad idea? Sure you might > kill it and have to start over, but thats kind of the point in a dev > database. My experience is that bad dev practices turn into bad production practices, whether inte

Re: [PERFORM] 8.4.1 ubuntu karmic slow createdb

2009-12-11 Thread Nikolas Everett
Turning fsync off on a dev database is a bad idea? Sure you might kill it and have to start over, but thats kind of the point in a dev database. On Fri, Dec 11, 2009 at 12:58 PM, Joshua D. Drake wrote: > On Thu, 2009-12-10 at 20:38 -0500, Nikolas Everett wrote: > > In my limited experience ext4

Re: [PERFORM] 8.4.1 ubuntu karmic slow createdb

2009-12-11 Thread Joshua D. Drake
On Thu, 2009-12-10 at 20:38 -0500, Nikolas Everett wrote: > In my limited experience ext4 as presented by Karmic is not db > friendly. I had to carve my swap partition into a swap partition and > an xfs partition to get better db performance. Try fsync=off first, > but if that doesn't work then t

Re: [PERFORM] 8.4.1 ubuntu karmic slow createdb

2009-12-10 Thread Nikolas Everett
In my limited experience ext4 as presented by Karmic is not db friendly. I had to carve my swap partition into a swap partition and an xfs partition to get better db performance. Try fsync=off first, but if that doesn't work then try a mini xfs. On Thu, Dec 10, 2009 at 5:09 PM, Andres Freund w

Re: [PERFORM] 8.4.1 ubuntu karmic slow createdb

2009-12-10 Thread Andres Freund
Hi, On Thursday 10 December 2009 23:01:08 Michael Clemmons wrote: > Im not sure what that means ppl in my office with slower hd speeds using > 8.4 can create a db in 2s vs my 8-12s. - Possibly their config is different - they could have disabled the "fsync" parameter which turns the database to

Re: [PERFORM] 8.4.1 ubuntu karmic slow createdb

2009-12-10 Thread Michael Clemmons
Im not sure what that means ppl in my office with slower hd speeds using 8.4 can create a db in 2s vs my 8-12s. Could using md5 instead of ident do it? On Thu, Dec 10, 2009 at 4:56 PM, Andres Freund wrote: > On Thursday 10 December 2009 21:41:08 Michael Clemmons wrote: > > Hey, > > I've got a c

Re: [PERFORM] 8.4.1 ubuntu karmic slow createdb

2009-12-10 Thread Andres Freund
On Thursday 10 December 2009 21:41:08 Michael Clemmons wrote: > Hey, > I've got a computer which runs but 8.3 and 8.4. To create a db it takes 4s > for 8.3 and 9s for 8.4. I have many unit tests which create databases all > of the time and now run much slower than 8.3 but it seems to be much long