Re: [PERFORM] 500rows = 1min/2.5k rows=20min/6K rows 2 hours and still running

2007-09-13 Thread Ow Mun Heng
On Wed, 2007-09-12 at 15:14 +0200, Nis Jørgensen wrote: > El-Lotso skrev: > > > I'm on the verge of giving up... the schema seems simple and yet there's > > so much issues with it. Perhaps it's the layout of the data, I don't > > know. But based on the ordering/normalisation of the data and the on

Re: [PERFORM] When/if to Reindex

2007-09-13 Thread Bruce Momjian
This has been saved for the 8.4 release: http://momjian.postgresql.org/cgi-bin/pgpatches_hold --- Tom Lane wrote: > "Steven Flatt" <[EMAIL PROTECTED]> writes: > > So, can we simply trust what's in pg_class.relpages

Re: [PERFORM] Index files

2007-09-13 Thread Tom Lane
"Harsh Azad" <[EMAIL PROTECTED]> writes: > Where are the database index files located in the $PGDATA directory? Read http://www.postgresql.org/docs/8.2/static/storage.html > I was > thinking on soft linking them to another physical hard disk array. Manual symlink management, while not impossible

Re: [PERFORM] Index files

2007-09-13 Thread Ow Mun Heng
On Fri, 2007-09-14 at 08:33 +0530, Harsh Azad wrote: > ah.. thanks. Didn't realize table spaces can be mentioned while > creating a index. BTW, are soft links ok to use for pg_clog / > pg_xlog . I moved the existing directories to /mnt/logs/pglogs and > made soft links for both directories in $PGDA

Re: [PERFORM] Index files

2007-09-13 Thread Harsh Azad
ah.. thanks. Didn't realize table spaces can be mentioned while creating a index. BTW, are soft links ok to use for pg_clog / pg_xlog . I moved the existing directories to /mnt/logs/pglogs and made soft links for both directories in $PGDATA Thanks On 9/14/07, Ow Mun Heng <[EMAIL PROTECTED]> wrote

Re: [PERFORM] Index files

2007-09-13 Thread Ow Mun Heng
On Fri, 2007-09-14 at 08:20 +0530, Harsh Azad wrote: > Hi, > > Where are the database index files located in the $PGDATA directory? I > was thinking on soft linking them to another physical hard disk array. you have to search through pg_class for the "number" Alternatively, you can try using tab

[PERFORM] Index files

2007-09-13 Thread Harsh Azad
Hi, Where are the database index files located in the $PGDATA directory? I was thinking on soft linking them to another physical hard disk array. Thanks, Azad

Re: [PERFORM] Long Running Commits - Not Checkpoints

2007-09-13 Thread Greg Smith
On Thu, 13 Sep 2007, Brad Nicholson wrote: A sysadmin looked at cache usage on the disk array. The read cache is being used heavily, and the write cache is not. Given that information, you can take the below (which I was just about to send before the above update came in) as something to thi

Re: [PERFORM] SAN vs Internal Disks

2007-09-13 Thread Michael Stone
On Tue, Sep 11, 2007 at 06:07:44PM -0500, Decibel! wrote: On Tue, Sep 11, 2007 at 05:09:00PM -0400, Michael Stone wrote: You can get DAS arrays with multiple controllers, PSUs, etc. DAS != single disk. It's still in the same chassis, though, I think you're confusing DAS and internal storage

Re: [PERFORM] Long Running Commits - Not Checkpoints

2007-09-13 Thread Brad Nicholson
On Thu, 2007-09-13 at 12:12 -0400, Greg Smith wrote: > Since you're probably not monitoring I/O waits and similar statistics on > how the disk array's cache is being used, whether this is happening or not > to you won't be obvious from what the operating system is reporting. A sysadmin looked

Re: [PERFORM] random_page_costs - are defaults of 4.0 realistic for SCSI RAID 1

2007-09-13 Thread Gregory Stark
"Gregory Stark" <[EMAIL PROTECTED]> writes: > "Luke Lonergan" <[EMAIL PROTECTED]> writes: > >> Right now the pattern for index scan goes like this: >> >> - Find qualifying TID in index >> - Seek to TID location in relfile >> - Acquire tuple from relfile, return >>... >> If we implement AIO

Re: [PERFORM] Long Running Commits - Not Checkpoints

2007-09-13 Thread Alvaro Herrera
Brad Nicholson wrote: > On Thu, 2007-09-13 at 12:19 -0400, Brad Nicholson wrote: > > On Thu, 2007-09-13 at 12:12 -0400, Greg Smith wrote: > > > On Thu, 13 Sep 2007, Brad Nicholson wrote: > > > > > I'd be curious to see how you've got your background writer configured to > > > see if it matches si

Re: [PERFORM] Long Running Commits - Not Checkpoints

2007-09-13 Thread Brad Nicholson
On Thu, 2007-09-13 at 12:19 -0400, Brad Nicholson wrote: > On Thu, 2007-09-13 at 12:12 -0400, Greg Smith wrote: > > On Thu, 13 Sep 2007, Brad Nicholson wrote: > > > I'd be curious to see how you've got your background writer configured to > > see if it matches situations like this I've seen in th

Re: [PERFORM] [Again] Postgres performance problem

2007-09-13 Thread Scott Marlowe
On 9/13/07, Erik Jones <[EMAIL PROTECTED]> wrote: > On Sep 13, 2007, at 12:58 AM, Greg Smith wrote: > > > On Wed, 12 Sep 2007, Scott Marlowe wrote: > > > >> I'm getting more and more motivated to rewrite the vacuum docs. I > >> think a rewrite from the ground up might be best... I keep seeing > >

Re: [PERFORM] Long Running Commits - Not Checkpoints

2007-09-13 Thread Brad Nicholson
On Thu, 2007-09-13 at 12:12 -0400, Greg Smith wrote: > On Thu, 13 Sep 2007, Brad Nicholson wrote: > I'd be curious to see how you've got your background writer configured to > see if it matches situations like this I've seen in the past. The > parameters controlling the all scan are the ones yo

Re: [PERFORM] Long Running Commits - Not Checkpoints

2007-09-13 Thread Greg Smith
On Thu, 13 Sep 2007, Brad Nicholson wrote: One big difference though is that the old array had 16 GB of cache, the new one has 4 GB. We have enough IO to spare that we have the bgwriter cranked up pretty high, dirty buffers are getting quickly. If your system is very active, running the bgw

Re: [PERFORM] [Again] Postgres performance problem

2007-09-13 Thread Erik Jones
On Sep 13, 2007, at 12:58 AM, Greg Smith wrote: On Wed, 12 Sep 2007, Scott Marlowe wrote: I'm getting more and more motivated to rewrite the vacuum docs. I think a rewrite from the ground up might be best... I keep seeing people doing vacuum full on this list and I'm thinking it's as mu

Re: [PERFORM] Long Running Commits - Not Checkpoints

2007-09-13 Thread Brad Nicholson
On Thu, 2007-09-13 at 11:10 -0400, Tom Lane wrote: > Brad Nicholson <[EMAIL PROTECTED]> writes: > > On Thu, 2007-09-13 at 10:15 -0400, Brad Nicholson wrote: > >> I'm having a problem with long running commits appearing in my database > >> logs. It may be hardware related, as the problem appeared w

Re: [PERFORM] [Again] Postgres performance problem

2007-09-13 Thread Gavin M. Roy
How many backends do you have at any given time? Have you tried using something like pgBouncer to lower backend usage? How about your IO situation? Have you run something like sysstat to see what iowait is at? On 9/11/07, Ruben Rubio <[EMAIL PROTECTED]> wrote: > -BEGIN PGP SIGNED MESSAGE---

Re: [PERFORM] Long Running Commits - Not Checkpoints

2007-09-13 Thread Tom Lane
Brad Nicholson <[EMAIL PROTECTED]> writes: > On Thu, 2007-09-13 at 10:15 -0400, Brad Nicholson wrote: >> I'm having a problem with long running commits appearing in my database >> logs. It may be hardware related, as the problem appeared when we moved >> the database to a new server connected to a

Re: [PERFORM] Clustered tables improves perfs ?

2007-09-13 Thread Chris Browne
[EMAIL PROTECTED] (Patrice Castet) writes: > I wonder if clustering a table improves perfs somehow ? > Any example/ideas about that ? > ref : http://www.postgresql.org/docs/8.2/interactive/sql-cluster.html Sometimes. 1. It compacts the table, which may be of value, particularly if the table is n

Re: [PERFORM] Long Running Commits - Not Checkpoints

2007-09-13 Thread Brad Nicholson
On Thu, 2007-09-13 at 10:15 -0400, Brad Nicholson wrote: > I'm having a problem with long running commits appearing in my database > logs. It may be hardware related, as the problem appeared when we moved > the database to a new server connected to a different disk array. The > disk array is a lo

Re: [PERFORM] [Again] Postgres performance problem

2007-09-13 Thread Scott Marlowe
On 9/13/07, Greg Smith <[EMAIL PROTECTED]> wrote: > On Wed, 12 Sep 2007, Scott Marlowe wrote: > > > I'm getting more and more motivated to rewrite the vacuum docs. I think > > a rewrite from the ground up might be best... I keep seeing people > > doing vacuum full on this list and I'm thinking it

[PERFORM] Long Running Commits - Not Checkpoints

2007-09-13 Thread Brad Nicholson
I'm having a problem with long running commits appearing in my database logs. It may be hardware related, as the problem appeared when we moved the database to a new server connected to a different disk array. The disk array is a lower class array, but still more than powerful enough to handle th

Re: [PERFORM] Clustered tables improves perfs ?

2007-09-13 Thread Alexander Staubo
On 9/13/07, Patrice Castet <[EMAIL PROTECTED]> wrote: > I wonder if clustering a table improves perfs somehow ? As I understand it, clustering will help cases where you are fetching data in the same sequence as the clustering order, because adjacent rows will be located in adjacent pages on disk;

[PERFORM] Clustered tables improves perfs ?

2007-09-13 Thread Patrice Castet
hi! I wonder if clustering a table improves perfs somehow ? Any example/ideas about that ? ref : http://www.postgresql.org/docs/8.2/interactive/sql-cluster.html thx, P. ---(end of broadcast)--- TIP 4: Have you searched our list archives?

[PERFORM] Index usage when bitwise operator is used

2007-09-13 Thread W.Alphonse HAROUNY
Hello, My question is about index usage when bitwise operations are invoked. Situation Context: -- Lets suppose we have 2 tables TBL1 and TBL2 as the following: TBL1 { . ; integer categoryGroup; // categoryGroup is declared as an index on TABL1 . ; }