Re: [PERFORM] Performance issue with 8.2.3 - "C" application

2007-07-24 Thread Nis Jørgensen
Karl Denninger skrev: > I've got an interesting issue here that I'm running into with 8.2.3 > > This is an application that has run quite well for a long time, and has > been operating without significant changes (other than recompilation) > since back in the early 7.x Postgres days. But now we'r

Re: [PERFORM] Performance issue with 8.2.3 - "C" application

2007-07-24 Thread Karl Denninger
Aha! BIG difference. I won't know for sure until the biz day tomorrow but the "first blush" look is that it makes a HUGE difference in system load, and I no longer have the stats collector process on the top of the "top" list.. Karl Denninger ([EMAIL PROTECTED]) http://www.denninger.net

Re: [PERFORM] Performance issue with 8.2.3 - "C" application

2007-07-24 Thread Tom Lane
Karl Denninger <[EMAIL PROTECTED]> writes: > Hm. now that's interesting. Stats collector IS accumulating > quite a bit of runtime. me thinks its time to go grab 8.2.4. I think Merlin might have nailed it --- the "stats collector bug" is that it tries to write out the stats file way m

Re: [PERFORM] Performance issue with 8.2.3 - "C" application

2007-07-24 Thread Karl Denninger
Hm. now that's interesting. Stats collector IS accumulating quite a bit of runtime. me thinks its time to go grab 8.2.4. Karl Denninger ([EMAIL PROTECTED]) http://www.denninger.net Merlin Moncure wrote: On 7/25/07, Karl Denninger <[EMAIL PROTECTED]> wrote: Yeah, the problem

Re: [PERFORM] Performance issue with 8.2.3 - "C" application

2007-07-24 Thread Merlin Moncure
On 7/25/07, Karl Denninger <[EMAIL PROTECTED]> wrote: Yeah, the problem doesn't appear to be there. As I said, if I look at the PS of the system when its bogging, there aren't a whole bunch of processes stuck doing these, so while this does take a second or two to come back, that's not that ba

Re: [PERFORM] Performance issue with 8.2.3 - "C" application

2007-07-24 Thread Karl Denninger
Yeah, the problem doesn't appear to be there. As I said, if I look at the PS of the system when its bogging, there aren't a whole bunch of processes stuck doing these, so while this does take a second or two to come back, that's not that bad. Its GENERAL performance that just bites - the syst

Re: [PERFORM] Performance issue with 8.2.3 - "C" application

2007-07-24 Thread Tom Lane
Karl Denninger <[EMAIL PROTECTED]> writes: > But here's the query that has a habit of taking the most time > select forum, * from post where toppost = 1 and (replied > (select > lastview from forumlog where login='theuser' and forum=post.forum and > number is null)) is not false AND (rep

[PERFORM] Performance issue with 8.2.3 - "C" application

2007-07-24 Thread Karl Denninger
I've got an interesting issue here that I'm running into with 8.2.3 This is an application that has run quite well for a long time, and has been operating without significant changes (other than recompilation) since back in the early 7.x Postgres days. But now we're seeing a LOT more load tha

Re: [PERFORM] 8.2 -> 8.3 performance numbers

2007-07-24 Thread Merlin Moncure
On 7/20/07, Josh Berkus <[EMAIL PROTECTED]> wrote: Jim, > Has anyone benchmarked HEAD against 8.2? I'd like some numbers to use in > my OSCon lightning talk. Numbers for both with and without HOT would be > even better (I know we've got HOT-specific benchmarks, but I want > complete 8.2 -> 8.3 n

Re: [PERFORM] index over timestamp not being used

2007-07-24 Thread Tom Lane
Arnau <[EMAIL PROTECTED]> writes: >> Alternatively, do you really need to_timestamp at all? The standard >> timestamp input routine won't have any problem with that format: >> t.timestamp_in >= '20070101' > This is always I think I'm worried, what happens if one day the internal > format in whic

Re: [PERFORM] index over timestamp not being used

2007-07-24 Thread Arnau
Hi Tom, Alternatively, do you really need to_timestamp at all? The standard timestamp input routine won't have any problem with that format: t.timestamp_in >= '20070101' This is always I think I'm worried, what happens if one day the internal format in which the DB stores the date/times

Re: [PERFORM] index over timestamp not being used

2007-07-24 Thread Tom Lane
Arnau <[EMAIL PROTECTED]> writes: > timestamp_in | timestamp without time zone | default now() > SELECT ... > FROM > transactions t > LEFT OUTER JOIN statistics s ON t.transaction_id = s.transaction_id > WHERE > t.timestamp_in >= to_timestamp('20070101', 'MMDD') > GROUP BY date,

Re: [PERFORM] Table Statistics with pgAdmin III

2007-07-24 Thread Campbell, Lance
All of the fields are zero except for the three I listed in my posting. Thanks, Lance Campbell Project Manager/Software Architect Web Services at Public Affairs University of Illinois 217.333.0382 http://webservices.uiuc.edu -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROT

[PERFORM] index over timestamp not being used

2007-07-24 Thread Arnau
Hi all, I've got the following two tables running on postgresql 8.1.4 transactions Column |Type | Modifiers --+-+--- transaction_id| character varying(32) | not null u

Re: [PERFORM] Table Statistics with pgAdmin III

2007-07-24 Thread Dave Page
> --- Original Message --- > From: Jean-Max Reymond <[EMAIL PROTECTED]> > To: pgsql-performance@postgresql.org > Sent: 24/07/07, 18:23:53 > Subject: Re: [PERFORM] Table Statistics with pgAdmin III > > Campbell, Lance a écrit : > > I have installed pgAdmin III 1.6. In the tool when you c

Re: [PERFORM] Table Statistics with pgAdmin III

2007-07-24 Thread Jean-Max Reymond
Campbell, Lance a écrit : I have installed pgAdmin III 1.6. In the tool when you click on a particular table you can select a tab called “Statistics”. This tab has all kinds of info on your table. For some reason the only info I see is for table size, toast table size and indexes size. Is t

[PERFORM] Table Statistics with pgAdmin III

2007-07-24 Thread Campbell, Lance
I have installed pgAdmin III 1.6. In the tool when you click on a particular table you can select a tab called "Statistics". This tab has all kinds of info on your table. For some reason the only info I see is for table size, toast table size and indexes size. Is there a reason that the other 1

Re: [PERFORM] Postgres configuration for 64 CPUs, 128 GB RAM...

2007-07-24 Thread Marc Mamin
Hello, thank you for all your comments and recommendations. I'm aware that the conditions for this benchmark are not ideal, mostly due to the lack of time to prepare it. We will also need an additional benchmark on a less powerful - more realistic - server to better understand the scability of

Re: [PERFORM] Query performance issue

2007-07-24 Thread Jonathan Gray
That particular plan is our goal because we've "hacked" it together to perform better than the normal sql plans. Analytically it makes sense to approach this particular problem in this way because it is relatively invariant to the distributions and sizes of the tables (with only having to deal wit

Re: [PERFORM] Query performance issue

2007-07-24 Thread Chris
Jonathan Gray wrote: Chris, Creating indexes on the customerclass table does speed up the queries but still does not create the plan we are looking for (using the double index with a backward index scan on the orders table). Stupid question - why is that particular plan your "goal" plan? The

Re: [PERFORM] Query performance issue

2007-07-24 Thread Jonathan Gray
Chris, Creating indexes on the customerclass table does speed up the queries but still does not create the plan we are looking for (using the double index with a backward index scan on the orders table). The plans we now get, with times on par or slightly better than with the plpgsql hack, are:

Re: [PERFORM] Query performance issue

2007-07-24 Thread Chris
Chris wrote: Jonathan Gray wrote: We’re experiencing a query performance problem related to the planner and its ability to perform a specific type of merge. We have created a test case (as attached, or here: http://www3.streamy.com/postgres/indextest.sql) which involves a hypothetical cus

Re: [PERFORM] Query performance issue

2007-07-24 Thread Chris
Jonathan Gray wrote: We’re experiencing a query performance problem related to the planner and its ability to perform a specific type of merge. We have created a test case (as attached, or here: http://www3.streamy.com/postgres/indextest.sql) which involves a hypothetical customer ordering

Re: [PERFORM] multicolumn index column order

2007-07-24 Thread andrew
valgog <[EMAIL PROTECTED]> wrote .. > On Jul 23, 7:00 pm, [EMAIL PROTECTED] (Tom Lane) wrote: > > valgog <[EMAIL PROTECTED]> writes: > > > how to build an multicolumn index with one column order ASCENDING and > > > another column order DESCENDING? > > > > Use 8.3 ;-) > > > > In existing releases yo

Re: [PERFORM] multicolumn index column order

2007-07-24 Thread Valentine Gogichashvili
On 7/24/07, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote: valgog <[EMAIL PROTECTED]> wrote .. > On Jul 23, 7:00 pm, [EMAIL PROTECTED] (Tom Lane) wrote: > > valgog <[EMAIL PROTECTED]> writes: > > > how to build an multicolumn index with one column order ASCENDING and > > > another column order DES

Re: [PERFORM] disable archiving

2007-07-24 Thread valgog
On Jul 23, 7:24 pm, [EMAIL PROTECTED] (Paul van den Bogaard) wrote: > the manual somewhere states "... if archiving is enabled..." To me > this implies that archiving can be disabled. However I cannot find > the parameter to use to get this result. Or should I enable archiving > and use a backup sc