I promised that I will get back to the group with the reason. Well, of course 
was a query :). I do use a search engine file system based(lucene) that will 
take any desired entity saved into the database and find the primary keys and 
then do a select * from entity where id is in (:ids)If I get too many 
matches(3000-4000)... that will delay my postmaster and that postmaster 
associated with the query would take 10-15 minutes to process that query. So, 
now I limit that to 500, anything bigger than that will ask user to refine the 
query.However this whole investigation made me observe some things. On my 
server box 7.4.7 I have some queries that are executing pretty slow 1.2-1.5secs 
it's a lot for a query that goes thru 5000 records. On my local environment 8.1 
the same queries on similar table size executes much faster like 200-400ms. Do 
you know if this is a known issue or my dev box is better than my server box? I 
do have indexes on those fields I have criteria and order by on, I did run the 
reindex and I did a full vacuum. Anything else I need to do or I just need to 
go ahead an do an upgrade to 8.2 ? Another thing I try to figure it out is the 
postgresql.conf setting. I wanted only to log the statements that are taking 
more than 500ms, I enabled that in my conf file but that alone won't track the 
statements. It looks I need pt make log_statement=true but that will track all 
the statements. Is there anything I miss here ?Please let me know what you 
think.MCPs.I heard people complaining about my posting format. I use the 
hotmail web interface and the way they send the message is beyond my control 
;-|> Date: Fri, 8 Jun 2007 18:13:02 -0400> From: [EMAIL PROTECTED]> To: 
pgsql-general@postgresql.org> Subject: Re: [GENERAL] Postmaster processes 
taking all the CPU> > On Fri, Jun 08, 2007 at 05:08:26PM -0500, MC Moisei 
wrote:> > Yes all the connection are coming from within the box so no network> 
> latency.Well, isn't the swap can be because too many process> > postmaster 
are requiring more memory. > > But why are they requring more memory?  Do you 
maybe have (e.g.)> work_mem set too high, and that's what is causing your 
problem?  Or> shared buffers too big?  This is a common error, and on a smaller 
set> of data, it won't hurt; but when the data gets to a point, you lose.> > A> 
> -- > Andrew Sullivan  | [EMAIL PROTECTED]> A certain description of men are 
for getting out of debt, yet are> against all taxes for raising money to pay it 
off.>                --Alexander Hamilton> > ---------------------------(end of 
broadcast)---------------------------> TIP 3: Have you checked our extensive 
FAQ?> >                http://www.postgresql.org/docs/faq

Reply via email to