Re: [PERFORM] Slow response of PostgreSQL

2004-02-19 Thread Saleem Burhani Baloch
Hi,

Thanks every one for helping me. I have upgraded to 7.4.1 on redhat 8 ( rh 9 require a 
lot of lib's) and set the configuration sent by Chris. Now the query results in 6.3 
sec waooo. I m thinking that why the 7.1 process aggregate slowly. Anyway.

I still have to go for 2 sec result and now I m thinking to go for Free BSD 5.2.

The record locking by "select . update for" is working fine, but a situation 
arrises when the second user goes for locking the record,  the task will wait untill 
the first user ends up his work. IS their is a way that we can know or get a message 
that the row/record is already locked by some one else.

Thanks for help.

Saleem


---(end of broadcast)---
TIP 7: don't forget to increase your free space map settings


Re: [PERFORM] Slow response of PostgreSQL

2004-02-19 Thread Shridhar Daithankar
On Thursday 19 February 2004 14:31, Saleem Burhani Baloch wrote:
> Hi,
>
> Thanks every one for helping me. I have upgraded to 7.4.1 on redhat 8 ( rh
> 9 require a lot of lib's) and set the configuration sent by Chris. Now the
> query results in 6.3 sec waooo. I m thinking that why the 7.1 process
> aggregate slowly. Anyway.
>
> I still have to go for 2 sec result and now I m thinking to go for Free BSD
> 5.2.

Before that you can try something with kernel 2.6.3. I think it could make the 
difference you are looking at.

> The record locking by "select . update for" is working fine, but a
> situation arrises when the second user goes for locking the record,  the
> task will wait untill the first user ends up his work. IS their is a way
> that we can know or get a message that the row/record is already locked by
> some one else.

Right now, it is hotly debated on HACKERS about adding a NOWAIT clause to 
SELECT FOR UPDATE. If you think your application deployment is away for 
months and can try CVS head, you can expect some action on it in coming few 
days.

As a side bonus you would be benefitted by performance and scalability 
additions that won't make there way in 7.4 stream.

HTH

 Shridhar

---(end of broadcast)---
TIP 9: the planner will ignore your desire to choose an index scan if your
  joining column's datatypes do not match


Re: [PERFORM] Slow response of PostgreSQL

2004-02-19 Thread Christopher Kings-Lynne
> Thanks every one for helping me. I have upgraded to 7.4.1 on redhat 8 (
> rh 9 require a lot of lib's) and set the configuration sent by Chris.
> Now the query results in 6.3 sec waooo. I m thinking that why the 7.1
> process aggregate slowly. Anyway.

I'm glad we could help you Saleem :)

We knew PostgreSQL wasn't that slow :P

Chris



---(end of broadcast)---
TIP 7: don't forget to increase your free space map settings


[PERFORM] Postgresql on SAN

2004-02-19 Thread Anjan Dave
Title: Message



Hello,
 
Has anyone 
designed/implemented postgresql server on storage networks?
 
Are there any design 
considerations?
 
Are there any 
benchmarks for storage products (HBAs, Switches, Storage 
Arrays)?
 
Any recommendation 
on the design, resources, references, keeping PG in mind?
 
 
Thanks,Anjan
 

** 

This e-mail and any files transmitted with it are intended for the use of the 
addressee(s) only and may be confidential and covered by the attorney/client and 
other privileges. If you received this e-mail in error, please notify the 
sender; do not disclose, copy, distribute, or take any action in reliance on the 
contents of this information; and delete it from your system. Any other use of 
this e-mail is prohibited.
 


Re: [PERFORM] Postgresql on SAN

2004-02-19 Thread Josh Berkus
Anjan,

> Has anyone designed/implemented postgresql server on storage networks?

Yes, Zapatec.com runs their stuff this way.  Probably others as well.

> Are there any design considerations?

I don't know.   Probably.

> Are there any benchmarks for storage products (HBAs, Switches, Storage
> Arrays)?

Not specific to PostgreSQL.I'm sure there are generic benchmarks.   Keep 
in mind that PostgreSQL needs lots of 2-way I/O, batch writes, and random 
reads.

> Any recommendation on the design, resources, references, keeping PG in
> mind?

See above.   Also keep in mind that PostgreSQL's use of I/O should improve 
100% in version 7.5.

-- 
-Josh Berkus
 Aglio Database Solutions
 San Francisco


---(end of broadcast)---
TIP 3: if posting/reading through Usenet, please send an appropriate
  subscribe-nomail command to [EMAIL PROTECTED] so that your
  message can get through to the mailing list cleanly


Re: [PERFORM] Forcing filter/join order?

2004-02-19 Thread Josh Berkus
Tom,

> Uh, why do you need the child table?  

Because there's linked information which needs to be kept by day for multi-day 
events.   Also, it makes calendar reports easier, where one wants each day of 
a multi-day event to appear on each day of the calendar.

>Seems like the correct incantation
> given an assumption about maximum duration is
> 
> event_date <= 'end-date' AND (event_date + duration) >= 'start-date'
> AND event_date >= 'start-date' - 'max-duration'

H ... so the same as what I have, only with the extra condition for 
event_date+duration and without the IN clause.   I'll try it, thanks!

-- 
-Josh Berkus
 Aglio Database Solutions
 San Francisco


---(end of broadcast)---
TIP 9: the planner will ignore your desire to choose an index scan if your
  joining column's datatypes do not match


Re: [PERFORM] Postgresql on SAN

2004-02-19 Thread Nick Barr
Josh Berkus wrote:

Anjan,

 

Has anyone designed/implemented postgresql server on storage networks?
   

Yes, Zapatec.com runs their stuff this way.  Probably others as well.

 

Are there any design considerations?
   

I don't know.   Probably.

 

Are there any benchmarks for storage products (HBAs, Switches, Storage
Arrays)?
   

Not specific to PostgreSQL.I'm sure there are generic benchmarks.   Keep 
in mind that PostgreSQL needs lots of 2-way I/O, batch writes, and random 
reads.

 

Any recommendation on the design, resources, references, keeping PG in
mind?
   

See above.   Also keep in mind that PostgreSQL's use of I/O should improve 
100% in version 7.5.

 

We run PG on a SAN array. We currently have it setup so a single PG 
instance runs off of a single LUN, this includes the WAL logs. Apart 
from that we have made no other special considerations; we just treat it 
as a fast RAID array. We haven't got to the stage where the speed of the 
SAN is a problem as load hasn't increased as expected. This will change, 
when it does I am sure the performance list will be hearing from us ;-). 
Out current limitations, as I see it, are amount of memory and then 
processing power. The only problem we have had was a dodgy set of kernel 
modules (drivers) for the fibre cards, this was because they were beta 
drivers and obviously still had a few bugs. This was solved by reverting 
to an older version. Everything has run smoothly since then (uptime is 
153 days :-)).

Nick



---(end of broadcast)---
TIP 1: subscribe and unsubscribe commands go to [EMAIL PROTECTED]


Re: [PERFORM] Slow response of PostgreSQL

2004-02-19 Thread Hannu Krosing
Saleem Burhani Baloch kirjutas N, 19.02.2004 kell 11:01:
> Hi,
> 
> Thanks every one for helping me. I have upgraded to 7.4.1 on 
> redhat 8 ( rh 9 require a lot of lib's) and set the configuration 
> sent by Chris. Now the query results in 6.3 sec waooo. I m thinking 
> that why the 7.1 process aggregate slowly. Anyway.
> 
> I still have to go for 2 sec result 

What is the plan now ?


Hannu


---(end of broadcast)---
TIP 5: Have you checked our extensive FAQ?

   http://www.postgresql.org/docs/faqs/FAQ.html


Re: [PERFORM] Optimizer difference using function index between 7.3 and 7.4

2004-02-19 Thread Simon Riggs
>Jeff Boes writes
>  # explain select link_id from links l join clm_tmp_links t on
> (fn_urlrev(l.path_base) = t.rev_path_base);

> executes in 59.8 seconds!

> Now the odd part: if I change the query to this:
> 
> # explain analyze select link_id from links l join clm_tmp_links t on
> (fn_urlrev(l.path_base) = fn_urlrev(t.rev_path_base));

>  Total runtime: 18.125 ms
> 
> (i.e., apply the function to the data in the temp table), it runs a
> whole lot faster! Is this a bug in the optimizer? Or did something
> change about the way functional indexes are used?

Erm..I may have misunderstood your example, but surely the second
formulation of your query returns the wrong answer? It looks to me as if
you are comparing a reversed URL with a twice-reversed URL; if that's
true that would explain why it runs faster: They don't ever match. Is
that right?
 
Thanks for the idea of reversing the URLs, nice touch. I'd been thinking
about reverse key indexes as a way of relieving the hotspot down the
rightmost edge of an index during heavy insert traffic. I hadn't thought
this would also speed up the access also. 

Best Regards, Simon Riggs


---(end of broadcast)---
TIP 6: Have you searched our list archives?

   http://archives.postgresql.org


Re: [PERFORM] Forcing filter/join order?

2004-02-19 Thread Josh Berkus
Tom,

> event_date <= 'end-date' AND (event_date + duration) >= 'start-date'
> AND event_date >= 'start-date' - 'max-duration'

Great suggestion!   We're down to 160ms, from about 370ms with my subselect 
workaround.   Thanks!

-- 
-Josh Berkus
 Aglio Database Solutions
 San Francisco


---(end of broadcast)---
TIP 6: Have you searched our list archives?

   http://archives.postgresql.org