Re: [PERFORM] How to get higher tps

2006-08-22 Thread Marty Jia
Original Message- > From: Bucky Jordan [mailto:[EMAIL PROTECTED] > Sent: Tuesday, August 22, 2006 3:23 PM > To: Joshua D. Drake; Marty Jia > Cc: Alex Turner; Mark Lewis; pgsql-performance@postgresql.org; DBAs; > Rich Wilson; Ernest Wurzbach > Subject: RE: [PERFORM] How to

Re: [PERFORM] How to get higher tps

2006-08-22 Thread Bucky Jordan
ync)" I get ~255 mb/s from the above. Bucky -Original Message- From: Marty Jia [mailto:[EMAIL PROTECTED] Sent: Tuesday, August 22, 2006 3:38 PM To: Bucky Jordan; Joshua D. Drake Cc: Alex Turner; Mark Lewis; pgsql-performance@postgresql.org; DBAs; Rich Wilson; Ernest Wurzbach Subject:

Re: [PERFORM] How to get higher tps

2006-08-22 Thread Joshua D. Drake
. Drake; Marty Jia Cc: Alex Turner; Mark Lewis; pgsql-performance@postgresql.org; DBAs; Rich Wilson; Ernest Wurzbach Subject: RE: [PERFORM] How to get higher tps Marty, Here's pgbench results from a stock FreeBSD 6.1 amd64/PG 8.1.4 install on a Dell Poweredge 2950 with 8gb ram, 2x3.0 dual

Re: [PERFORM] How to get higher tps

2006-08-22 Thread Marty Jia
; DBAs; Rich Wilson; Ernest Wurzbach Subject: RE: [PERFORM] How to get higher tps Marty, Here's pgbench results from a stock FreeBSD 6.1 amd64/PG 8.1.4 install on a Dell Poweredge 2950 with 8gb ram, 2x3.0 dual-core woodcrest (4MB cache/socket) with 6x300GB 10k SAS drives: pgbench -c 10 -t 100

Re: [PERFORM] How to get higher tps

2006-08-22 Thread Bucky Jordan
AIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Joshua D. Drake Sent: Tuesday, August 22, 2006 12:16 PM To: Marty Jia Cc: Alex Turner; Mark Lewis; pgsql-performance@postgresql.org; DBAs; Rich Wilson; Ernest Wurzbach Subject: Re: [PERFORM] How to get higher tps Marty Jia wrote: > Here is

Re: [PERFORM] How to get higher tps

2006-08-22 Thread Joshua D. Drake
From: Alex Turner [mailto:[EMAIL PROTECTED] Sent: Tuesday, August 22, 2006 11:27 AM To: Mark Lewis Cc: Marty Jia; Joshua D. Drake; pgsql-performance@postgresql.org; DBAs; Rich Wilson; Ernest Wurzbach Subject: Re: [PERFORM] How to get higher tps Oh - and it&#

Re: [PERFORM] How to get higher tps

2006-08-22 Thread Marty Jia
_size = 61 random_page_cost = 3 Thanks -Original Message- From: Ron [mailto:[EMAIL PROTECTED] Sent: Tuesday, August 22, 2006 11:47 AM To: Marty Jia Cc: pgsql-performance@postgresql.org Subject: Re: [PERFORM] How to get higher tps At 04:45 PM 8/21/2006, Marty Jia wrote: >I'm exh

Re: [PERFORM] How to get higher tps

2006-08-22 Thread Ron
At 04:45 PM 8/21/2006, Marty Jia wrote: I'm exhausted to try all performance tuning ideas, like following parameters shared_buffers fsync max_fsm_pages max_connections shared_buffers work_mem max_fsm_pages effective_cache_size random_page_cost All of this comes =after= the Get the Correct HW (

Re: [PERFORM] How to get higher tps

2006-08-22 Thread Marty Jia
:27 AMTo: Mark LewisCc: Marty Jia; Joshua D. Drake; pgsql-performance@postgresql.org; DBAs; Rich Wilson; Ernest WurzbachSubject: Re: [PERFORM] How to get higher tps Oh - and it's usefull to know if you are CPU bound, or IO bound.  Check top or vmstat to get an idea of thatAlex On 8/22/06,

Re: [PERFORM] How to get higher tps

2006-08-22 Thread Marty Jia
. Drake; pgsql-performance@postgresql.org; DBAs; Rich Wilson; Ernest WurzbachSubject: Re: [PERFORM] How to get higher tps Oh - and it's usefull to know if you are CPU bound, or IO bound.  Check top or vmstat to get an idea of thatAlex On 8/22/06, Alex Turner < [EMAIL PROTECTED]> wrot

Re: [PERFORM] How to get higher tps

2006-08-22 Thread Marty Jia
a D. Drake; pgsql-performance@postgresql.org; DBAs; Rich Wilson; Ernest Wurzbach Subject: Re: [PERFORM] How to get higher tps Well, at least on my test machines running gnome-terminal, my pgbench runs tend to get throttled by gnome-terminal's lousy performance to no more than 300 tps or so.

Re: [PERFORM] How to get higher tps

2006-08-22 Thread Alex Turner
gt;> Here is pgbench I used:>> pgbench -c 10 -t 1 -d HQDB>> Thanks>> Marty >> -Original Message-> From: Joshua D. Drake [mailto:[EMAIL PROTECTED]] > Sent: Monday, August 21, 2006 6:09 PM> To: Marty Jia> Cc: pgsql-performance@postgresql.org> S

Re: [PERFORM] How to get higher tps

2006-08-22 Thread Alex Turner
IL PROTECTED]]> Sent: Monday, August 21, 2006 6:09 PM> To: Marty Jia> Cc: pgsql-performance@postgresql.org> Subject: Re: [PERFORM] How to get higher tps>> Marty Jia wrote:> > I'm exhausted to try all performance tuning ideas, like following > > paramete

Re: [PERFORM] How to get higher tps

2006-08-22 Thread Scott Marlowe
On Tue, 2006-08-22 at 08:16, Marty Jia wrote: > Hi, Mark > > Thanks, here is our hardware info: > > RAID 10, using 3Par virtual volume technology across ~200 physical FC > disks. 4 virtual disks for PGDATA, striped with LVM into one volume, 2 > virtual disks for WAL, also striped. SAN attached

Re: [PERFORM] How to get higher tps

2006-08-22 Thread Mark Lewis
gt; Marty > > -Original Message- > From: Joshua D. Drake [mailto:[EMAIL PROTECTED] > Sent: Monday, August 21, 2006 6:09 PM > To: Marty Jia > Cc: pgsql-performance@postgresql.org > Subject: Re: [PERFORM] How to get higher tps > > Marty Jia wrote: > > I'

Re: [PERFORM] How to get higher tps

2006-08-22 Thread Marty Jia
:[EMAIL PROTECTED] Sent: Monday, August 21, 2006 6:09 PM To: Marty Jia Cc: pgsql-performance@postgresql.org Subject: Re: [PERFORM] How to get higher tps Marty Jia wrote: > I'm exhausted to try all performance tuning ideas, like following > parameters > > shared_buffers > f

Re: [PERFORM] How to get higher tps

2006-08-22 Thread Marty Jia
Mark Lewis [mailto:[EMAIL PROTECTED] Sent: Monday, August 21, 2006 5:47 PM To: Marty Jia Cc: pgsql-performance@postgresql.org Subject: Re: [PERFORM] How to get higher tps Not much we can do unless you give us more info about how you're testing (pgbench setup), and what you've done with

Re: [PERFORM] How to get higher tps

2006-08-21 Thread Scott Marlowe
On Mon, 2006-08-21 at 15:45, Marty Jia wrote: > I'm exhausted to try all performance tuning ideas, like following > parameters > > shared_buffers > fsync > max_fsm_pages > max_connections > shared_buffers > work_mem > max_fsm_pages > effective_cache_size > random_page_cost > > I believe a

Re: [PERFORM] How to get higher tps

2006-08-21 Thread Joshua D. Drake
Marty Jia wrote: I'm exhausted to try all performance tuning ideas, like following parameters shared_buffers fsync max_fsm_pages max_connections shared_buffers work_mem max_fsm_pages effective_cache_size random_page_cost I believe all above have right size and values, but I just can no

Re: [PERFORM] How to get higher tps

2006-08-21 Thread Marty Jia
Jia Cc: pgsql-performance@postgresql.org Subject: Re: [PERFORM] How to get higher tps On Mon, 2006-08-21 at 16:45 -0400, Marty Jia wrote: > I'm exhausted to try all performance tuning ideas, like following > parameters > > shared_buffers > fsync By "tuning" fsync,

Re: [PERFORM] How to get higher tps

2006-08-21 Thread Mark Lewis
Not much we can do unless you give us more info about how you're testing (pgbench setup), and what you've done with the parameters you listed below. It would also be useful if you told us more about your drive array than just "3Par". We need to know the RAID level, number/speed of disks, whether

Re: [PERFORM] How to get higher tps

2006-08-21 Thread Jeff Davis
On Mon, 2006-08-21 at 16:45 -0400, Marty Jia wrote: > I'm exhausted to try all performance tuning ideas, like following > parameters > > shared_buffers > fsync By "tuning" fsync, what do you mean? Did you turn it off? If you turned fsync off, that could compromise your data in case of any kind

[PERFORM] How to get higher tps

2006-08-21 Thread Marty Jia
I'm exhausted to try all performance tuning ideas, like following parameters shared_buffers fsync max_fsm_pages max_connections shared_buffers work_mem max_fsm_pages effective_cache_size random_page_cost I believe all above have right size and values, but I just can not get higher tps mor