Re: [PERFORM] Peformance Tuning Opterons/ Hard Disk Layout

2005-02-28 Thread Markus Schaber
Hi, John, John Allgood schrieb: > My question is what is the best way to setup > postgres databases on different disks. I have setup multiple postmasters > on this system as a test. The only problem was configuring each > databases "ie postgresql.conf, pg_hba.conf". Is there anyway in > postgres

Re: [PERFORM] Peformance Tuning Opterons/ Hard Disk Layout

2005-02-25 Thread Jim C. Nasby
On Wed, Feb 23, 2005 at 01:37:28PM -0500, Tom Lane wrote: > "Bruno Almeida do Lago" <[EMAIL PROTECTED]> writes: > > Is there a real limit for max_connections? Here we've an Oracle server with > > up to 1200 simultaneous conections over it! > > [ shrug... ] If your machine has the beef to run 1200

Re: [PERFORM] Peformance Tuning Opterons/ Hard Disk Layout

2005-02-25 Thread Vig, Sandor (G/FI-2)
lto:[EMAIL PROTECTED] Behalf Of John Arbash Meinel Sent: Thursday, February 24, 2005 8:41 PM To: John Allgood Cc: pgsql-performance@postgresql.org Subject: Re: [PERFORM] Peformance Tuning Opterons/ Hard Disk Layout John Allgood wrote: > Hello Again > > In the below statement you mention pu

Re: [PERFORM] Peformance Tuning Opterons/ Hard Disk Layout

2005-02-24 Thread John Arbash Meinel
John Allgood wrote: Hello Again In the below statement you mention putting each database on its own raid mirror. "However, sticking with your arrangement, it would seem that you might be able to get some extra performance if each database is on it's own raid, since you are fairly likely to have 2 t

Re: [PERFORM] Peformance Tuning Opterons/ Hard Disk Layout

2005-02-24 Thread Joel Fradkin
I am no expert, but have been asking them a bunch and I think your missing a key concept. The data is best on several drives. I could be completely off, but if I understood (I just finished doing the same kind of thing minus several databases) you want your WAL on fast drives in raid 1 and your da

Re: [PERFORM] Peformance Tuning Opterons/ Hard Disk Layout

2005-02-24 Thread Bruno Almeida do Lago
: Bruno Almeida do Lago Cc: pgsql-performance@postgresql.org Subject: Re: [PERFORM] Peformance Tuning Opterons/ Hard Disk Layout Bruno, > For example, 150 active connections on a medium-end > 32-bit Linux server will consume significant system resources, and 600 is > about the limit."

Re: [PERFORM] Peformance Tuning Opterons/ Hard Disk Layout

2005-02-24 Thread Vig, Sandor (G/FI-2)
t: Re: [PERFORM] Peformance Tuning Opterons/ Hard Disk Layout Here is a summary about the cluster suite from redhat. All 9 databases will be on the primary server the secondary server I have is the failover. They don't actually share the partitions at the same time. When you have some

Re: [PERFORM] Peformance Tuning Opterons/ Hard Disk Layout

2005-02-23 Thread Christopher Browne
[EMAIL PROTECTED] ("Bruno Almeida do Lago") wrote: > Is there a real limit for max_connections? Here we've an Oracle server with > up to 1200 simultaneous conections over it! > > "max_connections: exactly like previous versions, this needs to be set to > the actual number of simultaneous connection

Re: [PERFORM] Peformance Tuning Opterons/ Hard Disk Layout

2005-02-23 Thread John Arbash Meinel
John Allgood wrote: Here is a summary about the cluster suite from redhat. All 9 databases will be on the primary server the secondary server I have is the failover. They don't actually share the partitions at the same time. When you have some type of failure the backup server takes over. Once you

Re: [PERFORM] Peformance Tuning Opterons/ Hard Disk Layout

2005-02-23 Thread Josh Berkus
Bruno, > For example, 150 active connections on a medium-end > 32-bit Linux server will consume significant system resources, and 600 is > about the limit." That, is, "is about the limit for a medium-end 32-bit Linux server".Sorry if the implication didn't translate well. If you use beefie

Re: [PERFORM] Peformance Tuning Opterons/ Hard Disk Layout

2005-02-23 Thread John Allgood
Here is a summary about the cluster suite from redhat. All 9 databases will be on the primary server the secondary server I have is the failover. They don't actually share the partitions at the same time. When you have some type of failure the backup server takes over. Once you setup the hardwa

Re: [PERFORM] Peformance Tuning Opterons/ Hard Disk Layout

2005-02-23 Thread John Arbash Meinel
John Allgood wrote: This some good info. The type of attached storage is a Kingston 14 bay Fibre Channel Infostation. I have 14 36GB 15,000 RPM drives. I think the way it is being explained that I should build a mirror with two disk for the pg_xlog and the striping and mirroring the rest and put al

Re: [PERFORM] Peformance Tuning Opterons/ Hard Disk Layout

2005-02-23 Thread John Allgood
This some good info. The type of attached storage is a Kingston 14 bay Fibre Channel Infostation. I have 14 36GB 15,000 RPM drives. I think the way it is being explained that I should build a mirror with two disk for the pg_xlog and the striping and mirroring the rest and put all my databases i

Re: [PERFORM] Peformance Tuning Opterons/ Hard Disk Layout

2005-02-23 Thread Michael Adler
On Wed, Feb 23, 2005 at 02:15:52PM -0500, John Allgood wrote: > using custom scripts. Maybe I have given a better explanation of the > application. my biggest concern is how to partition the shared storage > for maximum performance. Is there a real benifit to having more that one > raid5 partiti

Re: [PERFORM] Peformance Tuning Opterons/ Hard Disk Layout

2005-02-23 Thread John Arbash Meinel
John Allgood wrote: I think maybe I didn't explain myself well enough. At most we will service 200-250 connections across all the 9 databases mentioned. The database we are building is for a trucking company. Each of the databases represents a different division. With one master database that every

Re: [PERFORM] Peformance Tuning Opterons/ Hard Disk Layout

2005-02-23 Thread John Allgood
I think maybe I didn't explain myself well enough. At most we will service 200-250 connections across all the 9 databases mentioned. The database we are building is for a trucking company. Each of the databases represents a different division. With one master database that everything is updated

Re: [PERFORM] Peformance Tuning Opterons/ Hard Disk Layout

2005-02-23 Thread Tom Lane
Rod Taylor <[EMAIL PROTECTED]> writes: > The kernel also starts to play a significant role with a high number of > connections. Some operating systems don't perform as well with a high > number of processes (process handling, scheduling, file handles, etc.). Right; the main problem with having lot

Re: [PERFORM] Peformance Tuning Opterons/ Hard Disk Layout

2005-02-23 Thread Rod Taylor
On Wed, 2005-02-23 at 15:26 -0300, Bruno Almeida do Lago wrote: > Is there a real limit for max_connections? Here we've an Oracle server with > up to 1200 simultaneous conections over it! If you can reduce them by using something like pgpool between PostgreSQL and the client, you'll save some head

Re: [PERFORM] Peformance Tuning Opterons/ Hard Disk Layout

2005-02-23 Thread Tom Lane
"Bruno Almeida do Lago" <[EMAIL PROTECTED]> writes: > Is there a real limit for max_connections? Here we've an Oracle server with > up to 1200 simultaneous conections over it! [ shrug... ] If your machine has the beef to run 1200 simultaneous queries, you can set max_connections to 1200. The poin

Re: [PERFORM] Peformance Tuning Opterons/ Hard Disk Layout

2005-02-23 Thread Bruno Almeida do Lago
ubject: Re: [PERFORM] Peformance Tuning Opterons/ Hard Disk Layout On Wed, Feb 23, 2005 at 11:39:27AM -0500, John Allgood wrote: > Hello All > >I am setting up a hardware clustering solution. My hardware is Dual > Opteron 550 with 8GB ram. My external storage is a Kingston Fibre > c

Re: [PERFORM] Peformance Tuning Opterons/ Hard Disk Layout

2005-02-23 Thread Michael Adler
On Wed, Feb 23, 2005 at 11:39:27AM -0500, John Allgood wrote: > Hello All > >I am setting up a hardware clustering solution. My hardware is Dual > Opteron 550 with 8GB ram. My external storage is a Kingston Fibre > channel Infostation. With 14 15000'k 36GB drives. The OS we are running > is