Re: [PERFORM] RAID controllers for Postgresql on large setups

2008-05-13 Thread PFC
You say that like you don't mind having PCI in a server whose job is to perform massive query over large data sets. I am in my 4th week at a new job. Trying to figure what I am working with. LOOL, ok, hehe, not exactly the time to have a "let's change everything" fit ;) From what I

Re: [PERFORM] RAID controllers for Postgresql on large setups

2008-05-13 Thread James Mansion
PFC wrote: PCI limits you to 133 MB/s (theoretical), actual speed being around 100-110 MB/s. Many servers do have more than one bus. You have to process that data too so its not going to be as much of a limit as you are suggesting. It may be possible to stream a compressed data file to th

Re: [PERFORM] RAID controllers for Postgresql on large setups

2008-05-13 Thread Vivek Khera
On May 12, 2008, at 11:24 PM, Francisco Reyes wrote: Any PCI controller you have had good experience with? How any other PCI-X/PCI-e controller that you have had good results? The LSI controllers are top-notch, and always my first choice. They have PCI-X and PCI-e versions. -- Sent via

Re: [PERFORM] RAID controllers for Postgresql on large setups

2008-05-13 Thread Vivek Khera
On May 12, 2008, at 10:04 PM, Francisco Reyes wrote: Adaptec 2120 SCSI controller (64MB of cache). The servers have mostly have 12 drives in RAID 10. We are going to redo one machine to compare RAID 10 vs RAID 50. Mostly to see if the perfomance is close, the space gain may be usefull.

Re: [PERFORM] RAID controllers for Postgresql on large setups

2008-05-13 Thread Merlin Moncure
On Tue, May 13, 2008 at 8:00 AM, Francisco Reyes <[EMAIL PROTECTED]> wrote: > PFC writes: > > > >You say that like you don't mind having PCI in a server whose job > is to perform massive query over large data sets. > > > > I am in my 4th week at a new job. Trying to figure what I am worki

Re: [PERFORM] RAID controllers for Postgresql on large setups

2008-05-13 Thread Francisco Reyes
PFC writes: You say that like you don't mind having PCI in a server whose job is to perform massive query over large data sets. I am in my 4th week at a new job. Trying to figure what I am working with. From what I see I will likely get as much improvement from new hardware as from re-doing

Re: [PERFORM] RAID controllers for Postgresql on large setups

2008-05-13 Thread PFC
Will it pay to go to a controller with higher memory for existing machines? The one machine I am about to redo has PCI which seems to somewhat limit our options. Urgh. You say that like you don't mind having PCI in a server whose job is to perform massive query over large data s

Re: [PERFORM] RAID controllers for Postgresql on large setups

2008-05-13 Thread Scott Marlowe
On Mon, May 12, 2008 at 8:04 PM, Francisco Reyes <[EMAIL PROTECTED]> wrote: > Inheritted a number of servers and I am starting to look into the hardware. > > So far what I know from a few of the servers > Redhat servers. > 15K rpm disks, 12GB to 32GB of RAM. > Adaptec 2120 SCSI controller (64MB of

Re: [PERFORM] RAID controllers for Postgresql on large setups

2008-05-12 Thread Greg Smith
On Mon, 12 May 2008, Francisco Reyes wrote: We are going to redo one machine to compare RAID 10 vs RAID 50. Mostly to see if the perfomance is close, the space gain may be usefull. Good luck with that, you'll need it. Will it pay to go to a controller with higher memory for existing machine

Re: [PERFORM] RAID controllers for Postgresql on large setups

2008-05-12 Thread Joshua D. Drake
Francisco Reyes wrote: Joshua D. Drake writes: Any PCI controller you have had good experience with? I don't have any PCI test data. How any other PCI-X/PCI-e controller that you have had good results? http://www.commandprompt.com/blogs/joshua_drake/2008/04/is_that_performance_i_smell_ext

Re: [PERFORM] RAID controllers for Postgresql on large setups

2008-05-12 Thread Joshua D. Drake
Chris Ruprecht wrote: Joshua, did you try to run the 345 on an IBM ServeRAID 6i? No the only controllers I had at the time were the 2120 and the LSI on board that is limited to RAID 1. I put the drives on the LSI in JBOD and used Linux software raid. The key identifier for me was using a s

Re: [PERFORM] RAID controllers for Postgresql on large setups

2008-05-12 Thread Chris Ruprecht
Joshua, did you try to run the 345 on an IBM ServeRAID 6i? I have one in mine, but I never actually ran any speed test. Do you have any benchmarks that I could run and compare? best regards, chris -- chris ruprecht database grunt and bit pusher extraordinaíre On May 12, 2008, at 22:11, Josh

Re: [PERFORM] RAID controllers for Postgresql on large setups

2008-05-12 Thread Francisco Reyes
Joshua D. Drake writes: Most likely you have a scsi onboard as well I am guessing. Will check. shouldn't bother with the 2120. My tests show it is a horrible controller for random writes. Thanks for the feedback.. Comparing software raid on an LSI onboard for an IBM 345 versus a 2120s u

Re: [PERFORM] RAID controllers for Postgresql on large setups

2008-05-12 Thread Joshua D. Drake
On Mon, 12 May 2008 22:04:03 -0400 Francisco Reyes <[EMAIL PROTECTED]> wrote: > Inheritted a number of servers and I am starting to look into the > hardware. > > So far what I know from a few of the servers > Redhat servers. > 15K rpm disks, 12GB to 32GB of RAM. > Adaptec 2120 SCSI controller (64

[PERFORM] RAID controllers for Postgresql on large setups

2008-05-12 Thread Francisco Reyes
Inheritted a number of servers and I am starting to look into the hardware. So far what I know from a few of the servers Redhat servers. 15K rpm disks, 12GB to 32GB of RAM. Adaptec 2120 SCSI controller (64MB of cache). The servers have mostly have 12 drives in RAID 10. We are going to redo one m