Re: [HACKERS] Horizontal Write Scaling

2010-11-27 Thread Eliot Gable
Thanks, everyone, for all the feedback! I am nowhere near a database expert yet, but you guys have been very helpful in clearing up some of my confusion. I have checked out Postgres-XC and it looks like the version 1.0 that will be released soon probably covers everything I have been looking for in

Re: [HACKERS] Horizontal Write Scaling

2010-11-25 Thread Robert Haas
On Thu, Nov 25, 2010 at 4:45 AM, Koichi Suzuki wrote: >>> plus the >>> communication protocol overhead and latency. However, it occurs to me >>> that if you had a shared disk system via either iSCSI, Fiber Channel, >>> NFS, or whatever (which also had higher I/O capabilities than a single >>> serv

Re: [HACKERS] Horizontal Write Scaling

2010-11-25 Thread Koichi Suzuki
Hi, 2010/11/25 Markus Wanner : > Eliot, > > On 11/23/2010 09:43 PM, Eliot Gable wrote: >> I know there has been a lot of talk about replication getting built into >> Postgres and I know of many projects that aim to fill the role. However, >> I have not seen much in the way of a serious attempt at

Re: [HACKERS] Horizontal Write Scaling

2010-11-25 Thread Markus Wanner
Eliot, On 11/23/2010 09:43 PM, Eliot Gable wrote: > I know there has been a lot of talk about replication getting built into > Postgres and I know of many projects that aim to fill the role. However, > I have not seen much in the way of a serious attempt at multi-master > write scaling. Postgres-

Re: [HACKERS] Horizontal Write Scaling

2010-11-23 Thread Greg Smith
Eliot Gable wrote: However, I have not seen much in the way of a serious attempt at multi-master write scaling. Scaling writes across nodes using PL/Proxy works. Of course, I am assuming the disk system would be RAID 1, RAID 10, RAID 5, or RAID 6 for reliability purposes and that it is suffi

Re: [HACKERS] Horizontal Write Scaling

2010-11-23 Thread Mark Kirkwood
On 24/11/10 09:43, Eliot Gable wrote: However, it occurs to me that if you had a shared disk system via either iSCSI, Fiber Channel, NFS, or whatever (which also had higher I/O capabilities than a single server could utilize) Yeah, current Postgres multi-master projects seem to be focusing on

Re: [HACKERS] Horizontal Write Scaling

2010-11-23 Thread Kevin Grittner
Eliot Gable wrote: > the locks would ensure a strict ordering of queries. PostgreSQL doesn't support S2PL. I'm not sure what locks you mean. -Kevin -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpre

Re: [HACKERS] Horizontal Write Scaling

2010-11-23 Thread Eliot Gable
On Tue, Nov 23, 2010 at 3:43 PM, Eliot Gable > wrote: > Other than that, is there anything else I am missing? Wouldn't this type of > setup be far simpler to implement and provide better scalability than trying > to do multi-master replication using log shipping or binary object shipping > or an

[HACKERS] Horizontal Write Scaling

2010-11-23 Thread Eliot Gable
I know there has been a lot of talk about replication getting built into Postgres and I know of many projects that aim to fill the role. However, I have not seen much in the way of a serious attempt at multi-master write scaling. I understand the fundamental problem with write scaling across multip