On 10/17/06, tonemcd <[EMAIL PROTECTED]> wrote: > What I'd really like to know is how we could replicate this level of > functionality with a django setup.
I highly, highly, highly recommend taking a look at Perlbal[1] for load balancing. Don't let the fact that it's written in Perl turn you off; it's from the same people who developed memcached (and who, between LiveJournal and TypePad, have to support some truly massively scalable setups), and is dead simple to set up and use. I don't know much about doing MySQL replication, but PostgreSQL has Slony[2], which is a little intimidating at first but can do a great job of DB replication; for connection management, pgpool[3] gives you connection pooling among multiple PostgreSQL servers, and isn't hard to set up. It also has a form of "poor man's replication", but I wouldn't trust mission-critical data to that when Slony is available. So the stack ends up looking like this: * On the frontend, however many load-balancing machines you want to have, running Perlbal and loaded up with RAM for memcached. * In the middle, the Perlbal boxes reverse proxy to pools of standard servers running Apache+mod_python. * On the backend, those servers talk (through pgpool) to pools of database servers running pgpool and replicating via Slony. The only other piece in the puzzle is the media server; RAID can work for that, and if you need to read/write to the media server(s) from the web servers you can always do NFS. More than a couple of really smart people I know have also been looking lately into MogileFS[4], which is an incredibly cool-looking distributed filesystem setup (and is from the same folks who do memcached and Perlbal). [1] http://www.danga.com/perlbal/ [2] http://gborg.postgresql.org/project/slony1/projdisplay.php [3] http://pgpool.projects.postgresql.org/ [4] http://www.danga.com/mogilefs/ -- "May the forces of evil become confused on the way to your house." -- George Carlin --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Django users" group. To post to this group, send email to django-users@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/django-users -~----------~----~----~----~------~----~------~--~---