Re: [PHP] Pulling from Multiple Databases

2011-02-01 Thread Jon Hood
Bah, forgot to reply-all On Tue, Feb 1, 2011 at 11:59 AM, Jon Hood wrote: > Using pcntl_fork mostly accomplished what I wanted (I had to go back and > create the actual connection in each of the forked processes, otherwise, the > first process that ended would destroy the connection to

Re: [PHP] Pulling from Multiple Databases

2011-02-01 Thread Jon Hood
(comments in-line) On Tue, Feb 1, 2011 at 10:34 AM, Richard Quadling wrote: > I use a data warehouse (a semi denormalized db) to hold data from > around 200 different data sources (DB, Excel spreadsheets, Web, etc.) > > I use multiple scripts to update the DB, each one tuned to a > particular fre

[PHP] Pulling from Multiple Databases

2011-02-01 Thread Jon Hood
I have a website that is currently pulling from more than 30 databases, combining the data, and displaying it to the user. As more and more databases are added, the script continues to get slower and slower, and I've realized that I need to either find a way to pull these data in parallel. So - wha