Re: [PHP] PHP cron job optimization

2011-09-12 Thread Igor Escobar
@Eric ok ;) Regards, Igor Escobar *Software Engineer * + http://blog.igorescobar.com + http://www.igorescobar.com + @igorescobar On Mon, Sep 12, 2011 at 10:52 AM, Eric Butera wrote: > On Mon, Sep 12, 2011 at 9:37 AM, Igor Escobar > wrote: > > Other goo

Re: [PHP] PHP cron job optimization

2011-09-12 Thread Eric Butera
On Mon, Sep 12, 2011 at 9:37 AM, Igor Escobar wrote: > Other good point is: always set a timeout connection when you're getting the > RSS data to avoid your thread get stuck unnecessary. Use cURL (is much more > faster then file_get_contents). > > Multithreading in PHP with cURL http://devzone.zen

Re: [PHP] PHP cron job optimization

2011-09-12 Thread Igor Escobar
Other good point is: always set a timeout connection when you're getting the RSS data to avoid your thread get stuck unnecessary. Use cURL (is much more faster then file_get_contents). Multithreading in PHP with cURL http://devzone.zend.com/article/3341 Regards, Igor Escobar *Software Engineer *

Re: [PHP] PHP cron job optimization

2011-09-12 Thread Igor Escobar
Use PHP threads. Do the job separately.. in parts... in other words... you can't read all them at once. You can read a little more about php multithreading here: http://blog.motane.lu/2009/01/02/multithreading-in-php/ You can use a non-relational database like mongo or couchdb to manage where you

Re: [PHP] PHP cron job optimization

2011-09-10 Thread Stuart Dallas
On 10 Sep 2011, at 09:35, muad shibani wrote: > I want to design an application that reads news from RSS sources. > I have about 1000 RSS feed to collect from. > > I also will use Cron jobs every 15 minutes to collect the data. > the question is: Is there a clever way to collect all those feed it

Re: [PHP] PHP cron job optimization

2011-09-10 Thread Eric Butera
On Sat, Sep 10, 2011 at 1:47 PM, Sean Greenslade wrote: > On Sat, Sep 10, 2011 at 4:35 AM, muad shibani wrote: > >> I want to design an application that reads news from RSS sources. >> I have about 1000 RSS feed to collect from. >> >> I also will use Cron jobs every 15 minutes to collect the data.

Re: [PHP] PHP cron job optimization

2011-09-10 Thread MUAD SHIBANI
thanks a lot after I test it I will share the code .. Thanks again On Sat, Sep 10, 2011 at 11:20 AM, Gary Golden wrote: > > I want to design an application that reads news from RSS sources. > >> I have about 1000 RSS feed to collect from. > >> > >> I also will use Cron jobs every 15 minutes to c

Re: [PHP] PHP cron job optimization

2011-09-10 Thread Gary Golden
> I want to design an application that reads news from RSS sources. >> I have about 1000 RSS feed to collect from. >> >> I also will use Cron jobs every 15 minutes to collect the data. >> the question is: Is there a clever way to collect all those feed items >> without exhausting the server >> any

Re: [PHP] PHP cron job optimization

2011-09-10 Thread Sean Greenslade
On Sat, Sep 10, 2011 at 4:35 AM, muad shibani wrote: > I want to design an application that reads news from RSS sources. > I have about 1000 RSS feed to collect from. > > I also will use Cron jobs every 15 minutes to collect the data. > the question is: Is there a clever way to collect all those f