Re: concurrency and threading question

2009-10-22 Thread Graham Dumpleton
On Oct 22, 3:44 am, Javier Guerra wrote: > On Wed, Oct 21, 2009 at 9:49 AM, Michael Thon wrote: > > Thanks for pointing me towards celery.  Its probably overkill for what > > I want to do right now but I'm going to try to set it up anyway. > > the roll-your-own alternative is just setting a DB

Re: concurrency and threading question

2009-10-21 Thread Mike Thon
On Oct 21, 6:44 pm, Javier Guerra wrote: > On Wed, Oct 21, 2009 at 9:49 AM, Michael Thon wrote: > > Thanks for pointing me towards celery.  Its probably overkill for what > > I want to do right now but I'm going to try to set it up anyway. > > the roll-your-own alternative is just setting a DB

Re: concurrency and threading question

2009-10-21 Thread Javier Guerra
On Wed, Oct 21, 2009 at 9:49 AM, Michael Thon wrote: > Thanks for pointing me towards celery.  Its probably overkill for what > I want to do right now but I'm going to try to set it up anyway. the roll-your-own alternative is just setting a DB table with the queued tasks, and a cron job (or a lo

Re: concurrency and threading question

2009-10-21 Thread Michael Thon
On Oct 21, 2009, at 11:55 AM, Daniel Roseman wrote: > > On Oct 21, 9:28 am, Mike Thon wrote: >> I'm new to web programming and I have a basic question about the >> design of my Django application. my application will do some number >> crunching on data files uploaded by users. The data proces

Re: concurrency and threading question

2009-10-21 Thread Daniel Roseman
On Oct 21, 9:28 am, Mike Thon wrote: > I'm new to web programming and I have a basic question about the > design of my Django application.  my application will do some number > crunching on data files uploaded by users.  The data processing will > take from minutes to hours for each job.  I don't

Re: concurrency and threading question

2009-10-21 Thread Jani Tiainen
Use separate background process (daemon) to handle queue + crunching (or launching crunching). So your web app just posts jobs to background process and then returns control back to user. Otherwise your idea is quite correct. Mike Thon kirjoitti: > I'm new to web programming and I have a basic

concurrency and threading question

2009-10-21 Thread Mike Thon
I'm new to web programming and I have a basic question about the design of my Django application. my application will do some number crunching on data files uploaded by users. The data processing will take from minutes to hours for each job. I don't expect to ever get a large number of concurre