Re: Is it better to use threads or fork in the following case

2009-05-08 Thread JanC
Gabriel Genellina wrote: > In addition, the zip file format stores the directory at the end of the > file. So you can't process it until it's completely downloaded. Well, you *can* download the directory part first (if the HTTP server supports it), and if you only need some files, you could t

Re: Is it better to use threads or fork in the following case

2009-05-04 Thread CTO
> Which brings us backs to the "20 questions"-part of my earlier post. It > could be, but it could also be that processing takes seconds. Or it takes > so long that even concurrency won't help. Who knows? Probably the OP ;) Geremy Condra -- http://mail.python.org/mailman/listinfo/python-list

Re: Is it better to use threads or fork in the following case

2009-05-04 Thread Diez B. Roggisch
CTO wrote: >> In addition, the zip file format stores the directory at the end of the >> file. So you can't process it until it's completely downloaded. >> Concurrency doesn't help here. > > Don't think that's relevant, if I'm understanding the OP correctly. > Lets say you've downloaded the file

Re: Is it better to use threads or fork in the following case

2009-05-03 Thread Martin P. Hellwig
grocery_stocker wrote: Let's say there is a new zip file with updated information every 30 minutes on a remote website. Now, I wanna connect to this website every 30 minutes, download the file, extract the information, and then have the program search the file search for certain items. Would it

Re: Is it better to use threads or fork in the following case

2009-05-03 Thread CTO
> In addition, the zip file format stores the directory at the end of the   > file. So you can't process it until it's completely downloaded.   > Concurrency doesn't help here. Don't think that's relevant, if I'm understanding the OP correctly. Lets say you've downloaded the file once and you're d

Re: Is it better to use threads or fork in the following case

2009-05-03 Thread Gabriel Genellina
En Sun, 03 May 2009 17:45:36 -0300, Paul Hankin escribió: On May 3, 10:29 pm, grocery_stocker wrote: On May 3, 1:16 pm, "Diez B. Roggisch" wrote: > grocery_stocker schrieb: > > Would it be better to use threads to break this up? I have one thread > > download the data and then have anothe

Re: Is it better to use threads or fork in the following case

2009-05-03 Thread grocery_stocker
On May 3, 1:40 pm, "Diez B. Roggisch" wrote: > grocery_stocker schrieb: > > > > > On May 3, 1:16 pm, "Diez B. Roggisch" wrote: > >> grocery_stocker schrieb: > > >>> Let's say there is a new zip file with updated information every 30 > >>> minutes on a remote website. Now, I wanna connect to this

Re: Is it better to use threads or fork in the following case

2009-05-03 Thread Paul Hankin
On May 3, 10:29 pm, grocery_stocker wrote: > On May 3, 1:16 pm, "Diez B. Roggisch" wrote: > > > grocery_stocker schrieb: > > > > Let's say there is a new zip file with updated information every 30 > > > minutes on a remote website. Now, I wanna connect to this website > > > every 30 minutes, down

Re: Is it better to use threads or fork in the following case

2009-05-03 Thread CTO
Probably better just to check HEAD and see if its updated within the time you're looking at before any unpack. Even on a 56k that's going to be pretty fast, and you don't risk unpacking an old file while a new version is on the way. If you still want to be able to unpack the old file if there's an

Re: Is it better to use threads or fork in the following case

2009-05-03 Thread Diez B. Roggisch
grocery_stocker schrieb: On May 3, 1:16 pm, "Diez B. Roggisch" wrote: grocery_stocker schrieb: Let's say there is a new zip file with updated information every 30 minutes on a remote website. Now, I wanna connect to this website every 30 minutes, download the file, extract the information, an

Re: Is it better to use threads or fork in the following case

2009-05-03 Thread grocery_stocker
On May 3, 1:16 pm, "Diez B. Roggisch" wrote: > grocery_stocker schrieb: > > > Let's say there is a new zip file with updated information every 30 > > minutes on a remote website. Now, I wanna connect to this website > > every 30 minutes, download the file, extract the information, and then > > hav

Re: Is it better to use threads or fork in the following case

2009-05-03 Thread Diez B. Roggisch
grocery_stocker schrieb: Let's say there is a new zip file with updated information every 30 minutes on a remote website. Now, I wanna connect to this website every 30 minutes, download the file, extract the information, and then have the program search the file search for certain items. Would i