Re: maximum number of threads

2007-01-12 Thread Ganesan Rajagopal
> Felipe Almeida Lessa <[EMAIL PROTECTED]> writes: >> >> to modify the maximum number of user process (AFAIK each thread use a >> process entry on Linux) > I don't think it's only this. It isn't that at all. The default Linux POSIX threads stack size is 8MB. Linux user space is 3GB (Kernel i

Re: maximum number of threads

2007-01-12 Thread Hendrik van Rooyen
"William Heymann" <[EMAIL PROTECTED]> wrote: > So you know I tried this on ubuntu edgy 64bit edition on a dual 2218 opteron > system with 8G of ram and I got > > > Exception raised: can't start new thread > Biggest number of threads: 32274 > This almost looks as if the number of threads is

Re: maximum number of threads

2007-01-11 Thread Cecil Westerhof
Felipe Almeida Lessa wrote: > $ python test.py > 50 > 100 > 150 > 200 > 250 > 300 > 350 > Exception raised: can't start new thread I tried your script on a PII 300 MHz and only 150 MB. I broke it of when it reached more as 1,25 million. ;-} -- http://mail.python.org/mailman/listinfo/python-list

Re: maximum number of threads

2007-01-11 Thread William Heymann
On Wednesday 10 January 2007 7:11 am, Felipe Almeida Lessa wrote: > --- > $ python test.py > 50 > 100 > 150 > 200 > 250 > 300 > 350 > Exception raised: can't start new thread > > Biggest number of threads: 382 > --- > > The test.py script is attached. So you know I tried this on ubuntu edgy 64bit

Re: maximum number of threads

2007-01-10 Thread Jeremy Sanders
Jean-Paul Calderone wrote: > Indeed you are correct. The actual limit you are hitting is the size > of your address space. Each thread is allocated 8MB of stack. 382 > threads consumes about 3GB of address space. Even though most of this > memory isn't actually allocated, the address space is

Re: maximum number of threads

2007-01-10 Thread Paul Sijben
All thanks for all the input! This was very informative. Looks like I indeed need stackless as my code benefits from being concurrently designed. Paul Jean-Paul Calderone wrote: > On Wed, 10 Jan 2007 12:11:59 -0200, Felipe Almeida Lessa > <[EMAIL PROTECTED]> wrote: >> On 1/10/07, Laurent Pointal

Re: maximum number of threads

2007-01-10 Thread hg
Jean-Paul Calderone wrote: > On Wed, 10 Jan 2007 12:11:59 -0200, Felipe Almeida Lessa > <[EMAIL PROTECTED]> wrote: >>On 1/10/07, Laurent Pointal <[EMAIL PROTECTED]> wrote: >>>This is a system configurable limit (up to a maximum). >>> >>>See ulimit man pages. >>> >>>test >>> >>> ulimit -a >

Re: maximum number of threads

2007-01-10 Thread Jean-Paul Calderone
On Wed, 10 Jan 2007 12:11:59 -0200, Felipe Almeida Lessa <[EMAIL PROTECTED]> wrote: >On 1/10/07, Laurent Pointal <[EMAIL PROTECTED]> wrote: >>This is a system configurable limit (up to a maximum). >> >>See ulimit man pages. >> >>test >> >> ulimit -a >> >>to see what are the current limits,

Re: maximum number of threads

2007-01-10 Thread Felipe Almeida Lessa
On 1/10/07, Laurent Pointal <[EMAIL PROTECTED]> wrote: This is a system configurable limit (up to a maximum). See ulimit man pages. test ulimit -a to see what are the current limits, and try with ulimit -u 2000 to modify the maximum number of user process (AFAIK each thread

Re: maximum number of threads

2007-01-10 Thread Laurent Pointal
Paul Sijben a écrit : > Gabriel Genellina wrote: >> Simply you can't, as you can't have 1 open files at once. Computer >> resources are not infinite. > > sure but *how* fast they run out is the issue here > >> Do you really need so many threads? > > I might be able to do with a few less but

Re: maximum number of threads

2007-01-10 Thread Paul Sijben
Felipe Almeida Lessa wrote: > Maybe Stackless could help the OP? > http://www.stackless.com/ > thanks I will look into it! -- http://mail.python.org/mailman/listinfo/python-list

Re: maximum number of threads

2007-01-10 Thread Paul Sijben
Gabriel Genellina wrote: > > Simply you can't, as you can't have 1 open files at once. Computer > resources are not infinite. sure but *how* fast they run out is the issue here > Do you really need so many threads? I might be able to do with a few less but I still need many. I have done a

Re: maximum number of threads

2007-01-10 Thread Felipe Almeida Lessa
On 1/10/07, Gabriel Genellina <[EMAIL PROTECTED]> wrote: > At Wednesday 10/1/2007 04:38, Paul Sijben wrote: > >Does anyone know what it going on here and how I can ensure that I have > >all the threads I need? > > Simply you can't, as you can't have 1 open files at once. > Computer resources ar

Re: maximum number of threads

2007-01-10 Thread Gabriel Genellina
At Wednesday 10/1/2007 04:38, Paul Sijben wrote: I have a server in Python 2.5 that generates a lot of threads. It is running on a linux server (Fedora Core 6). The server quickly runs out of threads. File "/usr/local/lib/python2.5/threading.py", line 434, in start _start_new_thread(self.

maximum number of threads

2007-01-09 Thread Paul Sijben
I have a server in Python 2.5 that generates a lot of threads. It is running on a linux server (Fedora Core 6). The server quickly runs out of threads. I am seeing the following error. File "/home/sijben/ORCA/src/libmercury_mt.py", line 565, in __init__ MercuryObject.__init__(self,mylink)