Re: maxusers and random system freezes

2002-12-19 Thread Maxim Konovalov
On 16:51+0300, Dec 19, 2002, Varshavchick Alexander wrote: > On Thu, 19 Dec 2002, Maxim Konovalov wrote: [...] > > [ Trim -questions ] > > > > On 16:21+0300, Dec 19, 2002, Varshavchick Alexander wrote: > > > > > There seems to be archive posts already on the subject, the most > > > informative o

Re: maxusers and random system freezes

2002-12-19 Thread Varshavchick Alexander
IL PROTECTED]>, > Terry Lambert <[EMAIL PROTECTED]>, <[EMAIL PROTECTED]> > Subject: Re: maxusers and random system freezes > > > [ Trim -questions ] > > On 16:21+0300, Dec 19, 2002, Varshavchick Alexander wrote: > > > There seems to be archive p

Re: maxusers and random system freezes

2002-12-19 Thread Maxim Konovalov
t; Terry Lambert <[EMAIL PROTECTED]>, [EMAIL PROTECTED], > > [EMAIL PROTECTED] > > Subject: Re: maxusers and random system freezes > > > > Hi, > > > > Despite the increased KVA space (2G now) and the perfect patch of the > > pthreads mechanism made

Re: maxusers and random system freezes

2002-12-19 Thread Varshavchick Alexander
> To: Dmitry Morozovsky <[EMAIL PROTECTED]> > Cc: David Schultz <[EMAIL PROTECTED]>, > Terry Lambert <[EMAIL PROTECTED]>, [EMAIL PROTECTED], > [EMAIL PROTECTED] > Subject: Re: maxusers and random system freezes > > Hi, > > Despite the increased K

Re: maxusers and random system freezes

2002-12-19 Thread Varshavchick Alexander
lexander <[EMAIL PROTECTED]> > Cc: David Schultz <[EMAIL PROTECTED]>, > Terry Lambert <[EMAIL PROTECTED]>, > <[EMAIL PROTECTED]>, <[EMAIL PROTECTED]> > Subject: Re: maxusers and random system freezes > > On Mon, 9 Dec 2002, Varshavchick Ale

Re: maxusers and random system freezes

2002-12-13 Thread Terry Lambert
Nate Lawson wrote: > On Wed, 4 Dec 2002, Terry Lambert wrote: > > useful documentation; otherwise, I would have published what I > > wrote in Pentad Embedded Systems Journal already (example: the >^^^ > > I appreciate some of the info you give. But every tim

Re: maxusers and random system freezes

2002-12-09 Thread Dmitry Morozovsky
On Mon, 9 Dec 2002, Varshavchick Alexander wrote: VA> the server went to a swap, because it occurs practically instantly, and VA> this state goes for hours. The system is lacking some resources, or may be VA> a bug somewhere, can you give any hints to it? Hmm, what about logging vmstat/pstat/nets

Re: maxusers and random system freezes

2002-12-09 Thread Varshavchick Alexander
0 > From: David Schultz <[EMAIL PROTECTED]> > To: Varshavchick Alexander <[EMAIL PROTECTED]> > Cc: Terry Lambert <[EMAIL PROTECTED]>, [EMAIL PROTECTED], > [EMAIL PROTECTED] > Subject: Re: maxusers and random system freezes > > Thus spake Varshavchick Alexan

Re: maxusers and random system freezes

2002-12-06 Thread David Schultz
Thus spake Gary Thorpe <[EMAIL PROTECTED]>: > I have a question: does the entire KVA *have* to be mapped into the > each process's address space? How much of the KVA does a process need > to communicate with the kernel effectively? No, it doesn't have to be that way. An alternative organization i

Re: maxusers and random system freezes

2002-12-06 Thread Gary Thorpe
--- David Schultz <[EMAIL PROTECTED]> wrote: > Thus spake Varshavchick Alexander <[EMAIL PROTECTED]>: > > Well, now I made KVA space 2G, we'll see later on if it helps to > get rid > > of the sudden system halts, but for some reason a side-effect has > > appeared: pthread_create function returns E

Re: maxusers and random system freezes

2002-12-06 Thread Varshavchick Alexander
On Fri, 6 Dec 2002, David Schultz wrote: ... > > Yes this makes sense, however this call to pthread_create didn't specify > > any special addresses for the new thread. The pthread_create was called > > with the NULL attribute which means that the system defaults were being > > used. Something in t

Re: maxusers and random system freezes

2002-12-06 Thread David Schultz
Thus spake Varshavchick Alexander <[EMAIL PROTECTED]>: > On Fri, 6 Dec 2002, David Schultz wrote: > > > Thus spake Varshavchick Alexander <[EMAIL PROTECTED]>: > > > Well, now I made KVA space 2G, we'll see later on if it helps to get rid > > > of the sudden system halts, but for some reason a side

Re: maxusers and random system freezes

2002-12-06 Thread Varshavchick Alexander
On Fri, 6 Dec 2002, David Schultz wrote: > Thus spake Varshavchick Alexander <[EMAIL PROTECTED]>: > > Well, now I made KVA space 2G, we'll see later on if it helps to get rid > > of the sudden system halts, but for some reason a side-effect has > > appeared: pthread_create function returns EAGAIN

Re: maxusers and random system freezes

2002-12-06 Thread David Schultz
Thus spake Varshavchick Alexander <[EMAIL PROTECTED]>: > Well, now I made KVA space 2G, we'll see later on if it helps to get rid > of the sudden system halts, but for some reason a side-effect has > appeared: pthread_create function returns EAGAIN error now, so I had to > recompile the software us

Re: maxusers and random system freezes

2002-12-06 Thread Varshavchick Alexander
On Fri, 6 Dec 2002, David Schultz wrote: > > vm.zone_kmem_pages: 5413 > > vm.zone_kmem_kvaspace: 218808320 > > vm.kvm_size: 1065353216 > > vm.kvm_free: 58720256 > > > > does it mean that total KVA reservation is 1065353216 bytes (1G) and > > almost all of it is really mapped to physical memory bec

Re: maxusers and random system freezes

2002-12-06 Thread David Schultz
Thus spake Varshavchick Alexander <[EMAIL PROTECTED]>: > Thank you David for such an excellent explanation. So if sysctl reports > > vm.zone_kmem_pages: 5413 > vm.zone_kmem_kvaspace: 218808320 > vm.kvm_size: 1065353216 > vm.kvm_free: 58720256 > > does it mean that total KVA reservation is 1065353

Re: maxusers and random system freezes

2002-12-06 Thread Varshavchick Alexander
On Thu, 5 Dec 2002, Terry Lambert wrote: ... > > Are you talking primarily about SHMMAXPGS=262144 option here? Then may be > > it'll be oevrall better to reduce it and make KVA space 2G, to leave more > > room for user address space? > > That's the one I was referring to, yes, but you didn't post

Re: maxusers and random system freezes

2002-12-06 Thread Varshavchick Alexander
On Thu, 5 Dec 2002, David Schultz wrote: > In FreeBSD, each process has a unique 4G virtual address space > associated with it. Not every virtual page in every address space > has to be associated with real memory. Most pages can be pushed > out to disk when there isn't enough free RAM, and una

Re: maxusers and random system freezes

2002-12-05 Thread Peter Wemm
"Ronald G. Minnich" wrote: > On Thu, 5 Dec 2002, David Schultz wrote: > > > Linux used to do that, but AFAIK it doesn't anymore. > > Linux puts kvm at 0xc000, kernel at physical 0x10, etc. There > was a time when you could address all of physical memory just by > direct-mapping the PT

Re: maxusers and random system freezes

2002-12-05 Thread Ronald G. Minnich
On Thu, 5 Dec 2002, David Schultz wrote: > Linux used to do that, but AFAIK it doesn't anymore. Linux puts kvm at 0xc000, kernel at physical 0x10, etc. There was a time when you could address all of physical memory just by direct-mapping the PTEs, since base of 0xc000 means KVM sp

Re: maxusers and random system freezes

2002-12-05 Thread David Schultz
Thus spake Gary Thorpe <[EMAIL PROTECTED]>: > As far as I know, Linux maps all the memory in the machine into the > kernel address space, so there is never a problem of it running out > while there is free memory (if you run out of it, there isn't any at > all left in the machine). It also permits

Re: maxusers and random system freezes

2002-12-05 Thread Gary Thorpe
--- Terry Lambert <[EMAIL PROTECTED]> wrote: > Marc Recht wrote: > > Every now and this I hear people saying (mostly you :)) that some > problems > > are KVA related or that the KVA must be increased. This makes me a > bit > > curious, since I've never seen problems like that on Linux. It > sounds

Re: maxusers and random system freezes

2002-12-05 Thread Nate Lawson
On Wed, 4 Dec 2002, Terry Lambert wrote: > Marc Recht wrote: > > Every now and this I hear people saying (mostly you :)) that some problems > > are KVA related or that the KVA must be increased. This makes me a bit > > curious, since I've never seen problems like that on Linux. It sounds for > > me

Re: maxusers and random system freezes

2002-12-05 Thread Varshavchick Alexander
On Thu, 5 Dec 2002, David Schultz wrote: > In FreeBSD, each process has a unique 4G virtual address space > associated with it. Not every virtual page in every address space > has to be associated with real memory. Most pages can be pushed > out to disk when there isn't enough free RAM, and unal

Re: maxusers and random system freezes

2002-12-05 Thread Jan Grant
On Thu, 5 Dec 2002, Varshavchick Alexander wrote: > On Thu, 5 Dec 2002, Terry Lambert wrote: > > > IMO, KVA need to be more than half of physical memory. But I tend > > to use a lot of mbufs and mbuf clusters in products I work on lately > > (mostly networking stuff). If you don't tune kernel me

Re: maxusers and random system freezes

2002-12-05 Thread David Schultz
Thus spake Varshavchick Alexander <[EMAIL PROTECTED]>: > A question arises. The value 256 (1G KVA space) acts as a default for any > system installation, not depending of real phisical memory size. So for > any server with RAM less than 2G (which is a majority I presume) the KVA > space occupies mo

Re: maxusers and random system freezes

2002-12-05 Thread Varshavchick Alexander
On Thu, 5 Dec 2002, Terry Lambert wrote: > IMO, KVA need to be more than half of physical memory. But I tend > to use a lot of mbufs and mbuf clusters in products I work on lately > (mostly networking stuff). If you don't tune kernel memory usage up, > then you may be able to get away with 2G.

Re: maxusers and random system freezes

2002-12-05 Thread David Schultz
Thus spake Terry Lambert <[EMAIL PROTECTED]>: > As a rule, swap should be at least physical memory size + 64K on > any system that you need to be able to get a system dump from, > since it needs to dump physical RAM. If you are not worried about > the machine falling over, then you can ignore that

Re: maxusers and random system freezes

2002-12-05 Thread Terry Lambert
Varshavchick Alexander wrote: > > So: 2G might be OK, 3G would be more certain, given you are cranking > > some things up, in the config you posted, that make me think you will > > be eating more physical memory. > > Are you talking primarily about SHMMAXPGS=262144 option here? Then may be > it'll

Re: maxusers and random system freezes

2002-12-05 Thread Varshavchick Alexander
On Thu, 5 Dec 2002, Terry Lambert wrote: ... > > Because it's not defined in the custom > > server's kernel then it's value default to 256 (FreeBSD 4.5-STABLE), which > > makes the KVA space to occupy 1G. Then if I make KVA_PAGES=512 (KVA space > > 2G), will it solve the problem for this particul

Re: maxusers and random system freezes

2002-12-05 Thread Terry Lambert
Varshavchick Alexander wrote: > On Wed, 4 Dec 2002, Terry Lambert wrote: > > > grep -B 7 KVA_ /sys/i386/conf/LINT > > Thanks a lot Terry, and will you please correct me if I'm wrong, so I > don't mess anything up on a production server? The kernel option in > question is KVA_PAGES, correct?

Re: maxusers and random system freezes

2002-12-05 Thread Varshavchick Alexander
On Wed, 4 Dec 2002, Terry Lambert wrote: > grep -B 7 KVA_ /sys/i386/conf/LINT > > -- Terry > Thanks a lot Terry, and will you please correct me if I'm wrong, so I don't mess anything up on a production server? The kernel option in question is KVA_PAGES, correct? Because it's not defined in t

Re: maxusers and random system freezes

2002-12-04 Thread Terry Lambert
Marc Recht wrote: > Every now and this I hear people saying (mostly you :)) that some problems > are KVA related or that the KVA must be increased. This makes me a bit > curious, since I've never seen problems like that on Linux. It sounds for > me, the not kernel hacker, a bit like something which

Re: maxusers and random system freezes

2002-12-04 Thread Marc Recht
With these settings, and that much physical RAM, you should set your KVA space to 3G (the default is 2G); have you? Most likely, you are running out of KVA space for mappings. Every now and this I hear people saying (mostly you :)) that some problems are KVA related or that the KVA must be incre

Re: maxusers and random system freezes

2002-12-04 Thread Terry Lambert
Varshavchick Alexander wrote: > > With these settings, and that much physical RAM, you should set > > your KVA space to 3G (the default is 2G); have you? > > > > Most likely, you are running out of KVA space for mappings. > > No, I didn't do it, and I'm not sure how to perform it, can you please >

Re: maxusers and random system freezes

2002-12-04 Thread Varshavchick Alexander
On Wed, 4 Dec 2002, Terry Lambert wrote: > Varshavchick Alexander wrote: > > Can it be so that kernel maxusers=768 value being more than 512 leads to > > spontaneous system freezes which can take up to several hours when the > > system is just sleeping (only replying to ping) and doing nothing els

Re: maxusers and random system freezes

2002-12-04 Thread Terry Lambert
Varshavchick Alexander wrote: > Can it be so that kernel maxusers=768 value being more than 512 leads to > spontaneous system freezes which can take up to several hours when the > system is just sleeping (only replying to ping) and doing nothing else, > not allowing to telnet or anything. The syste

maxusers and random system freezes

2002-12-04 Thread Varshavchick Alexander
Hi people, Can it be so that kernel maxusers=768 value being more than 512 leads to spontaneous system freezes which can take up to several hours when the system is just sleeping (only replying to ping) and doing nothing else, not allowing to telnet or anything. The system is 4.5-STABLE with much