Re: Network performance roadmap.

2001-07-17 Thread Bosko Milekic
On Fri, Jul 13, 2001 at 04:37:46PM -0500, Mike Silbersack wrote: > Jiangyi Liu has been working on mbuf limiting code for the past week or > so. What he has is pretty complete, I expect to get most of it committed > once Bosko gets back. Well, I'm back. I'm now going to bed but my INBOX

Re: Network performance roadmap.

2001-07-13 Thread Julian Elischer
definitly don't stop. Talk to people doing stuff and get involved... On Fri, 13 Jul 2001, Leo Bicknell wrote: > On Fri, Jul 13, 2001 at 04:37:46PM -0500, Mike Silbersack wrote: > > Jiangyi Liu has been working on mbuf limiting code for the past week or > > so. What he has is pretty complete,

Re: Network performance roadmap.

2001-07-13 Thread Leo Bicknell
On Fri, Jul 13, 2001 at 04:37:46PM -0500, Mike Silbersack wrote: > Jiangyi Liu has been working on mbuf limiting code for the past week or > so. What he has is pretty complete, I expect to get most of it committed > once Bosko gets back. *nod* > There are tons of nice ideas presented here, but

Re: Network performance roadmap.

2001-07-13 Thread Mike Silbersack
On Fri, 13 Jul 2001, Leo Bicknell wrote: > Let's go through some new details: > > 1) FreeBSD's TCP windows cannot grow large enough to allow for >optimum performance. The primary obstical to raising them is >that if you do so, the system can run out of MBUF's. Schemes >need to

Re: Network performance roadmap.

2001-07-13 Thread Leo Bicknell
On Fri, Jul 13, 2001 at 01:03:59PM -0700, Terry Lambert wrote: > When I run out of mbufs, I do not have "bad things happen". > > The "bad things" are an artifact of memory overcommit; if you One thing is clear is that we're talking about two different level of problems. On the systems I run (ad

Re: Network performance roadmap.

2001-07-13 Thread Terry Lambert
Bernd Walter wrote: > > On Fri, Jul 13, 2001 at 03:12:57PM -0400, Leo Bicknell wrote: > > On Fri, Jul 13, 2001 at 12:00:04PM -0700, Terry Lambert wrote: > > > One good way to prevent this is to not unreasonably set > > > your window size... 8-p. > > > > Ah, I see, so to prevent MBUF exhaustion I

Re: Network performance roadmap.

2001-07-13 Thread Terry Lambert
Leo Bicknell wrote: > > > B) When the system runs out of MBUF's, really bad things happen. It > > >would be nice to make the system handle MBUF exhaustion in a nicer > > >way, or avoid it. > > > > The easiest way to do this is to know ahead of time how many > > you _really_ have. Then ba

Re: Network performance roadmap.

2001-07-13 Thread Bernd Walter
On Fri, Jul 13, 2001 at 03:12:57PM -0400, Leo Bicknell wrote: > On Fri, Jul 13, 2001 at 12:00:04PM -0700, Terry Lambert wrote: > > One good way to prevent this is to not unreasonably set > > your window size... 8-p. > > Ah, I see, so to prevent MBUF exhaustion I should not let > my socket buffers

Re: Network performance roadmap.

2001-07-13 Thread Leo Bicknell
On Fri, Jul 13, 2001 at 10:11:07AM -0400, Leo Bicknell wrote: > c - Prevent MBUF exhaustion. Today, when you run out of MBUF's, bad > things start to happen. It would be nice to prevent that from > happening, and also to provide sysadmins some warning when it is > about to happen. S

Re: Network performance roadmap.

2001-07-13 Thread Leo Bicknell
On Fri, Jul 13, 2001 at 12:00:04PM -0700, Terry Lambert wrote: > Not quite true. They are administratively limited, because of > the artificial fixed ratio of mbufs to clusters. This is a > design problem, not a physical limitation. I understand they are administratively limited. Also, I under

Re: Network performance roadmap.

2001-07-13 Thread Terry Lambert
Leo Bicknell wrote: > 1) FreeBSD's TCP windows cannot grow large enough to allow for >optimum performance. The primary obstical to raising them is >that if you do so, the system can run out of MBUF's. Schemes >need to be put in place to limit MBUF usage, and better allocate >buff

Re: Network performance roadmap.

2001-07-13 Thread Leo Bicknell
On Fri, Jul 13, 2001 at 01:14:07PM -0700, Julian Elischer wrote: > I would suggest that 2 * the current window may be too small > because the window might be increasing and > reception of one ack might move the window up by > the entire transmitted window size, resulting in starvation > if the w

Re: Network performance roadmap.

2001-07-13 Thread Julian Elischer
On Fri, 13 Jul 2001, Leo Bicknell wrote: > [...] I think you have analysed it very well.. I can summarise: We want the ability to make the current window to be able to grow to a very large value if the link needs it. So sndbuf shold eb set high. We don't want every process buffering in adv

Network performance roadmap.

2001-07-13 Thread Leo Bicknell
After talking with a number of people and reading some more papers, I think I can put together a better road map for what should be done to increase network performance. The good news is there are some immediate bandaids. In particular, I'd like those who are working on comitting network change