Re: FreeBSD 9.0 hangs on heavy I/O

2012-06-10 Thread Kees Jan Koster
Dear All, Been a while since I worked on this and I thought I'd send out an update. I found out I had two related issues. Seemingly random hangs that seem to have their root in disk I/O and the other is that network connections are not being served quickly enough because of this. For the latte

Re: FreeBSD 9.0 hangs on heavy I/O

2012-05-29 Thread Gary Palmer
On Tue, May 29, 2012 at 10:59:58PM +0200, Kees Jan Koster wrote: > Dear Gary, > > >> # camcontrol devlist > >> at scbus1 target 0 lun 0 (pass0,ada0) > >> at scbus2 target 0 lun 0 (pass1,ada1) > >> at scbus3 target 0 lun 0 (pass2,ada2) > >> at scbus4 target 0 lun 0 (pa

Re: FreeBSD 9.0 hangs on heavy I/O

2012-05-29 Thread Freddie Cash
On Tue, May 29, 2012 at 2:30 PM, Kees Jan Koster wrote: > Dear Freddie, > >> Granted, I haven't played with gsched yet (most of our high-I/O >> systems are ZFS), so there may be a way to use it across-GEOMs. > > From my previous experiments ZFS suffers the same fate when there is heavy > write ac

Re: FreeBSD 9.0 hangs on heavy I/O

2012-05-29 Thread Kees Jan Koster
Dear Freddie, > Granted, I haven't played with gsched yet (most of our high-I/O > systems are ZFS), so there may be a way to use it across-GEOMs. From my previous experiments ZFS suffers the same fate when there is heavy write activity. Reads just don't get served in time. How do you deal with

Re: FreeBSD 9.0 hangs on heavy I/O

2012-05-29 Thread Freddie Cash
On Tue, May 29, 2012 at 2:12 PM, Kees Jan Koster wrote: >>> You may want to play around with gshed, the GEOM Scheduler. >>> >>> Matt Dillon did a bunch of tests comparing FreeBSD+UFS to >>> DragonflyBSD+HAMMER and found that FreeBSD starves read threads in >>> order to satisfy write threads (or th

Re: FreeBSD 9.0 hangs on heavy I/O

2012-05-29 Thread Kees Jan Koster
Dear Freddie, >> You may want to play around with gshed, the GEOM Scheduler. >> >> Matt Dillon did a bunch of tests comparing FreeBSD+UFS to >> DragonflyBSD+HAMMER and found that FreeBSD starves read threads in >> order to satisfy write threads (or the other way around?). But, >> adding gsched i

Re: FreeBSD 9.0 hangs on heavy I/O

2012-05-29 Thread Kees Jan Koster
Dear Gary, >> # camcontrol devlist >> at scbus1 target 0 lun 0 (pass0,ada0) >> at scbus2 target 0 lun 0 (pass1,ada1) >> at scbus3 target 0 lun 0 (pass2,ada2) >> at scbus4 target 0 lun 0 (pass3,ada3) >> at scbus7 target 0 lun 0 (pass4,cd0) >> at scbus8 targ

Re: FreeBSD 9.0 hangs on heavy I/O

2012-05-29 Thread Kees Jan Koster
Dear Doug, >> I seem to have a problem where really heavy disk I/O is drowning my machine. > > Assuming you're using the default scheduler (SCHED_ULE), try switching > to the 4BSD scheduler in your kernel config file and see if that helps. I will, thanks for the suggestion. -- Kees Jan http://

Re: FreeBSD 9.0 hangs on heavy I/O

2012-05-29 Thread Kees Jan Koster
Dear Freddie, >> You may want to play around with gshed, the GEOM Scheduler. >> >> Matt Dillon did a bunch of tests comparing FreeBSD+UFS to >> DragonflyBSD+HAMMER and found that FreeBSD starves read threads in >> order to satisfy write threads (or the other way around?). But, >> adding gsched i

Re: FreeBSD 9.0 hangs on heavy I/O

2012-05-29 Thread Gary Palmer
On Tue, May 29, 2012 at 09:26:32PM +0200, Kees Jan Koster wrote: > Dear All, > > I seem to have a problem where really heavy disk I/O is drowning my machine. > I see hangs in the shell where I am logged on using ssh. Network connections > get dropped for no apparent reason and some HTTP requests

Re: FreeBSD 9.0 hangs on heavy I/O

2012-05-29 Thread Freddie Cash
On Tue, May 29, 2012 at 12:34 PM, Freddie Cash wrote: > On Tue, May 29, 2012 at 12:26 PM, Kees Jan Koster wrote: >> I seem to have a problem where really heavy disk I/O is drowning my machine. >> I see hangs in the shell where I am logged on using ssh. Network connections >> get dropped for no

Re: FreeBSD 9.0 hangs on heavy I/O

2012-05-29 Thread Freddie Cash
On Tue, May 29, 2012 at 12:26 PM, Kees Jan Koster wrote: > I seem to have a problem where really heavy disk I/O is drowning my machine. > I see hangs in the shell where I am logged on using ssh. Network connections > get dropped for no apparent reason and some HTTP requests are served really >

Re: FreeBSD 9.0 hangs on heavy I/O

2012-05-29 Thread Doug Barton
On 5/29/2012 12:26 PM, Kees Jan Koster wrote: > I seem to have a problem where really heavy disk I/O is drowning my machine. Assuming you're using the default scheduler (SCHED_ULE), try switching to the 4BSD scheduler in your kernel config file and see if that helps. Doug -- This .signatur