Re: Freebsd 8.0 kmem map too small

2010-06-14 Thread Paul Schenkeveld
On Fri, Jun 11, 2010 at 04:12:50PM +0200, Florian Smeets wrote: > On 6/8/10 11:11 AM, Yoshiaki Kasahara wrote: > > Hello, > > > > I'd like to add another instance of similar problems. I recently > > updated my FreeBSD amd64 box with ZFS root and 8GB RAM from 8-STABLE > > (as of Mar 1st) to 8.1-PR

Re: Freebsd 8.0 kmem map too small

2010-06-11 Thread Florian Smeets
On 6/8/10 11:11 AM, Yoshiaki Kasahara wrote: > Hello, > > I'd like to add another instance of similar problems. I recently > updated my FreeBSD amd64 box with ZFS root and 8GB RAM from 8-STABLE > (as of Mar 1st) to 8.1-PRERELEASE (as of May 27th). After that, my > box started to crash every coup

Re: Freebsd 8.0 kmem map too small

2010-06-08 Thread Jeremy Chadwick
On Tue, Jun 08, 2010 at 07:26:45PM +0900, Yoshiaki Kasahara wrote: > On Tue, 8 Jun 2010 02:54:44 -0700, > Jeremy Chadwick said: > > > I realise you're talking about amd64, but I'm not sure how UMA is > > getting enabled on i386 to begin with. It does look like it's enabled > > on amd64 by

Re: Freebsd 8.0 kmem map too small

2010-06-08 Thread Pete French
> So to recap, vfs.zfs.zio.use_uma doesn't show up in sysctl output. Errr, does for me $ sysctl -a | grep vfs.zfs.zio.use_uma vfs.zfs.zio.use_uma: 1 Thats from 8.1-PRERELEASE on June 2nd. ...but all the question of sysctls is a bit of a red herring to me ?I'm more intyerested in whether we

Re: Freebsd 8.0 kmem map too small

2010-06-08 Thread Jeremy Chadwick
On Tue, Jun 08, 2010 at 12:20:36PM +0200, Pawel Jakub Dawidek wrote: > On Tue, Jun 08, 2010 at 02:54:44AM -0700, Jeremy Chadwick wrote: > > SYSCTL_DECL(_vfs_zfs); > > SYSCTL_NODE(_vfs_zfs, OID_AUTO, zio, CTLFLAG_RW, 0, "ZFS ZIO"); > > TUNABLE_INT("vfs.zfs.zio.use_uma", &zio_use_uma); > > SYSCTL_INT

Re: Freebsd 8.0 kmem map too small

2010-06-08 Thread Yoshiaki Kasahara
On Tue, 8 Jun 2010 02:54:44 -0700, Jeremy Chadwick said: > I realise you're talking about amd64, but I'm not sure how UMA is > getting enabled on i386 to begin with. It does look like it's enabled > on amd64 by default. I believe that this thread had been started before this tunable was

Re: Freebsd 8.0 kmem map too small

2010-06-08 Thread Pawel Jakub Dawidek
On Tue, Jun 08, 2010 at 02:54:44AM -0700, Jeremy Chadwick wrote: > SYSCTL_DECL(_vfs_zfs); > SYSCTL_NODE(_vfs_zfs, OID_AUTO, zio, CTLFLAG_RW, 0, "ZFS ZIO"); > TUNABLE_INT("vfs.zfs.zio.use_uma", &zio_use_uma); > SYSCTL_INT(_vfs_zfs_zio, OID_AUTO, use_uma, CTLFLAG_RDTUN, &zio_use_uma, 0, > "Use um

Re: Freebsd 8.0 kmem map too small

2010-06-08 Thread Jeremy Chadwick
On Tue, Jun 08, 2010 at 06:11:46PM +0900, Yoshiaki Kasahara wrote: > Hello, > > I'd like to add another instance of similar problems. I recently > updated my FreeBSD amd64 box with ZFS root and 8GB RAM from 8-STABLE > (as of Mar 1st) to 8.1-PRERELEASE (as of May 27th). After that, my > box start

Re: Freebsd 8.0 kmem map too small

2010-06-08 Thread Yoshiaki Kasahara
Hello, I'd like to add another instance of similar problems. I recently updated my FreeBSD amd64 box with ZFS root and 8GB RAM from 8-STABLE (as of Mar 1st) to 8.1-PRERELEASE (as of May 27th). After that, my box started to crash every couple of days due to kmem_map too small. Here is a (last we

Re: Freebsd 8.0 kmem map too small

2010-05-10 Thread Richard Perini
On Mon, May 10, 2010 at 04:43:26PM -0700, Artem Belevich wrote: > You can try disabling ZIO_USE_UMA in sys/modules/zfs/Makefile > > Comment out following line in that file: > CFLAGS+=-DZIO_USE_UMA > > This should revert memory allocation method back to its previous mode. > Let us know whether it

Re: Freebsd 8.0 kmem map too small

2010-05-10 Thread Artem Belevich
You can try disabling ZIO_USE_UMA in sys/modules/zfs/Makefile Comment out following line in that file: CFLAGS+=-DZIO_USE_UMA This should revert memory allocation method back to its previous mode. Let us know whether it helps or not. --Artem On Mon, May 10, 2010 at 4:14 PM, Richard Perini wro

Re: Freebsd 8.0 kmem map too small

2010-05-10 Thread Richard Perini
On Wed, May 05, 2010 at 03:33:02PM +0200, Pawel Jakub Dawidek wrote: > On Wed, May 05, 2010 at 10:46:31AM +0200, Giulio Ferro wrote: > > On 05.05.2010 09:52, Jeremy Chadwick wrote: > > > > Nope, it's happened again... Now I've tried to rise vm.kmem_size to 6G... > > [ ... ] > Could you try to t

Re: Freebsd 8.0 kmem map too small

2010-05-10 Thread Artem Belevich
vm.kmem_size limitation has been this way for a pretty long time. What's changed recently is that ZFS ARC now uses UMA for its memory allocations. If I understand it correctly, this would make ARC's memory use more efficient as allocated chunks will end up in a zone tuned for allocations of partic

Re: Freebsd 8.0 kmem map too small

2010-05-10 Thread Mike Andrews
On Mon, 10 May 2010, Steve Polyack wrote: On 05/10/10 11:55, Mike Andrews wrote: On 5/5/10 11:19 AM, Freddie Cash wrote: On Tue, May 4, 2010 at 11:32 PM, Giulio Ferro wrote: Giulio Ferro wrote: Thanks, I'll try these settings. I'll keep you posted. Nope, it's happened again... Now I'v

Re: Freebsd 8.0 kmem map too small

2010-05-10 Thread Steve Polyack
On 05/10/10 11:55, Mike Andrews wrote: On 5/5/10 11:19 AM, Freddie Cash wrote: On Tue, May 4, 2010 at 11:32 PM, Giulio Ferro wrote: Giulio Ferro wrote: Thanks, I'll try these settings. I'll keep you posted. Nope, it's happened again... Now I've tried to rise vm.kmem_size to 6G... I'm

Re: Freebsd 8.0 kmem map too small

2010-05-10 Thread Artem Belevich
> On this specific system, it has 32 GB physical memory and has > vfs.zfs.arc_max="2G" and vm.kmem_size="64G" in /boot/loader.conf.  The > latter was added per earlier suggestions on this list, but appears to be > ignored as "sysctl vm.kmem_size" returns about 2 GB (2172452864) anyway. Set vm.kmem

Re: Freebsd 8.0 kmem map too small

2010-05-10 Thread Jeremy Chadwick
On Mon, May 10, 2010 at 11:55:09AM -0400, Mike Andrews wrote: > Sorry to semi-hijack this, but... I'm also running into frequent > "kmem_map too small" panics on 8-STABLE, such as: > > panic: kmem_malloc(131072): kmem_map too small: 2023780352 total allocated > panic: kmem_malloc(131072): kmem_ma

Re: Freebsd 8.0 kmem map too small

2010-05-10 Thread Mike Andrews
On 5/5/10 11:19 AM, Freddie Cash wrote: On Tue, May 4, 2010 at 11:32 PM, Giulio Ferro wrote: Giulio Ferro wrote: Thanks, I'll try these settings. I'll keep you posted. Nope, it's happened again... Now I've tried to rise vm.kmem_size to 6G... I'm really astounded at how unstable zfs is, i

Re: Freebsd 8.0 kmem map too small

2010-05-06 Thread Ruben van Staveren
On 5 May 2010, at 15:33, Pawel Jakub Dawidek wrote: > Could you try to track down the commit that is causing your problems? > Could you try 8-STABLE kernel from before r206815? I do suspect something similar like that, and try to roll the kernel back too. I was just fine with 8.0 with zfs-on-roo

Re: Freebsd 8.0 kmem map too small

2010-05-05 Thread Freddie Cash
On Tue, May 4, 2010 at 11:32 PM, Giulio Ferro wrote: > Giulio Ferro wrote: > >> Thanks, I'll try these settings. >> >> I'll keep you posted. >> > > Nope, it's happened again... Now I've tried to rise vm.kmem_size to 6G... > I'm really astounded at how unstable zfs is, it's causing me a lot of > p

Re: Freebsd 8.0 kmem map too small

2010-05-05 Thread Steve Polyack
On 05/05/10 10:12, Ben Kelly wrote: On May 5, 2010, at 9:33 AM, Pawel Jakub Dawidek wrote: On Wed, May 05, 2010 at 10:46:31AM +0200, Giulio Ferro wrote: On 05.05.2010 09:52, Jeremy Chadwick wrote: Nope, it's happened again... Now I've tried to rise vm.kmem_size to 6G... D

Re: Freebsd 8.0 kmem map too small

2010-05-05 Thread Ben Kelly
On May 5, 2010, at 9:33 AM, Pawel Jakub Dawidek wrote: > On Wed, May 05, 2010 at 10:46:31AM +0200, Giulio Ferro wrote: >> On 05.05.2010 09:52, Jeremy Chadwick wrote: >> >> Nope, it's happened again... Now I've tried to rise vm.kmem_size to 6G... >> >> >>> Did you set both vm.kmem_size and vfs.

Re: Freebsd 8.0 kmem map too small

2010-05-05 Thread Pawel Jakub Dawidek
On Wed, May 05, 2010 at 10:46:31AM +0200, Giulio Ferro wrote: > On 05.05.2010 09:52, Jeremy Chadwick wrote: > > Nope, it's happened again... Now I've tried to rise vm.kmem_size to 6G... > > > >Did you set both vm.kmem_size and vfs.zfs.arc_max, setting the latter to > >something *less* than vm.km

Re: Freebsd 8.0 kmem map too small

2010-05-05 Thread Giulio Ferro
On 05.05.2010 11:11, Simun Mikecin wrote: - Original Message I'm really astounded at how unstable zfs is, it's causing me a lot of problem. Why isn't it stated in the handbook that zfs isn't up to production yet? Why people responsible for

Re: Freebsd 8.0 kmem map too small

2010-05-05 Thread Giulio Ferro
On 05.05.2010 09:52, Jeremy Chadwick wrote: Nope, it's happened again... Now I've tried to rise vm.kmem_size to 6G... Did you set both vm.kmem_size and vfs.zfs.arc_max, setting the latter to something *less* than vm.kmem_size? Yes. After your suggestion, I set vfs.zfs.arc_max: 375809638

Re: Freebsd 8.0 kmem map too small

2010-05-05 Thread Jeremy Chadwick
On Wed, May 05, 2010 at 08:32:03AM +0200, Giulio Ferro wrote: > Giulio Ferro wrote: > >Thanks, I'll try these settings. > > > >I'll keep you posted. > > Nope, it's happened again... Now I've tried to rise vm.kmem_size to 6G... Did you set both vm.kmem_size and vfs.zfs.arc_max, setting the latter

Re: Freebsd 8.0 kmem map too small

2010-05-04 Thread Giulio Ferro
Giulio Ferro wrote: Thanks, I'll try these settings. I'll keep you posted. Nope, it's happened again... Now I've tried to rise vm.kmem_size to 6G... I'm really astounded at how unstable zfs is, it's causing me a lot of problem. Why isn't it stated in the handbook that zfs isn't up to prod

Re: Freebsd 8.0 kmem map too small

2010-05-03 Thread Giulio Ferro
On 03.05.2010 13:01, Jeremy Chadwick wrote: On Mon, May 03, 2010 at 12:41:50PM +0200, Giulio Ferro wrote: NFS server amd64 Freebsd 8.0 recent (2 days ago) This server has been running for several months without problems. Beginning last week, however, I'm experiencing panics (about 1 per day

Re: Freebsd 8.0 kmem map too small

2010-05-03 Thread Jeremy Chadwick
On Mon, May 03, 2010 at 12:41:50PM +0200, Giulio Ferro wrote: > NFS server amd64 Freebsd 8.0 recent (2 days ago) > > This server has been running for several months without problems. > Beginning last week, however, I'm experiencing panics (about 1 per day) > with the error in the subject > > Curr

Freebsd 8.0 kmem map too small

2010-05-03 Thread Giulio Ferro
NFS server amd64 Freebsd 8.0 recent (2 days ago) This server has been running for several months without problems. Beginning last week, however, I'm experiencing panics (about 1 per day) with the error in the subject Current settings: vm.kmem_size_scale: 3 vm.kmem_size_max: 329853485875 vm.kme