Re: Speed improvements in ZFS

Am 2023-09-15 13:40, schrieb George Michaelson: Not wanting to hijack threads I am interested if any of this can translate back up tree and make Linux ZFS faster. And, if there are simple sysctl tuning worth trying in large (tb) memory model pre 14 FreeBSD systems with slow zfs. Older freebsd

Re: Speed improvements in ZFS

Not wanting to hijack threads I am interested if any of this can translate back up tree and make Linux ZFS faster. And, if there are simple sysctl tuning worth trying in large (tb) memory model pre 14 FreeBSD systems with slow zfs. Older freebsd alas.

Re: Speed improvements in ZFS

Am 2023-09-04 14:26, schrieb Mateusz Guzik: On 9/4/23, Alexander Leidinger wrote: Am 2023-08-28 22:33, schrieb Alexander Leidinger: Am 2023-08-22 18:59, schrieb Mateusz Guzik: On 8/22/23, Alexander Leidinger wrote: Am 2023-08-21 10:53, schrieb Konstantin Belousov: On Mon, Aug 21, 2023 at 08

Re: Speed improvements in ZFS

On 9/4/23, Alexander Leidinger wrote: > Am 2023-08-28 22:33, schrieb Alexander Leidinger: >> Am 2023-08-22 18:59, schrieb Mateusz Guzik: >>> On 8/22/23, Alexander Leidinger wrote: Am 2023-08-21 10:53, schrieb Konstantin Belousov: > On Mon, Aug 21, 2023 at 08:19:28AM +0200, Alexander Leid

Re: Speed improvements in ZFS

Am 2023-08-28 22:33, schrieb Alexander Leidinger: Am 2023-08-22 18:59, schrieb Mateusz Guzik: On 8/22/23, Alexander Leidinger wrote: Am 2023-08-21 10:53, schrieb Konstantin Belousov: On Mon, Aug 21, 2023 at 08:19:28AM +0200, Alexander Leidinger wrote: Am 2023-08-20 23:17, schrieb Konstantin

Re: Speed improvements in ZFS

Am 2023-08-22 18:59, schrieb Mateusz Guzik: On 8/22/23, Alexander Leidinger wrote: Am 2023-08-21 10:53, schrieb Konstantin Belousov: On Mon, Aug 21, 2023 at 08:19:28AM +0200, Alexander Leidinger wrote: Am 2023-08-20 23:17, schrieb Konstantin Belousov: > On Sun, Aug 20, 2023 at 11:07:08PM +020

Re: Speed improvements in ZFS

On 8/22/23, Alexander Leidinger wrote: > Am 2023-08-21 10:53, schrieb Konstantin Belousov: >> On Mon, Aug 21, 2023 at 08:19:28AM +0200, Alexander Leidinger wrote: >>> Am 2023-08-20 23:17, schrieb Konstantin Belousov: >>> > On Sun, Aug 20, 2023 at 11:07:08PM +0200, Mateusz Guzik wrote: >>> > > On 8

Re: Speed improvements in ZFS

Am 2023-08-21 10:53, schrieb Konstantin Belousov: On Mon, Aug 21, 2023 at 08:19:28AM +0200, Alexander Leidinger wrote: Am 2023-08-20 23:17, schrieb Konstantin Belousov: > On Sun, Aug 20, 2023 at 11:07:08PM +0200, Mateusz Guzik wrote: > > On 8/20/23, Alexander Leidinger wrote: > > > Am 2023-08-2

Re: Speed improvements in ZFS

On Mon, Aug 21, 2023 at 08:19:28AM +0200, Alexander Leidinger wrote: > Am 2023-08-20 23:17, schrieb Konstantin Belousov: > > On Sun, Aug 20, 2023 at 11:07:08PM +0200, Mateusz Guzik wrote: > > > On 8/20/23, Alexander Leidinger wrote: > > > > Am 2023-08-20 22:02, schrieb Mateusz Guzik: > > > >> On 8

Re: Speed improvements in ZFS

Am 2023-08-20 23:17, schrieb Konstantin Belousov: On Sun, Aug 20, 2023 at 11:07:08PM +0200, Mateusz Guzik wrote: On 8/20/23, Alexander Leidinger wrote: > Am 2023-08-20 22:02, schrieb Mateusz Guzik: >> On 8/20/23, Alexander Leidinger wrote: >>> Am 2023-08-20 19:10, schrieb Mateusz Guzik: O

Re: Speed improvements in ZFS

On Sun, Aug 20, 2023 at 11:07:08PM +0200, Mateusz Guzik wrote: > On 8/20/23, Alexander Leidinger wrote: > > Am 2023-08-20 22:02, schrieb Mateusz Guzik: > >> On 8/20/23, Alexander Leidinger wrote: > >>> Am 2023-08-20 19:10, schrieb Mateusz Guzik: > On 8/18/23, Alexander Leidinger wrote: > >>

Re: Speed improvements in ZFS

On 8/20/23, Alexander Leidinger wrote: > Am 2023-08-20 22:02, schrieb Mateusz Guzik: >> On 8/20/23, Alexander Leidinger wrote: >>> Am 2023-08-20 19:10, schrieb Mateusz Guzik: On 8/18/23, Alexander Leidinger wrote: >>> > I have a 51MB text file, compressed to about 1MB. Are you intereste

Re: Speed improvements in ZFS

Am 2023-08-20 22:02, schrieb Mateusz Guzik: On 8/20/23, Alexander Leidinger wrote: Am 2023-08-20 19:10, schrieb Mateusz Guzik: On 8/18/23, Alexander Leidinger wrote: I have a 51MB text file, compressed to about 1MB. Are you interested to get it? Your problem is not the vnode limit, but

Re: Speed improvements in ZFS

On 8/20/23, Alexander Leidinger wrote: > Am 2023-08-20 19:10, schrieb Mateusz Guzik: >> On 8/18/23, Alexander Leidinger wrote: > >>> I have a 51MB text file, compressed to about 1MB. Are you interested >>> to >>> get it? >>> >> >> Your problem is not the vnode limit, but nullfs. >> >> https://peo

Re: Speed improvements in ZFS

Am 2023-08-20 19:10, schrieb Mateusz Guzik: On 8/18/23, Alexander Leidinger wrote: I have a 51MB text file, compressed to about 1MB. Are you interested to get it? Your problem is not the vnode limit, but nullfs. https://people.freebsd.org/~mjg/netchild-periodic-find.svg 122 nullfs moun

Re: Speed improvements in ZFS

On 8/18/23, Alexander Leidinger wrote: > Am 2023-08-16 18:48, schrieb Alexander Leidinger: >> Am 2023-08-15 23:29, schrieb Mateusz Guzik: >>> On 8/15/23, Alexander Leidinger wrote: Am 2023-08-15 14:41, schrieb Mateusz Guzik: > With this in mind can you provide: sysctl kern.maxvnodes

Re: Speed improvements in ZFS

On 8/18/23, Alexander Leidinger wrote: > Am 2023-08-16 18:48, schrieb Alexander Leidinger: >> Am 2023-08-15 23:29, schrieb Mateusz Guzik: >>> On 8/15/23, Alexander Leidinger wrote: Am 2023-08-15 14:41, schrieb Mateusz Guzik: > With this in mind can you provide: sysctl kern.maxvnodes

Re: Speed improvements in ZFS

Am 2023-08-16 18:48, schrieb Alexander Leidinger: Am 2023-08-15 23:29, schrieb Mateusz Guzik: On 8/15/23, Alexander Leidinger wrote: Am 2023-08-15 14:41, schrieb Mateusz Guzik: With this in mind can you provide: sysctl kern.maxvnodes vfs.wantfreevnodes vfs.freevnodes vfs.vnodes_created vfs.n

Re: Speed improvements in ZFS

Am 2023-08-15 23:29, schrieb Mateusz Guzik: On 8/15/23, Alexander Leidinger wrote: Am 2023-08-15 14:41, schrieb Mateusz Guzik: With this in mind can you provide: sysctl kern.maxvnodes vfs.wantfreevnodes vfs.freevnodes vfs.vnodes_created vfs.numvnodes vfs.recycles_free vfs.recycles After a r

Re: Speed improvements in ZFS

On 8/15/23, Alexander Leidinger wrote: > Am 2023-08-15 14:41, schrieb Mateusz Guzik: > >> With this in mind can you provide: sysctl kern.maxvnodes >> vfs.wantfreevnodes vfs.freevnodes vfs.vnodes_created vfs.numvnodes >> vfs.recycles_free vfs.recycles > > After a reboot: > kern.maxvnodes: 10485760

Re: Speed improvements in ZFS

When I watch the activity leds of the disks on one of our ZFS servers, I notice there will be a burst of activity for 3 or 4 seconds, then no activity for a couple of seconds, then it repeats. Is that normal? Thanks, joe Joe McGuckin ViaNet Communications j...@via.net 650-207-0372 cell 650-2

Re: Speed improvements in ZFS

Am 2023-08-15 14:41, schrieb Mateusz Guzik: With this in mind can you provide: sysctl kern.maxvnodes vfs.wantfreevnodes vfs.freevnodes vfs.vnodes_created vfs.numvnodes vfs.recycles_free vfs.recycles After a reboot: kern.maxvnodes: 10485760 vfs.wantfreevnodes: 2621440 vfs.freevnodes: 24696 vfs.

Re: Speed improvements in ZFS

On 8/15/23, Alexander Leidinger wrote: > Hi, > > just a report that I noticed a very high speed improvement in ZFS in > -current. Since a looong time (at least since last year), for a > jail-host of mine with about >20 jails on it which each runs periodic > daily, the periodic daily runs of the ja

Re: Speed improvements in ZFS

On 15/08/2023 13:05, Alexander Leidinger wrote: … periodic runs … Here, I get a sense that these benefit greatly from L2ARC. … So whatever was done inside ZFS or VFS or nullfs between 2023-06-19 and 2023-07-20 has given a huge speed improvement. …