Re: Fwd: Re: Fedora27: NFS v4 terrible write performance, is async working

2018-02-14 Thread J. Bruce Fields
On Mon, Feb 05, 2018 at 06:06:29PM -0500, J. Bruce Fields wrote: > Or this?: > > > https://www.newegg.com/Product/Product.aspx?Item=N82E16820156153&cm_re=ssd_power_loss_protection-_-20-156-153-_-Product Ugh, Anandtech explains that their marketing is misleading, that drive can't actually d

Re: Fwd: Re: Fedora27: NFS v4 terrible write performance, is async working

2018-02-08 Thread J. Bruce Fields
On Thu, Feb 08, 2018 at 08:21:44PM +, Terry Barnaby wrote: > Doesn't fsync() and perhaps sync() work across NFS then when the server has > an async export, No. On a local filesystem, a file create followed by a sync will ensure the file create reaches disk. Normally on NFS, the same is true-

Re: Fwd: Re: Fedora27: NFS v4 terrible write performance, is async working

2018-02-08 Thread Terry Barnaby
On 06/02/18 21:48, J. Bruce Fields wrote: On Tue, Feb 06, 2018 at 08:18:27PM +, Terry Barnaby wrote: Well, when a program running on a system calls open(), write() etc. to the local disk FS the disk's contents is not actually updated. The data is in server buffers until the next sync/fsync o

Re: Fwd: Re: Fedora27: NFS v4 terrible write performance, is async working

2018-02-06 Thread J. Bruce Fields
On Tue, Feb 06, 2018 at 08:18:27PM +, Terry Barnaby wrote: > Well, when a program running on a system calls open(), write() etc. to the > local disk FS the disk's contents is not actually updated. The data is in > server buffers until the next sync/fsync or some time has passed. So, in > your p

Re: Fwd: Re: Fedora27: NFS v4 terrible write performance, is async working

2018-02-06 Thread Terry Barnaby
On 06/02/18 18:55, J. Bruce Fields wrote: On Tue, Feb 06, 2018 at 06:49:28PM +, Terry Barnaby wrote: On 05/02/18 14:52, J. Bruce Fields wrote: Yet another poor NFSv3 performance issue. If I do a "ls -lR" of a certain NFS mounted directory over a slow link (NFS over Openvpn over FTTP 80/20Mb

Re: Fwd: Re: Fedora27: NFS v4 terrible write performance, is async working

2018-02-06 Thread Terry Barnaby
On 05/02/18 23:06, J. Bruce Fields wrote: On Thu, Feb 01, 2018 at 08:29:49AM +, Terry Barnaby wrote: 1. Have an OPEN-SETATTR-WRITE RPC call all in one and a SETATTR-CLOSE call all in one. This would reduce the latency of a small file to 1ms rather than 3ms thus 66% faster. Would require the

Re: Fwd: Re: Fedora27: NFS v4 terrible write performance, is async working

2018-02-06 Thread Terry Barnaby
On 05/02/18 14:52, J. Bruce Fields wrote: Yet another poor NFSv3 performance issue. If I do a "ls -lR" of a certain NFS mounted directory over a slow link (NFS over Openvpn over FTTP 80/20Mbps), just after mounting the file system (default NFSv4 mount with async), it takes about 9 seconds. If I r

Re: Fwd: Re: Fedora27: NFS v4 terrible write performance, is async working

2018-02-06 Thread J. Bruce Fields
On Tue, Feb 06, 2018 at 06:49:28PM +, Terry Barnaby wrote: > On 05/02/18 14:52, J. Bruce Fields wrote: > > > Yet another poor NFSv3 performance issue. If I do a "ls -lR" of a certain > > > NFS mounted directory over a slow link (NFS over Openvpn over FTTP > > > 80/20Mbps), just after mounting t

Re: Fwd: Re: Fedora27: NFS v4 terrible write performance, is async working

2018-02-05 Thread J. Bruce Fields
On Thu, Feb 01, 2018 at 08:29:49AM +, Terry Barnaby wrote: > 1. Have an OPEN-SETATTR-WRITE RPC call all in one and a SETATTR-CLOSE call > all in one. This would reduce the latency of a small file to 1ms rather than > 3ms thus 66% faster. Would require the client to delay the OPEN/SETATTR > unti

Re: Fwd: Re: Fedora27: NFS v4 terrible write performance, is async working

2018-02-05 Thread J. Bruce Fields
On Mon, Feb 05, 2018 at 08:21:06AM +, Terry Barnaby wrote: > On 01/02/18 08:29, Terry Barnaby wrote: > > On 01/02/18 01:34, Jeremy Linton wrote: > > > On 01/31/2018 09:49 AM, J. Bruce Fields wrote: > > > > On Tue, Jan 30, 2018 at 01:52:49PM -0600, Jeremy Linton wrote: > > > > > Have you tried t

Re: Fwd: Re: Fedora27: NFS v4 terrible write performance, is async working

2018-02-05 Thread Chris Murphy
http://vger.kernel.org/vger-lists.html#linux-nfs -- Chris Murphy ___ devel mailing list -- devel@lists.fedoraproject.org To unsubscribe send an email to devel-le...@lists.fedoraproject.org

Re: Fwd: Re: Fedora27: NFS v4 terrible write performance, is async working

2018-02-05 Thread Terry Barnaby
On 01/02/18 08:29, Terry Barnaby wrote: On 01/02/18 01:34, Jeremy Linton wrote: On 01/31/2018 09:49 AM, J. Bruce Fields wrote: On Tue, Jan 30, 2018 at 01:52:49PM -0600, Jeremy Linton wrote: Have you tried this with a '-o nfsvers=3' during mount? Did that help? I noticed a large decrease in my

Re: Fwd: Re: Fedora27: NFS v4 terrible write performance, is async working

2018-02-01 Thread J. Bruce Fields
On Wed, Jan 31, 2018 at 07:34:24PM -0600, Jeremy Linton wrote: > On 01/31/2018 09:49 AM, J. Bruce Fields wrote: > > In the kernel compile case there's probably also a lot of re-opening and > > re-reading files too? NFSv4 is chattier there too. Read delegations > > should help compensate, but we n

Re: Fwd: Re: Fedora27: NFS v4 terrible write performance, is async working

2018-02-01 Thread Terry Barnaby
On 01/02/18 01:34, Jeremy Linton wrote: On 01/31/2018 09:49 AM, J. Bruce Fields wrote: On Tue, Jan 30, 2018 at 01:52:49PM -0600, Jeremy Linton wrote: Have you tried this with a '-o nfsvers=3' during mount? Did that help? I noticed a large decrease in my kernel build times across NFS/lan a whi

Re: Fwd: Re: Fedora27: NFS v4 terrible write performance, is async working

2018-01-31 Thread Jeremy Linton
On 01/31/2018 09:49 AM, J. Bruce Fields wrote: On Tue, Jan 30, 2018 at 01:52:49PM -0600, Jeremy Linton wrote: Have you tried this with a '-o nfsvers=3' during mount? Did that help? I noticed a large decrease in my kernel build times across NFS/lan a while back after a machine/kernel/10g upgrade

Re: Fwd: Re: Fedora27: NFS v4 terrible write performance, is async working

2018-01-31 Thread J. Bruce Fields
On Tue, Jan 30, 2018 at 01:52:49PM -0600, Jeremy Linton wrote: > Have you tried this with a '-o nfsvers=3' during mount? Did that help? > > I noticed a large decrease in my kernel build times across NFS/lan a while > back after a machine/kernel/10g upgrade. After playing with mount/export > option

Re: Fwd: Re: Fedora27: NFS v4 terrible write performance, is async working

2018-01-30 Thread J. Bruce Fields
On Tue, Jan 30, 2018 at 10:30:04PM +, Terry Barnaby wrote: > Also, on the 0.5ms. Is this effectively the 1ms system tick ie. the NFS > processing is not processing based on the packet events (not pre-emptive) > but on the next system tick ? > > An ICMP ping is about 0.13ms (to and fro) between

Re: Fwd: Re: Fedora27: NFS v4 terrible write performance, is async working

2018-01-30 Thread Terry Barnaby
On 30/01/18 21:31, J. Bruce Fields wrote: On Tue, Jan 30, 2018 at 07:03:17PM +, Terry Barnaby wrote: It looks like each RPC call takes about 0.5ms. Why do there need to be some many RPC calls for this ? The OPEN call could set the attribs, no need for the later GETATTR or SETATTR calls. The

Re: Fwd: Re: Fedora27: NFS v4 terrible write performance, is async working

2018-01-30 Thread J. Bruce Fields
On Tue, Jan 30, 2018 at 04:31:58PM -0500, J. Bruce Fields wrote: > On Tue, Jan 30, 2018 at 07:03:17PM +, Terry Barnaby wrote: > > It looks like each RPC call takes about 0.5ms. Why do there need to be some > > many RPC calls for this ? The OPEN call could set the attribs, no need for > > the la

Re: Fwd: Re: Fedora27: NFS v4 terrible write performance, is async working

2018-01-30 Thread J. Bruce Fields
On Tue, Jan 30, 2018 at 07:03:17PM +, Terry Barnaby wrote: > It looks like each RPC call takes about 0.5ms. Why do there need to be some > many RPC calls for this ? The OPEN call could set the attribs, no need for > the later GETATTR or SETATTR calls. The first SETATTR (which sets ctime and mt

Re: Fwd: Re: Fedora27: NFS v4 terrible write performance, is async working

2018-01-30 Thread Jeremy Linton
Hi, On 01/30/2018 01:03 PM, Terry Barnaby wrote: Being a daredevil, I have used the NFS async option for 27 years without an issue on multiple systems :) I have just mounted my ext4 disk with the same options you were using and the same NFS export options and the speed here looks the same a

Re: Fwd: Re: Fedora27: NFS v4 terrible write performance, is async working

2018-01-30 Thread Terry Barnaby
Being a daredevil, I have used the NFS async option for 27 years without an issue on multiple systems :) I have just mounted my ext4 disk with the same options you were using and the same NFS export options and the speed here looks the same as I had previously. As I can't wait 2+ hours so I'

Re: Fwd: Re: Fedora27: NFS v4 terrible write performance, is async working

2018-01-30 Thread Terry Barnaby
On 30/01/18 17:54, J. Bruce Fields wrote: On Tue, Jan 30, 2018 at 12:31:22PM -0500, J. Bruce Fields wrote: On Tue, Jan 30, 2018 at 04:49:41PM +, Terry Barnaby wrote: I have just tried running the untar on our work systems. These are again Fedora27 but newer hardware. I set one of the server

Re: Fwd: Re: Fedora27: NFS v4 terrible write performance, is async working

2018-01-30 Thread J. Bruce Fields
On Tue, Jan 30, 2018 at 12:31:22PM -0500, J. Bruce Fields wrote: > On Tue, Jan 30, 2018 at 04:49:41PM +, Terry Barnaby wrote: > > I have just tried running the untar on our work systems. These are again > > Fedora27 but newer hardware. > > I set one of the servers NFS exports to just rw (remove

Re: Fwd: Re: Fedora27: NFS v4 terrible write performance, is async working

2018-01-30 Thread J. Bruce Fields
On Tue, Jan 30, 2018 at 04:49:41PM +, Terry Barnaby wrote: > I have just tried running the untar on our work systems. These are again > Fedora27 but newer hardware. > I set one of the servers NFS exports to just rw (removed the async option in > /etc/exports and ran exportfs -arv). > Remounted

Re: Fwd: Re: Fedora27: NFS v4 terrible write performance, is async working

2018-01-30 Thread Terry Barnaby
On 30/01/18 16:22, J. Bruce Fields wrote: On Tue, Jan 30, 2018 at 03:29:41PM +, Terry Barnaby wrote: On 30/01/18 15:09, J. Bruce Fields wrote: By comparison on my little home server (Fedora, ext4, a couple WD Black 1TB drives), with sync, that untar takes is 7:44, about 8ms/file. Ok, that

Re: Fwd: Re: Fedora27: NFS v4 terrible write performance, is async working

2018-01-30 Thread J. Bruce Fields
On Tue, Jan 30, 2018 at 03:29:41PM +, Terry Barnaby wrote: > On 30/01/18 15:09, J. Bruce Fields wrote: > > By comparison on my little home server (Fedora, ext4, a couple WD Black > > 1TB drives), with sync, that untar takes is 7:44, about 8ms/file. > Ok, that is far more reasonable, so somethin

Re: Fwd: Re: Fedora27: NFS v4 terrible write performance, is async working

2018-01-30 Thread Terry Barnaby
On 30/01/18 15:09, J. Bruce Fields wrote: On Tue, Jan 30, 2018 at 08:49:27AM +, Terry Barnaby wrote: On 29/01/18 22:28, J. Bruce Fields wrote: On Mon, Jan 29, 2018 at 08:37:50PM +, Terry Barnaby wrote: Ok, that's a shame unless NFSv4's write performance with small files/dirs is relativ

Re: Fwd: Re: Fedora27: NFS v4 terrible write performance, is async working

2018-01-30 Thread J. Bruce Fields
On Tue, Jan 30, 2018 at 08:49:27AM +, Terry Barnaby wrote: > On 29/01/18 22:28, J. Bruce Fields wrote: > > On Mon, Jan 29, 2018 at 08:37:50PM +, Terry Barnaby wrote: > > > Ok, that's a shame unless NFSv4's write performance with small files/dirs > > > is relatively ok which it isn't on my s

Re: Fwd: Re: Fedora27: NFS v4 terrible write performance, is async working

2018-01-30 Thread Terry Barnaby
On 29/01/18 22:28, J. Bruce Fields wrote: On Mon, Jan 29, 2018 at 08:37:50PM +, Terry Barnaby wrote: Ok, that's a shame unless NFSv4's write performance with small files/dirs is relatively ok which it isn't on my systems. Although async was "unsafe" this was not an issue in main standard sce

Re: Fwd: Re: Fedora27: NFS v4 terrible write performance, is async working

2018-01-29 Thread Petr Pisar
On 2018-01-29, J. Bruce Fields wrote: > The file create isn't allowed to return until the server has created the > file and the change has actually reached disk. > Why is there such a requirement? This is not true for local file systems. This is why fsync() exists. -- Petr ___

Re: Fwd: Re: Fedora27: NFS v4 terrible write performance, is async working

2018-01-29 Thread J. Bruce Fields
On Mon, Jan 29, 2018 at 08:37:50PM +, Terry Barnaby wrote: > Ok, that's a shame unless NFSv4's write performance with small files/dirs > is relatively ok which it isn't on my systems. > Although async was "unsafe" this was not an issue in main standard > scenarios such as an NFS mounted home di

Re: Fwd: Re: Fedora27: NFS v4 terrible write performance, is async working

2018-01-29 Thread Terry Barnaby
On 29/01/18 19:50, Steve Dickson wrote: On 01/29/2018 12:42 PM, Steven Whitehouse wrote: Forwarded Message Subject:Re: Fedora27: NFS v4 terrible write performance, is async working Date: Sun, 28 Jan 2018 21:17:02 + From: Terry Barnaby To: Steven Whiteho

Re: Fwd: Re: Fedora27: NFS v4 terrible write performance, is async working

2018-01-29 Thread Steve Dickson
On 01/29/2018 12:42 PM, Steven Whitehouse wrote: > > > > Forwarded Message > Subject: Re: Fedora27: NFS v4 terrible write performance, is async > working > Date: Sun, 28 Jan 2018 21:17:02 + > From: Terry Barnaby > To: Steven Whitehouse , Developme