Re: [nfs-discuss] Re: [zfs-discuss] Re: NFS Performance and Tar

2006-10-13 Thread Spencer Shepler
On Fri, Joerg Schilling wrote: > Spencer Shepler <[EMAIL PROTECTED]> wrote: > > > Sorry, the code in Solaris would behave as I described. Upon the > > application closing the file, modified data is written to the server. > > The client waits for completion of those writes. If there is an error,

Re: [nfs-discuss] Re: [zfs-discuss] Re: NFS Performance and Tar

2006-10-13 Thread Joerg Schilling
Jeff Victor <[EMAIL PROTECTED]> wrote: > >>Your working did not match with the reality, this is why I did write this. > >>You did write that upon close() the client will first do something similar > >>to > >>fsync on that file. The problem is that this is done asynchronously and the > >>close()

Re: [nfs-discuss] Re: [zfs-discuss] Re: NFS Performance and Tar

2006-10-13 Thread Joerg Schilling
Spencer Shepler <[EMAIL PROTECTED]> wrote: > Sorry, the code in Solaris would behave as I described. Upon the > application closing the file, modified data is written to the server. > The client waits for completion of those writes. If there is an error, > it is returned to the caller of close(

Re: [nfs-discuss] Re: [zfs-discuss] Re: NFS Performance and Tar

2006-10-13 Thread Spencer Shepler
On Fri, Jeff Victor wrote: > Spencer Shepler wrote: > >On Fri, Joerg Schilling wrote: > > > >>>This doesn't change the fact that upon close() the NFS client will > >>>write data back to the server. This is done to meet the > >>>close-to-open semantics of NFS. > >> > >>Your working did not match wi

Re: [nfs-discuss] Re: [zfs-discuss] Re: NFS Performance and Tar

2006-10-13 Thread Jeff Victor
Spencer Shepler wrote: On Fri, Joerg Schilling wrote: This doesn't change the fact that upon close() the NFS client will write data back to the server. This is done to meet the close-to-open semantics of NFS. Your working did not match with the reality, this is why I did write this. You did

Re: [nfs-discuss] Re: [zfs-discuss] Re: NFS Performance and Tar

2006-10-13 Thread Spencer Shepler
On Fri, Joerg Schilling wrote: > Spencer Shepler <[EMAIL PROTECTED]> wrote: > > > I didn't comment on the error conditions that can occur during > > the writing of data upon close(). What you describe is the preferred > > method of obtaining any errors that occur during the writing of data. > > T

Re: [nfs-discuss] Re: [zfs-discuss] Re: NFS Performance and Tar

2006-10-13 Thread Joerg Schilling
Spencer Shepler <[EMAIL PROTECTED]> wrote: > I didn't comment on the error conditions that can occur during > the writing of data upon close(). What you describe is the preferred > method of obtaining any errors that occur during the writing of data. > This occurs because the NFS client is writin

Re: [nfs-discuss] Re: [zfs-discuss] Re: NFS Performance and Tar

2006-10-12 Thread Spencer Shepler
On Thu, Joerg Schilling wrote: > Spencer Shepler <[EMAIL PROTECTED]> wrote: > > > On Thu, Joerg Schilling wrote: > > > Spencer Shepler <[EMAIL PROTECTED]> wrote: > > > > > > > The close-to-open behavior of NFS clients is what ensures that the > > > > file data is on stable storage when close() re

Re: [nfs-discuss] Re: [zfs-discuss] Re: NFS Performance and Tar

2006-10-12 Thread Joerg Schilling
Spencer Shepler <[EMAIL PROTECTED]> wrote: > On Thu, Joerg Schilling wrote: > > Spencer Shepler <[EMAIL PROTECTED]> wrote: > > > > > The close-to-open behavior of NFS clients is what ensures that the > > > file data is on stable storage when close() returns. > > > > In the 1980s this was definit

Re: [nfs-discuss] Re: [zfs-discuss] Re: NFS Performance and Tar

2006-10-12 Thread Spencer Shepler
On Thu, Joerg Schilling wrote: > Spencer Shepler <[EMAIL PROTECTED]> wrote: > > > The close-to-open behavior of NFS clients is what ensures that the > > file data is on stable storage when close() returns. > > In the 1980s this was definitely not the case. When did this change? It has not. NFS

Re: [nfs-discuss] Re: [zfs-discuss] Re: NFS Performance and Tar

2006-10-12 Thread Joerg Schilling
"Frank Batschulat (Home)" <[EMAIL PROTECTED]> wrote: > On Tue, 10 Oct 2006 01:25:36 +0200, Roch <[EMAIL PROTECTED]> wrote: > > > You tell me ? We have 2 issues > > > > can we make 'tar x' over direct attach, safe (fsync) > > and posix compliant while staying close to current > > perfor

Re: [nfs-discuss] Re: [zfs-discuss] Re: NFS Performance and Tar

2006-10-12 Thread Joerg Schilling
Spencer Shepler <[EMAIL PROTECTED]> wrote: > The close-to-open behavior of NFS clients is what ensures that the > file data is on stable storage when close() returns. In the 1980s this was definitely not the case. When did this change? > The meta-data requirements of NFS is what ensures that fi

Re: [zfs-discuss] Re: NFS Performance and Tar

2006-10-12 Thread Joerg Schilling
Roch <[EMAIL PROTECTED]> wrote: > > Neither Sun tar nor GNU tar call fsync which is the only way to > > enforce data integrity over NFS. > > I tend to agree with this although I'd say that in practice, > from performance perspective, calling fsync should be more > relevant for direct attach.

Re: [nfs-discuss] Re: [zfs-discuss] Re: NFS Performance and Tar

2006-10-09 Thread Sanjeev Bagewadi
I think the original point of NFS being better WRT data making it to the disk was that : NFS follows the SYNC-ON-CLOSE semantics. You will not see an explicit fsync() being called by the tar... -- Sanjeev. Frank Batschulat (Home) wrote: On Tue, 10 Oct 2006 01:25:36 +0200, Roch <[EMAIL PROTECT

Re: [nfs-discuss] Re: [zfs-discuss] Re: NFS Performance and Tar

2006-10-09 Thread Frank Batschulat (Home)
On Tue, 10 Oct 2006 01:25:36 +0200, Roch <[EMAIL PROTECTED]> wrote: You tell me ? We have 2 issues can we make 'tar x' over direct attach, safe (fsync) and posix compliant while staying close to current performance characteristics ? In other words do we have the

Re: [nfs-discuss] Re: [zfs-discuss] Re: NFS Performance and Tar

2006-10-09 Thread Spencer Shepler
On Tue, Roch wrote: > > Joerg Schilling writes: > > Roch <[EMAIL PROTECTED]> wrote: > > > > > I would add that this is not a bug or deficientcy in > > > implementation. Any NFS implementation tweak to make 'tar x' > > > go as fast as direct attached will lead to silent data >

Re: [zfs-discuss] Re: NFS Performance and Tar

2006-10-09 Thread Roch
Joerg Schilling writes: > Roch <[EMAIL PROTECTED]> wrote: > > > I would add that this is not a bug or deficientcy in > > implementation. Any NFS implementation tweak to make 'tar x' > > go as fast as direct attached will lead to silent data > > corruption (tar x succeeds but

Re: [zfs-discuss] Re: NFS Performance and Tar

2006-10-09 Thread Joerg Schilling
Roch <[EMAIL PROTECTED]> wrote: > I would add that this is not a bug or deficientcy in > implementation. Any NFS implementation tweak to make 'tar x' > go as fast as direct attached will lead to silent data > corruption (tar x succeeds but the files don't checksum > ok). > > Int

Re: [zfs-discuss] Re: NFS Performance and Tar

2006-10-07 Thread Roch
Spencer Shepler writes: > On Tue, eric kustarz wrote: > > Ben Rockwood wrote: > > >I was really hoping for some option other than ZIL_DISABLE, but finally > > >gave up the fight. Some people suggested NFSv4 helping over NFSv3 but it > > >didn't... at least not enough to matter. > > > > >

Re: [zfs-discuss] Re: NFS Performance and Tar

2006-10-03 Thread Joerg Schilling
eric kustarz <[EMAIL PROTECTED]> wrote: > Ben Rockwood wrote: > I imagine what's happening is that tar is a single-threaded application > and it's basically doing: open, asynchronous write, close. This will go > really fast locally. But for NFS due to the way it does cache > consistency, on

Re: [zfs-discuss] Re: NFS Performance and Tar

2006-10-03 Thread Spencer Shepler
On Tue, eric kustarz wrote: > Ben Rockwood wrote: > >I was really hoping for some option other than ZIL_DISABLE, but finally > >gave up the fight. Some people suggested NFSv4 helping over NFSv3 but it > >didn't... at least not enough to matter. > > > >ZIL_DISABLE was the solution, sadly. I'm ru

Re: [zfs-discuss] Re: NFS Performance and Tar

2006-10-03 Thread eric kustarz
Ben Rockwood wrote: I was really hoping for some option other than ZIL_DISABLE, but finally gave up the fight. Some people suggested NFSv4 helping over NFSv3 but it didn't... at least not enough to matter. ZIL_DISABLE was the solution, sadly. I'm running B43/X86 and hoping to get up to 48 o

[zfs-discuss] Re: NFS Performance and Tar

2006-10-03 Thread Ben Rockwood
I was really hoping for some option other than ZIL_DISABLE, but finally gave up the fight. Some people suggested NFSv4 helping over NFSv3 but it didn't... at least not enough to matter. ZIL_DISABLE was the solution, sadly. I'm running B43/X86 and hoping to get up to 48 or so soonish (I BFU'd