Re: [zfs-discuss] Faster copy from UFS to ZFS

2011-05-19 Thread Daniel Rock
On Thu, 19 May 2011 15:39:50 +0200, Frank Van Damme wrote: Op 03-05-11 17:55, Brandon High schreef: -H: Hard links If you're going to this for 2 TB of data, remember to expand your swap space first (or have tons of memory). Rsync will need it to store every inode number in the directory.

Re: [zfs-discuss] Faster copy from UFS to ZFS

2011-05-19 Thread Frank Van Damme
Op 03-05-11 17:55, Brandon High schreef: > -H: Hard links If you're going to this for 2 TB of data, remember to expand your swap space first (or have tons of memory). Rsync will need it to store every inode number in the directory. -- No part of this copyright message may be reproduced, read or

Re: [zfs-discuss] Faster copy from UFS to ZFS

2011-05-06 Thread Ian Collins
On 05/ 5/11 10:02 PM, Joerg Schilling wrote: Ian Collins wrote: *ufsrestore works fine on ZFS filesystems (although I haven't tried it with any POSIX ACLs on the original ufs filesystem, which would probably simply get lost). star -copy -no-fsync is typically 30% faster that ufsdump | u

Re: [zfs-discuss] Faster copy from UFS to ZFS

2011-05-05 Thread Joerg Schilling
Ian Collins wrote: > >> *ufsrestore works fine on ZFS filesystems (although I haven't tried it > >> with any POSIX ACLs on the original ufs filesystem, which would probably > >> simply get lost). > > star -copy -no-fsync is typically 30% faster that ufsdump | ufsrestore. > > > Does it preser

Re: [zfs-discuss] Faster copy from UFS to ZFS

2011-05-05 Thread Joerg Schilling
Erik Trimble wrote: > rsync is indeed slower than star; so far as I can tell, this is due > almost exclusively to the fact that rsync needs to build an in-memory > table of all work being done *before* it starts to copy. After that, it > copies at about the same rate as star (my observations).

Re: [zfs-discuss] Faster copy from UFS to ZFS

2011-05-03 Thread Brandon High
On Tue, May 3, 2011 at 12:36 PM, Erik Trimble wrote: > rsync is indeed slower than star; so far as I can tell, this is due almost > exclusively to the fact that rsync needs to build an in-memory table of all > work being done *before* it starts to copy. After that, it copies at about rsync 3.0+ w

Re: [zfs-discuss] Faster copy from UFS to ZFS

2011-05-03 Thread Freddie Cash
On Tue, May 3, 2011 at 12:36 PM, Erik Trimble wrote: > On 5/3/2011 8:55 AM, Brandon High wrote: >> >> On Tue, May 3, 2011 at 5:47 AM, Joerg Schilling >>  wrote: >>> >>> But this is most likely slower than star and does rsync support sparse >>> files? >> >> 'rsync -ASHXavP' >> >> -A: ACLs >> -S: S

Re: [zfs-discuss] Faster copy from UFS to ZFS

2011-05-03 Thread Ian Collins
On 05/ 4/11 01:35 AM, Joerg Schilling wrote: Andrew Gabriel wrote: Dan Shelton wrote: Is anyone aware of any freeware program that can speed up copying tons of data (2 TB) from UFS to ZFS on same server? I use 'ufsdump | ufsrestore'*. I would also suggest try setting 'sync=disabled' during

Re: [zfs-discuss] Faster copy from UFS to ZFS

2011-05-03 Thread Erik Trimble
On 5/3/2011 8:55 AM, Brandon High wrote: On Tue, May 3, 2011 at 5:47 AM, Joerg Schilling wrote: But this is most likely slower than star and does rsync support sparse files? 'rsync -ASHXavP' -A: ACLs -S: Sparse files -H: Hard links -X: Xattrs -a: archive mode; equals -rlptgoD (no -H,-A,-X)

Re: [zfs-discuss] Faster copy from UFS to ZFS

2011-05-03 Thread Brandon High
On Tue, May 3, 2011 at 5:47 AM, Joerg Schilling wrote: > But this is most likely slower than star and does rsync support sparse files? 'rsync -ASHXavP' -A: ACLs -S: Sparse files -H: Hard links -X: Xattrs -a: archive mode; equals -rlptgoD (no -H,-A,-X) You don't need to specify --whole-file, it'

Re: [zfs-discuss] Faster copy from UFS to ZFS

2011-05-03 Thread Joerg Schilling
Andrew Gabriel wrote: > Dan Shelton wrote: > > Is anyone aware of any freeware program that can speed up copying tons > > of data (2 TB) from UFS to ZFS on same server? > > I use 'ufsdump | ufsrestore'*. I would also suggest try setting > 'sync=disabled' during the operation, and reverting it a

Re: [zfs-discuss] Faster copy from UFS to ZFS

2011-05-03 Thread Andrew Gabriel
Dan Shelton wrote: Is anyone aware of any freeware program that can speed up copying tons of data (2 TB) from UFS to ZFS on same server? I use 'ufsdump | ufsrestore'*. I would also suggest try setting 'sync=disabled' during the operation, and reverting it afterwards. Certainly, fastfs (a simi

Re: [zfs-discuss] Faster copy from UFS to ZFS

2011-05-03 Thread Joerg Schilling
Freddie Cash wrote: > On Fri, Apr 29, 2011 at 10:53 AM, Dan Shelton wrote: > > Is anyone aware of any freeware program that can speed up copying tons of > > data (2 TB) from UFS to ZFS on same server? > > rsync, with --whole-file --inplace (and other options), works well for > the initial copy.

Re: [zfs-discuss] Faster copy from UFS to ZFS

2011-04-29 Thread Richard Elling
On Apr 29, 2011, at 1:37 PM, Brandon High wrote: > On Fri, Apr 29, 2011 at 10:53 AM, Dan Shelton wrote: >> Is anyone aware of any freeware program that can speed up copying tons of >> data (2 TB) from UFS to ZFS on same server? > > Setting 'sync=disabled' for the initial copy will help, since it

Re: [zfs-discuss] Faster copy from UFS to ZFS

2011-04-29 Thread Brandon High
On Fri, Apr 29, 2011 at 10:53 AM, Dan Shelton wrote: > Is anyone aware of any freeware program that can speed up copying tons of > data (2 TB) from UFS to ZFS on same server? Setting 'sync=disabled' for the initial copy will help, since it will make all writes asynchronous. You will probably wan

Re: [zfs-discuss] Faster copy from UFS to ZFS

2011-04-29 Thread Ian Collins
On 04/30/11 06:00 AM, Freddie Cash wrote: On Fri, Apr 29, 2011 at 10:53 AM, Dan Shelton wrote: Is anyone aware of any freeware program that can speed up copying tons of data (2 TB) from UFS to ZFS on same server? rsync, with --whole-file --inplace (and other options), works well for the initi

Re: [zfs-discuss] Faster copy from UFS to ZFS

2011-04-29 Thread Joerg Schilling
Dan Shelton wrote: > Is anyone aware of any freeware program that can speed up copying tons > of data (2 TB) from UFS to ZFS on same server? Try star -copy Note that due to the problems on ZFS to deal with stable states, I recommend to use -no-fsync and it may of course help to specify a

Re: [zfs-discuss] Faster copy from UFS to ZFS

2011-04-29 Thread Freddie Cash
On Fri, Apr 29, 2011 at 10:53 AM, Dan Shelton wrote: > Is anyone aware of any freeware program that can speed up copying tons of > data (2 TB) from UFS to ZFS on same server? rsync, with --whole-file --inplace (and other options), works well for the initial copy. rsync, with --no-whole-file --in

[zfs-discuss] Faster copy from UFS to ZFS

2011-04-29 Thread Dan Shelton
Is anyone aware of any freeware program that can speed up copying tons of data (2 TB) from UFS to ZFS on same server? Thanks. ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss