Patch for rsync --link-dest won't link even if existing file is out of date (fwd)

2015-04-06 Thread Robert Bell
Folks, We faced a similar situation to that which Ken described - we recycle backup directories, for good reason. There is a patch to solve the problem. Our systems administrator provided the following description of the patches we use: ==

Re: rsync --link-dest won't link even if existing file is out of date

2015-04-06 Thread Kevin Korb
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 ZFS does have big RAM requirements. 8GB of RAM is pretty much the minimum. As for CPU besides being new enough to be on a motherboard with 8GB of RAM you should be fine. On 04/06/2015 12:25 PM, Clint Olsen wrote: > Not to mention the fact that ZFS r

Re: rsync --link-dest won't link even if existing file is out of date

2015-04-06 Thread Kevin Korb
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 It is actually pretty simple... Instead of mkdir you run zfs create [options] /path/to/directory zfspath When the rsync run finishes you would do: zfs snapshot zfspath@date When you want to delete an old backup it do: zfs destroy zfspath To list the s

Re: rsync --link-dest won't link even if existing file is out of date

2015-04-06 Thread Clint Olsen
Not to mention the fact that ZFS requires considerable hardware resources (CPU & memory) to perform well. It also requires you to learn a whole new terminology to wrap your head around it. It's certainly not a trivial swap to say the least... Thanks, -Clint On Mon, Apr 6, 2015 at 9:12 AM, Ken C

Re: rsync --link-dest won't link even if existing file is out of date

2015-04-06 Thread Ken Chase
This has been a consideration. But it pains me that a tiny change/addition to the rsync option set would save much time and space for other legit use cases. We know rsync very well, we dont know ZFS very well (licensing kept the tech out of our linux-centric operations). We've been using it but we

Re: rsync --link-dest won't link even if existing file is out of date

2015-04-06 Thread Kevin Korb
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Since you are in an environment with millions of files I highly recommend that you move to ZFS storage and use ZFS's subvolume snapshots instead of --link-dest. It is much more space efficient, rsync run time efficient, and the old backups can be dele

Re: Downloading specific files with rsync and make them keeping the original directories structures.

2015-04-06 Thread Hongyi Zhao
On Mon, 06 Apr 2015 00:34:37 -0400, Kevin Korb wrote: > See --relative though it will need a little bit of massaging to avoid > the debian dir. Good, thanks a lot. The following command does the trick: rsync -vR -P rsync://ftp.cn.debian.org/debian/./dists/Debian7.8/main/ binary-i386/Packages.gz