On Tue, March 5, 2013 11:17, Russ Poyner wrote:
> Your idea to use zfs diff to limit the need to stat the entire
> filesystem tree intrigues me. My current rsync backups are normally
> limited by this very factor. It takes longer to walk the filesystem tree
> than it does to transfer the new data.
On 3/5/2013 10:27 AM, Bob Friesenhahn wrote:
On Tue, 5 Mar 2013, David Magda wrote:
It's also possible to reduce the amount that rsync has to walk the
entire
file tree.
Most folks simply do a "rsync --options /my/source/ /the/dest/", but if
you use "zfs diff", and parse/feed the output of that
On Tue, 5 Mar 2013, David Magda wrote:
It's also possible to reduce the amount that rsync has to walk the entire
file tree.
Most folks simply do a "rsync --options /my/source/ /the/dest/", but if
you use "zfs diff", and parse/feed the output of that to rsync, then the
amount of thrashing can pro
On 3/5/2013 9:40 AM, David Magda wrote:
On Tue, March 5, 2013 10:02, Bob Friesenhahn wrote:
Rsync does need to read files on the destination filesystem to see if
they have changed. If the system has sufficient RAM (and/or L2ARC)
then files may still be cached from the previous day's run. In m
On Tue, March 5, 2013 10:02, Bob Friesenhahn wrote:
> Rsync does need to read files on the destination filesystem to see if
> they have changed. If the system has sufficient RAM (and/or L2ARC)
> then files may still be cached from the previous day's run. In most
> cases only a small subset of th
On Mon, 4 Mar 2013, Matthew Ahrens wrote:
Magic rsync options used:
-a --inplace --no-whole-file --delete-excluded
This causes rsync to overwrite the file blocks in place rather than writing
to a new temporary file first. As a result, zfs COW produces primitive
"deduplication" of at least t
> >> We do the same for all of our "legacy" operating system backups.
> Take
> >> a snapshot then do an rsync and an excellent way of maintaining
> >> incremental backups for those.
> >
> >
> > Magic rsync options used:
> >
> > -a --inplace --no-whole-file --delete-excluded
> >
> > This causes rs
