Re: question about --link-dest and the rsync protocol

2025-01-12 Thread Anthony LaTorre via rsync
Thanks for the advice. Unfortunately I tried: --link-dest=/snapshots/rsync_test/last and it still does not find it. On Sun, Jan 12, 2025 at 8:37 AM Paul Slootman via rsync wrote: > > On Sat 11 Jan 2025, Anthony LaTorre via rsync wrote: > > > Thanks for your quick response. The r

Re: question about --link-dest and the rsync protocol

2025-01-12 Thread Paul Slootman via rsync
t; uid = root > gid = root > read only = false > auth users = admin > > I'm still confused about how to specify the path. The actual UNIX path is: > > /c/user/snapshots/rsync_test/last > > I've tried: > > --link-dest=snapshots/rsync_test/last >

Re: question about --link-dest and the rsync protocol

2025-01-12 Thread Hardy via rsync
On 12.01.25 03:52, Anthony LaTorre via rsync wrote: $ rsync -aPh --link-dest=/user/snapshots/rsync_test/last /home/user/rsync_test rsync://admin@readynas.internal/snapshots/user/Jan_11_2025 Password: sending incremental file list --link-dest arg does not exist: /user/snapshots/rsync_test/last

Re: question about --link-dest and the rsync protocol

2025-01-11 Thread Anthony LaTorre via rsync
IX path is: /c/user/snapshots/rsync_test/last I've tried: --link-dest=snapshots/rsync_test/last --link-dest=./snapshots/rsync_test/last --link-dest=../last but none seem to work. Thanks, Tony On Sat, Jan 11, 2025 at 9:02 PM Kevin Korb via rsync wrote: > > rsyncd doesn't t

Re: question about --link-dest and the rsync protocol

2025-01-11 Thread Kevin Korb via rsync
rsyncd doesn't take unix paths. You must adapt your --link-dest to contend with however the rsycd module is defined in rsyncd.conf. On 1/11/25 9:52 PM, Anthony LaTorre via rsync wrote: Hi all, I'm trying to figure out why a script works when using SSH but not when using the rsyn

question about --link-dest and the rsync protocol

2025-01-11 Thread Anthony LaTorre via rsync
Hi all, I'm trying to figure out why a script works when using SSH but not when using the rsync protocol. When I run the following command: rsync -aPh --link-dest=/user/snapshots/rsync_test/last /home/user/rsync_test root@readynas.internal:/user/snapshots/rsync_test/Jan_11_2025 it

Re: rsync as a de-duplication-only tool, using --link-dest

2024-05-01 Thread Kevin Korb via rsync
I don't believe that what you are asking for can be done with rsync. At first thought you can't mix --ignore-existing with --ignore-non-existing as that would ignore everything. Something would have to at least exist and not be ignored for rsync to link to it. Anyway, for a laug

rsync as a de-duplication-only tool, using --link-dest

2024-05-01 Thread B via rsync
Recently I was thinking about --link-dest= and if it was possible to use rsync to de-duplicate two nearly-identical directory structures. Normally I would use a tool like hardlink, jdupes, or rdfind, but in this case the files are huge and numerous, so hashing them would take forever. I did a

Is this the best way to combine --times and --link-dest along with a de-duplicator?

2023-07-08 Thread Andrew Gideon via rsync
I'm copying files using --link-dest to avoid duplication. I'm also using a de-duplicator (rmlint) to further reduce duplication. For files that are duplicates, I've rmlint set to use the timestamp of the oldest file. This ends up with starting conditions where the source of a

Re: Per file Log output to understand hard-link decision

2023-05-14 Thread Hardy via rsync
Don't know if this is enough for you, but it may help at least a bit to hunt down your problem. There is a flag -i From man rsync --itemize-changes, -ioutput a change-summary for all updates this gives either a "." for no change, or a letter code for each change in "data, time, size" etc.,

Re: Per file Log output to understand hard-link decision

2023-05-14 Thread Kevin Korb via rsync
The only way I know of to determine this behavior is to use the --link-dest option in rsync OR use the much older cp -al then rsync over top of it method. With --link-dest a change in the file's metadata causes rsync to duplicate the file in order to store both versions of the metadata.

Per file Log output to understand hard-link decision

2023-05-14 Thread c.buhtz--- via rsync
Hello, I know it is a often discussed topic how rsync decide about using hardlinks or copy a file. Even if content is unchanged problems are often file permissions and owner ships. I know that. Is it possible to configure rsync that way that it logs for each file its decision about using a hardli

Re: Question about rsync -uav dir1/. dir2/.: possib to link?

2021-09-04 Thread Kevin Korb via rsync
Yes, cpio -l can be useful since cpio can easily operate on the output from the very capable find command. On 9/4/21 8:34 PM, Dan Stromberg wrote: > > I was thinking --link-dest too. > > Sometimes this can be done with cpio too; check out the -pdlv options. > > On Sat, Sep

Re: Question about rsync -uav dir1/. dir2/.: possib to link?

2021-09-04 Thread Dan Stromberg via rsync
I was thinking --link-dest too. Sometimes this can be done with cpio too; check out the -pdlv options. On Sat, Sep 4, 2021 at 4:57 PM Kevin Korb via rsync wrote: > Rsync does almost everything cp does but since it is designed to network > it never got that feature. I was thinking maybe

Re: Question about rsync -uav dir1/. dir2/.: possib to link?

2021-09-04 Thread Kevin Korb via rsync
Rsync does almost everything cp does but since it is designed to network it never got that feature. I was thinking maybe --link-dest could be tortured into doing it but if it can I can't figure out how. BTW, you have some pointless dots in there. On 9/4/21 6:41 PM, L A Walsh via rsync

Question about rsync -uav dir1/. dir2/.: possib to link?

2021-09-04 Thread L A Walsh via rsync
to by accident, and dir2=the original dir). The files were "smallish" so I just copied them, BUT I wass wondering if there was an option similar to using 'cp' for a dircopy, but instead of cp -a dr1 dr2 using: cp -al dr1 dr2 to just hard-link over files from "dir1

[Bug 14683] failed to set permissions on symlinks; need `--omit-link-permissions` option

2021-04-07 Thread just subscribed for rsync-qa from bugzilla via rsync
https://bugzilla.samba.org/show_bug.cgi?id=14683 --- Comment #2 from Ciprian Dorin Craciun --- (In reply to Ciprian Dorin Craciun from comment #1) Trying to `strace` what `rsync` does in my OpenAFS use-case I've found that the only syscals invoked by `rysync` (and pertaining to the file in quest

[Bug 14683] failed to set permissions on symlinks; need `--omit-link-permissions` option

2021-04-07 Thread just subscribed for rsync-qa from bugzilla via rsync
https://bugzilla.samba.org/show_bug.cgi?id=14683 --- Comment #1 from Ciprian Dorin Craciun --- I've encountered a similar situation, but with OpenAFS, which for some reason reports the protection for symlinks as `rwxr-xr-x`. Thus using `rsync` with `--perms` and targeting an OpenAFS folder fails

[Bug 14683] New: failed to set permissions on symlinks; need `--omit-link-permissions` option

2021-04-01 Thread just subscribed for rsync-qa from bugzilla via rsync
https://bugzilla.samba.org/show_bug.cgi?id=14683 Bug ID: 14683 Summary: failed to set permissions on symlinks; need `--omit-link-permissions` option Product: rsync Version: 3.2.0 Hardware: All OS: All

rsync -H with --link-dest

2020-11-17 Thread Gareth Evans via rsync
Hello, man rsync for -H includes: "If you specify a --link-dest directory that contains hard links, the linking of the destination files against the --link-dest files can cause some paths in the destination to become linked together due to the --link-dest associations." Can anyone e

Destination file lost with --link-dest and --backup-dir options

2020-11-05 Thread CRTS via rsync
Hello, I am facing an issue when using --link-dest and --backup-dir together. When a source file differs from the file in the destination directory and the --backup and --backup-dir options are provided then a copy of the destination file is made in --backup-dir. However, if additionally

[Bug 12199] multiple link-dest dirs not working

2020-07-27 Thread just subscribed for rsync-qa from bugzilla via rsync
https://bugzilla.samba.org/show_bug.cgi?id=12199 Wayne Davison changed: What|Removed |Added Status|NEW |RESOLVED Resolution|---

[Bug 8594] Allow --link-dest argument to be a file

2020-07-26 Thread just subscribed for rsync-qa from bugzilla via rsync
|RESOLVED --- Comment #1 from Wayne Davison --- If you have just one file you can run the ln yourself. Rsync needs the file in a dir using the same name for the link-dest option to work. -- You are receiving this mail because: You are the QA Contact for the bug. -- Please use

[Bug 13526] Hard link creation time

2020-04-26 Thread just subscribed for rsync-qa from bugzilla via rsync
https://bugzilla.samba.org/show_bug.cgi?id=13526 Wayne Davison changed: What|Removed |Added Version|3.1.3 |3.2.0 Resolution|---

[Bug 13445] Fuzzy searching in link-dest tries to open regular file as directory

2020-04-06 Thread just subscribed for rsync-qa from bugzilla via rsync
https://bugzilla.samba.org/show_bug.cgi?id=13445 --- Comment #9 from Ben RUBSON --- Good news, thank you very much Wayne ! Glad to see you back :) -- You are receiving this mail because: You are the QA Contact for the bug. -- Please use reply-all for most replies to avoid omitting the mailing

[Bug 13445] Fuzzy searching in link-dest tries to open regular file as directory

2020-04-05 Thread just subscribed for rsync-qa from bugzilla via rsync
https://bugzilla.samba.org/show_bug.cgi?id=13445 Wayne Davison changed: What|Removed |Added Resolution|--- |FIXED Status|NEW

[Bug 13445] Fuzzy searching in link-dest tries to open regular file as directory

2019-10-03 Thread just subscribed for rsync-qa from bugzilla via rsync
https://bugzilla.samba.org/show_bug.cgi?id=13445 --- Comment #7 from Ben RUBSON --- Wayne, let's merge this ? Many thanks ! -- You are receiving this mail because: You are the QA Contact for the bug. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe o

Re: --link-dest. Time to 'building file list' incrementing

2019-01-08 Thread John Simpson via rsync
Don't know how I missed this when I was trying to figure out the cheapest solution. I don't need the complexity but it seems to be worth investigating. ThanksOn 8 Jan 2019 16:15, Andrew McGlashan via rsync wrote: > > On 8/1/19 8:56 pm, John Simpson via rsync wrote: > > Any ideas anyone? > > How

Re: --link-dest. Time to 'building file list' incrementing

2019-01-08 Thread Andrew McGlashan via rsync
On 8/1/19 8:56 pm, John Simpson via rsync wrote: > Any ideas anyone? How about using snapshots and doing the rsync off those? https://www.thewindowsclub.com/vss-volume-shadow-copy-service https://blogs.technet.microsoft.com/josebda/2007/10/10/the-basics-of-the-volume-shadow-copy-service-vss/

Re: --link-dest. Time to 'building file list' incrementing

2019-01-08 Thread John Simpson via rsync
ia rsync <rsync@lists.samba.org> wrote:KevinThe link-dest parameter is a single directory (the previous day's directory), the destination is today's directory.I haven't tried deleting a backup,  there's no particular need in space terms,  at the current rate there's enough

Re: --link-dest. Time to 'building file list' incrementing

2019-01-08 Thread Ben RUBSON via rsync
gt;> On 4 Jan 2019 09:53, John Simpson via rsync wrote: >> >> Kevin >> >> The link-dest parameter is a single directory (the previous day's >> directory), the destination is today's directory. >> >> I haven't tried deleting a backup,

Re: --link-dest. Time to 'building file list' incrementing

2019-01-08 Thread John Simpson via rsync
Any ideas anyone? I still need at least a weekly backup of all data. The current workaround is just for the most active directories. Are there any diagnostics I can do which might shed some light on this? Thanks JohnOn 4 Jan 2019 09:53, John Simpson via rsync wrote: > > Kevin > &

Re: --link-dest. Time to 'building file list' incrementing

2019-01-04 Thread John Simpson via rsync
Kevin The link-dest parameter is a single directory (the previous day's directory), the destination is today's directory. I haven't tried deleting a backup, there's no particular need in space terms, at the current rate there's enough space for several years of dail

Re: --link-dest. Time to 'building file list' incrementing

2019-01-03 Thread Kevin Korb via rsync
It does normally take some time to analyze large trees of files. It has to call stat() on each file to get the size and timestamp. However, 15 hours seems a bit excessive even though I have never tried to do this on Windows or a NAS system. Just to be clear, is your --link-dest parameter a

--link-dest. Time to 'building file list' incrementing

2019-01-03 Thread John Simpson via rsync
I've been running rsync as a cygwin task on Windows Server 2008 for about two months now. I'm using the --link-dest option to do a daily 'snapshot' of the contents of a server containing about 10TB of data, about 13 million files, to a Linux based NAS server. Things sta

[Bug 13656] New: --link-dest target with symbolic links from different user produces unnecessary error

2018-10-16 Thread just subscribed for rsync-qa from bugzilla via rsync
https://bugzilla.samba.org/show_bug.cgi?id=13656 Bug ID: 13656 Summary: --link-dest target with symbolic links from different user produces unnecessary error Product: rsync Version: 3.1.3 Hardware: All OS

[Bug 13569] New: --link-dest may follow symlinks and failure to hard link a non-regular file is fatal

2018-08-12 Thread just subscribed for rsync-qa from bugzilla via rsync
https://bugzilla.samba.org/show_bug.cgi?id=13569 Bug ID: 13569 Summary: --link-dest may follow symlinks and failure to hard link a non-regular file is fatal Product: rsync Version: 3.1.3 Hardware: All OS

BUG: --link-dest may follow symlinks and failure to hard link a non-regular file is fatal

2018-08-03 Thread Donald Buczek via rsync
Hi, following the instructions on https://bugzilla.samba.org/createaccount-save.html, I've applied for a bugzilla account at bugzilla-maintena...@samba.org but didn't receive a reply, so I report through this list. With --link-dest the search for a candidate to link from, follow

Re: Aw: Re: link-dest and batch-file

2018-07-20 Thread Kevin Korb via rsync
Von: "Kevin Korb via rsync" >> An: rsync@lists.samba.org >> Betreff: Re: link-dest and batch-file >> >> If you are using ZFS then forget --link-dest. Just rsync to the same >> zfs mount every time and do a zfs snapshot after the rsync finishes. >> Then de

Aw: Re: link-dest and batch-file

2018-07-20 Thread devzero--- via rsync
But don‘t forget —inplace, otherwise snapshots would not be efficient > Gesendet: Mittwoch, 18. Juli 2018 um 21:53 Uhr > Von: "Kevin Korb via rsync" > An: rsync@lists.samba.org > Betreff: Re: link-dest and batch-file > > If you are using ZFS then forget --link-d

Re: link-dest and batch-file

2018-07-18 Thread Kevin Korb via rsync
If you are using ZFS then forget --link-dest. Just rsync to the same zfs mount every time and do a zfs snapshot after the rsync finishes. Then delete old backups with a zfs destroy. On 07/18/2018 03:42 PM, Дугин Сергей via rsync wrote: > Hello. > > I need that during today'

Re: link-dest and batch-file

2018-07-18 Thread Дугин Сергей via rsync
Hello. I need that during today's backup, the metadata about the files is saved in a file, so that tomorrow when creating a backup with the option "link-dest" instead of this option I would specify a file with metadata, then rsync will not scan the folder spec

[Bug 13526] New: Hard link creation time

2018-07-12 Thread just subscribed for rsync-qa from bugzilla via rsync
https://bugzilla.samba.org/show_bug.cgi?id=13526 Bug ID: 13526 Summary: Hard link creation time Product: rsync Version: 3.1.3 Hardware: All OS: All Status: NEW Severity: normal Priority: P5

Re: link-dest and batch-file

2018-06-28 Thread Larry Irwin (gmail) via rsync
You have to have a script that places a "successful" file in the root of the completed rsync... And use that to figure out what to do for link-dest at the top of the script... I use something more like daily.0-daily.7 and monthly.0-monthly.3 for the folders and rotate them dail

Re: link-dest and batch-file

2018-06-26 Thread Kevin Korb via rsync
I don't know how the OP manages their backups. I write out a backupname.current symlink pointing to the new backup once it is completed. That is what I use as the --link-dest parameter and what I would restore from. If a backup is aborted in the middle, doesn't happen at all, or

Re: link-dest and batch-file

2018-06-26 Thread Dan Stromberg via rsync
On Tue, Jun 26, 2018 at 12:02 PM, Дугин Сергей via rsync < rsync@lists.samba.org> wrote: > I am launching a cron bash script that does the following: > > Day 1 > /usr/bin/rsync -aH --link-dest /home/backuper/.BACKUP/009/2018-06-25 > root@192.168.1.103:/home/ /home/bac

Re: link-dest and batch-file

2018-06-26 Thread Kevin Korb via rsync
experience with many millions of files vs rsync --link-dest is that running the backup isn't a problem. The problem came when it was time to delete the oldest backup. An rm -rf took a lot longer than an rsync. If you haven't gotten there yet maybe you should try one and see if it is going

link-dest and batch-file

2018-06-26 Thread Дугин Сергей via rsync
Hello. I am launching a cron bash script that does the following: Day 1 /usr/bin/rsync -aH --link-dest /home/backuper/.BACKUP/009/2018-06-25 root@192.168.1.103:/home/ /home/backuper/.BACKUP/009/2018-06-26 Day 2 /usr/bin/rsync -aH --link-dest /home/backuper/.BACKUP/009/2018-06-26

[Bug 13445] Fuzzy searching in link-dest tries to open regular file as directory

2018-06-09 Thread just subscribed for rsync-qa from bugzilla via rsync
https://bugzilla.samba.org/show_bug.cgi?id=13445 --- Comment #6 from Ben RUBSON --- Created attachment 14231 --> https://bugzilla.samba.org/attachment.cgi?id=14231&action=edit Patch using FLAG_PERHAPS_DIR Here is a working patch using the method detailed in comment #2. -- You are receiving t

[Bug 13445] Fuzzy searching in link-dest tries to open regular file as directory

2018-05-26 Thread just subscribed for rsync-qa from bugzilla via rsync
https://bugzilla.samba.org/show_bug.cgi?id=13445 --- Comment #5 from Ben RUBSON --- I reproduced the issue the same way, I meant just creating a directory in my backed-up tree with the name of a just-deleted file, this file remaining in the link-dest folder. I'm not sure the opposit

[Bug 13445] Fuzzy searching in link-dest tries to open regular file as directory

2018-05-21 Thread just subscribed for rsync-qa from bugzilla via rsync
https://bugzilla.samba.org/show_bug.cgi?id=13445 --- Comment #4 from Einhard Leichtfuß --- Did I understand correctly that you were able to reproduce this in a notably different way? I had not sufficiently examined the code to see that in all the other cases the existance of a directory is made

[Bug 13445] Fuzzy searching in link-dest tries to open regular file as directory

2018-05-19 Thread just subscribed for rsync-qa from bugzilla via rsync
https://bugzilla.samba.org/show_bug.cgi?id=13445 --- Comment #2 from Ben RUBSON --- Nice catch, I was able to easily reproduce this issue just creating a directory with the name of a just-deleted file. The path you mention Einhard seems to be the only one where no check is done to be sure a dire

[Bug 13445] Fuzzy searching in link-dest tries to open regular file as directory

2018-05-19 Thread just subscribed for rsync-qa from bugzilla via rsync
https://bugzilla.samba.org/show_bug.cgi?id=13445 --- Comment #3 from Ben RUBSON --- We could also stat() fnamecmpbuf in recv_generator(), but I think it's rather interesting to save such calls. -- You are receiving this mail because: You are the QA Contact for the bug. -- Please use reply-all

[Bug 13445] Fuzzy searching in link-dest tries to open regular file as directory

2018-05-18 Thread just subscribed for rsync-qa from bugzilla via rsync
https://bugzilla.samba.org/show_bug.cgi?id=13445 --- Comment #1 from Einhard Leichtfuß --- Maybe more or less related: Bug 11866 [0], Bug 12489 [1] [0] https://bugzilla.samba.org/show_bug.cgi?id=11866 [1] https://bugzilla.samba.org/show_bug.cgi?id=12489 -- You are receiving this mail because:

[Bug 13445] New: Fuzzy searching in link-dest tries to open regular file as directory

2018-05-18 Thread just subscribed for rsync-qa from bugzilla via rsync
https://bugzilla.samba.org/show_bug.cgi?id=13445 Bug ID: 13445 Summary: Fuzzy searching in link-dest tries to open regular file as directory Product: rsync Version: 3.1.3 Hardware: All OS: All

[Bug 13139] New: Formatted output turned off when --link-dest is used

2017-11-14 Thread just subscribed for rsync-qa from bugzilla via rsync
https://bugzilla.samba.org/show_bug.cgi?id=13139 Bug ID: 13139 Summary: Formatted output turned off when --link-dest is used Product: rsync Version: 3.1.2 Hardware: All OS: All Status: NEW Severity

[Bug 11571] rsync-3.1.1 --link-dest arbitrary limit

2017-10-08 Thread just subscribed for rsync-qa from bugzilla via rsync
https://bugzilla.samba.org/show_bug.cgi?id=11571 Wayne Davison changed: What|Removed |Added Resolution|--- |FIXED Status|NEW

[Bug 11866] rsync fails (failed to re-stat) when using double fuzzy + link-dest on renamed files

2017-10-08 Thread just subscribed for rsync-qa from bugzilla via rsync
https://bugzilla.samba.org/show_bug.cgi?id=11866 --- Comment #5 from Ben RUBSON --- Thank you very much for the merge Wayne ! -- You are receiving this mail because: You are the QA Contact for the bug. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe

[Bug 11866] rsync fails (failed to re-stat) when using double fuzzy + link-dest on renamed files

2017-10-08 Thread just subscribed for rsync-qa from bugzilla via rsync
https://bugzilla.samba.org/show_bug.cgi?id=11866 Wayne Davison changed: What|Removed |Added Resolution|--- |FIXED Status|NEW

[Bug 11866] rsync fails (failed to re-stat) when using double fuzzy + link-dest on renamed files

2017-10-04 Thread just subscribed for rsync-qa from bugzilla via rsync
https://bugzilla.samba.org/show_bug.cgi?id=11866 --- Comment #3 from Ben RUBSON --- Hi, Could it be possible to merge this please ? It's really tiny (one character) and easily understandable :) And it avoids silent data loss ! Thank you very much ! Ben -- You are receiving this mail because

Re: hard-link reference error when trying to delete

2017-08-15 Thread Kevin Korb via rsync
You should use rrsync for that. On 08/15/2017 08:58 PM, Jared via rsync wrote: > Hi, Kevin. Thank you for the suggestion. It triggered a memory that I > had set some restrictions on this rsync copy a while back. Sure enough, > in ~/.ssh/authorized_keys: > > command="rsync --server -vulogDtpre.

Re: hard-link reference error when trying to delete

2017-08-15 Thread Jared via rsync
Hi, Kevin. Thank you for the suggestion. It triggered a memory that I had set some restrictions on this rsync copy a while back. Sure enough, in ~/.ssh/authorized_keys: command="rsync --server -vulogDtpre.iLsfxC --timeout=600 --bwlimit=5120 . dest" ssh-rsa Tacking on --delete in the appropriat

Re: hard-link reference error when trying to delete

2017-08-15 Thread Kevin Korb via rsync
files on > the remote server at this point. > > Adding --delete is when I run into my problem: > > sending incremental file list > hard-link reference out of range: 105 (10) > rsync error: protocol incompatibility (code 2) at flist.c(769) > [Receiver=3.1.2] > > The

hard-link reference error when trying to delete

2017-08-15 Thread jared via rsync
emote server at this point. Adding --delete is when I run into my problem: sending incremental file list hard-link reference out of range: 105 (10) rsync error: protocol incompatibility (code 2) at flist.c(769) [Receiver=3.1.2] The source and destination servers are running the same versions of rsync, s

broken link report

2017-07-25 Thread Wolfram Volpi via rsync
On https://rsync.samba.org/lists.html page, the archive 2 link is broken.   Wolfram Volpi-- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr

[Bug 11866] rsync fails (failed to re-stat) when using double fuzzy + link-dest on renamed files

2017-07-04 Thread just subscribed for rsync-qa from bugzilla via rsync
https://bugzilla.samba.org/show_bug.cgi?id=11866 --- Comment #2 from Ben RUBSON --- Created attachment 13342 --> https://bugzilla.samba.org/attachment.cgi?id=13342&action=edit rsync_double_fuzzy_11866 Bug found, patch attached. Wayne could you please review and commit please ? Thank you very m

[Bug 11866] rsync fails (failed to re-stat) when using double fuzzy + link-dest on renamed files

2017-07-04 Thread just subscribed for rsync-qa from bugzilla via rsync
q 0 9` do echo content_$i > $i done # rsync -a . $usr@$srv:/tmp/dst1/ # rsync -a --link-dest=../dst1 . $usr@$srv:/tmp/dst2/ # ssh $usr@$srv "ls -lin /tmp/dst1 /tmp/dst2" /tmp/dst1: total 45 660319 -rw-r--r-- 2 501 0 10 4 Jul 12:55 0 660320 -rw-r--r-- 2 501 0 10 4 Jul 12

[Bug 12835] New: Allow --link-dest to link to an optionally unexisting directory

2017-06-12 Thread just subscribed for rsync-qa from bugzilla via rsync
https://bugzilla.samba.org/show_bug.cgi?id=12835 Bug ID: 12835 Summary: Allow --link-dest to link to an optionally unexisting directory Product: rsync Version: 3.1.3 Hardware: All OS: All Status

Re: link-dest + fuzzy twice = vanished

2016-12-30 Thread Ben RUBSON
I just submitted a bug report : https://bugzilla.samba.org/show_bug.cgi?id=12489 -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-

link-dest + fuzzy twice = vanished

2016-12-29 Thread Ben RUBSON
Hello, I use --link-dest which works perfectly : rsync -a -R --link-dest="../2016-12-28/" --link-dest="../2016-12-27/" /my/backup/folder ::daemon/mycomputer/2016-12-29/ Now I would like to use --fuzzy --fuzzy, so that rsync algorithm can also work with similarly named files

Re: Use of multiple --link-dest options

2016-11-11 Thread John Lane
On 20/09/16 12:21, John Lane wrote: > I can use --link-dest multiple times for backups so that files affected > by a backup-delete-backup-replace-backup scenario get linked. It works well. > > However, consider this scenario: backup-modify-backup-undo-backup. We have > > * back

Use of multiple --link-dest options

2016-09-20 Thread John Lane
I can use --link-dest multiple times for backups so that files affected by a backup-delete-backup-replace-backup scenario get linked. It works well. However, consider this scenario: backup-modify-backup-undo-backup. We have * backup 1 contains file 'a' * backup 2 contains file

[Bug 12199] multiple link-dest dirs not working

2016-09-06 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=12199 --- Comment #2 from Brian J. Murrell --- No triage on this at least? -- You are receiving this mail because: You are the QA Contact for the bug. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or chan

[Bug 12199] multiple link-dest dirs not working

2016-09-01 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=12199 --- Comment #1 from Kevin Korb --- I have been discussing this in IRC for more than an hour now. The OP's complaint is not that multiple --link-dest paths aren't searched. The OP's complaint is that rsync finds an apparent ma

[Bug 12199] New: multiple link-dest dirs not working

2016-09-01 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=12199 Bug ID: 12199 Summary: multiple link-dest dirs not working Product: rsync Version: 3.0.6 Hardware: All OS: All Status: NEW Severity: major

[Bug 12036] New: Multiple --link-dest, --copy-dest, or --compare-dest flags produce incorrect behavior

2016-07-25 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=12036 Bug ID: 12036 Summary: Multiple --link-dest, --copy-dest, or --compare-dest flags produce incorrect behavior Product: rsync Version: 3.1.2 Hardware: All OS

[Bug 12036] Multiple --link-dest, --copy-dest, or --compare-dest flags produce incorrect behavior

2016-07-25 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=12036 --- Comment #2 from Chris Kuehl --- Created attachment 12289 --> https://bugzilla.samba.org/attachment.cgi?id=12289&action=edit proposed patch -- You are receiving this mail because: You are the QA Contact for the bug. -- Please use reply-all

[Bug 12036] Multiple --link-dest, --copy-dest, or --compare-dest flags produce incorrect behavior

2016-07-25 Thread samba-bugs
m "copy_dest/good", which has the same content. The mtime doesn't match, though, so we break there. On the second iteration of the loop, "match_level" is still 2, and we only compare the attributes with the file from "copy_dest/bad" (never the content). We then brea

[Bug 11866] New: rsync fails (failed to re-stat) when using double fuzzy + link-dest on renamed files

2016-04-21 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=11866 Bug ID: 11866 Summary: rsync fails (failed to re-stat) when using double fuzzy + link-dest on renamed files Product: rsync Version: 3.1.1 Hardware: All OS

Re: --link-dest not working on remote server (running daemon)

2016-02-09 Thread Christian Huldt
If you specify your target as offsite/backup I think you should specify your link-dest as --link-dest=offsite/backup/backup-2016-02-01-0100 ...perhaps... On 02/08/2016 11:10 PM, Sam Holton wrote: > With the following server config: > > log file = /var/log/rsyncd.log > pid >

Re: --link-dest not working on remote server (running daemon)

2016-02-08 Thread Sam Holton
/rsyncd.scrt uid = 0 gid = 0 I tried the following for --link-dest and they all tried to transfer all files --link-dest=../backup-2016-02-01-0100 --link-dest=backup-2016-02-01-0100 --link-dest=/backup-2016-02-01-0100 --link-dest=/backup/backup-2016-02-01-0100 --link-dest=./backup/backup-2016-02-01

Re: --link-dest not working on remote server (running daemon)

2016-02-08 Thread Kevin Korb
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 try: --link-dest=../backup-2016-02-01-0100 On 02/08/2016 04:51 PM, Sam Holton wrote: > Thanks for the reply. The link-dest is different. It is Feb 1 while > the source is Feb 2. > > I tried setting path = /media/external/ for the daem

Re: --link-dest not working on remote server (running daemon)

2016-02-08 Thread Sam Holton
Thanks for the reply. The link-dest is different. It is Feb 1 while the source is Feb 2. I tried setting path = /media/external/ for the daemon and using rsync -a -v -i --delete --link-dest=backup-2016-02-01-0100 --password-file=/media/external/scripts/offsite_rsync.pass /media/external/backup

Re: --link-dest not working on remote server (running daemon)

2016-02-08 Thread Kevin Korb
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 by misaligned I meant that your source is a directory, your link-dest is a directory (with the same name even), and your target is the root of the share. All 3 params should be directories and the link-dest param should be a different date than the

Re: --link-dest not working on remote server (running daemon)

2016-02-08 Thread Sam Holton
t sure what you mean by "link-dest and your target parameters misaligned". Both servers have the same directory structure so it may be a bit confusing. I'm trying to link to the previous day's backup on the remote server. I forgot to mention that both servers are running 3.0.9

Re: --link-dest not working on remote server (running daemon)

2016-02-08 Thread Kevin Korb
some simple typo. I have > two servers in my setup: > > *Server 1* Doing rsync with --link-dest daily and working as > expected. I'm getting the hard links in the new daily directories. > > > *Server 2* Running rsync daemon mode with following config > > [offsi

--link-dest not working on remote server (running daemon)

2016-02-08 Thread Sam Holton
Hello, I have read through the list of previous issues regarding this issue but haven't been able to resolve mine. I apologize in advance for the long text and am probably doing some simple typo. I have two servers in my setup: *Server 1* Doing rsync with --link-dest daily and worki

Broken "patches dir" link

2015-12-06 Thread Andrey Gursky
Yet another broken link "patches dir" [1] on the rsync bug-tracking page [2]. [1] https://download.samba.org/pub/rsync/dev/patches/ [2] https://rsync.samba.org/bugzilla.html -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change opti

Broken "Log In" link

2015-12-06 Thread Andrey Gursky
Hi, on the main page [1] if you click on "Log In" [2] and then on "Reset Password", a new page appears, where the "Log In" link is broken [3]. Regards, Andrey [1] https://bugzilla.samba.org [2] https://bugzilla.samba.org/index.cgi?GoAheadAndLogIn=1 [3] https:

[Bug 11545] -A (preserve ACLs) with --link-dest=DIR fails when DIR has a directory with the same file's name

2015-11-24 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=11545 --- Comment #1 from Iavor Stoev --- Hello, Is there any development on that bug? I've encountered the same issue. Regards -- You are receiving this mail because: You are the QA Contact for the bug. -- Please use reply-all for most replies

[Bug 11571] New: rsync-3.1.1 --link-dest arbitrary limit

2015-10-24 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=11571 Bug ID: 11571 Summary: rsync-3.1.1 --link-dest arbitrary limit Product: rsync Version: 3.1.1 Hardware: x86 OS: Linux Status: NEW Severity: critical

[Bug 11545] New: -A (preserve ACLs) with --link-dest=DIR fails when DIR has a directory with the same file's name

2015-10-07 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=11545 Bug ID: 11545 Summary: -A (preserve ACLs) with --link-dest=DIR fails when DIR has a directory with the same file's name Product: rsync Version: 3.1.0 Hardware

Re: rsync --link-dest and --files-from lead by a "change list" from some file system audit tool (Was: Re: cut-off time for rsync ?)

2015-07-16 Thread Simon Hobson
Andrew Gideon wrote: >> btrfs has support for this: you make a backup, then create a btrfs >> snapshot of the filesystem (or directory), then the next time you make a >> new backup with rsync, use --inplace so that just changed parts of the >> file are written to the same blocks and btrfs will ta

Re: rsync --link-dest and --files-from lead by a "change list" from some file system audit tool (Was: Re: cut-off time for rsync ?)

2015-07-16 Thread Andrew Gideon
On Tue, 14 Jul 2015 08:59:25 +0200, Paul Slootman wrote: > btrfs has support for this: you make a backup, then create a btrfs > snapshot of the filesystem (or directory), then the next time you make a > new backup with rsync, use --inplace so that just changed parts of the > file are written to th

Re: Fwd: rsync --link-dest and --files-from lead by a "change list" from some file system audit tool (Was: Re: cut-off time for rsync ?)

2015-07-16 Thread Ken Chase
yeah, i read somewhere that zfs DOES have separate tuning for metadata and data cache, but i need to read up on that more. as for heavy block duplication: daily backups of the whole system = alot of dupe. /kc On Thu, Jul 16, 2015 at 05:42:32PM +, Andrew Gideon said: >On Mon, 13 Jul 201

Re: Fwd: rsync --link-dest and --files-from lead by a "change list" from some file system audit tool (Was: Re: cut-off time for rsync ?)

2015-07-16 Thread Andrew Gideon
On Mon, 13 Jul 2015 17:38:35 -0400, Selva Nair wrote: > As with any dedup solution, performance does take a hit and its often > not worth it unless you have a lot of duplication in the data. This is so only in some volumes in our case, but it appears that zfs permits this to be enabled/disabled

Re: rsync --link-dest and --files-from lead by a "change list" from some file system audit tool (Was: Re: cut-off time for rsync ?)

2015-07-14 Thread Simon Hobson
Ken Chase wrote: > And what's performance like? I've heard lots of COW systems performance > drops through the floor when there's many snapshots. For BTRFS I'd suspect the performance penalty to be fairly small. Snapshots can be done in different ways, and the way BTRFS and (I think) ZFS do it

Re: rsync --link-dest and --files-from lead by a "change list" from some file system audit tool (Was: Re: cut-off time for rsync ?)

2015-07-14 Thread Ken Chase
And what's performance like? I've heard lots of COW systems performance drops through the floor when there's many snapshots. /kc On Tue, Jul 14, 2015 at 08:59:25AM +0200, Paul Slootman said: >On Mon 13 Jul 2015, Andrew Gideon wrote: >> >> On the other hand, I do confess that I am sometime

Re: rsync --link-dest and --files-from lead by a "change list" from some file system audit tool (Was: Re: cut-off time for rsync ?)

2015-07-14 Thread Paul Slootman
On Mon 13 Jul 2015, Andrew Gideon wrote: > > On the other hand, I do confess that I am sometimes miffed at the waste > involved in a small change to a very large file. Rsync is smart about > moving minimal data, but it still stores an entire new copy of the file. > > What's needed is a file sy

Fwd: rsync --link-dest and --files-from lead by a "change list" from some file system audit tool (Was: Re: cut-off time for rsync ?)

2015-07-13 Thread Selva Nair
On Mon, Jul 13, 2015 at 5:19 PM, Simon Hobson wrote: > > What's needed is a file system that can do what hard links do, but at the > > file page level. I imagine that this would work using the same Copy On > > Write logic used in managing memory pages after a fork(). > > Well some (all ?) enterp

  1   2   3   4   5   6   7   8   9   >