Adding timestamp before printing file name

2021-09-17 Thread hancooper via rsync
I am using rsync in the following manner rsync -av --inplace --update --log-file=/medhd/a3-swbase/05-nonfsw.log /medhc/a3-swbase/05-nonfsw /medhd/a3-swbase/ Normally the file name is outputted. Would it be possible to also add the time before the name?-- Please use reply-all for most replies t

Passing result of shuf to rsync

2021-09-17 Thread hancooper via rsync
ce > > > > > arguments. Instead of the source simply being . it can be a list of > > > > > stuff. Also, note that -a includes --recursive except when > > > > > --files-from > > > > > is in play. > > > > > > > > I am tr

Passing result of shuf to rsync

2021-09-17 Thread hancooper via rsync
t; > > > I am trying send via rsync a shuffled list of files. > > > > > On 9/17/21 7:11 PM, hancooper via rsync wrote: > > > > > > > I am trying to pass filename results that have been shuffled, then pass > > > > the file to rsync. > > &g

Passing result of shuf to rsync

2021-09-17 Thread hancooper via rsync
rsync can have multiple source > arguments. Instead of the source simply being . it can be a list of > stuff. Also, note that -a includes --recursive except when --files-from > is in play. I am trying send via rsync a shuffled list of files. > On 9/17/21 7:11 PM, hancooper via rsync wro

Passing result of shuf to rsync

2021-09-17 Thread hancooper via rsync
I am trying to pass filename results that have been shuffled, then pass the file to rsync. Not quite sure whether to use --files-from=- or some other way. shuf -n "$nf" -e ${dpath}/${incl} | rsync -av --update --files-from=- . "$dst"-- Please use reply-all for most replies to avoid omitting the

Skip file transfer on detecton of error code

2021-09-17 Thread hancooper via rsync
Occasionally rsync issues errors, which result in slowing a system during a transfer. Would it be possible to skip the transfer of the file rather than having rsync continue to insist, trying the transfer many times? rsync: read errors mapping "/media/hagbard/hc1/d5-comms/c-periodc/a-exposn/new

Rsync options –update and –append-verify

2021-09-11 Thread hancooper via rsync
e: > > > ‐‐‐ Original Message ‐‐‐ > > On Sunday, September 12, 2021 2:34 AM, hancooper via rsync > > rsync@lists.samba.org wrote: > > > > > ‐‐‐ Original Message ‐‐‐ > > > On Sunday, September 12, 2021 2:03 AM, Kevin Korb k...@sanitarium.

Rsync options –update and –append-verify

2021-09-11 Thread hancooper via rsync
‐‐‐ Original Message ‐‐‐ On Sunday, September 12, 2021 2:34 AM, hancooper via rsync wrote: > ‐‐‐ Original Message ‐‐‐ > On Sunday, September 12, 2021 2:03 AM, Kevin Korb k...@sanitarium.net wrote: > > > I thought I did elaborate. If it is a problem for you

Re: Rsync options –update and –append-verify

2021-09-11 Thread hancooper via rsync
refore it will be > > > newer than the source file and unless the source is updated rsync > > > --update will never complete the file. > > > > Is there a solution to this problem and should we consider it a bug? > > I am encountering this, and it's a real prob

Rsync options –update and –append-verify

2021-09-11 Thread hancooper via rsync
x27;s a real problem for me if files are not completed. > On 9/11/21 6:50 PM, hancooper via rsync wrote: > > > I am struggling to understand exactly what the rsync options --update and > > --append-verify do. > > Doing info rsync gives > > -u, --update > > This f

Rsync options –update and –append-verify

2021-09-11 Thread hancooper via rsync
I am struggling to understand exactly what the rsync options --update and --append-verify do. Doing info rsync gives -u, --update This forces rsync to skip any files which exist on the destina‐ tion and have a modified time that is newer than the source file. (If

Speeding up rsync

2021-08-24 Thread hancooper via rsync
multiple CPUs on the > > > single host. You would need to do some experimentation to determine the > > > best number for your hardware and network. Also, if you exceed that > > > number you can put more stress on the backup machine lessening the > > > impact to the ho

Speeding up rsync

2021-08-24 Thread hancooper via rsync
‐‐‐ Original Message ‐‐‐ On Tuesday, August 24, 2021 9:12 PM, hancooper via rsync wrote: > ‐‐‐ Original Message ‐‐‐ > On Tuesday, August 24, 2021 8:25 PM, Kevin Korb via rsync > rsync@lists.samba.org wrote: > > > In my experience backing up multiple hosts to

Re: Speeding up rsync

2021-08-24 Thread hancooper via rsync
o do some experimentation to determine the > best number for your hardware and network. Also, if you exceed that > number you can put more stress on the backup machine lessening the > impact to the hosts being backed up. > > On 8/24/21 3:58 PM, hancooper via rsync wrote: > > > It makes

Speeding up rsync

2021-08-24 Thread hancooper via rsync
It makes sense to we to run multiple rsync commands to speed up a backup. At work, some have argued that if I sync the data all to the same host, there is no advantage in parallelization. Whether you sync 3x 1G in parallel or 1x 3G makes no noticeable difference. Speed in general does not incre