Downloading a great number of files from different rsync servers for good loadbalancing and high efficiency.

mirrors.list` rsync -amH --progress --append-verify --timeout=10 --contimeout=5 \ ${mirror_used} ${line[0]} debs/ & mirror=$[mirror+1] done < deb-file.list wait --- Any hints for this issue? Regards -- Hongyi Zhao Xinjiang Technical Institute of Physics and Chemistr

--append and then --append-verify will not work.

es.bz2 werner@debian:~/http_resume_test$ Any hints on this issue? Regards -- Hongyi Zhao Xinjiang Technical Institute of Physics and Chemistry Chinese Academy of Sciences GnuPG DSA: 0xD108493 -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or

--append and then --append-verify will not work.

$ diff Packages.bz2 ~/Packages.bz2 werner@debian:~/http_resume_test$ Any hints on this issue? Regards -- .: Hongyi Zhao [ hongyi.zhao AT gmail.com ] Free as in Freedom :. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.sam

Downloading specific files with rsync and make them keeping the original directories structures.

Release in the following location: ./dists/Debian7.8/Release If the directory tree doesn't exist, let the rsync create the directory structure firstly and then put the file into it. Is this possible for this case? Regards -- .: Hongyi Zhao [ hongyi.zhao AT gmail.com ] Free as in Fr

Re: Downloading specific files with rsync and make them keeping the original directories structures.

y-i386/Packages.gz . Regards -- .: Hongyi Zhao [ hongyi.zhao AT gmail.com ] Free as in Freedom :. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs

Finding specific files/directories from a remote rsync server.

of the `foo/file' on this rsync server, i.e., a file named file which is located under the foo directory. How can I do this thing within bash/shell script with the invoking on rsync client? Regards -- .: Hongyi Zhao [ hongyi.zhao AT gmail.com ] Free as in Freedom :. -- Please use repl

Re: Finding specific files/directories from a remote rsync server.

rsync -aiv --include=foo/file --include='*/' --exclude='*' > rsync.example.net::module/ /dest/ > > You might also try using --prune-empty-dirs. > > ..wayne.. Thanks a lot for your hints. Regards -- .: Hongyi Zhao [ hongyi.zhao AT gmail.com ] Free as in Fr

Re: Finding specific files/directories from a remote rsync server.

egards > > You might also try using --prune-empty-dirs. -- .: Hongyi Zhao [ hongyi.zhao AT gmail.com ] Free as in Freedom :. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Two same rsync commands give different results on two debian mirrors.

) _ Why the same rsync commands give different results on the above two debian mirrors? The first one failed to find anything even the README exists, while the second one succeed for the job. Any hints on this issue? Regards -- .: Hongyi Zhao [ hongyi.zhao AT gmail.com

Re: Two same rsync commands give different results on two debian mirrors.

On Tue, 14 Apr 2015 09:32:10 +0200, Paul Slootman wrote: > On Tue 14 Apr 2015, Hongyi Zhao wrote: >> >> See the following commands: >> >> ___ >> >> $ rsync -rmnv -f +_README -f -_* ftp.is.co.za::mirror/ftp.debian.org/ >> f

The --inplace is very different from the behaviour of --partial when resuming a complex case transfer.

The 2,112,951 bytes is only a little larger than the actual data for updating the file. Of course, the control data are needed for rsync to work, so it will need a little more data for that thing. So this method is worked just as the description in the manual. Any hints on the above issues? Rega

Re: Two same rsync commands give different results on two debian mirrors.

;s a module name > and hence the starting point is the contents of the module's directory, > which contains README so that can be found. Again, thanks a lot for your notes. Regards > > > Paul -- .: Hongyi Zhao [ hongyi.zhao AT gmail.com ] Free as in Freedom :. -- Please use r

The complicated filter rule used by me worked for one Debian mirror and not for the other.

+_dists/***/ \ -f -_* \ ftp.is.co.za::mirror/ftp.debian.org/ftp.us.debian.org/debian/ This time, it will give nothing. You can try the above commands for inspecting the things I mentioned above. Could you please give me some hints on this issue? Regards -- .: Hongyi Zhao [ hongyi.zhao AT

Re: The complicated filter rule used by me worked for one Debian mirror and not for the other.

oted for the these servers? Regards -- .: Hongyi Zhao [ hongyi.zhao AT gmail.com ] Free as in Freedom :. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://

Re: The complicated filter rule used by me worked for one Debian mirror and not for the other.

lar to my case ;-) Regards > > > Paul -- .: Hongyi Zhao [ hongyi.zhao AT gmail.com ] Free as in Freedom :. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: The complicated filter rule used by me worked for one Debian mirror and not for the other.

On Tue, 14 Apr 2015 13:28:26 +, Hongyi Zhao wrote: >> but I wouldn't be surprised if some of the filter rules don't work on >> the older rsync. I've done a further test, and it doesn't support your point of view. Even I connect to a server with protocol ver

Does the --delete conflict with --files-from?

Hi all, I've tried to use the --files-from and --delete options together. But finally find that in this case, the `--delete' won't delete the extraneous files from dest dirs. So, does the --delete conflict with --files-from? Any hints on this issue? Regards -- .: Hongyi Zha

Re: Does the --delete conflict with --files-from?

So, --delete will only work if > your files-from file is a list of directories rather that files. > > OTOH, you are probably actually looking for the --delete-missing-args > option which is a fairly new feature. Thanks a lot for your hints. Regards -- .: Hongyi Zhao [ hongyi.zhao AT g

Can I let rsync only transer a part of file within specific byte ranges?

-- .: Hongyi Zhao [ hongyi.zhao AT gmail.com ] Free as in Freedom :. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

How to capture the stderr of rsync and redirect it into a file?

104) rsync error: error in socket IO (code 10) at io.c(785) [Receiver=3.1.2dev] Why rsync cann't let me redirect the stderr of it into a file, say, aaa, for this case? Regards -- .: Hongyi Zhao [ hongyi.zhao AT gmail.com ] Free as in Freedom :. -- Please use reply-all for most replies

Re: How to capture the stderr of rsync and redirect it into a file?

direction operator and the logfile: … 2> aaaa Regards -- .: Hongyi Zhao [ hongyi.zhao AT gmail.com ] Free as in Freedom :. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posti

Rsync a directory via a linked name.

clude/exclude rules for the above jobs. Any hints on how to write this rsync rules? Regards -- .: Hongyi Zhao [ hongyi.zhao AT gmail.com ] Free as in Freedom :. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samb

Re: Rsync a directory via a linked name.

ommand like this and it does the trick: rsync -rlKLPv --delete --delete-excluded \ ftp.cn.debian.org::debian/dists/wheezy/main/installer-amd64/current/ But, even though, I cann't figure out whether the method used by me is the most appropriate method or not for this case. Regards -- .: Hong

Re: Rsync a directory via a linked name.

On Thu, 16 Apr 2015 20:09:59 -0400, Kevin Korb wrote: > Always have either --times or --archives. Otherwise rsync will have no > idea what needs updating when you run it again. Thanks for your hints. Regards -- .: Hongyi Zhao [ hongyi.zhao AT gmail.com ] Free as in Freedom :. -- Plea

Skip based on checksum not worked as expected when using with complex filter rules.

bash su_dists.rsync|awk -F'/' \ '/^dists/ && $NF' dists/wheezy-updates/Release dists/wheezy-updates/Release.gpg dists/wheezy-updates/non-free/i18n/Translation-en.bz2 As you can see, for my case, there only have three files which need to be updated all toghethe

Re: Skip based on checksum not worked as expected when using with complex filter rules.

thout --itemize-changes. In fact, if I was in charge > I would make -v include --itemize-changes. Thanks a lot for your hints. Based on your hints, I use the `-cniv' options combinations and do the extract as follows on the output of rsync: awk '/^>fc/' And it does the tric

Is it possiable to suppress the site-specified messages?

.. [snip] If I want to suppress the messages before the following line with rsync client's args/options when connect to this rsync server: receiving file list ... Is this possible or not? Regards -- .: Hongyi Zhao [ hongyi.zhao AT gmail.com ] Free as in Freedom :. -- Please use repl

Re: Skip based on checksum not worked as expected when using with complex filter rules.

me-consuming thing ;-( > > Simply put, if you use --checksum without one of --itemize-changes, > - --link-dest, or --write-batch you are doing something horribly wrong. So, I think that use the `-niv' combinations and then do the extract as follows: awk '/^>f/' Sh

Re: Skip based on checksum not worked as expected when using with complex filter rules.

anges' is enough for my case? Or Do you want to see the output from my case of running on the different rsync options? Regards -- .: Hongyi Zhao [ hongyi.zhao AT gmail.com ] Free as in Freedom :. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe

Re: Skip based on checksum not worked as expected when using with complex filter rules.

ill happen to that file. All in a very > short string of characters. > > Simply put, --itemize-changes is so determinative that every second you > resist using it is evidence that you are falsifying a nonsensical > problem with rsync. Got it, thanks a lot. Regards -- .: Hongy

On the case `an identical item replaces the dots with spaces' for `--itemize-changes'.

t, I cann't figure out the case for the `(2) an identical item replaces the dots with spaces'. And I've never meet such things. Could you please give me some more hints or a minimal example on this case? Regards -- .: Hongyi Zhao [ hongyi.zhao AT gmail.com ] Free as in Freedo

Re: On the case `an identical item replaces the dots with spaces' for `--itemize-changes'.

th `-ii', and it seems that you are right. Regards > > Steven -- .: Hongyi Zhao [ hongyi.zhao AT gmail.com ] Free as in Freedom :. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo

Re: Is it possiable to suppress the site-specified messages?

On Sun, 19 Apr 2015 09:43:26 -0700, Wayne Davison wrote: > On Fri, Apr 17, 2015 at 8:51 PM, Hongyi Zhao > wrote: > >> When connect to a remote rsync server, often it will give some >> site-specified messages [...] >> If I want to suppress the messages [...] >&

List subdirectories only n level deep on the remote server when use the -a option of rsync.

? Regards -- Hongyi Zhao Xinjiang Technical Institute of Physics and Chemistry Chinese Academy of Sciences GnuPG DSA: 0xD108493 -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting

Re: List subdirectories only n level deep on the remote server when use the -a option of rsync.

Regards 2014-02-02, Paul Slootman : > On Sun 02 Feb 2014, Hongyi Zhao wrote: >> >> I want to list the contents on the remote rsync server only to n, say, >> 2 level deep. >> >> In my case the the server is rsync://ftp.cn.debian.org, and I want to >> l