rsync batch file list output?

2011-06-15 Thread Justin T Pryzby
Is there any way to output some "stat/ls/diffstat/index"-type output from a batch file? I'd like to see what's taking the most space, so the important bits would be the file name and some metric for the changed file size. Total size of the data in the batch file for that file would be fine, even

Re: rsync pauses

2011-08-31 Thread Justin T Pryzby
I assume it's doing I/O, you can start a strace on the process to see for sure. Note that the rsync client usually forks a few times, so you may want to strace all of them (strace -p X -p Y -p Z), or launch the command under strace (strace -f CMD ARGS). Justin On Wed, Aug 31, 2011 at 07:09:35PM

Re: How to specify the dest directory?

2012-07-11 Thread Justin T Pryzby
Yes, if you run rsync -az A/ B Be careful to specify the thing you intend. Justin On Wed, Jul 11, 2012 at 04:52:43PM -0500, Peng Yu wrote: > When I use the following command, A (a directory) will be created in > B. But I actually want to cp the content of A to B. > > rsync -az A B > >

Re: local -> local file copy question

2012-08-19 Thread Justin T Pryzby
Note that --whole-file "is the default when both the source and destination are specified as local paths", and implies that the file is copied without the "delta transfer" algorithm. Justin On Sat, Aug 18, 2012 at 11:05:47PM -0700, Linda Walsh wrote: > In looking at source, I started at fileio an

Re: collecting the differences between a local host and remote archive to third local location (a usb device)

2012-10-11 Thread Justin T Pryzby
You can use rsync --write-batch (and write-batch-only). Justin On Thu, Oct 11, 2012 at 02:33:22PM -0700, Dan Stromberg wrote: > I wonder if rdiff would do this nicely...? > http://librsync.sourcefrog.net/doc/rdiff.html > > On Thu, Sep 27, 2012 at 12:33 AM, Benjamin Ward wrote: > > > > > Hi eve

Re: Problem rsyncing 450GB file to my NAS: 'connection unexpectedly closed'

2012-10-12 Thread Justin T Pryzby
Not sure, but some ideas: -P means to retain partial files, and doesn't have anything to do with /tmp; I wonder if you mean --inplace (not sure)? It sounds like a daemon may be timing out; is there a timeout specified in rsyncd.conf? Is there a remote logfile with any useful content? Justin On

Re: Problem rsyncing 450GB file to my NAS: 'connection unexpectedly closed'

2012-10-12 Thread Justin T Pryzby
QNap and timeout no longer defaults to 0? > > > >So I added "timeout = 0" and started a new run with --inplace and -: > >Until now its still running fine! > > > >I'll report back when it finishes > >So long - thanks for the quick and helpful poi

Re: vanilla rsync 3.0.9 hangs after transferring ~2000 files

2012-11-02 Thread Justin T Pryzby
On Fri, Nov 02, 2012 at 02:33:13PM +0100, Christian Iversen wrote: > However, 1 server is giving me a lot of trouble. It has a directory > with (currently) 734088 files in it, and every time I try to backup > this dir, rsync hangs after transferring roughly 2000 files. > Sometimes it's around 1800,

Re: vanilla rsync 3.0.9 hangs after transferring ~2000 files

2012-11-08 Thread Justin T Pryzby
On Thu, Nov 08, 2012 at 11:54:52PM +0100, Christian Iversen wrote: > On 2012-11-02 19:32, Justin T Pryzby wrote: > >On Fri, Nov 02, 2012 at 02:33:13PM +0100, Christian Iversen wrote: > >>However, 1 server is giving me a lot of trouble. It has a directory > >>with (cu

Re: Help: Make 2 Dirs Identical

2013-02-10 Thread Justin T Pryzby
If you really want to exclude /vault/test1/ccc, and for /vault/test2 to end up at /store/test2, then I would suggest: rsync -avz --exclude /test1/ccc src:/vault/ dest:/store rsync -avz src:/vault/test2 dest:/store that runs rsync over ssh. Note that the trailing slash on the "src" argument in th

Re: Fwd: rsync 3.0.9 partial file left after CTRL-C WITHOUT using --partial

2013-04-05 Thread Justin T Pryzby
Is it a new tmp file every time ?? Or is the tmpfile leftover from some (probably not reproducible) run? Are you sure there are no "stuck" rsync processes running? To be sure, you might run sudo lsof on that tmpfile. Justin On Fri, Apr 05, 2013 at 12:45:39PM +0200, Paul Lopez wrote: > Hi folks

Re: [Bug 9915] New: File stopped synchronizing during transmission

2013-06-10 Thread Justin T Pryzby
On Wed, May 29, 2013 at 04:39:55AM +, samba-b...@samba.org wrote: > https://bugzilla.samba.org/show_bug.cgi?id=9915 > We have currently trying to transmit data from one server to another using > RYSNC by synchronizing 2 folders. Occasionally, we noticed that the file stop > when in the middle o

Re: Fwd: Re: need help with an rsync patch

2013-08-13 Thread Justin T Pryzby
On Tue, Aug 13, 2013 at 08:44:08PM +0530, Sherin A wrote: > On Tuesday 13 August 2013 05:50 PM, Paul Slootman wrote: > >On Tue 13 Aug 2013, Matthias Schniedermeyer wrote: > >>BUT there is no direct vulnerability in that, only processes after that > >>(like backup/rsync) can make a vulnerability out

Re: Fwd: Re: need help with an rsync patch

2013-08-13 Thread Justin T Pryzby
On Tue, Aug 13, 2013 at 09:43:06PM +0530, Sherin A wrote: > If linux user foo , with home /home/foo , what ownership we need > to give the files under his home folder , it must be "foo" and not > root. Why? The user created the hardlink themselves, and it had root ownership, why should the ba

Re: Fwd: Re: need help with an rsync patch

2013-08-13 Thread Justin T Pryzby
On Tue, Aug 13, 2013 at 10:10:04PM +0530, Sherin A wrote: > I am doing rsync from root@10.0.0.10/home/foo to > storageuser@10.0.0.20/home/storageuser/dailybackup/foo over ssh (no > role for -H) Why not rsync from root to root? Or use the rsync protocol (not over ssh). Note that you can use -H

Re: keeping folders in sync *sparingly*

2013-09-03 Thread Justin T Pryzby
Try --fuzzy: -y, --fuzzy This option tells rsync that it should look for a basis file for any destination file that is missing. The current algorithm looks in the same directory as the destination file for either a file that has an identical size and modified-time, or a simi‐ larly-named fil