RE: The "out of memory" problem with large numbers of files

[Schmitt, Martin]

Dave,

thanks for your reply.

> No, it's not an out of memory problem but it is like one of 
> the numerous
> different kinds of hangs that people experience.  Are you 
> copying between
> two places on the same system or are you copying to another 
> system?  What
> kinds of network transport is involved?  What version of 
> rsync were you
> using. 

It's two systems (Sun 450), everything mounted locally, ssh (ssh2, that
strange commercial one) transport, rsync 2.4.1.

To make it short, here is the command line I used for invocation:

/opt/gnu/bin/rsync --rsh=ssh \
                   --rsync-path=/opt/gnu/bin/rsync \
                   --archive \
                   --verbose \
                   otherhost:/dir/FOO /test/dir

In order to replicate /dir/FOO on otherhost as /test/dir/FOO on the local
system.
 
> Breaking up copies into smaller pieces will reduce the memory usage.

I believe I will start going for this solution. I just hoped someone had
already found a way to work around this through some obscure rsync option.

Thanks again,

-martin