Re: rsync to a destination > 8TB problem...

2004-08-10 Thread Matt Miller
Actually... a cp -r has the same issues... anyone seen this? BTW, I'm on SuSE 9.1 (personal) with the 2.6 kernel, lvm2, reiserfs, 2G RAM, 2G swap matt On Aug 10, 2004, at 4:41 PM, Matt Miller wrote: I am trying to use a large (10TB) reiserfs filesystem as an rsync target. The filesystem is on

Re: rsync erroring out when syncing a large tree

2004-08-10 Thread Wayne Davison
On Tue, Aug 10, 2004 at 11:28:04AM +0100, Mark Watts wrote: > rsync: connection unexpectedly closed (289336107 bytes read so far) > rsync error: error in rsync protocol data stream (code 12) at io.c(189) This error just means that the other side went away for some reason. What you need to figure o

Re: out of memory in receive_file_entry rsync-2.6.2

2004-08-10 Thread Eberhard Moenkeberg
Hi, On Tue, 10 Aug 2004, James Bagley Jr wrote: > I've had some problems using rsync to transfer directories with more than > 3 million files. Here's the error message from rsync: > > > ERROR: out of memory in receive_file_entry > rsync error: error allocating core memory buffers (code 22) at

rsync to a destination > 8TB problem...

2004-08-10 Thread Matt Miller
I am trying to use a large (10TB) reiserfs filesystem as an rsync target. The filesystem is on top of lvm2 (pretty sure this doesn't matter, but just in case.) I get the following error when trying to sync a modest set of files to that 10TB target (just syncing /etc for now): rsync: writefd_unbu

Re: out of memory in receive_file_entry rsync-2.6.2

2004-08-10 Thread James Bagley Jr
On Tue, 10 Aug 2004, Widyono wrote: > I've rsync'ed 7413719 files successfully (2.6.2 on RH7.2 server, Fermi > SL3.0.1 client), 680GB. When I do the top level directory all at > once, there are several points where it locks up the server for > minutes at a time (directories with large #'s of file

Re: out of memory in receive_file_entry rsync-2.6.2

2004-08-10 Thread Widyono
On Tue, Aug 10, 2004 at 11:36:26AM -0700, James Bagley Jr wrote: > Hello, > > I've had some problems using rsync to transfer directories with more than > 3 million files. Here's the error message from rsync: > > ERROR: out of memory in receive_file_entry > rsync error: error allocating core memor

out of memory in receive_file_entry rsync-2.6.2

2004-08-10 Thread James Bagley Jr
Hello, I've had some problems using rsync to transfer directories with more than 3 million files. Here's the error message from rsync: ERROR: out of memory in receive_file_entry rsync error: error allocating core memory buffers (code 22) at util.c(116) rsync: connection unexpectedly closed (634

Re: bash: /usr/local/bin/rsync: Argument list too long

2004-08-10 Thread Wayne Davison
On Tue, Aug 10, 2004 at 04:17:59PM +0300, victor wrote: > I will try the first sugestion [to run multiple rsync commands]. Don't do that. Read Tim Conway's reply instead. You probably just want to drop the '*' from your command (and leave the trailing '/'). ..wayne.. -- To unsubscribe or chang

Re: bash: /usr/local/bin/rsync: Argument list too long

2004-08-10 Thread Tim Conway
You want everything in wex into wex on the remote. Gotcha. Let's take a simple case. wex contains a b c d e. "/usr/local/bin/rsync -rsh=/usr/bin/rsh -r --delete --perms --owner --group /mail/spool/imap/user/wex/* [EMAIL PROTECTED]:/mail/spool/imap/user/wex" on the commandline becomes "/usr/loca

Re: bash: /usr/local/bin/rsync: Argument list too long

2004-08-10 Thread Jan-Benedict Glaw
On Tue, 2004-08-10 16:17:59 +0300, victor <[EMAIL PROTECTED]> wrote in message <[EMAIL PROTECTED]>: > However, can you explain me why this command works? > /usr/local/bin/rsync -r --delete --perms --owner --group > /mail/spool/imap/user [EMAIL PROTECTED]:/mail/spool/imap > In /mail/spool/imap/user

bash: /usr/local/bin/rsync: Argument list too long

2004-08-10 Thread victor
Thank you. I will try the first sugestion. However, can you explain me why this command works? /usr/local/bin/rsync -r --delete --perms --owner --group /mail/spool/imap/user [EMAIL PROTECTED]:/mail/spool/imap In /mail/spool/imap/user I have a lot of subdirectories with >1000 files. What I mean is

Re: bash: /usr/local/bin/rsync: Argument list too long

2004-08-10 Thread Jan-Benedict Glaw
On Tue, 2004-08-10 14:41:54 +0300, victor <[EMAIL PROTECTED]> wrote in message <[EMAIL PROTECTED]>: > I get this error when I try to copy a directory with a lot of files: > "bash: /usr/local/bin/rsync: Argument list too long" > > The exact command is: "/usr/local/bin/rsync -rsh=/usr/bin/rsh -r >

Re: bash: /usr/local/bin/rsync: Argument list too long

2004-08-10 Thread Mark Watts
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 > I get this error when I try to copy a directory with a lot of files: > "bash: /usr/local/bin/rsync: Argument list too long" > > The exact command is: "/usr/local/bin/rsync -rsh=/usr/bin/rsh -r > --delete --perms --owner --group /mail/spool/imap/user

Re: bash: /usr/local/bin/rsync: Argument list too long

2004-08-10 Thread YOSHIFUJI Hideaki / 吉藤英明
In article <[EMAIL PROTECTED]> (at Tue, 10 Aug 2004 14:41:54 +0300), victor <[EMAIL PROTECTED]> says: > I get this error when I try to copy a directory with a lot of files: > "bash: /usr/local/bin/rsync: Argument list too long" > > The exact command is: "/usr/local/bin/rsync -rsh=/usr/bin/rsh -

bash: /usr/local/bin/rsync: Argument list too long

2004-08-10 Thread victor
I get this error when I try to copy a directory with a lot of files: "bash: /usr/local/bin/rsync: Argument list too long" The exact command is: "/usr/local/bin/rsync -rsh=/usr/bin/rsh -r --delete --perms --owner --group /mail/spool/imap/user/wex/* [EMAIL PROTECTED]:/mail/spool/imap/user/wex".

rsync erroring out when syncing a large tree

2004-08-10 Thread Mark Watts
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 I'm trying to sync a mandrakelinux tree (~120GB) but it bombs out after a while with this error: rsync: connection unexpectedly closed (289336107 bytes read so far) rsync error: error in rsync protocol data stream (code 12) at io.c(189) rsync: write