Re: 4TB and "150 000 000" files out of memory error

2008-01-14 Thread Matt McCutchen
On Mon, 2008-01-14 at 17:05 +0100, Sylvain Gargasson wrote: > I want use you product to migrate 4TB of data (in 150 millions files) > > When rsync make the list of files it full my RAM and after my SWAP and my > server crash. Use a development version of rsync 3.0.0, which has an incremental rec

4TB and "150 000 000" files out of memory error

2008-01-14 Thread Sylvain Gargasson
Hi all, Thank you for your very useful product but I have a memory problem. I want use you product to migrate 4TB of data (in 150 millions files) When rsync make the list of files it full my RAM and after my SWAP and my server crash. I have 4GB of RAM and 4GB of SWAP Do you know what can I do

Re: rsync 3.00pre6 segfault in add_dirs_to_tree

2008-01-14 Thread Ming Zhang
Hi Matt No news is good news, so far Q&A and I have never seen crash again. Thanks a lot for the fix! Ming On Mon, 2008-01-14 at 17:12 -0500, Matt McCutchen wrote: > On Fri, 2007-12-14 at 13:34 -0500, Ming Zhang wrote: > > sorry but seems it still crashes somehow. > > > > global dir_count is

Re: rsync 3.00pre6 segfault in add_dirs_to_tree

2008-01-14 Thread Ming Zhang
ps, not sure if you saw the half open socket issue i reported last month? will you fix it or leave it there? Ming On Mon, 2008-01-14 at 17:12 -0500, Matt McCutchen wrote: > On Fri, 2007-12-14 at 13:34 -0500, Ming Zhang wrote: > > sorry but seems it still crashes somehow. > > > > global dir_co

Re: rsync 3.00pre6 segfault in add_dirs_to_tree

2008-01-14 Thread Matt McCutchen
On Fri, 2007-12-14 at 13:34 -0500, Ming Zhang wrote: > sorry but seems it still crashes somehow. > > global dir_count is 23. > > (gdb) bt > #0 0x0040544a in add_dirs_to_tree (parent_ndx=10, > from_flist=0x57c5d0, dir_cnt=4) at flist.c:1423 > #1 0x004090ef in send_extra_file_list

Re: Rsync 3.0.0pre8 released

2008-01-14 Thread Matt McCutchen
On Sat, 2008-01-12 at 11:19 -0800, Wayne Davison wrote: > I've just released rsync 3.0.0pre8. This version may be the last pre- > release before the 3.0.0 release. Darn. I was hoping to get into the double digits! :) Matt -- To unsubscribe or change options: https://lists.samba.org/mailman/l

DO NOT REPLY [Bug 5201] New: Rsync lets user corrupt dest by applying non-inplace batch in inplace mode

2008-01-14 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=5201 Summary: Rsync lets user corrupt dest by applying non-inplace batch in inplace mode Product: rsync Version: 3.0.0 Platform: Other OS/Version: Linux Status: NEW

Re: non-recursive remote listing breakage in 3.0.0pre1

2008-01-14 Thread Matt McCutchen
On Sun, 2007-10-07 at 01:31 -0400, Matt McCutchen wrote: > In the process of investigating this, I ran across another oddity with > --dirs and --relative that appears to be present in both rsync 2.6.9 > and the current CVS rsync. When a source argument ends in a ./ but > isn't ./ itself, rsync ski

DO NOT REPLY [Bug 5199] New: Exclusion of source arg ancestor short-circuits recursion

2008-01-14 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=5199 Summary: Exclusion of source arg ancestor short-circuits recursion Product: rsync Version: 3.0.0 Platform: Other OS/Version: Linux Status: NEW Severity: norm

Re: "fork failed in do_recv: Not enough space"

2008-01-14 Thread Dave Sill
Matt McCutchen <[EMAIL PROTECTED]> writes: > On Mon, 2008-01-14 at 12:51 -0500, Dave Sill wrote: >> I'm using rsync 2.6.9 under Solaris 10. The file system I'm trying to >> sync has ~7.6 million files. Here's what happens: >> >> # rsync -avS . /newfiles1 >> building file list ... done >> rsync:

Re: "fork failed in do_recv: Not enough space"

2008-01-14 Thread Matt McCutchen
On Mon, 2008-01-14 at 12:51 -0500, Dave Sill wrote: > I'm using rsync 2.6.9 under Solaris 10. The file system I'm trying to > sync has ~7.6 million files. Here's what happens: > > # rsync -avS . /newfiles1 > building file list ... done > rsync: fork failed in do_recv: Not enough space (12) > rsyn

"fork failed in do_recv: Not enough space"

2008-01-14 Thread Dave Sill
I'm using rsync 2.6.9 under Solaris 10. The file system I'm trying to sync has ~7.6 million files. Here's what happens: # rsync -avS . /newfiles1 building file list ... done rsync: fork failed in do_recv: Not enough space (12) rsync error: error in IPC code (code 14) at main.c(709) [receiver=2.6.

Re: "rsync cheatsheets"

2008-01-14 Thread Fabian Cenedese
At 21:45 11.01.2008 +0100, David Tonhofer wrote: >Hello, > >I have just put reviewed versions of the "rsync cheatsheets" which I posted a >couple of years ago >(if I correctly keep track of time), right here: > >http://public.m-plify.net/rsync_cheatsheets/ > >- Sheet one lists the possible combina