How can we avoid partially transfered file

2004-12-03 Thread kbala
Is it possible to ideintify the file which are partially transfered from the remote machine. We want to avoid the partially transferred file to be in the target machine. If any failure is happen at the time of rsync transfer then that file should be transferred in the next time rathter than current

RSync with /really/ long file lists

2004-12-03 Thread Brandon Knitter
Hi everyone! rsync 2.5.7 linux RHES v3 We need to sync over 4 Million files, and when we run rsync we run out of memory! :( We were going to batch things, but the build in Batch mode still will use a large amount of memory. Any manualy batching is proving to be harder than you'd think, even wit

RE: how to exclude hidden files/directories

2004-12-03 Thread Hong Zhu
Yes that worked! thanks very much!! Hong > -Original Message- > From: Wayne Davison [mailto:[EMAIL PROTECTED] > Sent: Friday, December 03, 2004 3:08 PM > To: Hong Zhu > Cc: [EMAIL PROTECTED]; [EMAIL PROTECTED] > Subject: Re: how to exclude hidden files/directories > > > On Fri, Dec 03, 2

Re: SUGGESTION: rsyncing gziped source with non gziped destination

2004-12-03 Thread Eberhard Moenkeberg
Hi, On Fri, 3 Dec 2004, Andrzej Adam Filip wrote: > Would it be possible to make rsync capable to sync gziped source (at server) > with non gziped detination file? > > PROBLEM: > The rsyncd server provides a few *frequently* accessed, slow changing, *big* > text files (DNS RBL zones). > > It se

SUGGESTION: rsyncing gziped source with non gziped destination

2004-12-03 Thread Andrzej Adam Filip
Would it be possible to make rsync capable to sync gziped source (at server) with non gziped detination file? PROBLEM: The rsyncd server provides a few *frequently* accessed, slow changing, *big* text files (DNS RBL zones). It seems that the source files are too big to stay in memory caches and

Re: how to exclude hidden files/directories

2004-12-03 Thread Wayne Davison
On Fri, Dec 03, 2004 at 02:29:57PM -0500, Hong Zhu wrote: > how am I able to exclude hidden directories to be transferred? Immediately prior to the --include="*/" add this: --exclude=".*/" ..wayne.. -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before p

RE: how to exclude hidden files/directories

2004-12-03 Thread Hong Zhu
Hi Martin, Many thanks for testing it out! Sorry I wasn't clear. Since I'm rsyncing the directory tree, the hidden directories like ".abc" also get transferred, how am I able to exclude hidden directories to be transferred? Hopefully this will also exclude those matched files under hidden dir

Re: how to exclude hidden files/directories

2004-12-03 Thread Martin Scharrer
Hi, On Thursday 02 December 2004 22:24, Hong Zhu wrote: > Hi all, > > I'm rsync'ing all directories tree plus *.html and > .htaccess files but excluding everything else. > Although *.html files are indeed the only files get > transferred, hidden files and directories like > ".abc" also get transfe

Re: PROPOSAL: --link-hash-dest, additional linking of files to their HASH values

2004-12-03 Thread Wayne Davison
On Fri, Dec 03, 2004 at 12:29:34PM +0100, Helge Jensen wrote: > In order to reduce the space used for each backup, I was thinking about > linking all files in the backups to their hash in a separate directory, > allowing only one storage of each file-value, reducing my backup-needs > with ~5Gb p

Re: PROPOSAL: --link-hash-dest, additional linking of files to their HASH values

2004-12-03 Thread Paul Slootman
On Fri 03 Dec 2004, Helge Jensen wrote: > > In order to reduce the space used for each backup, I was thinking about > linking all files in the backups to their hash in a separate directory, > allowing only one storage of each file-value, reducing my backup-needs > with ~5Gb per machince. > > F

PROPOSAL: --link-hash-dest, additional linking of files to their HASH values

2004-12-03 Thread Helge Jensen
I'm using the excellent --link-dest option on rsync to do every-day full backups of a number of servers. These servers share most of the file-system content, but of course has some variations. In order to reduce the space used for each backup, I was thinking about linking all files in the backu