Re: --link-dest. Time to 'building file list' incrementing

2019-01-08 Thread John Simpson via rsync
Don't know how I missed this when I was trying to figure out the cheapest solution. I don't need the complexity but it seems to be worth investigating. ThanksOn 8 Jan 2019 16:15, Andrew McGlashan via rsync wrote: > > On 8/1/19 8:56 pm, John Simpson via rsync wrote: > > Any ideas anyone? > > How

Re: --link-dest. Time to 'building file list' incrementing

2019-01-08 Thread Andrew McGlashan via rsync
On 8/1/19 8:56 pm, John Simpson via rsync wrote: > Any ideas anyone? How about using snapshots and doing the rsync off those? https://www.thewindowsclub.com/vss-volume-shadow-copy-service https://blogs.technet.microsoft.com/josebda/2007/10/10/the-basics-of-the-volume-shadow-copy-service-vss/

Re: --link-dest. Time to 'building file list' incrementing

2019-01-08 Thread John Simpson via rsync
Thanks. I'll give this a go and report back. On 8 Jan 2019 10:03, Ben RUBSON wrote:Hi,As you are on Cygwin, you should consider the notexec & noacl mount options :https://cygwin.com/cygwin-ug-net/using.html#mount-tableThey impact stat() performance.BenOn 8 Jan 2019, at 10:56, John Simpson via rsyn

Re: --link-dest. Time to 'building file list' incrementing

2019-01-08 Thread Ben RUBSON via rsync
Hi, As you are on Cygwin, you should consider the notexec & noacl mount options : https://cygwin.com/cygwin-ug-net/using.html#mount-table They impact stat() performance. Ben > On 8 Jan 2019, at 10:56, John Simpson via rsync wrote: > >

Re: --link-dest. Time to 'building file list' incrementing

2019-01-08 Thread John Simpson via rsync
Any ideas anyone? I still need at least a weekly backup of all data. The current workaround is just for the most active directories. Are there any diagnostics I can do which might shed some light on this? Thanks JohnOn 4 Jan 2019 09:53, John Simpson via rsync wrote: > > Kevin > > The link-des

Re: --link-dest. Time to 'building file list' incrementing

2019-01-04 Thread John Simpson via rsync
Kevin The link-dest parameter is a single directory (the previous day's directory), the destination is today's directory. I haven't tried deleting a backup, there's no particular need in space terms, at the current rate there's enough space for several years of daily backups. I've reverted t

Re: --link-dest. Time to 'building file list' incrementing

2019-01-03 Thread Kevin Korb via rsync
It does normally take some time to analyze large trees of files. It has to call stat() on each file to get the size and timestamp. However, 15 hours seems a bit excessive even though I have never tried to do this on Windows or a NAS system. Just to be clear, is your --link-dest parameter a singl

--link-dest. Time to 'building file list' incrementing

2019-01-03 Thread John Simpson via rsync
I've been running rsync as a cygwin task on Windows Server 2008 for about two months now. I'm using the --link-dest option to do a daily 'snapshot' of the contents of a server containing about 10TB of data, about 13 million files, to a Linux based NAS server. Things started out great but I soo