Re: Timeout on deletion

2013-10-03 Thread AZ 9901
Le 29 sept. 2013 à 18:49, AZ 9901 a écrit : > Le 3 août 2013 à 21:26, AZ 9901 a écrit : > >> Le 20 mai 2013 à 10:55, AZ 9901 a écrit : >> >>> Hello, >>> >>> I use Rsync client (3.0.9) synchronising to a Rsync daemon (3.0.8) over SSH. >>>

Re: Timeout on deletion

2013-09-29 Thread AZ 9901
Le 3 août 2013 à 21:26, AZ 9901 a écrit : > Le 20 mai 2013 à 10:55, AZ 9901 a écrit : > >> Hello, >> >> I use Rsync client (3.0.9) synchronising to a Rsync daemon (3.0.8) over SSH. >> >> I have sometimes a huge amount of files to delete. >> Rsync da

Re: Large exclude list

2013-08-07 Thread AZ 9901
Le 7 août 2013 à 09:00, Mirek Lauš a écrit : >> >>> Le 11 juil. 2013 à 15:37, Mirek Lauš a écrit : >>> Hi, I'm facing problems with rsync using very large exclude-from list (around 780k lines, 32MB in size). Clients reads whole exclude list, then the sender receive

Re: rsync speed limited by read chunk size?

2013-08-04 Thread AZ 9901
Le 12 juil. 2013 à 19:35, Wayne Davison a écrit : > The fileio routines are usually reading 256K chunks except for the receiver, > which tries to read 16K chunks (since it may be randomly accessing the file > data in some cases). Wayne, when the Rsync daemon accesses the data (randomly or not),

Re: Rsync and RAID storage specifications

2013-08-04 Thread AZ 9901
Le 4 août 2013 à 17:25, K S Braunsdorf a écrit : > In message , AZ 9901 writes: >> Due to --link-dest, I have a huge read activity at the beginning of each >> backup, and huge hard links creation activity. >> I also plan to have several backups at the same time, coming from

Re: Rsync and RAID storage specifications

2013-08-04 Thread AZ 9901
2013 à 23:23, Kevin Korb a écrit : > It probably isn't going to make much of a difference. The bottleneck > will be in the networking. > > On 08/03/13 15:46, AZ 9901 wrote: >> Let's say that I would like to try using --link-dest :-) >> >> What about RA

Re: Rsync and RAID storage specifications

2013-08-03 Thread AZ 9901
à 19:29, Kevin Korb a écrit : > With millions of files I suggest ditching --link-dest and using ZFS > with subvolume snapshots. You will have nothing but pain trying to > deal with many millions of links. > > On 07/12/13 12:48, AZ 9901 wrote: >> Hello, >> >> I

Re: Timeout on deletion

2013-08-03 Thread AZ 9901
Le 20 mai 2013 à 10:55, AZ 9901 a écrit : > Hello, > > I use Rsync client (3.0.9) synchronising to a Rsync daemon (3.0.8) over SSH. > > I have sometimes a huge amount of files to delete. > Rsync daemon can take a lot of time to delete them, leading Rsync client into > a t

Re: Delete directories without browsing them

2013-08-03 Thread AZ 9901
Le 3 août 2013 à 18:27, Wayne Davison a écrit : > On Sun, Apr 7, 2013 at 2:25 AM, AZ 9901 wrote: > If so, is there a way to tell Rsync the following ? > "delete this top directory and all its files, but stop lacking time with > comparisons against the incl/excl list for each el

Re: Delete directories without browsing them

2013-08-03 Thread AZ 9901
Le 6 avr. 2013 à 16:57, AZ 9901 a écrit : > I make my production backups with Rsync. > > > Here is an example of my backup tree on the destination server : > /backups >/2013-04-03 >/2013-04-02 >/2013-04-01 >/2013-03-31 >/2013-03-30 >/

Re: rsync speed limited by read chunk size?

2013-07-28 Thread AZ 9901
Le 13 juil. 2013 à 14:42, AZ 9901 a écrit : > Le 12 juil. 2013 à 19:35, Wayne Davison a écrit : > >> On Tue, Jul 9, 2013 at 9:46 AM, CM Fields wrote: >> Is rsync speed limited to 160MB/sec read speeds due to the chunk read size? >> Or, are we seeing just a coinciden

Re: rsync speed limited by read chunk size?

2013-07-13 Thread AZ 9901
Le 12 juil. 2013 à 19:35, Wayne Davison a écrit : > On Tue, Jul 9, 2013 at 9:46 AM, CM Fields wrote: >> Is rsync speed limited to 160MB/sec read speeds due to the chunk read size? >> Or, are we seeing just a coincidence and the limitation is somewhere else? > > The fileio routines are usually

Rsync and RAID storage specifications

2013-07-12 Thread AZ 9901
Hello, I am going to use Rsync over millions of files, with --link-dest option. So huge read activity at the beginning of each backup, and huge hard links creation activity. Of course I will use a RAID array on receiver side, dedicated to Rsync. Do you have any recommandation over RAID type, nu

Re: Large exclude list

2013-07-12 Thread AZ 9901
Le 11 juil. 2013 à 15:37, Mirek Lauš a écrit : > Hi, > > I'm facing problems with rsync using very large exclude-from list (around > 780k lines, > 32MB in size). Clients reads whole exclude list, then the sender receives the > exclude > rules but is stuck at around line 32k ... Can you point m

Timeout on deletion

2013-05-20 Thread AZ 9901
Hello, I use Rsync client (3.0.9) synchronising to a Rsync daemon (3.0.8) over SSH. I have sometimes a huge amount of files to delete. Rsync daemon can take a lot of time to delete them, leading Rsync client into a timeout… Is there any way to avoid this timeout ? I would have liked not to incr

Re: Delete directories without browsing them

2013-04-07 Thread AZ 9901
Le 7 avr. 2013 à 13:29, Matthias Schniedermeyer a écrit : > On 07.04.2013 11:25, AZ 9901 wrote: >> Le 6 avr. 2013 à 17:15, Matthias Schniedermeyer a écrit : >> >>> On 06.04.2013 16:57, AZ 9901 wrote: >>>> >>>> Is there a way to tell Rsync to direc

Re: Delete directories without browsing them

2013-04-07 Thread AZ 9901
Le 6 avr. 2013 à 17:15, Matthias Schniedermeyer a écrit : > On 06.04.2013 16:57, AZ 9901 wrote: >> >> Is there a way to tell Rsync to directly delete backup directories at >> the top of the hierarchy without browsing them ? > > No. > > Deleting a directory-

Delete directories without browsing them

2013-04-06 Thread AZ 9901
Hello, I make my production backups with Rsync. Here is an example of my backup tree on the destination server : /backups /2013-04-03 /2013-04-02 /2013-04-01 /2013-03-31 /2013-03-30 /2013-03-29 At the end of the backup process, I upload a logfile in the backup directo

Re: ACL and link-dest

2011-05-23 Thread AZ 9901
without -A (--acls) will hard link files together. https://bugzilla.samba.org/show_bug.cgi?id=8130 Ben Le 23 mai 2011 à 21:07, Andrew Gideon a écrit : > On Mon, 23 May 2011 19:45:57 +0200, AZ 9901 wrote: > >> Well, when using -A (--acls), same (unchanged) files between 2 rsync >

Re: ACL and link-dest

2011-05-23 Thread AZ 9901
ment 3) to reproduce the bug. https://bugzilla.samba.org/show_bug.cgi?id=8130 Thank you ! Ben Le 23 mai 2011 à 15:25, Andrew Gideon a écrit : > On Sun, 08 May 2011 18:21:23 +0200, AZ 9901 wrote: > > [...] >> So why Rsync does not hard link them ? > > If I understand what you&

ACL and link-dest

2011-05-08 Thread AZ 9901
Hello, I am trying to use ACL and link-dest without success. Here is what I do. First step, without ACL : rsync -ai --link-dest= --link-dest= /sourcedir myserver::backup/$(date)/ All works fine there, my files are hard linked together, "ls -li" on myserver confirms. Second step, adding AC

chdir / chroot after pre-xfer ?

2008-11-19 Thread AZ 9901
Hello, I am trying to configure rsyncd to mount destination encrypted FS (using EncFS) before syncing. In my rsyncd.conf : [test] path = /home/dest <...> pre-xfer exec = sleep 30 ; echo mypassword | encfs -S /home/ encrypteddir /home/dest ; sleep 30 (I have put "sleep 30" instructions jus