Re: Rsync takes long time to finish

2012-04-12 Thread Matthias Schniedermeyer
On 12.04.2012 23:59, vijay patel wrote: > > Hi Friends, > > I am using rsync to copy data from Production File Server to Disaster > Recovery file server. I have 100Mbps link setup between these two servers. > Folder structure is very deep. It is having path like > /reports/folder1/date/folder

Re: Rsync takes long time to finish

2012-04-12 Thread Brian K. White
on another folder structure. It is running fine. Is there any option i can use with rsync to make this folder check fast? Regards, Vijay > From: matthew.st...@us.fujitsu.com > To: k...@sanitarium.net; rsync@lists.samba.org > Subject: RE: Rsync takes long time to finish > Date: Thu

Re: Rsync takes long time to finish

2012-04-12 Thread Karl O. Pinc
On 04/12/2012 04:36:44 PM, vijay patel wrote: > > We are running Kernel 2.6.18-308.1.1.el5 which is latest in RHEL 5.8 > on both the server. I think i might have to explore option of using > ext4. Before you do anything you want to figure out why it is slow so you can solve the real problem. vms

Re: Rsync takes long time to finish

2012-04-12 Thread Kevin Korb
e: Thu, 12 Apr 2012 17:31:35 -0400 From: k...@sanitarium.net >> To: rsync@lists.samba.org Subject: Re: Rsync takes long time to >> finish >> > There was also a serious performance regression in 2.6.39. > > > On 04/12/12 17:29, Dan Stromberg wrote: > >&g

RE: Rsync takes long time to finish

2012-04-12 Thread vijay patel
We are running Kernel 2.6.18-308.1.1.el5 which is latest in RHEL 5.8 on both the server. I think i might have to explore option of using ext4. > Date: Thu, 12 Apr 2012 17:31:35 -0400 > From: k...@sanitarium.net > To: rsync@lists.samba.org > Subject: Re: Rsync takes long ti

Re: Rsync takes long time to finish

2012-04-12 Thread Kevin Korb
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 There was also a serious performance regression in 2.6.39. On 04/12/12 17:29, Dan Stromberg wrote: > > I've heard lots of good suggestions already - another thing that > I've not seen mentioned is, upgrading your kernel may help. > Somewhere shortly

Re: Rsync takes long time to finish

2012-04-12 Thread Dan Stromberg
I've heard lots of good suggestions already - another thing that I've not seen mentioned is, upgrading your kernel may help. Somewhere shortly before kernel 3.0, pathname lookups got noticeably faster. You could also try an alternative filesystem like xfs. It's supposed to be pretty good at larg

Re: Rsync takes long time to finish

2012-04-12 Thread Karl O. Pinc
On 04/12/2012 04:19:47 PM, Kevin Korb wrote: > Yes, you have the feature in your filesystem. Good. (Note that you will want to check the filesystems on both ends.) Karl Free Software: "You don't pay back, you pay forward." -- Robert A. Heinlein -- Please use reply-all f

RE: Rsync takes long time to finish

2012-04-12 Thread vijay patel
yes both servers are having rsync 3.0.6. > Date: Thu, 12 Apr 2012 17:19:47 -0400 > From: k...@sanitarium.net > To: rsync@lists.samba.org > Subject: Re: Rsync takes long time to finish > > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > Yes, you have the featu

Re: Rsync takes long time to finish

2012-04-12 Thread Kevin Korb
using rsync as > daemon (Because i am confused with its usage at the moment), will > it make any difference? > > >> Date: Thu, 12 Apr 2012 17:05:06 -0400 From: k...@sanitarium.net >> To: rsync@lists.samba.org Subject: Re: Rsync takes long time to >> finish >> >

RE: Rsync takes long time to finish

2012-04-12 Thread vijay patel
), will it make any difference? > Date: Thu, 12 Apr 2012 17:05:06 -0400 > From: k...@sanitarium.net > To: rsync@lists.samba.org > Subject: Re: Rsync takes long time to finish > > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > And make sure both systems are runni

Re: Rsync takes long time to finish

2012-04-12 Thread Kevin Korb
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 And make sure both systems are running rsync v3. It indexes in parallel to the copying. On 04/12/12 16:59, Karl O. Pinc wrote: > On 04/12/2012 03:28:18 PM, vijay patel wrote: >> >> Thanks friends. We are using Redhat Linux 5.8 on Production and >>

Re: Rsync takes long time to finish

2012-04-12 Thread Karl O. Pinc
On 04/12/2012 03:28:18 PM, vijay patel wrote: > > Thanks friends. We are using Redhat Linux 5.8 on Production and > Disaster Recovery side. By drilling down we have found out it is > taking lot of time to check what has changed while data tranfer is > very fast. As i mentioned data in these fol

RE: Rsync takes long time to finish

2012-04-12 Thread vijay patel
structure. It is running fine. Is there any option i can use with rsync to make this folder check fast? Regards, Vijay > From: matthew.st...@us.fujitsu.com > To: k...@sanitarium.net; rsync@lists.samba.org > Subject: RE: Rsync takes long time to finish > Date: Thu, 12 Apr 2012 19

RE: Rsync takes long time to finish

2012-04-12 Thread Stier, Matthew
Original Message- From: rsync-boun...@lists.samba.org [mailto:rsync-boun...@lists.samba.org] On Behalf Of Kevin Korb Sent: Thursday, April 12, 2012 2:44 PM To: rsync@lists.samba.org Subject: Re: Rsync takes long time to finish -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Several suggestion

RE: Rsync takes long time to finish

2012-04-12 Thread Stier, Matthew
- From: rsync-boun...@lists.samba.org [mailto:rsync-boun...@lists.samba.org] On Behalf Of Kevin Korb Sent: Thursday, April 12, 2012 2:44 PM To: rsync@lists.samba.org Subject: Re: Rsync takes long time to finish -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Several suggestions... Add a lockfi

Re: Rsync takes long time to finish

2012-04-12 Thread Kevin Korb
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Several suggestions... Add a lockfile to your cron job so it doesn't run two instances at the same time and you don't have to predict the run time. Make sure you are running rsync version 3+ on both systems. It has significant performance benefits o