> -----Original Message-----
> From: Andrei Mikhailovsky [mailto:[EMAIL PROTECTED] 
> Sent: Monday, 08 August, 2005 08:59
> To: Chris Lee
> Cc: bacula-users@lists.sourceforge.net
> Subject: RE: [Bacula-users] poor network backup performance in 1.36.3
> 
> 
> 
> On Mon, 2005-08-08 at 05:48 -0500, Chris Lee wrote:
> > You mentioned you're running gentoo on the machine in 
> question.  Some more
> > information might help:
> > 
> > What profile are you using? (ls -l /etc/make.profile)
> > What kernel and version?
> > If 2.6 are you using udev?
> > Are you using ntpl with 2.6?
> > 
> 
> 1. ls -l /etc/make.profile
> lrwxr-xr-x  1 root root 48 May  4 14:02 /etc/make.profile
> -> ../usr/portage/profiles/default-linux/x86/2005.0
> 
> 
> 2. uname -r
> 2.6.9-gentoo-r6
> 
> 3. Yeah, i am using udev
> 
> 4. Yeah, native posix threading is enabled
> 
> > I'm inclined to suspect that either this is due to an 
> obscure configuration
> > issue, or there's some hidden problem with system libs or 
> something that
> > makes the filesystem scanning process lag a lot.  This is 
> just guess at this
> > point, but the info I asked for above might help.
> > 
> 
> might be the case. Well, i I try to scp or ftp a large amount of files
> (like in /usr/src/linux) should this reveal the problem of filesystem
> lags? I'll try doing that to see what average speed i'll get.
> 

Actually I meant more like something in ntpl or gentoo-sources that affects
src/findlib in bacula.

> 
> > Also, you might check to see if the remote machine has a 
> firewall rule with
> > "-m limit" that drops packet bursts over a particular limit 
> per time which
> > might be interfering with communication between the fd and 
> the director.
> > This was mentioned with an issue before and I didn't notice 
> that anyone ever
> > determined if it can be a problem or not.
> > 
> 
> there is a packet filter (iptables) script, but no "-m limit" 
> option is
> present
> 

Ok that was just a quick guess since Kern has mentioned before that the sd
hammers the fd pretty hard.  After thinking about it a bit more I suspect
that the limit option would not actually affect bacula in this manner anyway
unless it was applied to "ESTABLISHED" connections.

> 
> Great thanks for all the help
> > Thanks,
> > Chris  
> > 

My machines are nowhere near as robust as the ones you're talking about,
however one of my machines does run 2.6 without any slowdown that I've
noticed.  That machine is a PII 333Mhz running vanilla-sources (of the 2.6
variety) with no serious optimizations.  Of course I'm not dealing with very
large amounts of data on it either.  I'll try to talk somebody into trying
to reproduce this on a pretty fast x86 gentoo machine later today.  If they
can reproduce it then it might be a problem with "optimizations" in
gentoo-sources.

> > > -----Original Message-----
> > > From: [EMAIL PROTECTED] 
> > > [mailto:[EMAIL PROTECTED] On Behalf 
> > > Of Andrei Mikhailovsky
> > > Sent: Monday, 08 August, 2005 04:27
> > > To: Ryan Novosielski
> > > Cc: bacula-users@lists.sourceforge.net
> > > Subject: Re: [Bacula-users] poor network backup 
> performance in 1.36.3
> > > 
> > > 
> > > 
> > > On Mon, 2005-08-08 at 00:22 -0400, Ryan Novosielski wrote:
> > > > Are you absolutely certain that your ethernet cards are set 
> > > properly? 
> > > > Often an improperly negotiated link speed or duplex can 
> > > cause exactly 
> > > > this symptom. I know you mentioned other things that appear 
> > > to rule it 
> > > > out, but check that first regardless -- you might be surprised.
> > > > 
> > > 
> > > Yeah, I am 100% positive that this is not a network card 
> issue. I've
> > > tested it quite well, plus this server has been working 
> great at high
> > > network speeds for over a year now. No network card 
> related issues in
> > > the logs, no errors/collisions in the ifconfig output and 
> the card is
> > > set to full duplex. Must be something else.
> > > 
> > > 
> > > --
> > > Andrei
> > > 
> > > > =Ryan
> > > > 
> > > > Andrei Mikhailovsky wrote:
> > > > 
> > > > >On Sun, 2005-08-07 at 18:44 -0300, Roberto Alsina wrote:
> > > > >  
> > > > >
> > > > >>>Hello all,
> > > > >>>
> > > > >>>First of all, many thanks to all supporters/developers 
> > > of this project,
> > > > >>>keep up the great job!
> > > > >>>
> > > > >>>I have encountered a poor network backup performance for 
> > > one of our
> > > > >>>remote servers. The maximum transfer rate that I manage 
> > > to get is only
> > > > >>>50 kbyte/s. The server is hosted in a datacenter and 
> has a large
> > > > >>>available pipe. I can download files from this server at 
> > > 1-2 mbyte/s
> > > > >>>without any issues. However, when I try to backup files 
> > > from it (about
> > > > >>>15gig), the speed that I am getting is very very poor. I 
> > > mean it takes
> > > > >>>about 5 days to do a full backup. This should not be 
> happening,
> > > > >>>considering a lot of free bandwidth is not being used.
> > > > >>>      
> > > > >>>
> > > > >>Many datacenters have the bandwidth on non-standard ports 
> > > throttled way down.
> > > > >>
> > > > >>Try putting your bacula daemons on ports of 
> well-known but unused
> > > > >>services, and it will probably work much better.
> > > > >>
> > > > >>    
> > > > >>
> > > > >
> > > > >Yeah, I am aware of this issue. However, i've also tried 
> > > to carry out
> > > > >the backup using a VPN tunnel that I have setup. The copy 
> > > of files via
> > > > >vpn tunnel is as fast as without it 1-2mbyte/s. Then doing 
> > > bacula backup
> > > > >using the VPN tunnel i get about 50kbyte/s, which is about 
> > > the same as
> > > > >doing a backup without vpn. So the problem does not involve the
> > > > >datacenter.
> > > > >
> > > > >--
> > > > >Andrei
 


Thanks,
Chris



-------------------------------------------------------
SF.Net email is Sponsored by the Better Software Conference & EXPO
September 19-22, 2005 * San Francisco, CA * Development Lifecycle Practices
Agile & Plan-Driven Development * Managing Projects & Teams * Testing & QA
Security * Process Improvement & Measurement * http://www.sqe.com/bsce5sf
_______________________________________________
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Reply via email to