Hi Arno!
On Tuesday 07 August 2007, Arno Lehmann wrote:
> 07.08.2007 13:17,, Andreas Kopecki wrote::
> ...
>
> >>>> Do you have the Maximum Concurrent Jobs in at least 3 places in the
> >>>> bacula-dir.conf? It goes in the main bacula-dir.conf settings as well
> >>>> as the Storage and each client in that bacula-dir.conf file as well as
> >>>> the bacula-fd.conf on the clients and bacula-sd.conf too.
> >>>
> >>> The Maximum Concurrent Jobs in the sd and the client conf is set to
> >>> 20... so there shouldn't be a limitation there, also. So, do you have
> >>> any other clues?
> >>
> >> In the DIR configuration, there is not only the overall concurrency
> >> limit. In the storage resource there you have to set the "Maximum
> >> Concurrent Jobs", too. So you need at least
> >> DIR configuration, global setting
> >> DIR configuration, storage resource
> >
> > I set everything in the configuration files, and the director seems to
> > have them picked up (show xxx) as can be seen from my first mail:
> >
> > Storage: name=GRAU MaxJobs=5
> > Director: name=hadrian-dir MaxJobs=5
> > client: name=visper-fd MaxJobs=20
> >
> > And several jobs derived from a single JobDef
> > Job: name=VISPER-XXX.Backup-Full JobType=66 level=Full MaxJobs=4 Spool=1
> >
> >> SD configuration, global setting
> >
> > is set to 20, dir and sd restarted
> >
> >> Optionally and depending on your needs: Client global setting,
> >
> > is set to 20 at the server and client side, fd restarted
> >
> >> cliant-specific setting in DIR, job-specific setting.
> >> Note that there is *no* setting for the storage device specific
> >> setting in the SD.
> >
> > Is it possible I hit a bug here? Could something else have an impact on
> > concurrency?
>
> I doubt there is a bug, at least similar setups run quite well in many
> locations.
>
> Perhaps you have different priorities.
>
> Anyway, we will need more detailed information for further help...
> either a complete job output from 'show job=...' for two jobs that
> should run in parallel, but don't, or the complete job setup from the
> configuration file.
Here is the show job output for two jobs. Both share the same pool. I have
jobs that use different pools, also, but that doesn't change anything.
Job: name=VISPER-RAID-home6.Backup-Full JobType=66 level=Full Priority=10
Enabled=1
MaxJobs=4 Resched=0 Times=0 Interval=1,800 Spool=1 WritePartAfterJob=1
--> Client: name=visper-fd address=visper.hlrs.de FDport=9102 MaxJobs=20
JobRetention=1 month 19 days FileRetention=2 months AutoPrune=1
--> Catalog: name=HLRS.Catalog address=*None* DBport=0 db_name=bacula
db_user=bacula MutliDBConn=0
--> FileSet: name=VISPER-RAID-home6.Set
O M
N
I /mnt/raid/home/architekten
I /mnt/raid/home/hpcdiche
I /mnt/raid/home/hpczink
I /mnt/raid/home/rusma
N
--> Schedule: name=WeeklyFull
--> Run Level=Incremental
hour=21
mday=0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25
26 27 28 29 30
month=0 1 2 3 4 5 6 7 8 9 10 11
wday=1 2 3 4
wom=0 1 2 3 4
woy=0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25
26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51
52 53
mins=55
--> Run Level=Full
hour=21
mday=0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25
26 27 28 29 30
month=0 1 2 3 4 5 6 7 8 9 10 11
wday=5
wom=0 1 2 3 4
woy=0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25
26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51
52 53
mins=55
--> WriteBootstrap=/var/bacula/VISPER-RAID-home6.bsr
--> Storage: name=GRAU address=hadrian.hlrs.de SDport=9103 MaxJobs=5
DeviceName=GRAU MediaType=SDZ-130 StorageId=1
--> Pool: name=GRAU-WF PoolType=Backup
use_cat=1 use_once=0 cat_files=1
max_vols=0 auto_prune=1 VolRetention=14 days
VolUse=0 secs recycle=1 LabelFormat=*None*
CleaningPrefix=*None* LabelType=0
RecyleOldest=0 PurgeOldest=0
MaxVolJobs=0 MaxVolFiles=0 MaxVolBytes=0
MigTime=0 secs MigHiBytes=0 MigLoBytes=0
--> Messages: name=Standard
mailcmd=/usr/sbin/bsmtp -f "(Bacula) %r" -s "Bacula: %t %e of %c %l" %r
opcmd=/usr/sbin/bsmtp -f "(Bacula) %r" -s "Bacula: Intervention needed
for %j" %r
Job: name=VISPER-RAID-home7.Backup-Full JobType=66 level=Full Priority=10
Enabled=1
MaxJobs=4 Resched=0 Times=0 Interval=1,800 Spool=1 WritePartAfterJob=1
--> Client: name=visper-fd address=visper.hlrs.de FDport=9102 MaxJobs=20
JobRetention=1 month 19 days FileRetention=2 months AutoPrune=1
--> Catalog: name=HLRS.Catalog address=*None* DBport=0 db_name=bacula
db_user=bacula MutliDBConn=0
--> FileSet: name=VISPER-RAID-home7.Set
O M
N
I /mnt/raid/home/hpcmtt
N
--> Schedule: name=WeeklyFull
--> Run Level=Incremental
hour=21
mday=0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25
26 27 28 29 30
month=0 1 2 3 4 5 6 7 8 9 10 11
wday=1 2 3 4
wom=0 1 2 3 4
woy=0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25
26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51
52 53
mins=55
--> Run Level=Full
hour=21
mday=0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25
26 27 28 29 30
month=0 1 2 3 4 5 6 7 8 9 10 11
wday=5
wom=0 1 2 3 4
woy=0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25
26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51
52 53
mins=55
--> WriteBootstrap=/var/bacula/VISPER-RAID-home7.bsr
--> Storage: name=GRAU address=hadrian.hlrs.de SDport=9103 MaxJobs=5
DeviceName=GRAU MediaType=SDZ-130 StorageId=1
--> Pool: name=GRAU-WF PoolType=Backup
use_cat=1 use_once=0 cat_files=1
max_vols=0 auto_prune=1 VolRetention=14 days
VolUse=0 secs recycle=1 LabelFormat=*None*
CleaningPrefix=*None* LabelType=0
RecyleOldest=0 PurgeOldest=0
MaxVolJobs=0 MaxVolFiles=0 MaxVolBytes=0
MigTime=0 secs MigHiBytes=0 MigLoBytes=0
--> Messages: name=Standard
mailcmd=/usr/sbin/bsmtp -f "(Bacula) %r" -s "Bacula: %t %e of %c %l" %r
opcmd=/usr/sbin/bsmtp -f "(Bacula) %r" -s "Bacula: Intervention needed
for %j" %r
Those are the corresponding Jobs/JobDefs:
JobDefs {
Name = "FullBackup-Fast"
Type = Backup
Level = Full
Storage = GRAU
Messages = Standard
Pool = GRAU-WF
Priority = 10
Maximum Concurrent Jobs = 4
Spool Data = yes
Spool Attributes = no
Rerun Failed Levels = yes
}
Job {
Name = "VISPER-RAID-home6.Backup-Full"
JobDefs = "FullBackup-Fast"
FileSet = "VISPER-RAID-home6.Set"
Write Bootstrap = "/var/bacula/VISPER-RAID-home6.bsr"
Client = visper-fd
Schedule = "WeeklyFull"
}
Job {
Name = "VISPER-RAID-home7.Backup-Full"
JobDefs = "FullBackup-Fast"
FileSet = "VISPER-RAID-home7.Set"
Write Bootstrap = "/var/bacula/VISPER-RAID-home7.bsr"
Client = visper-fd
Schedule = "WeeklyFull"
}
Andreas
-------------------------------------------------------------------------
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems? Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now >> http://get.splunk.com/
_______________________________________________
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
