Hello Allan,
I've taken a look at the despooling code, and aside from locking to update
global statistics variables, there is no despooling locking code. Obviously,
the device in question is locked during despooling, but that should not
affect other devices or other spooling operations.
I've added a bit more debug info in the development version and will transfer
it to the released version -- I assume you are using 1.38.11. Once I have
tested it, I'll send you the new files. It may then give you more
information on what is going on.
I was serious about writing a regression script. The whole process with
multiple drives, multiple simultaneous jobs, and the reservation system is so
complex that even when I have a repeatable case, it is difficult debugging,
so for complex cases, I am going to request a regression script that
demonstrates the problem. Shortly, I will write up a mini-howto for writing
a regression script. It is not very hard. The advantage of a regression
script is that it is repeatable and it is independent of any particular
installation ...
On Tuesday 18 July 2006 20:04, Alan Brown wrote:
> On Tue, 18 Jul 2006, Kern Sibbald wrote:
> > The only way I can correct it (if there is really a problem) is to write
> > a regression script that demonstrates the problem, preferably using the
> > virtual disk autochanger script, otherwise, I don't have enough
> > information, and I don't know how to repeat it.
>
> Does this help?
>
> I am manually running 5 jobs each from 2 clients,
> using spooling to /var/bacula/spool/drive[0|1]
> There are 2 pools involved
> Each of the backup sets is approx 1000Gb
> Each of the clients has 2-3 jobs for each pool
>
> (I appear to be I/O bound on the spool disk, but this shouldn't be
> affecting anything other than generating some shoeshining.)
>
> Observations seem to indicate that when a job is using drive0, the storage
> director is fine, however when it's using drive1 it blocks access to
> drive0 and also blocks most status queries.
>
> Configuration is as follows:
>
> Storage { # definition of myself
> Name = Storage-sd
> SDPort = 9103 # Director's port
> WorkingDirectory = "/var/bacula/working"
> Pid Directory = "/var/run"
> Maximum Concurrent Jobs = 100
> Heartbeat Interval = 61s
> }
>
> Director {
> Name = Director-dir
> Password = "Gibberish"
> }
>
> Device {
> Name = FileStorage
> Media Type = File
> Archive Device = /var/bacula/Filestorage
> LabelMedia = yes; # lets Bacula label unlabeled media
> Random Access = Yes;
> AutomaticMount = yes; # when device opened, read it
> RemovableMedia = no;
> AlwaysOpen = no;
> }
>
> Autochanger {
> Name = MSL6000-changer
> Device = MSL6000-0
> Device = MSL6000-1
> Changer Command = "/etc/bacula/mtx-changer %c %o %S %a %d"
> Changer Device = /dev/sg16
> }
>
> Device {
> Name = MSL6000-0 #
> Drive Index = 0
> Media Type = LTO-2
> AutoChanger = yes;
> Changer Device = /dev/sg16
> Archive Device = /dev/nst0
> AutomaticMount = yes; # when device opened, read it
> AlwaysOpen = yes;
> LabelMedia = yes; # lets Bacula label unlabeled media
> RemovableMedia = yes;
> RandomAccess = no;
> Volume Poll Interval = 7200
> # Enable the Alert command only if you have the mtx package loaded
> Alert Command = "sh -c 'tapeinfo -f %c |grep TapeAlert|cat'"
> Spool Directory = /var/bacula/spool/MSL6000-0
> Maximum Spool Size = 200000000000 # 200Gb
> Maximum Job Spool Size = 10000000000 # 10Gb
> }
> Device {
> Name = MSL6000-1 #
> Drive Index = 1
> Device Type = Tape
> Media Type = LTO-2
> AutoChanger = yes;
> Changer Device = /dev/sg16
> Archive Device = /dev/nst1
> AutomaticMount = yes; # when device opened, read it
> AlwaysOpen = yes;
> LabelMedia = yes; # lets Bacula label unlabeled media
> RemovableMedia = yes;
> RandomAccess = no;
> Volume Poll Interval = 7200
> # Enable the Alert command only if you have the mtx package loaded
> Alert Command = "sh -c 'tapeinfo -f %c |grep TapeAlert|cat'"
> Spool Directory = /var/bacula/spool/MSL6000-1
> Maximum Spool Size = 200000000000 # 200Gb
> Maximum Job Spool Size = 10000000000 # 10Gb
> }
>
> # A DVD device
> #
> Device {
> Name = "DVD-Writer"
> Media Type = DVD
> Archive Device = /dev/hda
> LabelMedia = yes; # lets Bacula label unlabeled media
> Random Access = Yes;
> AutomaticMount = yes; # when device opened, read it
> RemovableMedia = yes;
> AlwaysOpen = no;
> MaximumPartSize = 800M;
> RequiresMount = yes;
> MountPoint = /media/cdrecorder
> MountCommand = "/bin/mount -t iso9660 -o ro %a %m";
> UnmountCommand = "/bin/umount %m";
> Spool Directory = /var/bacula/spool/DVD
> Maximum Spool Size = 200000000000 # 200Gb
> Maximum Job Spool Size = 10000000000 # 10Gb
> WritePartCommand = "/etc/bacula/dvd-handler %a write %e %v"
> FreeSpaceCommand = "/etc/bacula/dvd-handler %a free"
> }
>
> Messages {
> Name = Standard
> director = Director-dir = all
> }
>
> >>> On 18.07.2006, at 16:04, Alan Brown wrote:
> >>>> I'm not sure about this yet....
> >>>>
> >>>> It appears that when running spooling and concurrent jobs on an
> >>>> autochanger with multiple tape drives, that the tape drives are being
> >>>> locked on a per-changer basis and not on a per-drive one.
> >>>>
> >>>>
> >>>> IE: Full spool files are only being flushed to one drive at a time,
> >>>> even when there are spool files ready for both tape drives.
> >>>>
> >>>>
> >>>> Can anyone else confirm?
> >>>>
> >>>> Kern?
> >>>>
> >>>> AB
> >>>>
> >>>>
> >>>> ----------------------------------------------------------------------
> >>>>-- - Take Surveys. Earn Cash. Influence the Future of IT
> >>>> Join SourceForge.net's Techsay panel and you'll get the chance to
> >>>> share your
> >>>> opinions on IT & business topics through brief surveys -- and earn
> >>>> cash
> >>>> http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEV
> >>>>DE V _______________________________________________
> >>>> Bacula-users mailing list
> >>>> Bacula-users@lists.sourceforge.net
> >>>> https://lists.sourceforge.net/lists/listinfo/bacula-users
> >>
> >> ------------------------------------------------------------------------
> >>- Take Surveys. Earn Cash. Influence the Future of IT
> >> Join SourceForge.net's Techsay panel and you'll get the chance to share
> >> your opinions on IT & business topics through brief surveys -- and earn
> >> cash
> >> http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDE
> >>V _______________________________________________
> >> Bacula-users mailing list
> >> Bacula-users@lists.sourceforge.net
> >> https://lists.sourceforge.net/lists/listinfo/bacula-users
> >
> > -------------------------------------------------------------------------
> > Take Surveys. Earn Cash. Influence the Future of IT
> > Join SourceForge.net's Techsay panel and you'll get the chance to share
> > your opinions on IT & business topics through brief surveys -- and earn
> > cash
> > http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
> > _______________________________________________
> > Bacula-users mailing list
> > Bacula-users@lists.sourceforge.net
> > https://lists.sourceforge.net/lists/listinfo/bacula-users
-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys -- and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
_______________________________________________
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
