Hi, I am implementing a Vchanger to backup a group of machines to two central backup hosts. Here's some background information, and I have attached the relevant part of various configuration files. I hope someone could help resolve some of my problems.
At this point, I have created 2 changers, one, VCCoal13 with a 13 day retention, and the other VCCoal43 with a 43 day retention. VCCoal13 has 3 physical dives attached to it, and VCOal43 has 2; later on there will be about 8-10 drives per changer. Each drive has 100 volumes associated with it. The idea is that jobs will be directed to one of the changers without worrying about which disk it will backup to, and whether that disk has enough space to hold the backup. The changer will pick up the next available volume and start the backup, and if it runs out of disk space on the current disk, it will simply pick up the next volume available on the next disk with enough space, and finish the backup. At first, multiple jobs were blocking, waiting on the same volume, and waiting for the current job to finish. Now, when the current job finished, the next job will pick up the next volume and backup will start. i thought we resolved this issue, where more than one job are backing up simultaneously, but the problem is that all simultaneous jobs are backing up to the same volume; they should each be backing up to its own available volume. I hope I didn't miss any relevant information, and I hope I didn't confuse things too much, but here are the relevant configuration files and/or relevant portions, followed by bconsole messages relevant to this problem. Sorry for the long message, and thank you for your time and consideration. Elie *13 day changer configuration file:* # # $TOPDIR/etc/bacula/vchanger/VCCoal13.conf # baculasd="VCCoal13" baculasd_user=root bconsole="$TOPDIR/usr/sbin/bconsole" magslots=100 ndisks=3 diskids='B0001 B0003 B0005' maxdrive=5 maxdrives=6 maxdriveperdisk=1 maxdrivesperdisk=2 statedir="$TOPDIR/var/lib/bacula/vchanger/$baculasd/%DISKID" drivedir="$TOPDIR/var/lib/bacula/vchanger/$baculasd" mountpoint="$TOPDIR/backups/autofs/%DISKID/bacula" purgepool="VCPool13" # eof *Bacula Storage Daemon Configuration file:* .... .... # ## Vchanger: 13 day retention virtual autochanger with disks # Autochanger { Name = VCCoal13 Device = VCCoal13-drive-0 # on disk B0001 Device = VCCoal13-drive-1 # on disk B0001 Device = VCCoal13-drive-2 # on disk B0003 Device = VCCoal13-drive-3 # on disk B0003 Device = VCCoal13-drive-4 # on disk B0005 Device = VCCoal13-drive-5 # on disk B0005 Changer Command = "/etc/bacula/scripts/vchanger %c %o %S %a %d" Changer Device = /etc/bacula/vchanger/VCCoal13.conf } Device { Name = VCCoal13-drive-0 DriveIndex = 0 AutoChanger = yes; DeviceType = File MediaType = File ArchiveDevice = /var/lib/bacula/vchanger/VCCoal13/drive0 AutomaticMount = yes; RequiresMount = no; # # AlwaysOpen = yes; RemovableMedia = no; RandomAccess = yes; Autoselect = yes; } .......................................... .......................................... (Same for devices 1..4) .......................................... .......................................... Device { Name = VCCoal13-drive-5 DriveIndex = 5 AutoChanger = yes; DeviceType = File MediaType = File ArchiveDevice = /var/lib/bacula/vchanger/VCCoal13/drive5 AutomaticMount = yes; RequiresMount = no; # # AlwaysOpen = yes; RemovableMedia = no; RandomAccess = yes; Autoselect = yes; } *Bacula Director Configuration file:* .... .... # # Storage definition of vchangers with disk drives # Storage { Name = VCSCoal13 Address = coal-bk.impulse.net SDPort = 9103 Password = "xuCV21/ZNJbdp5joPZY0XEB10uFMf48ZnB98Lp3gri82" # password for Storage daemon Device = VCCoal13 # must be same as Device in Storage daemon Media Type = File # must be same as MediaType in Storage daemon Autochanger = yes # enable for autochanger device Maximum Concurrent Jobs = 20 } ................................................................ ................................................................ # # Jobdefs definitions for vchanger with disk drives # JobDefs { Name = "VCRetention13" Type = Backup Level = Incremental Messages = Standard Pool = VCPool13 Priority = 10 Storage = VCSCoal13 } ................................................................ ................................................................ # # Machine1 test job definition # Job { Name = "Coal-Test1" JobDefs = "VCRetention13" Client = coal-fd FileSet = "Test Set" Schedule = "WeeklyCycleFDI" Write Bootstrap = "/var/lib/bacula/Coal.bsr" } # # Machin2 test job definition # Job { Name = "Linux2-Test1" JobDefs = "VCRetention13" Client = linux2-fd FileSet = "Test Set" # Schedule = "WeeklyCycleSun" Write Bootstrap = "/var/lib/bacula/Linux2.bsr" } # # File Set definition for the test jobs #FileSet { Name = "Test Set" Include { Options { Signature = MD5 Compression = GZIP OneFS = yes NoATime = yes HardLinks = yes Exclude = yes @/etc/bacula/unix-option-excludes.inc } File = /usr } @/etc/bacula/unix-excludes.inc } BCONSOLE MESSAGES: ===================== For the first tests, the jobs ran sequentially; the first job backing up to Volume "B0003m01s004" on device "VCCoal13-drive-0"; and when it was finished, the second job backed up to Volume "B0003m01s005" on device "VCCoal13-drive-0", the same device. Now ultimately, I would expect the first job to be backing up to Volume "B0003m01s004" on device "VCCoal13-drive-0" while simultaneously the second job is backing up to Volume "B0003m01s005" but using device "VCCoal13-drive-1". Both drive-0 and drive-1 are on the same disk. Run Backup job JobName: Coal-Test1 Level: Incremental Client: coal-fd FileSet: Test Set Pool: VCPool13 (From Job resource) Storage: VCSCoal13 (From Job resource) When: 2007-10-22 13:43:44 Priority: 10 OK to run? (yes/mod/no): yes Job queued. JobId=12786 Run Backup job JobName: Linux2-Test1 Level: Incremental Client: linux2-fd FileSet: Test Set Pool: VCPool13 (From Job resource) Storage: VCSCoal13 (From Job resource) When: 2007-10-22 13:43:59 Priority: 10 OK to run? (yes/mod/no): yes Job queued. JobId=12787 *mes 22-Oct 13:43 coal-dir: No prior Full backup Job record found. 22-Oct 13:43 coal-dir: No prior or suitable Full backup found in catalog. Doing FULL backup. 22-Oct 13:43 coal-dir: Start Backup JobId 12786, Job=Coal-Test1.2007-10-22_13.43.49 22-Oct 13:43 coal-sd: 3307 Issuing autochanger "unload slot 103, drive 0" command. 22-Oct 13:43 coal-sd: 3304 Issuing autochanger "load slot 104, drive 0" command. 22-Oct 13:43 coal-sd: 3305 Autochanger "load slot 104, drive 0", status is OK. 22-Oct 13:43 coal-sd: 3301 Issuing autochanger "loaded? drive 0" command. 22-Oct 13:43 coal-sd: 3302 Autochanger "loaded? drive 0", result is Slot 104. 22-Oct 13:43 coal-sd: Wrote label to prelabeled Volume "B0003m01s004" on device "VCCoal13-drive-0" (/var/lib/bacula/vchanger/VCCoal13/drive0) 22-Oct 13:44 coal-dir: No prior Full backup Job record found. 22-Oct 13:44 coal-dir: No prior or suitable Full backup found in catalog. Doing FULL backup. * 22-Oct 13:44 coal-sd: Job write elapsed time = 00:00:16, Transfer rate = 121.9 K bytes/second 22-Oct 13:44 coal-dir: Max Volume jobs exceeded. Marking Volume "B0003m01s004" as Used. 22-Oct 13:44 coal-dir: Bacula 2.0.1 (12Jan07): 22-Oct-2007 13:44:18 * * JobId: 12786 Job: Coal-Test1.2007-10-22_13.43.49 Backup Level: Full (upgraded from Incremental) Client: "coal-fd" 2.0.1 (12Jan07) i686-pc-linux-gnu,gentoo,1.12.6 FileSet: "Test Set" 2007-10-22 13:43:49 Pool: "VCPool13" (From Job resource) Storage: "VCSCoal13" (From Job resource) Scheduled time: 22-Oct-2007 13:43:44 Start time: 22-Oct-2007 13:43:53 End time: 22-Oct-2007 13:44:18 Elapsed time: 25 secs Priority: 10 FD Files Written: 1,246 SD Files Written: 1,246 FD Bytes Written: 1,807,615 (1.807 MB) SD Bytes Written: 1,950,784 (1.950 MB) Rate: 72.3 KB/s Software Compression: 82.1 % VSS: no Encryption: no Volume name(s): B0003m01s004 Volume Session Id: 1 Volume Session Time: 1193085265 Last Volume Bytes: 1,988,229 (1.988 MB) Non-fatal FD errors: 0 SD Errors: 0 FD termination status: OK SD termination status: OK Termination: Backup OK 22-Oct 13:44 coal-dir: Begin pruning Jobs. 22-Oct 13:44 coal-dir: No Jobs found to prune. 22-Oct 13:44 coal-dir: Begin pruning Files. * * 22-Oct 13:44 coal-dir: Pruned Files from 2 Jobs for client coal-fd from catalog. 22-Oct 13:44 coal-dir: End auto prune. 22-Oct 13:44 coal-dir: Start Backup JobId 12787, Job=Linux2-Test1.2007-10-22_13.44.01 22-Oct 13:44 coal-sd: 3301 Issuing autochanger "loaded? drive 0" command. 22-Oct 13:44 coal-sd: 3302 Autochanger "loaded? drive 0", result is Slot 104. 22-Oct 13:44 coal-sd: 3307 Issuing autochanger "unload slot 104, drive 0" command. 22-Oct 13:44 coal-sd: 3304 Issuing autochanger "load slot 105, drive 0" command. 22-Oct 13:44 coal-sd: 3305 Autochanger "load slot 105, drive 0", status is OK. 22-Oct 13:44 coal-sd: 3301 Issuing autochanger "loaded? drive 0" command. 22-Oct 13:44 coal-sd: 3302 Autochanger "loaded? drive 0", result is Slot 105. 22-Oct 13:44 coal-sd: Wrote label to prelabeled Volume "B0003m01s005" on device "VCCoal13-drive-0" (/var/lib/bacula/vchanger/VCCoal13/drive0) 22-Oct 13:44 coal-sd: Job write elapsed time = 00:00:01, Transfer rate = 334.2 K bytes/second 22-Oct 13:44 coal-dir: Max Volume jobs exceeded. Marking Volume "B0003m01s005" as Used. 22-Oct 13:44 coal-dir: Bacula 2.0.1 (12Jan07): 22-Oct-2007 13:44:53 JobId: 12787 Job: Linux2-Test1.2007-10-22_13.44.01 Backup Level: Full (upgraded from Incremental) Client: "linux2-fd" 2.0.1 (12Jan07) i686-pc-linux-gnu,gentoo,1.4.16 FileSet: "Test Set" 2007-10-22 13:43:49 Pool: "VCPool13" (From Job resource) Storage: "VCSCoal13" (From Job resource) Scheduled time: 22-Oct-2007 13:43:59 Start time: 22-Oct-2007 13:44:46 End time: 22-Oct-2007 13:44:53 Elapsed time: 7 secs Priority: 10 FD Files Written: 488 SD Files Written: 488 FD Bytes Written: 286,788 (286.7 KB) SD Bytes Written: 334,228 (334.2 KB) Rate: 41.0 KB/s Software Compression: 65.8 % VSS: no Encryption: no Volume name(s): B0003m01s005 Volume Session Id: 2 Volume Session Time: 1193085265 Last Volume Bytes: 349,137 (349.1 KB) Non-fatal FD errors: 0 SD Errors: 0 FD termination status: OK SD termination status: OK Termination: Backup OK Select Job resource (1-119): 4 Run Backup job JobName: Coal-Test1 Level: Incremental Client: coal-fd FileSet: Test Set Pool: VCPool13 (From Job resource) Storage: VCSCoal13 (From Job resource) When: 2007-10-22 13:46:07 Priority: 10 OK to run? (yes/mod/no): yes Job queued. JobId=12788 22-Oct 13:46 coal-dir: No prior Full backup Job record found. 22-Oct 13:46 coal-dir: No prior or suitable Full backup found in catalog. Doing FULL backup. 22-Oct 13:46 coal-dir: Start Backup JobId 12788, Job=Coal-Test1.2007-10-22_13.46.08 * 22-Oct 13:46 coal-sd: 3301 Issuing autochanger "loaded? drive 0" command. 22-Oct 13:46 coal-sd: 3302 Autochanger "loaded? drive 0", result is Slot 105. 22-Oct 13:46 coal-sd: 3307 Issuing autochanger "unload slot 105, drive 0" command. 22-Oct 13:46 coal-sd: 3304 Issuing autochanger "load slot 106, drive 0" command. 22-Oct 13:46 coal-sd: 3305 Autochanger "load slot 106, drive 0", status is OK. 22-Oct 13:46 coal-sd: 3301 Issuing autochanger "loaded? drive 0" command. 22-Oct 13:46 coal-sd: 3302 Autochanger "loaded? drive 0", result is Slot 106. 22-Oct 13:46 coal-sd: Wrote label to prelabeled Volume "B0003m01s006" on device "VCCoal13-drive-0" (/var/lib/bacula/vchanger/VCCoal13/drive0) * Run Backup job JobName: Linux2-Test1 Level: Incremental Client: linux2-fd FileSet: Test Set Pool: VCPool13 (From Job resource) Storage: VCSCoal13 (From Job resource) When: 2007-10-22 13:46:22 Priority: 10 OK to run? (yes/mod/no): yes Job queued. JobId=12789 22-Oct 13:46 coal-dir: No prior Full backup Job record found. 22-Oct 13:46 coal-dir: No prior or suitable Full backup found in catalog. Doing FULL backup. * *status dir coal-dir Version: 2.0.1 (12 January 2007) i686-pc-linux-gnu gentoo 1.12.6 Daemon started 22-Oct-07 13:34, 2 Jobs run since started. Heap: bytes=1,298,219 max_bytes=1,299,116 bufs=14,546 max_bufs=14,651 Scheduled Jobs: Level Type Pri Scheduled Name Volume ============================================= ............................. Running Jobs: JobId Level Name Status ====================================================================== 12788 Full Coal-Test1.2007-10-22_13.46.08 is running *12789 Full Linux2-Test1.2007-10-22_13.46.24 is waiting on max Storage jobs* ==== Terminated Jobs: JobId Level Files Bytes Status Finished Name ==================================================================== .................................... * * * * *status storage=VCSCoal13 Connecting to Storage daemon VCSCoal13 at coal-bk.impulse.net:9103 coal-sd Version: 2.0.1 (12 January 2007) i686-pc-linux-gnu gentoo 1.12.6 Daemon started 22-Oct-07 13:34, 2 Jobs run since started. Heap: bytes=415,540 max_bytes=446,123 bufs=787 max_bufs=789 Running Jobs: Writing: Full Backup job Coal-Test1 JobId=12788 Volume="B0003m01s006" pool="VCPool13" device=""VCCoal13-drive-0" (/var/lib/bacula/vchanger/VCCoal13/drive0)" spooling=0 despooling=0 despool_wait=0 Files=40,599 Bytes=180,746,466 Bytes/sec=379,719 FDReadSeqNo=347,148 in_msg=232544 out_msg=5 fd=5 ==== Jobs waiting to reserve a drive: ==== Terminated Jobs: JobId Level Files Bytes Status Finished Name =================================================================== ............................................. ==== Device status: Autochanger "VCCoal13" with devices: "VCCoal13-drive-0" (/var/lib/bacula/vchanger/VCCoal13/drive0) "VCCoal13-drive-1" (/var/lib/bacula/vchanger/VCCoal13/drive1) "VCCoal13-drive-2" (/var/lib/bacula/vchanger/VCCoal13/drive2) "VCCoal13-drive-3" (/var/lib/bacula/vchanger/VCCoal13/drive3) "VCCoal13-drive-4" (/var/lib/bacula/vchanger/VCCoal13/drive4) "VCCoal13-drive-5" (/var/lib/bacula/vchanger/VCCoal13/drive5) Autochanger "VCCoal43" with devices: "VCCoal43-drive-0" (/var/lib/bacula/vchanger/VCCoal43/drive0) "VCCoal43-drive-1" (/var/lib/bacula/vchanger/VCCoal43/drive1) "VCCoal43-drive-2" (/var/lib/bacula/vchanger/VCCoal43/drive2) "VCCoal43-drive-3" (/var/lib/bacula/vchanger/VCCoal43/drive3) Device "TempFileStorage" (/tmp) is not open. Device "B0001" (/backups/autofs/B0001/bacula) is not open. ................................................................ ............................................................... Device "B0040" (/backups/autofs/B0040/bacula) is not open. Device "VCCoal13-drive-0" (/var/lib/bacula/vchanger/VCCoal13/drive0) is mounted with Volume="B0003m01s006" Pool="VCPool13" Slot 106 is loaded in drive 0. Total Bytes=182,246,445 Blocks=2,825 Bytes/block=64,512 Positioned at File=0 Block=182,246,444 Device "VCCoal13-drive-1" (/var/lib/bacula/vchanger/VCCoal13/drive1) is not open. Drive 1 status unknown. Device "VCCoal13-drive-2" (/var/lib/bacula/vchanger/VCCoal13/drive2) is not open. Drive 2 status unknown. Device "VCCoal13-drive-3" (/var/lib/bacula/vchanger/VCCoal13/drive3) is not open. Drive 3 status unknown. Device "VCCoal13-drive-4" (/var/lib/bacula/vchanger/VCCoal13/drive4) is not open. Drive 4 status unknown. Device "VCCoal13-drive-5" (/var/lib/bacula/vchanger/VCCoal13/drive5) is not open. Drive 5 status unknown. Device "VCCoal43-drive-0" (/var/lib/bacula/vchanger/VCCoal43/drive0) is not open. Drive 0 status unknown. Device "VCCoal43-drive-1" (/var/lib/bacula/vchanger/VCCoal43/drive1) is not open. Drive 1 status unknown. Device "VCCoal43-drive-2" (/var/lib/bacula/vchanger/VCCoal43/drive2) is not open. Drive 2 status unknown. Device "VCCoal43-drive-3" (/var/lib/bacula/vchanger/VCCoal43/drive3) is not open. Drive 3 status unknown. ==== In Use Volume status: B0003m01s006 on device "VCCoal13-drive-0" (/var/lib/bacula/vchanger/VCCoal13/drive0) ==== ***************************************************************************** Then we restart Bacula after some changes and run the same tests. The results this time are different. Run Backup job JobName: Coal-Test1 Level: Incremental Client: coal-fd FileSet: Test Set Pool: VCPool13 (From Job resource) Storage: VCSCoal13 (From Job resource) When: 2007-10-22 14:01:50 Priority: 10 OK to run? (yes/mod/no): yes Job queued. JobId=12790 22-Oct 14:01 coal-dir: No prior Full backup Job record found. 22-Oct 14:01 coal-dir: No prior or suitable Full backup found in catalog. Doing FULL backup. * Run Backup job JobName: Linux2-Test1 Level: Incremental Client: linux2-fd FileSet: Test Set Pool: VCPool13 (From Job resource) Storage: VCSCoal13 (From Job resource) When: 2007-10-22 14:01:56 Priority: 10 OK to run? (yes/mod/no): yes Job queued. JobId=12791 22-Oct 14:01 coal-dir: Start Backup JobId 12790, Job=Coal-Test1.2007-10-22_14.01.52 22-Oct 14:01 coal-sd: 3301 Issuing autochanger "loaded? drive 0" command. 22-Oct 14:01 coal-sd: 3302 Autochanger "loaded? drive 0", result is Slot 106. 22-Oct 14:01 coal-sd: Volume "B0003m01s006" previously written, moving to end of data. 22-Oct 14:01 coal-dir: No prior Full backup Job record found. 22-Oct 14:01 coal-dir: No prior or suitable Full backup found in catalog. Doing FULL backup. * 22-Oct 14:02 coal-dir: Start Backup JobId 12791, Job=Linux2-Test1.2007-10-22_14.01.57 * *status storage=VCSCoal13 Connecting to Storage daemon VCSCoal13 at coal-bk.impulse.net:9103 coal-sd Version: 2.0.1 (12 January 2007) i686-pc-linux-gnu gentoo 1.12.6 Daemon started 22-Oct-07 14:01, 0 Jobs run since started. Heap: bytes=552,572 max_bytes=552,678 bufs=817 max_bufs=819 Running Jobs: Writing: Full Backup job Coal-Test1 JobId=12790 Volume="B0003m01s006" pool="VCPool13" device=""VCCoal13-drive-0" (/var/lib/bacula/vchanger/VCCoal13/drive0)" spooling=0 despooling=0 despool_wait=0 Files=966 Bytes=36,654,122 Bytes/sec=1,145,441 FDReadSeqNo=8,464 in_msg=6019 out_msg=5 fd=5 Writing: Full Backup job Linux2-Test1 JobId=12791 Volume="B0003m01s006" pool="VCPool13" device=""VCCoal13-drive-0" (/var/lib/bacula/vchanger/VCCoal13/drive0)" spooling=0 despooling=0 despool_wait=0 Files=711 Bytes=17,581,880 Bytes/sec=1,098,867 FDReadSeqNo=5,786 in_msg=4011 out_msg=5 fd=8 ==== Jobs waiting to reserve a drive: ==== .......................................... .......................................... Run Backup job JobName: Red-FS Level: Incremental Client: red-fd FileSet: Red Set of root usr var home tmp var-spool Pool: VCPool13 (From Job resource) Storage: VCSCoal13 (From Job resource) When: 2007-10-22 14:33:01 Priority: 10 OK to run? (yes/mod/no): yes Job queued. JobId=12792 22-Oct 14:33 coal-dir: No prior Full backup Job record found. 22-Oct 14:33 coal-dir: No prior or suitable Full backup found in catalog. Doing FULL backup. * 22-Oct 14:33 coal-dir: Start Backup JobId 12792, Job=Red-FS.2007-10-22_14.33.05 * * *status storage=VCSCoal13 Connecting to Storage daemon VCSCoal13 at coal-bk.impulse.net:9103 coal-sd Version: 2.0.1 (12 January 2007) i686-pc-linux-gnu gentoo 1.12.6 Daemon started 22-Oct-07 14:01, 0 Jobs run since started. Heap: bytes=689,605 max_bytes=689,711 bufs=847 max_bufs=849 Running Jobs: Writing: Full Backup job Coal-Test1 *JobId=12790 *Volume="*B0003m01s006*" pool="VCPool13" device=""VCCoal13-drive-0" (/var/lib/bacula/vchanger/VCCoal13/drive0)" spooling=0 despooling=0 despool_wait=0 Files=138,654 Bytes=714,843,385 Bytes/sec=363,973 FDReadSeqNo=1,200,903 in_msg=804607 out_msg=5 fd=5 Writing: Full Backup job Linux2-Test1 *JobId=12791* Volume="*B0003m01s006*" pool="VCPool13" device=""VCCoal13-drive-0" (/var/lib/bacula/vchanger/VCCoal13/drive0)" spooling=0 despooling=0 despool_wait=0 Files=144,834 Bytes=702,866,929 Bytes/sec=360,814 FDReadSeqNo=1,237,059 in_msg=831546 out_msg=5 fd=8 Writing: Full Backup job Red-FS *JobId=12792* Volume="*B0003m01s006*" pool="VCPool13" device=""VCCoal13-drive-0" (/var/lib/bacula/vchanger/VCCoal13/drive0)" spooling=0 despooling=0 despool_wait=0 Files=4,562 Bytes=108,233,572 Bytes/sec=1,273,336 FDReadSeqNo=39,080 in_msg=26388 out_msg=5 fd=10 ==== Jobs waiting to reserve a drive: ==== For the above tests, the jobs ran simultaneously, but they all backed up to the same Volume "B0003m01s006" on device "VCCoal13-drive-0". I would have expected each job to backup to a different volume. ------------------------------------------------------------------------- This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/ _______________________________________________ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users