On Tue, Jul 28, 2020, at 12:52 PM, Martin Simmons wrote: > >>>>> On Tue, 28 Jul 2020 07:55:21 -0400, Dan Langille said: > > > > On Mon, Jul 27, 2020, at 11:55 AM, Dan Langille wrote: > > > On Sun, Jul 26, 2020, at 7:33 AM, Dan Langille wrote: > > > > > On Jul 24, 2020, at 6:00 PM, Martin Simmons <mar...@lispworks.com> > > > > > wrote: > > > > > > > > > >>>>>> On Fri, 24 Jul 2020 09:09:12 -0400, Dan Langille said: > > > > >> > > > > >> I'm using Bacula 9.6.5 on FreeBSD 12.1 > > > > >> > > > > >> I have noticed a BSR file which is not getting updated after every > > > > >> job run. > > > > >> ... > > > > >> This is the most recent job, from today: > > > > >> > > > > >> 24-Jul 03:05 bacula-dir JobId 314258: Start Backup JobId 314258, > > > > >> Job=tallboy_home.2020-07-24_03.05.00_08 > > > > >> 24-Jul 03:05 bacula-dir JobId 314258: There are no more Jobs > > > > >> associated with Volume "IncrAuto-7393". Marking it purged. > > > > >> 24-Jul 03:05 bacula-dir JobId 314258: All records pruned from Volume > > > > >> "IncrAuto-7393"; marking it "Purged" > > > > >> 24-Jul 03:05 bacula-dir JobId 314258: Recycled volume "IncrAuto-7393" > > > > >> 24-Jul 03:05 bacula-dir JobId 314258: Using Device > > > > >> "vDrive-IncrFile-6" to write. > > > > >> 24-Jul 03:05 bacula-sd-01-sd JobId 314258: Recycled volume > > > > >> "IncrAuto-7393" on File device "vDrive-IncrFile-6" > > > > >> (/usr/local/bacula/volumes/IncrFile), all previous data lost. > > > > >> 24-Jul 03:05 bacula-dir JobId 314258: Max Volume jobs=1 exceeded. > > > > >> Marking Volume "IncrAuto-7393" as Used. > > > > >> 24-Jul 03:05 bacula-sd-01-sd JobId 314258: Elapsed time=00:00:03, > > > > >> Transfer rate=0 Bytes/second > > > > >> 24-Jul 03:05 bacula-sd-01-sd JobId 314258: Sending spooled attrs to > > > > >> the Director. Despooling 0 bytes ... > > > > >> 24-Jul 03:05 bacula-dir JobId 314258: Bacula bacula-dir 9.6.5 > > > > >> (11Jun20): > > > > >> Build OS: amd64-portbld-freebsd12.1 freebsd > > > > >> 12.1-RELEASE-p7 > > > > >> JobId: 314258 > > > > >> Job: tallboy_home.2020-07-24_03.05.00_08 > > > > >> Backup Level: Incremental, since=2020-07-23 03:05:17 > > > > >> Client: "tallboy-fd" 9.6.5 (11Jun20) > > > > >> amd64-portbld-freebsd12.1,freebsd,12.1-RELEASE-p7 > > > > >> FileSet: "tallboy home" 2012-12-20 14:19:02 > > > > >> Pool: "IncrFile" (From Job IncPool override) > > > > >> Catalog: "MyCatalog" (From Client resource) > > > > >> Storage: "bacula-sd-01-IncrFile" (From Pool resource) > > > > >> Scheduled time: 24-Jul-2020 03:05:00 > > > > >> Start time: 24-Jul-2020 03:05:17 > > > > >> End time: 24-Jul-2020 03:05:21 > > > > >> Elapsed time: 4 secs > > > > >> Priority: 10 > > > > >> FD Files Written: 0 > > > > >> SD Files Written: 0 > > > > >> FD Bytes Written: 0 (0 B) > > > > >> SD Bytes Written: 0 (0 B) > > > > > > > > > > This job wrote nothing to the volume, so there is nothing to add to > > > > > the BSR > > > > > file. > > > > > > > > When I look at this post now, that's easy to see. I find myself > > > > smirking to myself when it see it now. Thanks. > > > > > > > > Why was this a problem to me? I'm backing up my BSR files with an rsync > > > > to other hosts. > > > > > > > > There is a monitoring script to make sure the rcync'd files are not > > > > more than 48 hours old. > > > > > > > > I have 'fixed' with with a crontab on the above referenced host: > > > > > > > > 0 0 * * * touch ~/.backmeup > > > > > > > > Cheers > > > > > > Today we have: > > > > > > -rw-r----- 1 bacula bacula 1035 Jul 26 03:05 > > > tallboy-fd_tallboy_home.bsr > > > > > > The file updated by cron is: > > > > > > [dan@tallboy:~] $ ls -l .backmeup > > > -rw-r--r-- 1 dan dan 0 Jul 27 00:00 .backmeup > > > > > > > > > The BSR file contains: > > > > > > [dan@bacula:/usr/local/bacula/bsr] $ cat tallboy-fd_tallboy_home.bsr > > > # 16-Jul-2020 16:19:59 - tallboy_home.2020-07-05_03.05.02_01 - Full, > > > since=2020-07-16 03:05:07 > > > Volume="HQ0024L4" > > > MediaType="LTO4" > > > Slot=3 > > > VolSessionId=32 > > > VolSessionTime=1594911018 > > > VolAddr=1791001367956-1791001368387 > > > FileIndex=1-91 > > > Volume="HQ0024L4" > > > MediaType="LTO4" > > > Slot=3 > > > VolSessionId=32 > > > VolSessionTime=1594911018 > > > VolAddr=1833951043364-1833951043364 > > > FileIndex=91-130 > > > # 18-Jul-2020 03:05:24 - tallboy_home.2020-07-18_03.05.01_50 - > > > Incremental, since=2020-07-17 03:05:08 > > > Volume="IncrAuto-11646" > > > MediaType="IncrFile" > > > VolSessionId=349 > > > VolSessionTime=1594656307 > > > VolAddr=257-14794 > > > FileIndex=1-3 > > > # 19-Jul-2020 03:05:14 - tallboy_home.2020-07-19_03.05.01_23 - > > > Differential, since=2020-07-05 03:07:39 > > > Volume="DiffAuto-1473" > > > MediaType="DiffFile" > > > VolSessionId=525 > > > VolSessionTime=1594656307 > > > VolAddr=235-19992 > > > FileIndex=1-5 > > > # 26-Jul-2020 03:05:12 - tallboy_home.2020-07-26_03.05.01_14 - > > > Differential, since=2020-07-05 03:07:39 > > > Volume="DiffAuto-10213" > > > MediaType="DiffFile" > > > VolSessionId=1468 > > > VolSessionTime=1594656307 > > > VolAddr=260-20069 > > > FileIndex=1-6 > > > [dan@bacula:/usr/local/bacula/bsr] $ > > > > > > The above represents the differential run on Sunday morning. > > > > > > But today's incremental backed up one file, but the BSR didn't get > > > updated. > > > > > > The backup from today is: > > > > > > 27-Jul 03:05 bacula-dir JobId 314390: Start Backup JobId 314390, > > > Job=tallboy_home.2020-07-27_03.05.01_47 > > > 27-Jul 03:05 bacula-dir JobId 314390: There are no more Jobs associated > > > with Volume "IncrAuto-5038". Marking it purged. > > > 27-Jul 03:05 bacula-dir JobId 314390: All records pruned from Volume > > > "IncrAuto-5038"; marking it "Purged" > > > 27-Jul 03:05 bacula-dir JobId 314390: Recycled volume "IncrAuto-5038" > > > 27-Jul 03:05 bacula-dir JobId 314390: Using Device "vDrive-IncrFile-6" > > > to write. > > > 27-Jul 03:05 bacula-sd-01-sd JobId 314390: Recycled volume > > > "IncrAuto-5038" on File device "vDrive-IncrFile-6" > > > (/usr/local/bacula/volumes/IncrFile), all previous data lost. > > > 27-Jul 03:05 bacula-dir JobId 314390: Max Volume jobs=1 exceeded. > > > Marking Volume "IncrAuto-5038" as Used. > > > 27-Jul 03:05 bacula-sd-01-sd JobId 314390: Elapsed time=00:00:01, > > > Transfer rate=114 Bytes/second > > > 27-Jul 03:05 bacula-sd-01-sd JobId 314390: Sending spooled attrs to the > > > Director. Despooling 232 bytes ... > > > 27-Jul 03:05 bacula-dir JobId 314390: Bacula bacula-dir 9.6.5 (11Jun20): > > > Build OS: amd64-portbld-freebsd12.1 freebsd > > > 12.1-RELEASE-p7 > > > JobId: 314390 > > > Job: tallboy_home.2020-07-27_03.05.01_47 > > > Backup Level: Incremental, since=2020-07-26 03:05:08 > > > Client: "tallboy-fd" 9.6.5 (11Jun20) > > > amd64-portbld-freebsd12.1,freebsd,12.1-RELEASE-p7 > > > FileSet: "tallboy home" 2012-12-20 14:19:02 > > > Pool: "IncrFile" (From Job IncPool override) > > > Catalog: "MyCatalog" (From Client resource) > > > Storage: "bacula-sd-01-IncrFile" (From Pool resource) > > > Scheduled time: 27-Jul-2020 03:05:01 > > > Start time: 27-Jul-2020 03:05:17 > > > End time: 27-Jul-2020 03:05:20 > > > Elapsed time: 3 secs > > > Priority: 10 > > > FD Files Written: 1 > > > SD Files Written: 1 > > > FD Bytes Written: 0 (0 B) > > > SD Bytes Written: 114 (114 B) > > > Rate: 0.0 KB/s > > > Software Compression: None > > > Comm Line Compression: 2.8% 1.0:1 > > > Snapshot/VSS: no > > > Encryption: no > > > Accurate: no > > > Volume name(s): IncrAuto-5038 > > > Volume Session Id: 1706 > > > Volume Session Time: 1594656307 > > > Last Volume Bytes: 808 (808 B) > > > Non-fatal FD errors: 0 > > > SD Errors: 0 > > > FD termination status: OK > > > SD termination status: OK > > > Termination: Backup OK > > > > > > 27-Jul 03:05 bacula-dir JobId 314390: Begin pruning Jobs older than 3 > > > years . > > > 27-Jul 03:05 bacula-dir JobId 314390: No Jobs found to prune. > > > 27-Jul 03:05 bacula-dir JobId 314390: Begin pruning Files. > > > 27-Jul 03:05 bacula-dir JobId 314390: No Files found to prune. > > > 27-Jul 03:05 bacula-dir JobId 314390: End auto prune. > > > > > > > > > The volume (IncrAuto-5038) in this backup job, with 1 file updated, is > > > not present in the BSR. > > > > > > There are tree other jobs on this host and their respective BSR files > > > are dated today. > > > > An update to document the situation as it changes. > > > > Today, the BSR was updated, via jobid 314434: > > > > [dan@bacula:/usr/local/bacula/bsr] $ cat tallboy-fd_tallboy_home.bsr > > # 16-Jul-2020 16:19:59 - tallboy_home.2020-07-05_03.05.02_01 - Full, > > since=2020-07-16 03:05:07 > > Volume="HQ0024L4" > > MediaType="LTO4" > > Slot=3 > > VolSessionId=32 > > VolSessionTime=1594911018 > > VolAddr=1791001367956-1791001368387 > > FileIndex=1-91 > > Volume="HQ0024L4" > > MediaType="LTO4" > > Slot=3 > > VolSessionId=32 > > VolSessionTime=1594911018 > > VolAddr=1833951043364-1833951043364 > > FileIndex=91-130 > > # 18-Jul-2020 03:05:24 - tallboy_home.2020-07-18_03.05.01_50 - Incremental, > > since=2020-07-17 03:05:08 > > Volume="IncrAuto-11646" > > MediaType="IncrFile" > > VolSessionId=349 > > VolSessionTime=1594656307 > > VolAddr=257-14794 > > FileIndex=1-3 > > # 19-Jul-2020 03:05:14 - tallboy_home.2020-07-19_03.05.01_23 - > > Differential, since=2020-07-05 03:07:39 > > Volume="DiffAuto-1473" > > MediaType="DiffFile" > > VolSessionId=525 > > VolSessionTime=1594656307 > > VolAddr=235-19992 > > FileIndex=1-5 > > # 26-Jul-2020 03:05:12 - tallboy_home.2020-07-26_03.05.01_14 - > > Differential, since=2020-07-05 03:07:39 > > Volume="DiffAuto-10213" > > MediaType="DiffFile" > > VolSessionId=1468 > > VolSessionTime=1594656307 > > VolAddr=260-20069 > > FileIndex=1-6 > > # 28-Jul-2020 03:05:08 - tallboy_home.2020-07-28_03.05.00_19 - Incremental, > > since=2020-07-27 03:05:17 > > Volume="IncrAuto-9734" > > MediaType="IncrFile" > > VolSessionId=1934 > > VolSessionTime=1594656307 > > VolAddr=259-14704 > > FileIndex=1-2 > > > > Interesting. It was two files backed up today: > > > > FD Files Written: 2 > > SD Files Written: 2 > > > > *list files jobid=314434 > > Automatically selected Catalog: MyCatalog > > Using Catalog "MyCatalog" > > +-----------------------------+ > > | filename | > > +-----------------------------+ > > | /usr/home/dan/.backmeup | > > | /usr/home/dan/.bash_history | > > +-----------------------------+ > > +---------+--------------+---------------------+------+-------+----------+----------+-----------+ > > | jobid | name | starttime | type | level | jobfiles | > > jobbytes | jobstatus | > > +---------+--------------+---------------------+------+-------+----------+----------+-----------+ > > | 314,434 | tallboy home | 2020-07-28 03:05:05 | B | I | 2 | > > 13,738 | T | > > +---------+--------------+---------------------+------+-------+----------+----------+-----------+ > > You have messages. > > Ha, it looks like a bug when "FD Bytes Written" is 0 (update_bootstrap_file in > src/dird/backup.c decides based on jcr->jr.JobBytes). Try putting something > in ~/.backmeup to work around it.
The file now contains 1 byte. [dan@bacula:/usr/local/bacula/bsr] $ ls -lt tallboy-fd* -rw-r----- 1 bacula bacula 19687 Aug 1 03:26 tallboy-fd_tallboy_jail_snapshots.bsr -rw-r----- 1 bacula bacula 10063 Aug 1 03:07 tallboy-fd_tallboy_Papers_Jail.bsr -rw-r----- 1 bacula bacula 4557 Aug 1 03:05 tallboy-fd_tallboy_basic.bsr -rw-r----- 1 bacula bacula 1923 Aug 1 03:05 tallboy-fd_tallboy_home.bsr BSR has been updated. I understand the optimization which may be going on there, but I'm using the BSR date to monitor that a backup has occurred and that the BSR files have been recently rscynced to remote locations. Thank you for your help. -- Dan Langille d...@langille.org _______________________________________________ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
