--- On Wed, 4/21/10, John Drescher <dresche...@gmail.com> wrote:
> From: John Drescher <dresche...@gmail.com>
> Subject: Re: [Bacula-users] Using removable SATA disks as media
> To: "Joseph Spenner" <joseph85...@yahoo.com>
> Cc: bacula-users@lists.sourceforge.net
> Date: Wednesday, April 21, 2010, 12:10 PM
> On Wed, Apr 21, 2010 at 2:08 PM, John
> Drescher <dresche...@gmail.com>
> wrote:
> >> Here are the file sizes (in date order):
> >>
> >> 7009019184 Apr 14 23:21 disk_0003
> >> 51149798 Apr 15 23:10 disk_0004
> >> 51159533 Apr 16 23:10 disk_0005
> >> 51167844 Apr 17 23:10 disk_0006
> >> 51177531 Apr 18 23:10 disk_0001
> >> 51182974 Apr 19 23:10 disk_0002
> >>
> >> There shouldn't be 51M+ of updates every night,
> since these systems are not doing too much. ?
> >>
> > The problem does not look like recycling but possibly
> bacula is
> > backing up more than you expect.
> >
> > I would check the finished job records to see the size
> of the jobs.
> > messages in a console should show this. If you did not
> already view
> > this information. Or just status client to see the
> size of the last
> > jobs on the client you are backing up.
> >
>
> Also any file changed in the fileset would trigger a full
> backup of
> the changed file. Log files tend to be big so this may be a
> cause.
>
> John
>
Ok, sorry for the long post, but it might be informative. Here's what the
messages were for the past few backups:
===
17-Apr 23:05 backula-dir JobId 175: Start Backup JobId 175,
Job=DefaultBackupClient.2010-04-17_23.05.00_23
17-Apr 23:05 backula-dir JobId 175: Max configured use duration exceeded.
Marking Volume "disk_0005" as Used.
17-Apr 23:05 backula-dir JobId 175: Recycled volume "disk_0006"
17-Apr 23:05 backula-dir JobId 175: Using Device "FileStorage"
17-Apr 23:05 backula-sd JobId 175: Recycled volume "disk_0006" on device
"FileStorage" (/opt/bacula/volumes), all previous data lost.
17-Apr 23:05 backula-sd JobId 175: Job write elapsed time = 00:00:01, Transfer
rate = 0 Bytes/second
17-Apr 23:05 backula-dir JobId 175: Bacula backula-dir 5.0.1 (24Feb10):
17-Apr-2010 23:05:04
Build OS: x86_64-unknown-linux-gnu redhat
JobId: 175
Job: DefaultBackupClient.2010-04-17_23.05.00_23
Backup Level: Incremental, since=2010-04-16 23:05:02
Client: "backula-fd" 5.0.1 (24Feb10)
x86_64-unknown-linux-gnu,redhat,
FileSet: "Full Set" 2010-03-11 06:40:31
Pool: "File" (From Job resource)
Catalog: "MyCatalog" (From Client resource)
Storage: "File" (From Job resource)
Scheduled time: 17-Apr-2010 23:05:00
Start time: 17-Apr-2010 23:05:03
End time: 17-Apr-2010 23:05:04
Elapsed time: 1 sec
Priority: 10
FD Files Written: 0
SD Files Written: 0
FD Bytes Written: 0 (0 B)
SD Bytes Written: 0 (0 B)
Rate: 0.0 KB/s
Software Compression: None
VSS: no
Encryption: no
Accurate: no
Volume name(s): disk_0006
Volume Session Id: 16
Volume Session Time: 1271098297
Last Volume Bytes: 621 (621 B)
Non-fatal FD errors: 0
SD Errors: 0
FD termination status: OK
SD termination status: OK
Termination: Backup OK
17-Apr 23:05 backula-dir JobId 175: Begin pruning Jobs older than 9 days .
17-Apr 23:05 backula-dir JobId 175: No Jobs found to prune.
17-Apr 23:05 backula-dir JobId 175: Begin pruning Jobs.
17-Apr 23:05 backula-dir JobId 175: No Files found to prune.
17-Apr 23:05 backula-dir JobId 175: End auto prune.
17-Apr 23:05 backula-dir JobId 176: Start Backup JobId 176,
Job=Tycho.2010-04-17_23.05.00_24
17-Apr 23:05 backula-dir JobId 176: Using Device "FileStorage"
17-Apr 23:04 tycho-fd JobId 176: DIR and FD clocks differ by -35 seconds, FD
automatically compensating.
17-Apr 23:05 backula-sd JobId 176: Volume "disk_0006" previously written,
moving to end of data.
17-Apr 23:05 backula-sd JobId 176: Ready to append to end of Volume "disk_0006"
size=621
17-Apr 23:05 backula-sd JobId 176: Job write elapsed time = 00:00:30, Transfer
rate = 0 Bytes/second
17-Apr 23:05 backula-dir JobId 176: Bacula backula-dir 5.0.1 (24Feb10):
17-Apr-2010 23:05:36
Build OS: x86_64-unknown-linux-gnu redhat
JobId: 176
Job: Tycho.2010-04-17_23.05.00_24
Backup Level: Incremental, since=2010-04-16 23:05:05
Client: "tycho-fd" 5.0.1 (24Feb10) i686-pc-linux-gnu,suse,10.3
FileSet: "Full Set" 2010-03-11 06:40:31
Pool: "File" (From Job resource)
Catalog: "MyCatalog" (From Client resource)
Storage: "File" (From Job resource)
Scheduled time: 17-Apr-2010 23:05:00
Start time: 17-Apr-2010 23:05:06
End time: 17-Apr-2010 23:05:36
Elapsed time: 30 secs
Priority: 10
FD Files Written: 0
SD Files Written: 0
FD Bytes Written: 0 (0 B)
SD Bytes Written: 0 (0 B)
Rate: 0.0 KB/s
Software Compression: None
VSS: no
Encryption: no
Accurate: no
Volume name(s):
Volume Session Id: 17
Volume Session Time: 1271098297
Last Volume Bytes: 987 (987 B)
Non-fatal FD errors: 0
SD Errors: 0
FD termination status: OK
SD termination status: OK
Termination: Backup OK
17-Apr 23:05 backula-dir JobId 176: Begin pruning Jobs older than 9 days .
17-Apr 23:05 backula-dir JobId 176: No Jobs found to prune.
17-Apr 23:05 backula-dir JobId 176: Begin pruning Jobs.
17-Apr 23:05 backula-dir JobId 176: No Files found to prune.
17-Apr 23:05 backula-dir JobId 176: End auto prune.
17-Apr 23:10 backula-dir JobId 177: shell command: run BeforeJob
"/opt/bacula/bin/make_catalog_backup.pl MyCatalog"
17-Apr 23:10 backula-dir JobId 177: Start Backup JobId 177,
Job=BackupCatalog.2010-04-17_23.10.00_25
17-Apr 23:10 backula-dir JobId 177: Using Device "FileStorage"
17-Apr 23:10 backula-sd JobId 177: Volume "disk_0006" previously written,
moving to end of data.
17-Apr 23:10 backula-sd JobId 177: Ready to append to end of Volume "disk_0006"
size=987
17-Apr 23:10 backula-sd JobId 177: Job write elapsed time = 00:00:01, Transfer
rate = 51.12 M Bytes/second
17-Apr 23:10 backula-dir JobId 177: Bacula backula-dir 5.0.1 (24Feb10):
17-Apr-2010 23:10:04
Build OS: x86_64-unknown-linux-gnu redhat
JobId: 177
Job: BackupCatalog.2010-04-17_23.10.00_25
Backup Level: Full
Client: "backula-fd" 5.0.1 (24Feb10)
x86_64-unknown-linux-gnu,redhat,
FileSet: "Catalog" 2010-03-09 14:09:54
Pool: "File" (From Job resource)
Catalog: "MyCatalog" (From Client resource)
Storage: "File" (From Job resource)
Scheduled time: 17-Apr-2010 23:10:00
Start time: 17-Apr-2010 23:10:03
End time: 17-Apr-2010 23:10:04
Elapsed time: 1 sec
Priority: 11
FD Files Written: 1
SD Files Written: 1
FD Bytes Written: 51,128,393 (51.12 MB)
SD Bytes Written: 51,128,513 (51.12 MB)
Rate: 51128.4 KB/s
Software Compression: None
VSS: no
Encryption: no
Accurate: no
Volume name(s): disk_0006
Volume Session Id: 18
Volume Session Time: 1271098297
Last Volume Bytes: 51,167,844 (51.16 MB)
Non-fatal FD errors: 0
SD Errors: 0
FD termination status: OK
SD termination status: OK
Termination: Backup OK
17-Apr 23:10 backula-dir JobId 177: Begin pruning Jobs older than 9 days .
17-Apr 23:10 backula-dir JobId 177: No Jobs found to prune.
17-Apr 23:10 backula-dir JobId 177: Begin pruning Jobs.
17-Apr 23:10 backula-dir JobId 177: No Files found to prune.
17-Apr 23:10 backula-dir JobId 177: End auto prune.
17-Apr 23:10 backula-dir JobId 177: shell command: run AfterJob
"/opt/bacula/bin/delete_catalog_backup"
18-Apr 23:05 backula-dir JobId 178: Start Backup JobId 178,
Job=DefaultBackupClient.2010-04-18_23.05.00_26
18-Apr 23:05 backula-dir JobId 178: Max configured use duration exceeded.
Marking Volume "disk_0006" as Used.
18-Apr 23:05 backula-dir JobId 178: Recycled volume "disk_0001"
18-Apr 23:05 backula-dir JobId 178: Using Device "FileStorage"
18-Apr 23:05 backula-sd JobId 178: Recycled volume "disk_0001" on device
"FileStorage" (/opt/bacula/volumes), all previous data lost.
18-Apr 23:05 backula-sd JobId 178: Job write elapsed time = 00:00:01, Transfer
rate = 530 Bytes/second
18-Apr 23:05 backula-dir JobId 178: Bacula backula-dir 5.0.1 (24Feb10):
18-Apr-2010 23:05:03
Build OS: x86_64-unknown-linux-gnu redhat
JobId: 178
Job: DefaultBackupClient.2010-04-18_23.05.00_26
Backup Level: Differential, since=2010-04-14 23:05:02
Client: "backula-fd" 5.0.1 (24Feb10)
x86_64-unknown-linux-gnu,redhat,
FileSet: "Full Set" 2010-03-11 06:40:31
Pool: "File" (From Job resource)
Catalog: "MyCatalog" (From Client resource)
Storage: "File" (From Job resource)
Scheduled time: 18-Apr-2010 23:05:00
Start time: 18-Apr-2010 23:05:02
End time: 18-Apr-2010 23:05:03
Elapsed time: 1 sec
Priority: 10
FD Files Written: 2
SD Files Written: 2
FD Bytes Written: 328 (328 B)
SD Bytes Written: 530 (530 B)
Rate: 0.3 KB/s
Software Compression: None
VSS: no
Encryption: no
Accurate: no
Volume name(s): disk_0001
Volume Session Id: 19
Volume Session Time: 1271098297
Last Volume Bytes: 1,199 (1.199 KB)
Non-fatal FD errors: 0
SD Errors: 0
FD termination status: OK
SD termination status: OK
Termination: Backup OK
18-Apr 23:05 backula-dir JobId 178: Begin pruning Jobs older than 9 days .
18-Apr 23:05 backula-dir JobId 178: No Jobs found to prune.
18-Apr 23:05 backula-dir JobId 178: Begin pruning Jobs.
18-Apr 23:05 backula-dir JobId 178: No Files found to prune.
18-Apr 23:05 backula-dir JobId 178: End auto prune.
18-Apr 23:05 backula-dir JobId 179: Start Backup JobId 179,
Job=Tycho.2010-04-18_23.05.00_27
18-Apr 23:05 backula-dir JobId 179: Using Device "FileStorage"
18-Apr 23:04 tycho-fd JobId 179: DIR and FD clocks differ by -37 seconds, FD
automatically compensating.
18-Apr 23:05 backula-sd JobId 179: Volume "disk_0001" previously written,
moving to end of data.
18-Apr 23:05 backula-sd JobId 179: Ready to append to end of Volume "disk_0001"
size=1199
18-Apr 23:05 backula-sd JobId 179: Job write elapsed time = 00:00:18, Transfer
rate = 0 Bytes/second
18-Apr 23:05 backula-dir JobId 179: Bacula backula-dir 5.0.1 (24Feb10):
18-Apr-2010 23:05:23
Build OS: x86_64-unknown-linux-gnu redhat
JobId: 179
Job: Tycho.2010-04-18_23.05.00_27
Backup Level: Differential, since=2010-04-14 23:05:36
Client: "tycho-fd" 5.0.1 (24Feb10) i686-pc-linux-gnu,suse,10.3
FileSet: "Full Set" 2010-03-11 06:40:31
Pool: "File" (From Job resource)
Catalog: "MyCatalog" (From Client resource)
Storage: "File" (From Job resource)
Scheduled time: 18-Apr-2010 23:05:00
Start time: 18-Apr-2010 23:05:05
End time: 18-Apr-2010 23:05:23
Elapsed time: 18 secs
Priority: 10
FD Files Written: 0
SD Files Written: 0
FD Bytes Written: 0 (0 B)
SD Bytes Written: 0 (0 B)
Rate: 0.0 KB/s
Software Compression: None
VSS: no
Encryption: no
Accurate: no
Volume name(s):
Volume Session Id: 20
Volume Session Time: 1271098297
Last Volume Bytes: 1,565 (1.565 KB)
Non-fatal FD errors: 0
SD Errors: 0
FD termination status: OK
SD termination status: OK
Termination: Backup OK
18-Apr 23:05 backula-dir JobId 179: Begin pruning Jobs older than 9 days .
18-Apr 23:05 backula-dir JobId 179: No Jobs found to prune.
18-Apr 23:05 backula-dir JobId 179: Begin pruning Jobs.
18-Apr 23:05 backula-dir JobId 179: No Files found to prune.
18-Apr 23:05 backula-dir JobId 179: End auto prune.
18-Apr 23:10 backula-dir JobId 180: shell command: run BeforeJob
"/opt/bacula/bin/make_catalog_backup.pl MyCatalog"
18-Apr 23:10 backula-dir JobId 180: Start Backup JobId 180,
Job=BackupCatalog.2010-04-18_23.10.00_28
18-Apr 23:10 backula-dir JobId 180: Using Device "FileStorage"
18-Apr 23:10 backula-sd JobId 180: Volume "disk_0001" previously written,
moving to end of data.
18-Apr 23:10 backula-sd JobId 180: Ready to append to end of Volume "disk_0001"
size=1565
18-Apr 23:10 backula-sd JobId 180: Job write elapsed time = 00:00:01, Transfer
rate = 51.13 M Bytes/second
18-Apr 23:10 backula-dir JobId 180: Bacula backula-dir 5.0.1 (24Feb10):
18-Apr-2010 23:10:03
Build OS: x86_64-unknown-linux-gnu redhat
JobId: 180
Job: BackupCatalog.2010-04-18_23.10.00_28
Backup Level: Full
Client: "backula-fd" 5.0.1 (24Feb10)
x86_64-unknown-linux-gnu,redhat,
FileSet: "Catalog" 2010-03-09 14:09:54
Pool: "File" (From Job resource)
Catalog: "MyCatalog" (From Client resource)
Storage: "File" (From Job resource)
Scheduled time: 18-Apr-2010 23:10:00
Start time: 18-Apr-2010 23:10:03
End time: 18-Apr-2010 23:10:03
Elapsed time: 0 secs
Priority: 11
FD Files Written: 1
SD Files Written: 1
FD Bytes Written: 51,137,502 (51.13 MB)
SD Bytes Written: 51,137,622 (51.13 MB)
Rate: 0.0 KB/s
Software Compression: None
VSS: no
Encryption: no
Accurate: no
Volume name(s): disk_0001
Volume Session Id: 21
Volume Session Time: 1271098297
Last Volume Bytes: 51,177,531 (51.17 MB)
Non-fatal FD errors: 0
SD Errors: 0
FD termination status: OK
SD termination status: OK
Termination: Backup OK
18-Apr 23:10 backula-dir JobId 180: Begin pruning Jobs older than 9 days .
18-Apr 23:10 backula-dir JobId 180: No Jobs found to prune.
18-Apr 23:10 backula-dir JobId 180: Begin pruning Jobs.
18-Apr 23:10 backula-dir JobId 180: No Files found to prune.
18-Apr 23:10 backula-dir JobId 180: End auto prune.
18-Apr 23:10 backula-dir JobId 180: shell command: run AfterJob
"/opt/bacula/bin/delete_catalog_backup"
19-Apr 23:05 backula-dir JobId 181: Start Backup JobId 181,
Job=DefaultBackupClient.2010-04-19_23.05.00_29
19-Apr 23:05 backula-dir JobId 181: Max configured use duration exceeded.
Marking Volume "disk_0001" as Used.
19-Apr 23:05 backula-dir JobId 181: Recycled volume "disk_0002"
19-Apr 23:05 backula-dir JobId 181: Using Device "FileStorage"
19-Apr 23:05 backula-sd JobId 181: Recycled volume "disk_0002" on device
"FileStorage" (/opt/bacula/volumes), all previous data lost.
19-Apr 23:05 backula-sd JobId 181: Job write elapsed time = 00:00:01, Transfer
rate = 0 Bytes/second
19-Apr 23:05 backula-dir JobId 181: Bacula backula-dir 5.0.1 (24Feb10):
19-Apr-2010 23:05:10
Build OS: x86_64-unknown-linux-gnu redhat
JobId: 181
Job: DefaultBackupClient.2010-04-19_23.05.00_29
Backup Level: Incremental, since=2010-04-18 23:05:02
Client: "backula-fd" 5.0.1 (24Feb10)
x86_64-unknown-linux-gnu,redhat,
FileSet: "Full Set" 2010-03-11 06:40:31
Pool: "File" (From Job resource)
Catalog: "MyCatalog" (From Client resource)
Storage: "File" (From Job resource)
Scheduled time: 19-Apr-2010 23:05:00
Start time: 19-Apr-2010 23:05:03
End time: 19-Apr-2010 23:05:10
Elapsed time: 7 secs
Priority: 10
FD Files Written: 0
SD Files Written: 0
FD Bytes Written: 0 (0 B)
SD Bytes Written: 0 (0 B)
Rate: 0.0 KB/s
Software Compression: None
VSS: no
Encryption: no
Accurate: no
Volume name(s): disk_0002
Volume Session Id: 22
Volume Session Time: 1271098297
Last Volume Bytes: 621 (621 B)
Non-fatal FD errors: 0
SD Errors: 0
FD termination status: OK
SD termination status: OK
Termination: Backup OK
19-Apr 23:05 backula-dir JobId 181: Begin pruning Jobs older than 9 days .
19-Apr 23:05 backula-dir JobId 181: No Jobs found to prune.
19-Apr 23:05 backula-dir JobId 181: Begin pruning Jobs.
19-Apr 23:05 backula-dir JobId 181: No Files found to prune.
19-Apr 23:05 backula-dir JobId 181: End auto prune.
19-Apr 23:05 backula-dir JobId 182: Start Backup JobId 182,
Job=Tycho.2010-04-19_23.05.00_30
19-Apr 23:05 backula-dir JobId 182: Using Device "FileStorage"
19-Apr 23:04 tycho-fd JobId 182: DIR and FD clocks differ by -40 seconds, FD
automatically compensating.
19-Apr 23:05 backula-sd JobId 182: Volume "disk_0002" previously written,
moving to end of data.
19-Apr 23:05 backula-sd JobId 182: Ready to append to end of Volume "disk_0002"
size=621
19-Apr 23:05 backula-sd JobId 182: Job write elapsed time = 00:00:21, Transfer
rate = 0 Bytes/second
19-Apr 23:05 backula-dir JobId 182: Bacula backula-dir 5.0.1 (24Feb10):
19-Apr-2010 23:05:33
Build OS: x86_64-unknown-linux-gnu redhat
JobId: 182
Job: Tycho.2010-04-19_23.05.00_30
Backup Level: Incremental, since=2010-04-18 23:05:05
Client: "tycho-fd" 5.0.1 (24Feb10) i686-pc-linux-gnu,suse,10.3
FileSet: "Full Set" 2010-03-11 06:40:31
Pool: "File" (From Job resource)
Catalog: "MyCatalog" (From Client resource)
Storage: "File" (From Job resource)
Scheduled time: 19-Apr-2010 23:05:00
Start time: 19-Apr-2010 23:05:12
End time: 19-Apr-2010 23:05:33
Elapsed time: 21 secs
Priority: 10
FD Files Written: 0
SD Files Written: 0
FD Bytes Written: 0 (0 B)
SD Bytes Written: 0 (0 B)
Rate: 0.0 KB/s
Software Compression: None
VSS: no
Encryption: no
Accurate: no
Volume name(s):
Volume Session Id: 23
Volume Session Time: 1271098297
Last Volume Bytes: 987 (987 B)
Non-fatal FD errors: 0
SD Errors: 0
FD termination status: OK
SD termination status: OK
Termination: Backup OK
19-Apr 23:05 backula-dir JobId 182: Begin pruning Jobs older than 9 days .
19-Apr 23:05 backula-dir JobId 182: Pruned 1 Job for client tycho-fd from
catalog.
19-Apr 23:05 backula-dir JobId 182: Begin pruning Jobs.
19-Apr 23:05 backula-dir JobId 182: No Files found to prune.
19-Apr 23:05 backula-dir JobId 182: End auto prune.
19-Apr 23:10 backula-dir JobId 183: shell command: run BeforeJob
"/opt/bacula/bin/make_catalog_backup.pl MyCatalog"
19-Apr 23:10 backula-dir JobId 183: Start Backup JobId 183,
Job=BackupCatalog.2010-04-19_23.10.00_31
19-Apr 23:10 backula-dir JobId 183: Using Device "FileStorage"
19-Apr 23:10 backula-sd JobId 183: Volume "disk_0002" previously written,
moving to end of data.
19-Apr 23:10 backula-sd JobId 183: Ready to append to end of Volume "disk_0002"
size=987
19-Apr 23:10 backula-sd JobId 183: Job write elapsed time = 00:00:01, Transfer
rate = 51.14 M Bytes/second
19-Apr 23:10 backula-dir JobId 183: Bacula backula-dir 5.0.1 (24Feb10):
19-Apr-2010 23:10:04
Build OS: x86_64-unknown-linux-gnu redhat
JobId: 183
Job: BackupCatalog.2010-04-19_23.10.00_31
Backup Level: Full
Client: "backula-fd" 5.0.1 (24Feb10)
x86_64-unknown-linux-gnu,redhat,
FileSet: "Catalog" 2010-03-09 14:09:54
Pool: "File" (From Job resource)
Catalog: "MyCatalog" (From Client resource)
Storage: "File" (From Job resource)
Scheduled time: 19-Apr-2010 23:10:00
Start time: 19-Apr-2010 23:10:03
End time: 19-Apr-2010 23:10:04
Elapsed time: 1 sec
Priority: 11
FD Files Written: 1
SD Files Written: 1
FD Bytes Written: 51,143,523 (51.14 MB)
SD Bytes Written: 51,143,643 (51.14 MB)
Rate: 51143.5 KB/s
Software Compression: None
VSS: no
Encryption: no
Accurate: no
Volume name(s): disk_0002
Volume Session Id: 24
Volume Session Time: 1271098297
Last Volume Bytes: 51,182,974 (51.18 MB)
Non-fatal FD errors: 0
SD Errors: 0
FD termination status: OK
SD termination status: OK
Termination: Backup OK
19-Apr 23:10 backula-dir JobId 183: Begin pruning Jobs older than 9 days .
19-Apr 23:10 backula-dir JobId 183: No Jobs found to prune.
19-Apr 23:10 backula-dir JobId 183: Begin pruning Jobs.
19-Apr 23:10 backula-dir JobId 183: No Files found to prune.
19-Apr 23:10 backula-dir JobId 183: End auto prune.
19-Apr 23:10 backula-dir JobId 183: shell command: run AfterJob
"/opt/bacula/bin/delete_catalog_backup"
====
My bacula-dir.conf has a default Fileset which I'm using, which includes:
/usr
/opt/bacula/bin
The /usr slice is about 4.8G, and shouldn't be changing-- at least not at the
tune of 51M every night.
------------------------------------------------------------------------------
_______________________________________________
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
