Hi Martin,
Thanks a lot for your time. Much appreciated.
On Mon, Dec 06, 2010 at 01:24:07PM +0000, Martin Simmons wrote:
> >>>>> On Sun, 5 Dec 2010 14:00:52 +0100, pbdlists said:
> >
> > Example 1:
> > turtle-010 is doing a full backup with 37'465 files
> > and 370 MB (manually run with the run command) and the next incremental a
> > couple of hours later counts 1'399 files with 866 MB. There's nothing
> > going on on that machine that would install additional files or
> > anything. The incremental is twice the size of the full!
>
> Use list files jobid=nnn (for jobid nnn) to find which files are in the
> incremental backup and then check their sizes on disk.
I did that before already (not checking the filesize though) and from
the list it was very clear that files were backed up again which surely
had not changed (manpages, library files, python scritps, ...)
> > *llist jobid=37
> > JobId: 37
> > Job: BackupClient-turtle-121.2010-12-05_02.06.00_37
> > Name: BackupClient-turtle-121
> > PurgedFiles: 0
> > Type: B
> > Level: I
> > ClientId: 18
> > Name: bacula-fd-turtle-121
> > JobStatus: T
> > SchedTime: 2010-12-05 02:06:00
> > StartTime: 2010-12-05 02:06:03
> > EndTime: 2010-12-05 03:50:42
> > RealEndTime: 2010-12-05 03:50:42
> > JobTDate: 1,291,521,042
> > VolSessionId: 2
> > VolSessionTime: 1,291,501,310
> > JobFiles: 269,108
> > JobErrors: 1
> > JobMissingFiles: 0
> > PoolId: 6
> > PooLname: Pool-File-pbdhetzner
> > PriorJobId: 0
> > FileSetId: 4
> > FileSet: turtle-121Fileset
>
> It says "JobErrors: 1" here. Can you post the log from this job?
I assumed it was the following:
: 05-Dec 03:30 bacula-fd-turtle-121 JobId 37: Error:
/var/www/data/munin/db/pinboard/pbdhetzner/turtle-121-diskstats_latency-vdc-svctm-g.rrd
mtime changed during backup.
Hmm, but possibly the following got something to do with it too? It's
something I thought I'd try to figure out as soon as I got around to
it (speak I'm no longer constantly purging the storage pools because
they fill up too quickly).
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option: J
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option: o
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option: b
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option: =
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option: B
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option: u
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option:
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option: E
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option: O
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option:
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option:
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option: j
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option: o
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option: b
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option: .
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option: :
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option: 1
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option: 1
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option: 5
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option: 2
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option:
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option: U
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option: o
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option:
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option: l
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option: u
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option: d
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option: /
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option: x
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option: l
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option: u
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option: d
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option:
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option: o
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option: t
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option: o
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option: :
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option:
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option:
: 05-Dec 11:14 bacula-fd-turtle-121: ERROR in job.c:1152 Unknown
include/exclude option:
Actually your question got me to think about something I was dismissing
up to now: I set Accurate = no in the JobDefs and commented out
Signature/basejob/accurate/verify in FileSet and the first tests look
promising. Obviously I'm misunderstanding something about Accurate and/or
the other things I commented out.
I'd surely want to use accurate mode, but probably I'll need to tweak
the accurate = line in the FileSet definition. If somebody has a working
sample to share I'll be glad to start from there, if not I'll probalby
need to spend another couple of hours to find the most restrictive set
which still works.
Thanks,
Kurt
> > - The jobs do have Accurate = yes
>
> Can you post the job and fileset definition?
These are the definitions I initially used:
JobDefs {
Name = "DefaultJob"
Enabled = yes
Type = Backup
Level = Incremental
Accurate = yes
FileSet = "DefaultFileset"
Schedule = "WeeklyCycle" # might want to override this for every client
Messages = Standard
Pool = Default
Priority = 10
Write Bootstrap = "/var/spool/bacula/%c.bsr"
Max Start Delay = 6 hours
Max Run Sched Time = 10 hours
Max Wait Time = 45 minutes
Max Full Interval = 63 days
Spool Data = no
Spool Attributes = yes
Reschedule On Error = no # might want to override this for laptops
Reschedule Interval = 30 minutes
Reschedule Times = 5
Cancel Lower Level Duplicates = yes
Write Part After Job = yes
}
FileSet {
Name = "DefaultFileset"
Ignore FileSet Changes = yes
Include {
Options {
compression = GZIP
signature = SHA1
basejob = ipnugsmc1
accurate = ipnugsmc1
verify = ipnugsmc1
onefs = yes
sparse = yes
noatime = yes
checkfilechanges = yes
wilddir = "lost+found"
Exclude = yes
aclsupport = yes
}
File = "\\|/bin/bash -c \"df -lPhT -x iso9660 -x tmpfs | egrep -v
'^Filesystem' | awk '{print \$NF}' | egrep -v '^/tmp' | egrep -v
'^/export/backup'\""
}
Exclude {
File = /var/spool/bacula
File = /.journal
File = /.fsck
File = /var/lock
File = /var/run
File = /var/tmp
File = /var/cache/yum
File = /var/lib/yum/yumdb
File = /home/*/.gvfs
}
}
And with these definitions the sun shines much brighter:
JobDefs {
Name = "DefaultJob"
Enabled = yes
Type = Backup
Level = Incremental
#Accurate = yes
Accurate = no
FileSet = "DefaultFileset"
Schedule = "WeeklyCycle" # might want to override this for every client
Messages = Standard
Pool = Default
Priority = 10
Write Bootstrap = "/var/spool/bacula/%c.bsr"
Max Start Delay = 6 hours
Max Run Sched Time = 10 hours
Max Wait Time = 45 minutes
Max Full Interval = 63 days
Spool Data = no
Spool Attributes = yes
Reschedule On Error = no # might want to override this for laptops
Reschedule Interval = 30 minutes
Reschedule Times = 5
Cancel Lower Level Duplicates = yes
Write Part After Job = yes
}
FileSet {
Name = "DefaultFileset"
Ignore FileSet Changes = yes
Include {
Options {
compression = GZIP
#signature = SHA1
#basejob = ipnugsmc1
#accurate = ipnugsmc1
#verify = ipnugsmc1
onefs = yes
sparse = yes
noatime = yes
checkfilechanges = yes
wilddir = "lost+found"
Exclude = yes
aclsupport = yes
}
File = "\\|/bin/bash -c \"df -lPhT -x iso9660 -x tmpfs | egrep -v
'^Filesystem' | awk '{print \$NF}' | egrep -v '^/tmp' | egrep -v
'^/export/backup'\""
}
Exclude {
File = /var/spool/bacula
File = /.journal
File = /.fsck
File = /var/lock
File = /var/run
File = /var/tmp
File = /var/cache/yum
File = /var/lib/yum/yumdb
File = /home/*/.gvfs
}
}
------------------------------------------------------------------------------
What happens now with your Lotus Notes apps - do you make another costly
upgrade, or settle for being marooned without product support? Time to move
off Lotus Notes and onto the cloud with Force.com, apps are easier to build,
use, and manage than apps on traditional platforms. Sign up for the Lotus
Notes Migration Kit to learn more. http://p.sf.net/sfu/salesforce-d2d
_______________________________________________
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
