Hi,
On 9/26/2006 6:04 PM, Claudinei Matos wrote:
> Well,
>
> I'm having some troubles to put bacula to automatically split the File
> volumes since Bacula can't automatically label the new created volumes.
> I did reconfigured my bacula using the site examples and now my setup
> looks like the one below:
>
> The Storage Device (bacula-sd.conf):
> Device {
> Name = "FileStorage"
> Media Type = "File"
> Archive Device = /data/backups
> LabelMedia = yes; # lets Bacula label unlabeled media
> Random Access = Yes;
> AutomaticMount = yes; # when device opened, read it
> RemovableMedia = no;
> AlwaysOpen = yes;
> AutoChanger = yes
> Changer Command = "/usr/libexec/bacula/disk-changer %c %o %S %a %d"
> }
Keep in mind that I never tested the disk-changer "fake" autochanger
script; I suspect that, at least in this stage of your testing efforts,
you don't need it.
> The Pool (bacula-dir.conf):
> Pool {
> Name = "TestePool"
> Pool Type = "Backup"
> Maximum Volumes = 0
> Maximum Volume Jobs = 1
> Maximum Volume Bytes = 150000000
> Label Format = "${Client}_${JobName}-"
> }
This looks correct, though I kind of miss the retention periods. If you
actually want the defaults that should be ok...
> The FileSet (bacula-dir.conf):
This doesn't matter for this problem.
...
> The Job (bacula-dir.conf):
> Job {
> Name = "Teste"
> JobDefs = "Defaults"
> Level = "Full"
> FileSet = "DoSrc"
> Pool = "TestePool"
> }
Looks ok.
>
> With this setup I get the following:
> *run
> A job name must be specified.
> The defined Job resources are:
> ...
> 14: Teste
> Select Job resource (1-14): 14
> Run Backup job
> JobName: Teste
> FileSet: DoSrc
> Level: Full
> Client: alpha-fd
> Storage: Ti02Dir
> Pool: TestePool
> When: 2006-09-26 11:59:00
> Priority: 10
> OK to run? (yes/mod/no): yes
> Job started. JobId=896
> *mess
> 26-Sep 11:59 alpha-dir: Start Backup JobId 896,
> Job=Teste.2006-09-26_11.59.02
> 26-Sep 11:59 alpha-dir: Created new Volume
> "alpha-fd_Teste.2006-09-26_11.59.02-" in catalog.
> 26-Sep 11:59 ti02-sd: Labeled new Volume
> "alpha-fd_Teste.2006-09-26_11.59.02-" on device "FileStorage"
> (/data/backups).
> 26-Sep 11:59 ti02-sd: Wrote label to prelabeled Volume
> "alpha-fd_Teste.2006-09-26_11.59.02-" on device "FileStorage"
> (/data/backups)
> *
>
> How we can see, everything works fine but when the file gets the size
> limit (150M) that's whats happen:
> You have messages.
> *mess
> 26-Sep 12:02 ti02-sd: User defined maximum volume capacity 150,000,000
> exceeded on device "FileStorage" (/data/backups).
> 26-Sep 12:02 ti02-sd: End of medium on Volume
> "alpha-fd_Teste.2006-09-26_11.59.02-" Bytes=149,990,257 Blocks=2,325 at
> 26-Sep-2006 12:02.
> 26-Sep 12:02 alpha-dir: Teste.2006-09-26_11.59.02 Error:
> sql_create.c:384 Volume "alpha-fd_Teste.2006-09-26_11.59.02-" already
> exists.
Good. This is an attempt to create a new volume. The problem is that
there's no distinction between the volume names you want to create
automatically, because - I quote TFM -
"If no variable expansion characters are found in the string, the Volume
name will be formed from the format string appended with the number of
volumes in the pool plus one, which will be edited as four digits with
leading zeros. For example, with a Label Format = "File-", the first
volumes will be named File-0001, File-0002, ..."
Notice that this implies that, if you include variables to expand in the
name, *no* automatic numbering will happen. You have to do that
yourself. BTW, the variable expansion stuff is quite a problem IMO. A
better solution might be a python script that gets called for events
like new volume needed. There's a manual section regarding this.
> 26-Sep 12:02 alpha-dir: Teste.2006-09-26_11.59.02 Error:
> sql_create.c:384 Volume "alpha-fd_Teste.2006-09-26_11.59.02-" already
> exists.
> 26-Sep 12:02 ti02-sd: Job Teste.2006-09-26_11.59.02 waiting. Cannot find
> any appendable volumes.
After several retries, Bacula gives up. We wouldn't want it trying
forever...
> Please use the "label" command to create a new Volume for:
> Storage: "FileStorage" (/data/backups)
> Media type: File
> Pool: TestePool
>
> If I do manual label the volume:
> *label
> The defined Storage resources are:
> 1: Ti02Dir
> 2: Ti01DVD
> Select Storage resource (1-2): 1
> Enter new Volume name: alpha-fd_Teste.2006-09-26_11.59.02-vol2
> Defined Pools:
> 1: Default
> 2: FilePool
> 3: TestePool
> Select the Pool (1-3): 3
> Connecting to Storage daemon Ti02Dir at ti02:9103 ...
> Sending label command for Volume
> "alpha-fd_Teste.2006-09-26_11.59.02-vol2" Slot 0 ...
> 3000 OK label. Volume=alpha-fd_Teste.2006-09-26_11.59.02-vol2
> Device="FileStorage" (/data/backups)
> Catalog record for Volume "alpha-fd_Teste.2006-09-26_11.59.02-vol2",
> Slot 0 successfully created.
> Requesting to mount FileStorage ...
> 3001 OK mount. Device="FileStorage" (/data/backups)
> *
> 26-Sep 12:04 ti02-sd: Wrote label to prelabeled Volume
> "alpha-fd_Teste.2006-09-26_11.59.02-vol2" on device "FileStorage"
> (/data/backups)
> 26-Sep 12:04 ti02-sd: New volume
> "alpha-fd_Teste.2006-09-26_11.59.02-vol2" mounted on device
> "FileStorage" (/data/backups) at 26-Sep-2006 12:04.
>
> Well, the process repeat one more time until the backup finish:
> ...
> 26-Sep 12:08 ti02-sd: Wrote label to prelabeled Volume
> "alpha-fd_Teste.2006-09-26_11.59.02-vol3" on device "FileStorage"
> (/data/backups)
> 26-Sep 12:08 ti02-sd: New volume
> "alpha-fd_Teste.2006-09-26_11.59.02-vol3" mounted on device
> "FileStorage" (/data/backups) at 26-Sep-2006 12:08.
> ...
> and, at the end:
> You have messages.
> *mess
> 26-Sep 12:11 alpha-dir: Max Volume jobs exceeded. Marking Volume
> "alpha-fd_Teste.2006-09-26_11.59.02-vol3" as Used.
> 26-Sep 12:11 alpha-dir: Bacula 1.38.9 (02May06): 26-Sep-2006 12:11:16
> JobId: 896
> Job: Teste.2006-09-26_11.59.02
> Backup Level: Full
> Client: "alpha-fd" i686-pc-linux-gnu,gentoo,1.6.15
> FileSet: "DoSrc" 2006-09-25 17:59:45
> Pool: "TestePool"
> Storage: "Ti02Dir"
> Scheduled time: 26-Sep-2006 11:59:00
> Start time: 26-Sep-2006 11:59:05
> End time: 26-Sep-2006 12:11:16
> Elapsed time: 12 mins 11 secs
> Priority: 10
> FD Files Written: 131,692
> SD Files Written: 131,692
> FD Bytes Written: 415,656,057 (415.6 MB)
> SD Bytes Written: 432,259,407 (432.2 MB)
> Rate: 568.6 KB/s
> Software Compression: 71.0 %
> Volume name(s):
> alpha-fd_Teste.2006-09-26_11.59.02-|alpha-fd_Teste.2006-09-26_11.59.02-vol2|alpha-fd_Teste.2006-09-26_11.59.02-vol3
> Volume Session Id: 17
> Volume Session Time: 1159216167
> Last Volume Bytes: 135,652,968 (135.6 MB)
> Non-fatal FD errors: 0
> SD Errors: 0
> FD termination status: OK
> SD termination status: OK
> Termination: Backup OK
>
> 26-Sep 12:11 alpha-dir: Begin pruning Jobs.
> 26-Sep 12:11 alpha-dir: No Jobs found to prune.
> 26-Sep 12:11 alpha-dir: Begin pruning Files.
> 26-Sep 12:11 alpha-dir: No Files found to prune.
> 26-Sep 12:11 alpha-dir: End auto prune.
>
> Well, how we can see the volumes are generated exactly with the names I
> told they to be named. But I can't do this manual process each time I
> have to do a backup.
> Actually, there's another stranger thing I noticed. On the backup
> directory, I have the following files:
> -rw-r----- 1 root bacula 64728 Sep 26 11:41
> alpha-fd_Teste.2006-09-25_16.52.11-
> -rw-r----- 1 root bacula 64728 Sep 26 11:41
> alpha-fd_Teste.2006-09-25_16.57.21-
> -rw-r----- 1 root bacula 9999556 Sep 26 11:41
> alpha-fd_Teste.2006-09-25_17.33.10-
> -rw-r----- 1 root bacula 21648305 Sep 26 11:41
> alpha-fd_Teste.2006-09-25_17.59.43-
> -rw-r----- 1 root bacula 149990472 Sep 26 12:02
> alpha-fd_Teste.2006-09-26_11.59.02-
> -rw-r----- 1 root bacula 149990508 Sep 26 12:07
> alpha-fd_Teste.2006-09-26_11.59.02-vol2
> -rw-r----- 1 root bacula 135653187 Sep 26 12:11
> alpha-fd_Teste.2006-09-26_11.59.02-vol3
>
> Isn't too much files? Isn't supposed to just have
> alpha-fd_Teste.2006-09-26_11.59.02-,
> alpha-fd_Teste.2006-09-26_11.59.02-vol2,
> alpha-fd_Teste.2006-09-26_11.59.02-vol3?
The others seem to be older, most probably remains from tests starting a
day earlier...
> If I do list volumes I just get those three:
> Pool: TestePool
> +---------+-----------------------------------------+-----------+-------------+----------+--------------+---------+------+-----------+-----------+---------------------+
> | MediaId | VolumeName | VolStatus |
> VolBytes | VolFiles | VolRetention | Recycle | Slot | InChanger |
> MediaType | LastWritten |
> +---------+-----------------------------------------+-----------+-------------+----------+--------------+---------+------+-----------+-----------+---------------------+
> | 782 | alpha-fd_Teste.2006-09-26_11.59.02- | Full |
> 149,990,257 | 0 | 31,536,000 | 1 | 0 | 0 |
> File | 2006-09-26 12:02:17 |
> | 783 | alpha-fd_Teste.2006-09-26_11.59.02-vol2 | Full |
> 149,990,289 | 0 | 31,536,000 | 1 | 0 | 1 |
> File | 2006-09-26 12:07:44 |
> | 784 | alpha-fd_Teste.2006-09-26_11.59.02-vol3 | Used |
> 135,652,968 | 0 | 31,536,000 | 1 | 0 | 1 |
> File | 2006-09-26 12:11:17 |
> +---------+-----------------------------------------+-----------+-------------+----------+--------------+---------+------+-----------+-----------+---------------------+
You should keep in mind that, when you delete volumes from the catalog,
the corresponding disk files are not automaticalle removed.
>
> So, Isn't it supposed to work automatically? And about the extra files
> generated on the process and not listed by bacula? I really need to
> split my files to hold it at a DVD (not this test backup, but another
> with more then 7GB) and I really don't want to manual split it with
> "split" tools or something else.
You might also consider testing direct DVD writing if you want to use
that... I guess that the developers will be glad if more people test it,
and the better the beta phase goes the sooner it will be stable.
Arno
> Thanks in any help,
>
> --
> <http://www.hospedevip.com.br> Claudinei Matos
> Coordenador de TI | [EMAIL PROTECTED]
> <mailto:[EMAIL PROTECTED]>
>
> <http://www.hospedevip.com.br>
>
>
> ------------------------------------------------------------------------
>
> -------------------------------------------------------------------------
> Take Surveys. Earn Cash. Influence the Future of IT
> Join SourceForge.net's Techsay panel and you'll get the chance to share your
> opinions on IT & business topics through brief surveys -- and earn cash
> http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
>
>
> ------------------------------------------------------------------------
>
> _______________________________________________
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
--
IT-Service Lehmann [EMAIL PROTECTED]
Arno Lehmann http://www.its-lehmann.de
-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys -- and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
_______________________________________________
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
