Re: [Bacula-users] Puring/Pruning doesn't seem to be happening.

Fri, 16 Dec 2005 14:44:09 -0800

This is the output of "llist volumes"............look at how maxvolbytes is different for every volume.....what does it mean? I never suggested any max value....

*llist volumes
Pool: MondayPool
          mediaid: 1
       volumename: LUNEDI
             slot: 1
           poolid: 2
        mediatype: LIBRARY
     firstwritten: 2005-12-06 10:29:00
      lastwritten: 2005-12-13 00:21:08
        labeldate: 2005-12-06 09:06:04
          voljobs: 5
         volfiles: 119
        volblocks: 1,813,826
        volmounts: 12
         volbytes: 117,013,429,088
        volerrors: 0
        volwrites: 13,299,810
 volcapacitybytes: 0
        volstatus: Full
          recycle: 1
     volretention: 518,400
   voluseduration: 0
       maxvoljobs: 0
      maxvolfiles: 0
      maxvolbytes: 117,013,490,826
        inchanger: 1
          endfile: 118
         endblock: 6,313

Pool: TuesdayPool
          mediaid: 2
       volumename: MARTEDI
             slot: 2
           poolid: 3
        mediatype: LIBRARY
     firstwritten: 2005-12-06 23:44:08
      lastwritten: 2005-12-07 09:36:57
        labeldate: 2005-12-06 22:52:13
          voljobs: 4
         volfiles: 102
        volblocks: 1,548,256
        volmounts: 12
         volbytes: 99,880,992,227
        volerrors: 0
        volwrites: 14,559,972
 volcapacitybytes: 0
        volstatus: Purged
          recycle: 1
     volretention: 518,400
   voluseduration: 0
       maxvoljobs: 0
      maxvolfiles: 0
      maxvolbytes: 99,881,055,010
        inchanger: 1
          endfile: 101
         endblock: 815

Pool: WednesdayPool
          mediaid: 3
       volumename: MERCOLEDI
             slot: 3
           poolid: 4
        mediatype: LIBRARY
     firstwritten: 2005-12-15 18:20:18
      lastwritten: 2005-12-15 22:06:51
        labeldate: 2005-12-15 21:00:07
          voljobs: 1
         volfiles: 20
        volblocks: 295,489
        volmounts: 17
         volbytes: 19,062,530,608
        volerrors: 0
        volwrites: 17,825,529
 volcapacitybytes: 0
        volstatus: Append
          recycle: 1
     volretention: 518,400
   voluseduration: 0
       maxvoljobs: 0
      maxvolfiles: 0
      maxvolbytes: 60,188,267,821
        inchanger: 1
          endfile: 19
         endblock: 989

Pool: ThursdayPool
          mediaid: 4
       volumename: GIOVEDI
             slot: 4
           poolid: 5
        mediatype: LIBRARY
     firstwritten: 2005-12-16 03:42:11
      lastwritten: 2005-12-16 10:58:33
        labeldate: 2005-12-16 02:34:24
          voljobs: 3
         volfiles: 51
        volblocks: 764,326
        volmounts: 12
         volbytes: 49,308,044,308
        volerrors: 0
        volwrites: 14,085,325
 volcapacitybytes: 0
        volstatus: Append
          recycle: 1
     volretention: 518,400
   voluseduration: 0
       maxvoljobs: 0
      maxvolfiles: 0
      maxvolbytes: 60,193,598,381
        inchanger: 1
          endfile: 50
         endblock: 9,479

Pool: FridayPool
          mediaid: 5
       volumename: VENERDI
             slot: 5
           poolid: 6
        mediatype: LIBRARY
     firstwritten: 2005-12-02 23:44:53
      lastwritten: 2005-12-16 23:30:19
        labeldate: 2005-12-16 22:55:59
          voljobs: 0
         volfiles: 18
        volblocks: 278,999
        volmounts: 12
         volbytes: 17,998,781,082
        volerrors: 0
        volwrites: 14,211,125
 volcapacitybytes: 0
        volstatus: Append
          recycle: 1
     volretention: 518,400
   voluseduration: 0
       maxvoljobs: 0
      maxvolfiles: 0
      maxvolbytes: 60,193,444,522
        inchanger: 1
          endfile: 17
         endblock: 15,499

Pool: SaturdayPool
          mediaid: 6
       volumename: SABATO
             slot: 6
           poolid: 7
        mediatype: LIBRARY
     firstwritten: 2005-12-03 23:45:48
      lastwritten: 2005-12-04 18:21:00
        labeldate: 2005-12-04 14:57:46
          voljobs: 1
         volfiles: 61
        volblocks: 933,059
        volmounts: 11
         volbytes: 60,193,444,514
        volerrors: 0
        volwrites: 14,134,285
 volcapacitybytes: 0
        volstatus: Append
          recycle: 1
     volretention: 518,400
   voluseduration: 0
       maxvoljobs: 0
      maxvolfiles: 0
      maxvolbytes: 60,193,444,514
        inchanger: 1
          endfile: 60
         endblock: 3,059

Pool: SundayPool
          mediaid: 7
       volumename: DOMENICA
             slot: 7
           poolid: 8
        mediatype: LIBRARY
     firstwritten: 2005-12-04 23:48:23
      lastwritten: 2005-12-05 18:24:50
        labeldate: 2005-12-05 14:59:43
          voljobs: 1
         volfiles: 61
        volblocks: 939,919
        volmounts: 10
         volbytes: 60,635,999,915
        volerrors: 0
        volwrites: 12,914,907
 volcapacitybytes: 0
        volstatus: Append
          recycle: 1
     volretention: 518,400
   voluseduration: 0
       maxvoljobs: 0
      maxvolfiles: 0
      maxvolbytes: 60,635,999,915
        inchanger: 1
          endfile: 60
         endblock: 9,919


Gabriele Bulfon - Sonicle S.r.l.
Tel +39 028246016 Int. 30 - Fax +39 028243880
Via Felice Cavallotti 16 - 20089, Rozzano - Milano - ITALY
http://www.sonicle.com



----------------------------------------------------------------------------------

Da: Arno Lehmann <[EMAIL PROTECTED]>
A: bacula-users@lists.sourceforge.net
Data: 16 dicembre 2005 21.13.04 CET
Oggetto: Re: [Bacula-users] Puring/Pruning doesn't seem to be happening.

Hello,

On 12/16/2005 7:04 PM, Gabriele Bulfon wrote:
>
> I think you didn't get the problem.
> I have 4 jobs each day. I have a retention of 6 days. I have auto prune.
> I have the recycle flag on.
> Then a week passes, and the tape is not recycled. Maybe because Bacula
> wants to retain as much
> as possible....and yes, there's still space on the tape (but how does it
> knows?)...

I knows because the tape is not full. Bacula considers a tape full when
it gets the corresponding return code when writing. Simething like the
error code for "no space" or "end of media".

> So, even if it appends, I'll get another 4 jobs appended on the
> tape....ok....I'm safe this second week.
> And another week passes, and the tape is not recycled again (why?!). Ok
> it wants to ratain again as
> much as possible....and this time the space is limited.
> So...I get one job done....and the second....and then I it asks for
> another tape! But it's 2am! Nobody's gonna change the tape!...and jobs
> will be canceled later on (If I don't auto cancel them, no other future
> job will be run without my manual intervention of canceling).
> ....this is soooooooo bad!
> Why it didn't want to recyle?!

Because, as I tried to point out in my earlier mail, you didn't
configure it to work the way you want it to work.

Once again: You have to set up the volumes to be used for a given time
period, so Bacula knows when to mark a volume as used.

Use the "Volume Use Duration" setting. Please read the manual section
explaining this setting. It contains a lot of useful information for
your needs.

> But then...this happens on monday, but not on tuesday (this week), but
> it happens on tuesday too next week....it's a mess!! Where's the problem?!
>
> And please, can you tell me what is the "User defined maximum capacity"?

It defines the maximum amount of data to put on a volume.

> I never defined this.
> It worked for weeks on an LTO library, and now it stops at a certain
> amount of Gb saying that
> the maximum defined capacity is reached.....where do I define this? I
> never did.

What Information about the volume is in the catalog? The llist command
can show you.

> Thanks.
> Gabriele.
>
> <http://www.sonicle.com>
> Gabriele Bulfon - Sonicle S.r.l.
> Tel +39 028246016 Int. 30 - Fax +39 028243880
> Via Felice Cavallotti 16 - 20089, Rozzano - Milano - ITALY
> http://www.sonicle.com
>
>
>
>
> ----------------------------------------------------------------------------------
>
> Da: Arno Lehmann <[EMAIL PROTECTED]>
> A: bacula-users@lists.sourceforge.net
> Data: 16 dicembre 2005 1.25.43 CET
> Oggetto: Re: [Bacula-users] Puring/Pruning doesn't seem to be happening.
>
> Hello,
>
> On 12/16/2005 12:56 AM, Gabriele Bulfon wrote:
> >
> > ....so....how does one force it to do it?!
>
> Apart from the configuration directives like "prune oldest volume" (or
> something) my advice is usually "you don't".
>
> When I find I have to force Bacula to anything, it's usually my
> fault or
> (more often these days, running a beta version :-) Bacula shows a bug.
>
> > Think: if the tape goes full after 3 jobs, and I have 4 each
> night, my
> > last job will not be done.
>
> Or, in other words, you need enough space available.
>
> > And this is not acceptable.
>
> No, this is,in my opinion, the best way to handle backups: Avoid
> overwriting valid data whenever possible.
>
> > If I tell bacula that the retention period is 12 days, I assume
> that 12
> > days later the tape will be recycled.
>
> Well, your assumption is not coherent with Bacula, then. Bacula
> treats a
> retention like "keep the data for at least this time. Only after this
> time has passed consider recycling that volume." Thus, you should
> assume
> that your data will not be overwriten until 12 days have passed after
> the last job on a given volume is finished.
>
> > After all...how does bacula knows the true capacity of a tape,
> until it
> > goes EOT?
>
> Why would Bacula need that information?
>
> > Wouldn't it be easier to have some kind of flag to tell Bacula :
> "Ok,
> > this tape is in the correct pool, look if it's recyclable, and if
> it is,
> > don't even try to append. Just scratch and reuse".
>
> Hmm. Isn't that how Bacula works? If a volume is in the right pool, and
> it is flagged as recyclable, and automatic pruning for the jobs and
> volumes is on, AND the retention period has passed, the volume will be
> considered when Bacula looks for a recyclable volume.
>
> If you want to limit the time Bacula uses a volume, you can do so by
> setting the proper volume use time or number of jobs.
>
> And, while jobs can be pruned automatically after a job, the step of
> recycling a volume only happens when Bacula actually needs another
> volume.
>
> > I see many users asking for this. And I still haven't found a way
> to do it.
> > Always appending.
>
> No, appending as long as it's allowed. Either until the volumes is
> full,
> it's filled with as much data as you configured, with as many jobs as
> you set, or used for the time you told it to use the volume.
>
> > But sometimes (some kind of randomly) it
> > recycles....wierd....isn't it?
>
> Erm. No.
>
> I understand Bacula works in a way to ensure that backups are available
> as long as possible. When determining how to set it up, it's my duty to
> set the retention times and the recycling strategy. Knowing the amount
> of data I want to store, I have to make sure I've got enough space.
>
> If I set up a pool to have backups available for a certain time, and
> I've not got enough volumes, Bacula tells me so. Either I re-think my
> backup strategy and modify the setup, or I buy more tapes.
>
> I never had a situation where Bacula didn't recycle correctly, and even
> my 1-year-retention pools are cycling as I set them up. Of course, for
> short-term storage I need the space for a worst-case scenario.
>
> Arno
>
> >
> > <http://www.sonicle.com>
> > Gabriele Bulfon - Sonicle S.r.l.
> > Tel +39 028246016 Int. 30 - Fax +39 028243880
> > Via Felice Cavallotti 16 - 20089, Rozzano - Milano - ITALY
> > http://www.sonicle.com
> >
> >
> >
> >
> >
> ----------------------------------------------------------------------------------
>
> >
> > Da: Arno Lehmann <[EMAIL PROTECTED]>
> > A: bacula-users@lists.sourceforge.net
> > Data: 15 dicembre 2005 21.12.01 CET
> > Oggetto: Re: [Bacula-users] Puring/Pruning doesn't seem to be
> happening.
> >
> > Hello,
> >
> > On 12/15/2005 5:01 PM, Beren Gamble wrote:
> > > I'm going crosseyed, it's probably something simple, but i've
> > been looking at it for too long.
> > >
> > > This shows the media i'm going to use for tonight's backup. The
> > problem is, it's still set to append, shouldn't it have a VolStatus
> > or Purged?
> > >
> > >
> >
> +---------+------------+-----------+-----------------+----------+--------------+---------+------+-----------+-----------+---------------------+
>
> >
> > > | MediaId | VolumeName | VolStatus | VolBytes | VolFiles |
> > VolRetention | Recycle | Slot | InChanger | MediaType |
> LastWritten |
> > >
> >
> +---------+------------+-----------+-----------------+----------+--------------+---------+------+-----------+-----------+---------------------+
>
> >
> > > | 6 | THURSDAY2 | Append | 99,017,877,864 | 102 | 1,036,800 | 1 |
> > 0 | 1 | SDLT | 2005-12-02 00:22:38 |
> > >
> >
> > Considering your retention period of 12 days, I guess that's what
> > you're
> > aiming at.
> >
> > And no, it should not yet be purged. Bacula only prunes jobs and
> > volumes
> > when it actually needs a new volume. In this case, I suppose
> that, if
> > this evening there's no more space available or usable, Bacula will
> > prune this volume and then recycle it.
> > Arno
> >
> > PS:
> > >
> >
> ***********************************************************************************
>
> >
> > > Mail FROM London Borough of Harrow:
> > > Unencrypted electronic mail is not secure and may not be
> > authentic, in whole or in part. You are advised to check directly
> > with the sender before acting upon any e-mail received.
> > >
> > > The information contained in this message and any attachments is
> > confidential and is intended for receipt by the above named
> > addressee(s) only. If you have otherwise encountered this message
> > please notify its originator via +44(0)20 8863 5611 at LONDON
> > BOROUGH OF HARROW. The unauthorised use, disclosure, copying or
> > alteration of this message is strictly forbidden. The views
> > expressed within this message are those of the individual sender and
> > not necessarily those of Harrow Council.
> > >
> > > Mail TO London Borough of Harrow:
> > > London Borough of Harrow monitors all electronic mail it receives
> > for Policy compliance and to protect its systems including anti-spam
> > and anti-virus measures.
> >
> > If anybody at your institution thinks that this disclaimer would be
> > helpful it would be nice to wrap the text as usual. Otherwise,
> please
> > simply drop it.
> >
> > If I really honored this disclaimer, I wouldn't reply to you -
> I'm not
> > the addressee of your mail, and we've got no contract, so how
> would I
> > know I'm really the one this mail intended for?
> >
> > And, if you worry about confidentiality, you should
> cryptographically
> > sign or encript your mail. Or, even better, not use E-Mail at all.
> >
> > Perhaps whoever is responsible for this stuff in your
> organisation can
> > explain if there's any real reason you need to send this out
> probably
> > thousands of times a day.
> >
> > Thanks,
> >
> > Arno
> >
> > > Electronic mail does not guarantee delivery, nor notification of
> > non-delivery. It is suggested you contact your intended recipient(s)
> > by other means should confirmation of receipt be important.
> > >
> >
> ***********************************************************************************
>
> >
> > >
> > >
> > >
> > > -------------------------------------------------------
> > > This SF.net email is sponsored by: Splunk Inc. Do you grep
> > through log files
> > > for problems? Stop! Download the new AJAX search engine that makes
> > > searching your log files as easy as surfing the web. DOWNLOAD
> > SPLUNK!
> > > http://ads.osdn.com/?ad_idv37&alloc_id865&op=click
> > > _______________________________________________
> > > Bacula-users mailing list
> > > Bacula-users@lists.sourceforge.net
> > > https://lists.sourceforge.net/lists/listinfo/bacula-users
> > >
> >
> > --
> > IT-Service Lehmann [EMAIL PROTECTED]
> > Arno Lehmann http://www.its-lehmann.de
> >
> >
> > -------------------------------------------------------
> > This SF.net email is sponsored by: Splunk Inc. Do you grep through
> > log files
> > for problems? Stop! Download the new AJAX search engine that makes
> > searching your log files as easy as surfing the web. DOWNLOAD
> SPLUNK!
> > http://ads.osdn.com/?ad_id=7637&alloc_id=16865&op=click
> > _______________________________________________
> > Bacula-users mailing list
> > Bacula-users@lists.sourceforge.net
> > https://lists.sourceforge.net/lists/listinfo/bacula-users
> >
> >
> >
>
> --
> IT-Service Lehmann [EMAIL PROTECTED]
> Arno Lehmann http://www.its-lehmann.de
>
>
> -------------------------------------------------------
> This SF.net email is sponsored by: Splunk Inc. Do you grep through
> log files
> for problems? Stop! Download the new AJAX search engine that makes
> searching your log files as easy as surfing the web. DOWNLOAD SPLUNK!
> http://ads.osdn.com/?ad_id=7637&alloc_id=16865&op=click
> _______________________________________________
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
>
>

--
IT-Service Lehmann [EMAIL PROTECTED]
Arno Lehmann http://www.its-lehmann.de


-------------------------------------------------------
This SF.net email is sponsored by: Splunk Inc. Do you grep through log files
for problems? Stop! Download the new AJAX search engine that makes
searching your log files as easy as surfing the web. DOWNLOAD SPLUNK!
http://ads.osdn.com/?ad_id=7637&alloc_id=16865&op=click
_______________________________________________
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users



Reply via email to