Re: [Bacula-users] Fw: Aw: Re: Renamed and moved files are backed up again

2017-09-06 Thread Roberts, Ben
Hi Fabian, Others on the list may correct me if I’m wrong, but fundamentally Bacula treats different filenames as different entities to be backed up, regardless of content being shared across multiple files. The flags you have been changing only relax the checks for a given filename to see whet

Re: [Bacula-users] Cancel Job thats already queued or running

2017-07-27 Thread Roberts, Ben
Hi Oliver, > It’s possible to define that a job will be cancelled if this job is already > queued or running? Take a look at the “Allow Duplicate Jobs” and related directives in the Job resource, described here: http://www.bacula.org/9.0.x-manuals/en/main/Configuring_Director.html#SECTION001830

Re: [Bacula-users] Bacula largest installations ever

2017-07-10 Thread Roberts, Ben
I manage a sizeable Bacula installation: ~70 FD ~10,000 volumes ~2,000 jobs currently in catalog of 45,000 jobs (lifetime for this instance of director/catalog) ~4.8 PB currently tracked by jobs in catalog ~30.1TB largest single job (which took 3d 9h on last run) This workload previously served f

Re: [Bacula-users] Special Permissions to Stop and Start Services during backup

2017-04-28 Thread Roberts, Ben
Hi Jim, Note that sudo requires the command be executed from a TTY by default for security, which isn't compatible with how system services run. Do you have a defaults entry for bacula that disables the "requiretty" option? Not having this would manifest as a permission denied as if the sudo ru

Re: [Bacula-users] Dell TL1000 IBM3850-HH7

2017-03-19 Thread Roberts, Ben
Hi Jim, > I am using bacula-7.0.5-7 which looks like it was packaged for el7 in May of > 2015. I will use the SPEC and related files from it with the latest source > and see where things go. If you're looking for newer el6/7 releases to avoid building from source, take a look at Slaanesh's COP

Re: [Bacula-users] btape fill failure on HP LTO6/4 drives

2017-01-29 Thread Roberts, Ben
n nor do we run it on alternative systems like Solaris. Too bad Solaris did not run the full Bacula regression tests :-) Kern On 01/28/2017 01:00 PM, Allan Black wrote: > On 09/05/14 14:09, Allan Black wrote: >> On 01/04/14 10:26, Roberts, Ben wrote: >>>> It appears that t

Re: [Bacula-users] Git repo down?

2017-01-02 Thread Roberts, Ben
Hi Michael, > Fatal: repository 'http://git.bacula.org/bacula' not found. Add ".git" to the end of your clone URL: http://git.bacula.org/bacula.git Regards, Ben Roberts This email and any files transmitted with it contain confidential and proprietary information and is solely for the use of the

Re: [Bacula-users] Bacula in the cloud

2016-10-19 Thread Roberts, Ben
The documentation is outdated and this limit was removed (or perhaps vastly increased?) somewhere around the 7 mark. I’ve had jobs running a lot longer since upgrading. In branch-5.2: http://www.bacula.org/git/cgit.cgi/bacula/tree/bacula/src/lib/bnet.c#n784 bsock->timeout = 60 * 60 * 6 * 24;

Re: [Bacula-users] Backup of system outside of restrictive firewall?

2016-08-05 Thread Roberts, Ben
Hi Andreas, Support for this was added in 7.0, you want "SD Calls Client" option enabled. It's covered in the manual here: http://www.bacula.org/7.4.x-manuals/en/main/New_Features_in_7_0_0.html#SECTION00512000 Alternative methods would be setting up a VPN (e.g. openvpn) to bypass th

Re: [Bacula-users] Storage Devices not displaying in bconsole status

2016-02-10 Thread Roberts, Ben
Hi Shon, > I am having an issue where when I run a status command in bconsole, select > "Storage", > I am only presented with the option for status on 3 of my defined storage > resources. > I am trying to figure out why this is, but am being left with a blank. > Backups do seem > to be running

Re: [Bacula-users] Bconsole Reload Sometimes Doesn't Load New Job Resource Definitions

2015-10-20 Thread Roberts, Ben
> On a particular customer system, we find that the new job resource has not > been loaded after the `reload` command has completed. My workflow relies on the reload command heavily (puppet drops in updated config files and executes the reload command afterwards; this normally works very well.

Re: [Bacula-users] Purge console messages?

2015-04-28 Thread Roberts, Ben
Hi Luc, If you don't want the messages to show up in the console at all, why not disable them at source rather than strip them out retrospectively? Messages { console = !all } (which might be the default since I have "console = all, !skipped, !saved" in my config file, I can't see from a qui

Re: [Bacula-users] List files in a volume

2015-04-22 Thread Roberts, Ben
Hi, > It would be far quicker to find the files I needed > and it means I can do this search without interfering with the daily > backups which are using the same drive. By the way, the CCTV isn't on 100% > of the time, so having said that the files might not be present and/or the > filenames not

Re: [Bacula-users] STK SL-3000 experiences

2015-03-05 Thread Roberts, Ben
Hi Tony, > Has anyone got any experience using bacula with the Storagetek SL-3000? > Or the SL-150 for that matter (they should behave the same way for what > I'm told) > > I'm looking for real-life experience here, not something like "if it can > be managed with mtx, then it _should_ work.." I

Re: [Bacula-users] how to debug a job

2015-01-25 Thread Roberts, Ben
Hi Kern, >> Hard-coded, huh? Nobody's tried backing up that big data I keep hearing >> about? > No, there is no change in the hard coded 6 day limit, and at the moment, I > personally > am not planning to implement anything, for two reasons: 1. I would like to > limit the > number of new Direct

Re: [Bacula-users] Bacula daemon message

2015-01-20 Thread Roberts, Ben
2015 16:39 To: Roberts, Ben; mike.br...@devnull.net.nz Cc: bacula-users@lists.sourceforge.net Subject: RE: [Bacula-users] Bacula daemon message This is all disk storage. I’m trying to truncate all expired volumes immediately after all backups have completed so as to have maximum space available when

Re: [Bacula-users] Bacula daemon message

2015-01-20 Thread Roberts, Ben
g Bacula is doing on its own. Bryn On 2015-01-17 10:54 AM, Polcari, Joe (Contractor) wrote: Nope, none of that. No admin jobs. All my storage is File. Backups and restores work fine. From: Roberts, Ben [mailto:ben.robe...@gsacapital.com] Sent: Saturday, January 17, 2015 1:05 PM To: Polcari, Joe

Re: [Bacula-users] Bacula daemon message

2015-01-17 Thread Roberts, Ben
Do you have an admin job in your config that's running console commands? It looks like something is executing purge commands automatically which sounds really rather dangerous to the health of your backups. The good news is it doesn't seem to be working because you no longer have a "File" storag

Re: [Bacula-users] LTO speed optimisation

2014-12-17 Thread Roberts, Ben
tapes. Regards, Ben Roberts > -Original Message- > From: Alan Brown [mailto:a.br...@ucl.ac.uk] > Sent: 17 December 2014 13:50 > To: Roberts, Ben; Cejka Rudolf; Bryn Hughes; Radosław Korzeniewski; Kern > Sibbald > Cc: bacula-users@lists.sourceforge.net > Subjec

Re: [Bacula-users] Mini-Status report

2014-12-06 Thread Roberts, Ben
To: Roberts, Ben; bacula-users Subject: Re: [Bacula-users] Mini-Status report Hello Ben, Thanks for your feedback on pruning. While I was reading your email, I kept wondering what version of Bacula you were running, because slowing down of the console with version 5.2.x and before was a typical

Re: [Bacula-users] Mini-Status report

2014-12-06 Thread Roberts, Ben
Hi Kern, Thanks for updating the docs regarding auto prune. I disabled this last week and it has immediately fixed a long-running performance problem we were having when Bacula was looking for appendable volumes for a running job. I bring this up not only to report success but also because our

Re: [Bacula-users] Problems with Quantum SuperLoader 3 LTO-6

2014-12-03 Thread Roberts, Ben
Hi Rainer, > First problem: > Starting Bacula this way doesn't work anymore: > cd /etc/init.d > ./bacula-dir start You're going to have to do some good old fashioned debug to work this out. Check the logs, try running the exact commands the init script executes (make sure to do it as the same u

Re: [Bacula-users] Compatibility.

2014-11-30 Thread Roberts, Ben
Hi Erik, > Is it possible to run bacula-dir and bacula-sd on bacula-5.2.13 with > bacula-fd running 7.0.x on another box? The only officially supported combination is (director version == storage daemon version) >= file daemon version. Your mileage may vary but don't expect a newer file daemon

Re: [Bacula-users] (no subject)

2014-11-21 Thread Roberts, Ben
Hi Luca, I’ve been using an LT60 S2 (SAS) with LTO-6 and LTO-04 drives for 12 months (many hundreds of TB written). I’ve had no problems until recently and have been happy with the unit on the whole (it is a significant improvement over the StorageTek unit it replaced). I’m currently working th

[Bacula-users] LTO speed optimisation

2014-11-05 Thread Roberts, Ben
Hi all, I'd like to try and make some speed improvements to my Bacula setup (5.2.13, Solaris11). I have data (and attribute) spooling enabled using a pool of 46x 1TB directly-attached SAS disks dedicated to this purpose. Data is being despooled to 2x directly-attached SAS LTO6 drives at around

Re: [Bacula-users] File volumes and scratch pool

2014-10-01 Thread Roberts, Ben
the latter, perhaps you can reply with your reasoning. Ben Roberts From: Peter Wood [mailto:peterwood...@gmail.com] Sent: 01 October 2014 22:01 To: Roberts, Ben Cc: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] File volumes and scratch pool Thank you Ben. I applied the changes

Re: [Bacula-users] File volumes and scratch pool

2014-10-01 Thread Roberts, Ben
Hi Peter, You need to set “Recycle Pool = Scratch” in your Scratch pool (and make sure you haven’t overridden it in any other poo)l. Note that this setting is applied to the volume when it’s created, so after changing the Scratch pool definition you will need to update all your volumes to re-ap

Re: [Bacula-users] Autochanger: yes or no?

2014-09-18 Thread Roberts, Ben
e Volumes just get created when needed. I still have to test if it works > though. > > Regards, > Florian S. > > Am 18.09.2014 um 11:42 schrieb Roberts, Ben: > > > Now I actually had to wonder: Is there no way to have bacula do both > > > labeling AND switc

Re: [Bacula-users] Autochanger: yes or no?

2014-09-18 Thread Roberts, Ben
> Now I actually had to wonder: Is there no way to have bacula do both > labeling AND switching Volumes automatically? > Or do I just misunderstand? Personally I pre-label all my volumes into the Scratch pool, and let Bacula handle moving volumes from there to a backup pool as needed. They're the

Re: [Bacula-users] How to handle many storage devices?

2014-09-18 Thread Roberts, Ben
Hi Florian, You would want a minimum of one Storage Device per distinct Media Type for a reserved restore device and there's no requirement to have a reserved restore device per client/job/etc so a single restore device would be OK. You can have additional reserved restore devices but unless yo

Re: [Bacula-users] Autochanger: yes or no?

2014-09-11 Thread Roberts, Ben
Hi Florian, >> Is using one Device Resource in the Storage daemon enough or is there any >> use for an autochanger in this case? > We do the same thing as this and have a single device resource with no > autochanger. Both options have their merits and drawbacks, so you should assess which would

Re: [Bacula-users] scripting bconsole (Re: vchanger and "intervention needed")

2014-08-18 Thread Roberts, Ben
> > You could use the expect command to script a reply to request as in: > > I could also use python's subprocess.Popen or execvp(3) and dup(2) in c. > The way every proper unix utility works is > > bconsole -c "delete volume=xyz" -y Bacula will do this for you without any other tools; you jus

Re: [Bacula-users] Bacula Loading Tape at the Wrong Library

2014-08-07 Thread Roberts, Ben
Hi Vinicius, You need to use a unique Media Type for each autochanger, e.g. “LTO5-Library1” and “LTO5-Library2”. These are arbitrary string values, the exact name doesn’t matter. Bacula believes a drive in library1 is suitable for loading a tape from library2 because the same Media Type is used

Re: [Bacula-users] Backup on Tape

2014-08-04 Thread Roberts, Ben
> 1) Can we tune bacula config files for maximize backup speed? Turn on attribute spooling to save on database round-trips during the backup run (these will be inserted at the end). Try to measure where your bottleneck is and then see if you can do anything about it: read I/O on the FD machine,

Re: [Bacula-users] How to forcefully recycle tape

2014-08-04 Thread Roberts, Ben
Hi Ankush, > I would like to forcefully recycle tape, I follow below command from > bconsole but not working. > +-+--+---+---+-+ > | MediaId | VolumeName | VolStatus | Enabled | VolBytes| VolFiles | > +-+--+---+--

Re: [Bacula-users] Bacula with LTO6 on TS3100

2014-07-25 Thread Roberts, Ben
Hi Philip, Bacula doesn’t have any issues with LTO6 media in general. I’m running with HP LTO6 drives (in a Fujitsu LT60 S2, which I understand to be functionally identical to an HP MSL4048) perfectly happily. Regards, Ben Roberts From: Stevens, Philip [mailto:philip.stev...@igb.fraunhofer.de]

Re: [Bacula-users] Baculum probelm with bconsole

2014-06-12 Thread Roberts, Ben
> Has nobody had this problem? > Or did anyone succeed in compiling baculum on Centos 6.5? > If so I would like to know what I am missing to get this running. I had a similar problem with webacula. By default my bconsole binary had something like 744 permissions so only root (the owner) could exe

[Bacula-users] Autochanger questions

2014-06-04 Thread Roberts, Ben
Hi all, I've got a tape library with 3xLTO6 drives and 1xLTO4 drive in it. All four drives are managed by the same library, and the same changer device is used to load either media type into any drive. I'd like to use them as follows: 1x LTO4 drive free for use by any job (likely to be restores

Re: [Bacula-users] Change a volume from 'Error' to 'Append'

2014-05-21 Thread Roberts, Ben
riginal Message- > From: Korbinian Grote [mailto:gr...@genomatix.de] > Sent: 21 May 2014 14:15 > To: John Drescher; Roberts, Ben; bacula-users@lists.sourceforge.net > Subject: Re: [Bacula-users] Change a volume from 'Error' to 'Append' > > Thanks Ben & J

Re: [Bacula-users] Change a volume from 'Error' to 'Append'

2014-05-21 Thread Roberts, Ben
Hi Korbinian, I've observed similar issues in the past. A job fails part way through and the catalog is not updated leaving a mismatch in the number of files in the volume versus what's recorded in the catalog. This is then detected the next time the volume is used, and Bacula marks the volume

Re: [Bacula-users] btape fill failure on HP LTO6/4 drives

2014-04-01 Thread Roberts, Ben
Hi Kern, > It appears that the OS tape driver does not properly > implement back space record after an EOT. This is a defect of the operating > system driver, but it is not fatal for Bacula. > > You will very likely see this defect show up when Bacula fills a tape and > writes the final EOT mark

[Bacula-users] btape fill failure on HP LTO6/4 drives

2014-03-28 Thread Roberts, Ben
Hi all, While setting up a new tape library with HP LTO6 drives, btape test runs successfully, but btape fill fails with what looks like a problem handling the last block on the tape (perhaps an off-by-one error?). The outputs below are repeatable with both LTO6 and LTO4 media, but I've been ab

Re: [Bacula-users] Backup Full and Incremental...

2014-03-14 Thread Roberts, Ben
provisioning calculations you had made. Bacula is being helpful by actually upgrading the job to a full. From: Gilberto Nunes [mailto:gilberto.nune...@gmail.com] Sent: 14 March 2014 14:40 To: Roberts, Ben Cc: John Drescher; bacula-users Subject: Re: [Bacula-users] Backup Full and Incremental...

Re: [Bacula-users] Backup Full and Incremental...

2014-03-14 Thread Roberts, Ben
014 14:14 To: Roberts, Ben Cc: John Drescher; bacula-users Subject: Re: [Bacula-users] Backup Full and Incremental... Just one more thing I have differents Volumes, one for Full and other for Incremental... On the Schedule I can define Full and Incremental like that? Schedule { Name = Backup

Re: [Bacula-users] Backup Full and Incremental...

2014-03-14 Thread Roberts, Ben
the Pool specifications provided in the Job resource." Regards, Ben Roberts From: Gilberto Nunes [mailto:gilberto.nune...@gmail.com] Sent: 14 March 2014 14:03 To: Roberts, Ben Cc: John Drescher; bacula-users Subject: Re: [Bacula-users] Backup Full and Incremental... but this will override

Re: [Bacula-users] Backup Full and Incremental...

2014-03-14 Thread Roberts, Ben
Instead of specifying the pools in the schedule, I use the Full Backup Pool and Incremental Backup Pool options as below. Pool { Name = Samba-Full Pool Type = Backup Maximum Volume Jobs = 1 Volume Retention = 30 days Recycle = yes AutoPrune = yes LabelFormat = FullMensal }

Re: [Bacula-users] Progress estimates for jobs

2014-03-14 Thread Roberts, Ben
chuerk...@nionex.net] > Sent: 14 March 2014 09:36 > To: Roberts, Ben > Cc: bacula-users@lists.sourceforge.net > Subject: Re: [Bacula-users] Progress estimates for jobs > > Hi folks, > > I created a similar console based tool a while ago which works similar to > "top&qu

[Bacula-users] Progress estimates for jobs

2014-03-12 Thread Roberts, Ben
Hi, I've built a simple dashboard internally for displaying the current status and most recent completion of each job in the director. It also makes an estimate of the average job size and run frequency (which we use for alerting when jobs run unexpectedly late or are abnormally sized). I pull

Re: [Bacula-users] Help please. Incremental backup works very strange.

2014-03-05 Thread Roberts, Ben
You will need to enable Accurate mode in your job or jobdefs resource. This lets Bacula keep track of files that have been deleted. See http://www.bacula.org/manuals/en/install/install/Configuring_Director.html#SECTION0063 for more info. Regards, Ben Roberts > -Original Mes

Re: [Bacula-users] SOLVED Errors restoring from disk backup: Volume data error Wanted ID: "BB02", got ""

2014-01-21 Thread Roberts, Ben
7959 7661 T +44 (0)20 7959 8800 www.gsacapital.com<http://www.gsacapital.com/> From: Kern Sibbald [mailto:k...@sibbald.com] Sent: 17 January 2014 19:35 To: Roberts, Ben; bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Errors restoring from disk backup: Volume data error

Re: [Bacula-users] Errors restoring from disk backup: Volume data error Wanted ID: "BB02", got ""

2014-01-17 Thread Roberts, Ben
(0)20 7959 7661 T +44 (0)20 7959 8800 www.gsacapital.com<http://www.gsacapital.com/> From: Kern Sibbald [mailto:k...@sibbald.com] Sent: 17 January 2014 17:23 To: Roberts, Ben; bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Errors restoring from disk backup: Volume dat

Re: [Bacula-users] Errors restoring from disk backup: Volume data error Wanted ID: "BB02", got ""

2014-01-17 Thread Roberts, Ben
> Are the failing block numbers always a little below 2^32 (like 4294944994 and > 4294941825 in your messages)? If so, that maybe suggests a compiler > bug if the same source code works when compiled on the older machine (or is it > the same binary too?). That is a very good spot, I hadn't picked

Re: [Bacula-users] Errors restoring from disk backup: Volume data error Wanted ID: "BB02", got ""

2014-01-16 Thread Roberts, Ben
Hi Josh, > Could you downgrade the client to 5.0.2? I know SD and DIR are backward > compatible with older clients, but I'm not so sure what happens when the > client is a newer version. Since this exact topic came up in IRC last night, I tried a restore of a backup made by a 5.0 client (RHEL

[Bacula-users] Errors restoring from disk backup: Volume data error Wanted ID: "BB02", got ""

2014-01-14 Thread Roberts, Ben
Hi all, I've recently setup a new Bacula director/storage daemon in preparation to move our existing backups to newer hardware. During testing, I've run into problems doing restores of backups taken to disk, failing with the messages: Error: block.c:275 Volume data error at 24:4294944994! Wan