Re: [Bacula-users] opportunistic backup?

2016-11-16 Thread Bryn Hughes
On 2016-11-16 06:12 AM, Paul J R wrote: > Hi All, > > I have a data set that i'd like to backup thats large and not very > important. Backing it up is a "nice to have" not a must have. I've been > trying to find a way to back it up to disk that isnt disruptive to the > normal flow of backups, but e

Re: [Bacula-users] Restore an entire directory from some day

2016-10-20 Thread Bryn Hughes
On 2016-10-20 01:36 PM, Dante F. B. Colò wrote: Hello Folks I already have been using Bacula for years, in the case of incremental backups maybe i`m doing do it wrong but when i need for example restore a folder from someday i restore it from the last full job before that date i need and al

Re: [Bacula-users] Issue with In-Changer Media after replacing Tape Library

2016-03-01 Thread Bryn Hughes
Appears you never did an 'Update Slots' on the old library after emptying the tapes from it... You can manually change the 'InChanger' flag from a '1' to a '0' for the affected tapes, it at least doesn't look like there are too many of them. You can also delete those volumes all together if y

Re: [Bacula-users] Question about versions to be installed in an Linux / Windows environment

2015-12-24 Thread Bryn Hughes
On 2015-12-24 07:34 AM, Daniel Bareiro wrote: > Hi Wanderlei and Greg. > > On 23/12/15 15:34, Greg Woods wrote: > >>> am thinking of using Debian Jessie which includes Bacula 5.2.6 in its >>> repository for director and storage daemon. But I remember a few cases >>> where I have experie

Re: [Bacula-users] Bacula and NFS

2015-12-16 Thread Bryn Hughes
The 'ERR=Connection refused' message means that the storage daemon itself isn't accepting connections. This could be due to firewall rules or due to mismatched passwords between the storage daemon and the other components. I don't believe it is being caused by or is related to your NFS mount i

Re: [Bacula-users] Bacula backup speed

2015-12-15 Thread Bryn Hughes
On 2015-12-15 04:50 PM, Lewis, Dave wrote: >> -Original Message- >> From: Uwe Schuerkamp [mailto:uwe.schuerk...@nionex.net] >> Sent: Tuesday, December 15, 2015 4:47 AM >> To: Lewis, Dave >> Cc: bacula-users@lists.sourceforge.net >> Subject: Re: [Bacula-users] Bacula backup speed >> > ... >>

Re: [Bacula-users] Bacula backup speed

2015-12-14 Thread Bryn Hughes
Sounds pretty clear that you have some performance issues on your database. What are you running (MySQL/Postgresql/Sqlite/etc) for your DB? Is it running on the same server as your director? What kind of disk storage do you have under your database? Bryn On 2015-12-14 01:12 PM, Lewis, Dave wr

Re: [Bacula-users] stat problems

2015-11-20 Thread Bryn Hughes
Is it just me or are all your slashes backwards for Windows? Shouldn't it be C:\ not C:/ ? Bryn On 2015-11-19 10:25 AM, Craig Shiroma wrote: > Hello, > > I came across a problem with a Windows 2012R2 server that generated > the below error messages in the log. The full backed up only a few >

Re: [Bacula-users] Copy job with PoolUncopiedJobs

2015-11-09 Thread Bryn Hughes
On 2015-10-30 02:38 PM, Jerry Lowry wrote: > Hi, > > Centos 5.11 64bit OS > Bacula 5.2.6 on all directors and clients > > I have run across a problem with one of my copy jobs. The job is > setup with the PoolUncopiedJobs parameter. The jobs are failing with > the following: > 30-Oct 11:05 distr

Re: [Bacula-users] lto4 hardware compression doesn't work when encryprion on?

2015-11-09 Thread Bryn Hughes
On 2015-11-09 09:35 AM, John Drescher wrote: > On Mon, Nov 9, 2015 at 12:26 PM, jstacey > wrote: >> I recently enabled encryption in my bacula-fd.conf with these entries: >> >>PKI Signatures = Yes >>PKI Encryption = Yes >>PKI Keypair = "/etc/bacula/client.pem" >>PKI Master Key = "

Re: [Bacula-users] wiping test backups and starting again.

2015-11-05 Thread Bryn Hughes
It's worth considering a filesystem that supports error detection/correction such as ZFS... Though to really make use of that you need to have a machine with ECC RAM. Not sure what all you have for a layout, but bitflips in backup data can make for a bad time. Generally speaking I doubt you'll

Re: [Bacula-users] Deadlock error

2015-08-06 Thread Bryn Hughes
I think what Kern is getting at is that your database is what threw the error, not Bacula. Whatever DB you are using is what is having the issue. Bryn On 2015-08-06 09:11 AM, Craig Shiroma wrote: Hi Kern, Thank you very much for the reply! Would you have any suggestions on what may be caus

Re: [Bacula-users] Multiple full backups in same month

2015-06-25 Thread Bryn Hughes
On 2015-06-25 10:17 AM, Silver Salonen wrote: On Thu, Jun 25, 2015 at 7:56 PM, Heitor Faria > wrote: Citando Thomas Lohman mailto:thom...@mtl.mit.edu>>: The question now is: bacula decides if it will upgrade jobs when

Re: [Bacula-users] Slow Attribute spooling

2015-06-08 Thread Bryn Hughes
On 2015-06-08 03:25 AM, Denis Witt wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > On Mon, 08 Jun 2015 11:10:11 +0100 > Alan Brown wrote: > >> What are you using for spool disk? > >> If it's not fast SSD then you can't run more than a couple of >> simultaneous backups (you are seek

Re: [Bacula-users] Use multiple HDDs to backup files to

2015-06-02 Thread Bryn Hughes
Do you have some specific reason to need to have these two volumes separate? You might be best off using LVM to create a single logical drive. That would certainly be a more flexible solution long term. Bryn On 2015-05-20 09:32 AM, SPQR wrote: > I would like to set up bacula - well, my first st

Re: [Bacula-users] bsmtp operation to retry sending e-mails

2015-05-28 Thread Bryn Hughes
The easiest way to resolve that is to run postfix (or the MTA of your choice) on the local machine and have it configured to forward mail to your mail gateway. Then bacula (or anything else that needs to send mail) just sends it to the local MTA and it handles everything from there. Retries,

Re: [Bacula-users] moving bacula

2015-05-25 Thread Bryn Hughes
Also, depending on how you had your MySQL authentication set up it may be looking for connections coming from a specific host. If the IP has changed or anything like that, and if Bacula was configured to connect to the actual address/name of the machine rather than localhost you may have issue

Re: [Bacula-users] Is Bacula and a LTO drive right for me?

2015-05-20 Thread Bryn Hughes
On 2015-05-20 12:16 PM, Dimitri Maziuk wrote: > On 05/20/2015 01:09 PM, Bryn Hughes wrote: > >> What do you call it when multiple backup jobs are writing to disk >> storage while at the same time a copy job is reading from that same disk >> subsystem and writing to tape?

Re: [Bacula-users] Is Bacula and a LTO drive right for me?

2015-05-20 Thread Bryn Hughes
On 2015-05-20 10:10 AM, Dimitri Maziuk wrote: > Then why TF are you quoting lto sustained write to hdd random i/o? "Disk > subsystem can't keep up with modern tape" in the same way apples can't > keep up with oranges. Compare optimized sustained writes to optimized > sustained writes or random seek

Re: [Bacula-users] Is Bacula and a LTO drive right for me?

2015-05-20 Thread Bryn Hughes
On 2015-05-19 10:43 AM, Dimitri Maziuk wrote: > On 05/19/2015 11:42 AM, Bryn Hughes wrote: > ... >> recent LTO versions (5/6) you really need to make sure your disk setup >> on your backup storage server is capable of keeping up with the tape >> drive - most consumer hard

Re: [Bacula-users] Is Bacula and a LTO drive right for me?

2015-05-19 Thread Bryn Hughes
On 2015-05-17 02:48 AM, Florian Rist wrote: > >> So you will need more than one tape for a full backup and this will >> need >> manual intervention for changing tapes. > Yes, I know, as long as this is supported (and as far as I can see it > is) by Bracula that's fin. I remember it was difficult us

Re: [Bacula-users] Same job started twice

2015-05-13 Thread Bryn Hughes
itten:0 (0 B) Rate:0.0 KB/s Volume name(s): Volume Session Id:0 Volume Session Time:0 Last Volume Bytes:0 (0 B) SD Errors:0 SD termination status: Termination:*** Copying Error *** *From:*Bryn Hughes [mailto:li...@nashira.ca] *Sent:* 30 April 2015 15:07 *To:* bacula-users@lists.sourceforge.ne

Re: [Bacula-users] "Locking" previous backups to prevent pruning

2015-05-11 Thread Bryn Hughes
bus so to speak. Bryn On 2015-05-11 05:15 AM, Ana Emília M. Arruda wrote: Hello Bryn, Do you mean to prevent pruning of volumes? If this is the case, you can update volumes status to archive. Best regards, Ana On Sat, May 9, 2015 at 4:39 PM, Bryn Hughes <mailto:li...@nashira.ca>&

[Bacula-users] "Locking" previous backups to prevent pruning

2015-05-09 Thread Bryn Hughes
I have a server that recently suffered a double disk failure. Rather than rebuilding we've reassigned its duties to other machines. I'd however like to prevent Bacula from expiring the last full+incrementals from it until I'm REALLY sure we've gotten everything we need. Is there a way to do th

Re: [Bacula-users] Same job started twice

2015-04-30 Thread Bryn Hughes
These directives might also be useful to you: Allow Duplicate Jobs = no Cancel Lower Level Duplicates = yes Cancel Queued Duplicates = yes Bryn On 2015-04-30 02:57 AM, Luc Van der Veken wrote: So simple that I’m a bit embarrassed: a Maximum Concurrent Jobs setting in the Job resource i

Re: [Bacula-users] HP 1/8 G2 LTO6 Ultrium 6250 SAS autoloader

2015-04-29 Thread Bryn Hughes
On 2015-04-29 07:56 AM, Michael Ivanov wrote: > Hallo, > > Does anybody use HP 1/8 G2 LTO6 Ultrium 6250 SAS autoloader device with > bacula? > We've been offered to buy this model but regrettab ly I couldn't find any > bacula compatibility statement about it. > > Best regards, Bacula is compatibl

Re: [Bacula-users] bacula-users replyTo address

2015-04-08 Thread Bryn Hughes
On 2015-04-08 07:44 AM, Dimitri Maziuk wrote: > On 2015-04-08 06:24, Robert Oschwald wrote: > >> Is it possible for the admins to set the reply-to address to the >> list-address so replies are posted to the list instead of the author? > TFRFC (5322) says > > The originator fields also provide

Re: [Bacula-users] Verify disk volumes

2015-04-03 Thread Bryn Hughes
Also worth mentioning... what version of Bacula are you using? I was seeing 'corrupted' disk volumes fairly frequently. I have ZFS as the underlying storage; there's no way the data was getting corrupted on disk, it was something Bacula was doing internally before writing it out. I upgraded

Re: [Bacula-users] Reserving devices for pools

2015-04-02 Thread Bryn Hughes
On 2015-04-02 10:50 AM, Heitor Faria wrote: >> I have a tape library with several LTO5 tape drives. I have 3 tape pools and >> a scratch pool. Pool1 is quite large and has most of the jobs. The jobs >> are in a fairly standard, monthly FULL, weekly DIFFERENTIAL, and daily >> INCREMENTAL schedule

Re: [Bacula-users] bacula doesn't write on the whole tape

2015-03-26 Thread Bryn Hughes
On 2015-03-26 08:26 AM, Markus Rosjat wrote: > Hi there, > > I know this question was asked befor and maybe it will be again in the > future but I'm kinda frustrated with it. > We have a LTO-3 hp tapeloader and suddenly our jobs began to randomly > mark tapes as full even the tape was writen with h

Re: [Bacula-users] Bacula newbie has some questions.

2015-03-16 Thread Bryn Hughes
7.x works just fine. There's not really any technical reason that it isn't in the distros yet, more just that nobody working with the various distros has taken the time to package it and put it in their repositories. I was able to build it quite easily myself, there's several features that ar

Re: [Bacula-users] IBM TS3100 Missing I/O Station

2015-03-13 Thread Bryn Hughes
Hi Wayne, I have an IBM 24 slot library as well which I had a similar issue on. The cause is that the I/O station is listed differently than the rest of the slots by the mt command. I had to tweak the mtx-changer script slightly to recognize my I/O station as a slot. It's because of the pa

Re: [Bacula-users] Job batches

2015-03-03 Thread Bryn Hughes
On 2015-03-03 07:01 AM, Luc Van der Veken wrote: If jobs are added in two batches at different times, does the oldest batch have to be completely finished before the newer one is started? My backups are made fd -> file (disk) store -> copy to tape (an old LTO2 drive). One client is huge co

Re: [Bacula-users] Help with monitoring/tunning Bacula v5.2.5

2015-02-19 Thread Bryn Hughes
Guessing those 3.4M files are mostly small files? They are likely scattered across the disk. Are you backing up to a disk destination, or to tape? From your verbiage I'm guessing to disk... Have you tried looking at iostat on the source server when a backup is running? I would not at all be

Re: [Bacula-users] bacula splitting big jobs in to two

2015-02-09 Thread Bryn Hughes
I'm in a somewhat similar boat, I don't have 70TB, but I do have 21.5TB and LTO3 equipment (max 80 MB/sec). If it were possible to keep a tape drive streaming constantly without ever having to change tapes or unloading it would still take me many days to finish. The easiest way to start splitt

Re: [Bacula-users] Bacula OCFS2 FileSystem Support

2015-02-04 Thread Bryn Hughes
Support in what regard? If you can see the files at the OS level then Bacula will back them up. I'm not particularly familiar with OCFS2 in terms of how it handles its metadata; anything that follows the 'normal' POSIX rules will be maintained. If OCFS2 is doing anything like custom ACLs or o

Re: [Bacula-users] Should I have a server in every location?

2015-01-26 Thread Bryn Hughes
You should have a storage server in each location for sure. You COULD run a single director but it would make more sense to run a director at each location, at least in my mind. You'll need Bacula v7.0 or later to get this all working properly, but what you'd do: - Run your regular backups

Re: [Bacula-users] Bacula daemon message

2015-01-17 Thread Bryn Hughes
Are you SURE there isn't anything like a crontab somewhere that someone set up? This very very very very much has to be something that is being either typed in to bconsole or executed via a script somewhere. It isn't something Bacula is doing on its own. Bryn On 2015-01-17 10:54 AM, Polcari

Re: [Bacula-users] Upgrade question.

2015-01-13 Thread Bryn Hughes
On 2015-01-08 03:22 PM, Erik P. Olsen wrote: > I am planning to upgrade bacula from 5.2.13 to 7.0.5. I will back-up the > current > catalogue, remove 5.2.13, install 7.0.5, copy the conf files from 5.2.13 to > 7.0.5, restore the catalogue and start bacula again. > > Is that feasible? > > I also ha

Re: [Bacula-users] Bacula backup obsessed with a specific tape

2015-01-06 Thread Bryn Hughes
On 2015-01-06 10:21 AM, philhu wrote: > No > > All tapes are physically labelled with barcodes as well as labelled by Bacula > and shown as status=append and used on tape 64,512, and in same pool. > > It would be helpful if you could show the output of 'list volumes' as your initial description o

Re: [Bacula-users] Problems with Tape.

2014-12-23 Thread Bryn Hughes
EXTREMELY unlikely that it is cable related - those errors would show up in dmesg as SCSI/SAS/FC/whatever errors, not as tape drive hardware errors. All of those transports have their own error detection/correction; the drive will never get a corrupted signal from the HBA or vice versa. Very m

Re: [Bacula-users] Dell powerVault 124T tape library

2014-12-04 Thread Bryn Hughes
On 2014-12-04 07:33 AM, Ian Lord wrote: Hi, We are looking for a solution to backup freebsd machine with large ZFS pools (8TB) We thought of purchasing a tape library with LTO6 drives which will gives us 40TB of Retention Everyone seems to indicate bacula as a good solution but when I loo

Re: [Bacula-users] Windows File Daemon maximum speed at 36 MByte/s

2014-12-01 Thread Bryn Hughes
On 2014-11-29 02:43 AM, Patrick wrote: > Hi Josh, > > Thanks for your reply. > >> You can try to isolate the problem. Try running a Windows backup with >> VSS, compression, and encryption all turned off. Compare a Windows VM >> against a Linux VM on the same host if possible. > I don’t use compress

Re: [Bacula-users] LTO-6 - tape cleaning frequency

2014-11-10 Thread Bryn Hughes
On 2014-11-10 07:32 AM, John Drescher wrote: >> How often does your LTO-6 tape drive need to be cleaned? >> >> I ask because a recent post mentioned every 10 tapes. With my limited tape >> knowledge, that seems rather high, but I have no LTO experience. > > That seems excessive to me although I a

Re: [Bacula-users] large jobs that fail

2014-11-07 Thread Bryn Hughes
On 2014-11-07 04:40 AM, Jeff MacDonald wrote: > Lets say you are doing a 500 gig job and it fails after 450 gigs.. and you > are using disk based backups. > > Do you ever bother to try to reclaim that space? I mean I delete the job, so > the volume can have that data recycled when the time comes,

Re: [Bacula-users] LTO speed optimisation

2014-11-05 Thread Bryn Hughes
Hi Ben, To start with I would watch the server using iostat and top to make sure you aren't running out of CPU and that you really aren't maxing out your disks during your backup. In particular pay attention to the '%util' - I like to run 'iostat -kx 2' which will show the stats every 2 secon

Re: [Bacula-users] Job transfer rate

2014-10-30 Thread Bryn Hughes
On 14-10-30 08:27 AM, Jeff MacDonald wrote: >> On Oct 30, 2014, at 12:17 PM, Bryn Hughes wrote: >> The job report rate will be the final average rate of the job, it doesn't >> know/specify the difference between the 'input' rate and the 'output' rate.

Re: [Bacula-users] Job transfer rate

2014-10-30 Thread Bryn Hughes
On 14-10-30 07:50 AM, Jeff MacDonald wrote: Tips/Suggestions? Jeff. What is the content of your backups? Some things (ie thousands of tiny files) will cause a lot of seeks on the machine to be backed up. If you aren't using attribute spooling then each backed up file also causes a record t

Re: [Bacula-users] Job transfer rate

2014-10-30 Thread Bryn Hughes
On 14-10-30 06:27 AM, Jeff MacDonald wrote: > Hi, > > I have some backups going at 2MB/s which for a 380gig backup is just too > slow. I’m trying to find my bottleneck. > > Some questions: > > - Is the rate of the backup only shown in “messages” or is it stored in the > db anywhere. Or could I ju

Re: [Bacula-users] [7.0.5] Option to start spooling before volume mount?

2014-10-27 Thread Bryn Hughes
On 14-10-26 09:28 AM, Harald Schmalzbauer wrote: > Bezüglich John Lockard's Nachricht vom 26.10.2014 15:34 (localtime): >> I run into this issue with several of my servers and dealt with it by >> creating "migrate" jobs. First job goes to disk. Second job runs >> some reasonable time later and

Re: [Bacula-users] Configuration reload for bacula-sd

2014-10-24 Thread Bryn Hughes
On 14-10-24 09:32 AM, Alan Brown wrote: > (Why would you want to disable a drive? If it's offline because it > failed its cleaning cycle, as a f'instance) So what you need is a feature request to be able to disable a drive via bconsole Not to be able to dynamically reload the SD configuration

Re: [Bacula-users] Configuration reload for bacula-sd

2014-10-24 Thread Bryn Hughes
On 14-10-24 06:26 AM, Andrea Carpani wrote: On 24/10/2014 14:55, Bryn Hughes wrote: On 14-10-24 05:28 AM, Andrea Carpani wrote: On 24/10/2014 12:47, Kern Sibbald wrote: No, the SD and the FD cannot be reloaded. On the FD in principle it would be easy, but on the SD, it would be complicated

Re: [Bacula-users] Configuration reload for bacula-sd

2014-10-24 Thread Bryn Hughes
On 14-10-24 05:28 AM, Andrea Carpani wrote: On 24/10/2014 12:47, Kern Sibbald wrote: No, the SD and the FD cannot be reloaded. On the FD in principle it would be easy, but on the SD, it would be complicated if drives changed. What would you do with Jobs that are using a drive that would be rem

Re: [Bacula-users] sg device node stickyness

2014-10-22 Thread Bryn Hughes
On 14-10-22 01:24 AM, Robert Oschwald wrote: > Using Bacula Server 7.0.4 on CentOS6_64. > > One thing which annoys me is that the sg device node for TapeAlert changes > with every reboot from /dev/sg4 to /dev/sg6 and vice versa. > Is there any setting I can set in udev to get sticky device nodes f

Re: [Bacula-users] very long "Dir inserting Attributes"

2014-10-20 Thread Bryn Hughes
You have a very large number of jobs all trying to do inserts into the database at once. What you are probably hitting is the limit of the number of transactions/second that your database server can sustain - most likely you are I/O bound at the disk level. All of those 'inserting attribute' j

Re: [Bacula-users] Forcing baccula to purge/recycle a tape instead of appending?!

2014-10-15 Thread Bryn Hughes
month's pool as well. Bryn On 14-10-15 09:58 AM, Bryn Hughes wrote: > There are a couple of things you can do in combination to get the result > you want... > > First off, in your pool set a 'volume use duration' - this will restrict > how long a time span of data can exi

Re: [Bacula-users] Forcing baccula to purge/recycle a tape instead of appending?!

2014-10-15 Thread Bryn Hughes
There are a couple of things you can do in combination to get the result you want... First off, in your pool set a 'volume use duration' - this will restrict how long a time span of data can exist on a tape. For instance in your case you could set the volume use duration to 32 days, this would

Re: [Bacula-users] Recover full backup from the incrementals

2014-10-15 Thread Bryn Hughes
Really it would come down to what files you needed to restore... If the files you need are all in the incremental then Bacula will restore them without touching the full backup at all. If you need to restore a full filesystem including files that will not have changed since the last full, you

Re: [Bacula-users] Communication issues with 7.0.5

2014-10-07 Thread Bryn Hughes
> The 5.2 install used packages from > https://repos.fedorapeople.org/repos/slaanesh/bacula/epel-6/x86_64/, so > your mileage may vary depending on where your 5.2 came from. > > > On 2014-10-08 09:19, Bryn Hughes wrote: >> I tried initially with my 5.x config. I then re-wrote

Re: [Bacula-users] Communication issues with 7.0.5

2014-10-07 Thread Bryn Hughes
t; >> Bryn >> >> On 14-10-07 12:01 PM, Jonathan Bayer wrote: >>> This happened to me the other day. >>> >>> Make sure that ALL the bacula processes are stopped. My problem was >>> that one of them was continuing to hang around with the old config

Re: [Bacula-users] Communication issues with 7.0.5

2014-10-07 Thread Bryn Hughes
e sure that ALL the bacula processes are stopped. My problem was > that one of them was continuing to hang around with the old config. > Drove me up the wall until I figured it out. > > > JBB > > > On 10/7/14, 2:00 PM, Bryn Hughes wrote: >> I've been having some iss

[Bacula-users] Communication issues with 7.0.5

2014-10-07 Thread Bryn Hughes
I've been having some issues with my old 5.2.6 installation and I thought it would be a good idea to upgrade to a more recent Bacula version, so I downloaded v7.0.5 and also the 'debian' files to allow me to build packages. I'm using Ubuntu 12.04. I have not been able to get communication work