[Bacula-users] TAPE backups

2017-10-21 Thread Alan Brown
Straw poll time for people using tape-based systems I'd like to know who is currently using what (not historical usage) 1:   Who on this list is NOT using half inch tape (12.7mm) formats(*) - if so, what are you using? 2:   Who on this list is NOT using a robot or changer device? 3:  For t

Re: [Bacula-users] Issue restoring from multiple tapes

2017-10-28 Thread Alan Brown
On 28/10/17 18:16, Kern Sibbald wrote: > > Hello Bill, > > By the way, I have just committed another patch for the problem of > marking all volumes read-only.  If you have time please test the > latest code in the repo, I think it should correct the last note you > put into your bug #2329. > > The

Re: [Bacula-users] Feature Request - job complete status of with warnings on zero files zero bytes

2017-11-13 Thread Alan Brown
On 11/11/17 17:26, Kern Sibbald wrote: Yes, that is one of the reasons why I am not very enthusiastic about it because it will require yet another directive :-( Kern, please clarify: If a backup is 0bytes/0files, does anything actually get written to storage (tape or disk), or is it just a da

Re: [Bacula-users] LTO-7 library question (planning purchase)

2017-11-30 Thread Alan Brown
On 30/11/17 15:13, itlinux_igtp wrote: Dear List, We've been using Bacula with a quantum i80 dual drive LTO-5 library for a while now, and it has been working great since we deployed a bit more than three years ago. I have to thank the developers for creating and releasing such a great tool.

Re: [Bacula-users] LTO-7 library question (planning purchase)

2017-11-30 Thread Alan Brown
capacity though is tempting. Regards, Iñaki On 11/30/2017 05:06 PM, Alan Brown wrote: On 30/11/17 15:13, itlinux_igtp wrote: Dear List, We've been using Bacula with a quantum i80 dual drive LTO-5 library for a while now, and it has been working great since we deployed a bit more than t

Re: [Bacula-users] convincing Bacula to use a different tape than it requested

2017-12-15 Thread Alan Brown
On 15/12/17 15:07, Tilman Schmidt wrote: On my server I see tapes staying in the "Used" status long after their retention has expired. Correct. Retention is the _minimum_ period before the tape can be marked for reuse Only when Bacula needs a tape *and* it cannot find one with status "Appen

Re: [Bacula-users] Autochanger best practicies

2018-01-11 Thread Alan Brown
On 11/01/18 13:53, krashoverr...@free.fr wrote: Yeah, i've just read Gary and Ralf tips, thanks to all of you. I'm sad to hear SQLite is depreciated, as it's still available in packages list. It was only ever intended that SQlite be used for testing purposes, not production systems We star

Re: [Bacula-users] Autochanger best practicies

2018-01-11 Thread Alan Brown
On 11/01/18 13:20, krashoverr...@free.fr wrote: Iñaki, Thank you for this. indeed, i've had this problem. Gonna use your script! If you have udev there's no need to do this look in /dev/tape/by-id/ I have taken this a little further with an extra udev rule that creates /dev/tape/by-id/{DRI

Re: [Bacula-users] Bytes/block=64,512 for an LT04

2018-01-31 Thread Alan Brown
On 31/01/18 10:14, Ben Laurie wrote: > I also have that on my LTO3 drive. You should test this using the fill command in btape (which will test with uncompressible data). if the block size is set correctly you're going to achieve very close to the published throughput. Please note that 250MB/s fo

Re: [Bacula-users] Problems getting a tape library to work under FreeBSD

2018-02-02 Thread Alan Brown
On 31/01/18 03:23, Kenneth Garges wrote: I’m having trouble getting a tape library to work. Individual tape drive seems ok but the library sometimes makes btape hang requiring a reboot. Or it fails. > # Define a Virtual autochanger Remove anything you're not actually using. They're just go

Re: [Bacula-users] Problems getting a tape library to work under FreeBSD

2018-02-06 Thread Alan Brown
On 03/02/18 13:45, Dan Langille wrote: *ahem* MTX is _only_ designed to interface to scsi generic devices. Unless /dev/pass42 is another name for the generic device you'll have problems. Can confirm /dev/pass* devices on FreeBSD are the right thing to use. From https://dan.langille.org/2016/0

Re: [Bacula-users] Problems getting a tape library to work under FreeBSD

2018-02-06 Thread Alan Brown
On 07/02/18 02:01, Kenneth Garges wrote: > Permissions and ownership are ok. I think I figured out the problem. > > Both mtx and chio would work for a while, then stop working returning only > “Inappropriate ioctl for device” or other errors. The culprit I think is a > library management tool by

Re: [Bacula-users] Problems getting a tape library to work under FreeBSD

2018-02-07 Thread Alan Brown
On 07/02/18 02:50, Alan Brown wrote: I also submitted some chages to the mtx-changer script a while ago which check that the changer's actually ready before attempting to send it commands. Kern's been sitting on them for a couple of years. @ -82,6 +66,7 @@ #$1

Re: [Bacula-users] Bacula marks tape full too soon

2018-02-07 Thread Alan Brown
On 07/02/18 09:16, Kern Sibbald wrote: Hello, On the software side, it is clear that the OS is sending back an EOT status. About the only other thing to check before looking at your tape wiring/controller ... is to be sure you have not put the tape drive into some unusual mode such as BSD mode.

Re: [Bacula-users] Bacula 7.4, 7, CentOS 7, and systemd - a cautionary tale

2018-05-15 Thread Alan Brown
hint: groups in the startup scripts On 15/05/18 22:09, Tom Plancon wrote: > > Hi folks, > > Just spent several frustrating hours trying to get some special backup > configs into my bacula-dir.conf file. I'd shut down the Director, > "sytemctl stop bacula-dir", edit the file, then start the Dire

Re: [Bacula-users] LTO-8/Scalar i3 support

2018-07-26 Thread Alan Brown
As long as your OS sees them, bacula sees them. What's your OS and what drivers are you using? NB: On linux you _must_ use the sg and st drivers. Stay away from the scsichanger and ibmtape drivers. On 26/07/18 14:18, Keenan McClure wrote: Hi! Does bacula 9.0.8 or 9.2.0 support the Quan

Re: [Bacula-users] tapes running out of space

2018-08-07 Thread Alan Brown
On 07/08/18 10:27, Kern Sibbald wrote: You definitely do not want to try to run any job that examines the tape.  First, I don't know if what you are asking is possible -- possibly on the more modern drives (LTO-6 or greater), but in any case, any time you move the tape, you wear it, so don't ma

Re: [Bacula-users] tapes running out of space

2018-08-07 Thread Alan Brown
y corrupted on load This refers to the directory of file locations in the memory chip (Which bacula doesn't use) and is fixed by recsanning the tape - something the drive usually does automatically. https://github.com/hreinecke/sg3_utils/issues/18 may be useful for anyone wanting to hac

Re: [Bacula-users] tapes running out of space

2018-08-07 Thread Alan Brown
On 07/08/18 13:04, Adam Weremczuk wrote: On 07/08/18 12:31, Alan Brown wrote: For LTO, there are a number of relatively easy ways of answering these questions _without_ moving the tape - as long as you have the latest version of sg3_utils installed Thank you Alan. The utilities look very

Re: [Bacula-users] tapes running out of space

2018-08-07 Thread Alan Brown
On 07/08/18 15:37, Adam Weremczuk wrote: My last concern is the level of additional wear of drive and tapes. Execution of sg_raw required the tape to be unmounted: /dev/nst0: Device or resource busy use the corresponding /dev/sg Which now needs to be re-mounted for the next backup run.

[Bacula-users] Migrate jobs: Major data loss risk (Bug, unfixed)

2019-01-14 Thread Alan Brown
If you are using Bacula for any form of archival work, or migrating OLD backups, then you need to be aware of of this issue. The Migrate feature only migrates jobs in a volume that are in the configuration file. What this means is that if you have jobs old jobs that are no longer backed up an

Re: [Bacula-users] IBM LTO-4 TS3200 Changer

2019-06-19 Thread Alan Brown
The st and sg drivers work fine on IBM LTO drives and robots (you need to remove lin_tape entirely) You need mt-st and mtx packages Yes, they're a bit clunky, but unless you're in a fabric you will be able to work with them without too many problems. HW that won't run EL7 must be seriously ol

Re: [Bacula-users] IBM LTO-4 TS3200 Changer

2019-06-19 Thread Alan Brown
On 19/06/2019 17:53, Jasen Lentz wrote: > Ok, got them installed and lin_tape completely removed. The drive is > /dev/st0 and the changer is /dev/sch0. I have a feeling I am close, but > missing something as it seems to not see the slots in my autoloader: Ignore /dev/sch0 - that's using the ch

Re: [Bacula-users] IBM LTO-4 TS3200 Changer

2019-06-19 Thread Alan Brown
On 19/06/2019 19:19, Jasen Lentz wrote: > Revised... > > [3:0:2:0]tapeIBM ULT3580-TD4 C7QH /dev/st0 /dev/sg47 > [3:0:2:1]mediumx IBM 3573-TL C.20 /dev/sch0 /dev/sg48 > > Use the sg names instead? > Yes. More specificially: bacula-sd.conf Autochanger { N

Re: [Bacula-users] [EXTERNAL] SAS HBA support on Linux

2019-10-21 Thread Alan Brown
On 21/10/2019 15:14, Clark, Patti via Bacula-users wrote: > Try the hardware compatibility list for the card on Redhat's website. Second > choice, the manufacturer's website. The issue is the driver. > > My question (rhetorical), why do you want to use an OS that is recently > released and stil

Re: [Bacula-users] [EXTERNAL] SAS HBA support on Linux

2019-10-21 Thread Alan Brown
On 21/10/2019 16:13, Dimitri Maziuk via Bacula-users wrote: > On 10/21/2019 9:14 AM, Clark, Patti via Bacula-users wrote: > ... >> My question (rhetorical), why do you want to use an OS that is >> recently released and still bleeding for a backup server?  I >> understand upgrade headaches, but ba

Re: [Bacula-users] Bar code labels suggestion

2020-03-05 Thread Alan Brown
We print our own using the excellent form generator at https://tapelabel.de/ If that website isn't in the Bacula FAQ, it SHOULD BE Caveats - and these have nothing to do with the form generator: 1: Proper LTO labels are ONLY available in US letter size (Avery 6571 or OL173) - anything else has

Re: [Bacula-users] New tape drive

2020-03-13 Thread Alan Brown
On 13/03/2020 14:51, Steven Hammond wrote: > Does anyone have recommendations for MAXIMUM BLOCK SIZE for a LTO-7 > tape drive (HP).  We are currently using 2M on the LTO-5 with success > (and it seemed to improve the speed).  I didn't know if there was a > better setting for the LTO-7 (e.g., 4M) th

Re: [Bacula-users] Tape issue: less size than before for LTO-4 tapes

2020-03-13 Thread Alan Brown
On 13/03/2020 12:37, Martin Simmons wrote: >> >> So it looks really there is really an issue on the drive 0 or the connection >> path. >> I will wait for the end of the both tests >> (btape on drive 1 and backup test on drive 0) > You could also try running the HP Library and Tape Tools: > > https

Re: [Bacula-users] Tape issue: less size than before for LTO-4 tapes

2020-03-15 Thread Alan Brown
On 15/03/2020 11:24, Pierre Bernhardt wrote: > >> I will now try to clean the drive with a fresh cleaning tape and use btape >> again for a test. I think I will not get big different result, but it's >> a try. > This does not has been helped. So I will disable the drive for write so only > the oth

[Bacula-users] Postgreql - partitioned tables?

2020-05-14 Thread Alan Brown
As we all know, Bacula's File table grows to stupidly large sizes. Postgresql has the ability to partition large tables to make management easier, either manually or with pg_partman https://www.postgresql.org/docs/12/ddl-partitioning.html https://www.postgresql.org/about/news/1964/ https://g

[Bacula-users] areas for improvement?

2020-05-27 Thread Alan Brown
I've been running Bacula for ~15 years (community/enterprise) and have identified a few areas which are in desperate of improvement: For an "enterprise" grade backup system, it's amazingly fragile in a few areas (particularly in actual Enterprise networks!) Bacula DOES NOT LIKE and does not han

Re: [Bacula-users] areas for improvement?

2020-05-27 Thread Alan Brown
On 27/05/2020 15:13, Gary R. Schmidt wrote: > On 27/05/2020 23:17, Alan Brown wrote: >> >> >> >> Bacula DOES NOT LIKE and does not handle network interruptions _at all_ >> if backups are in progress. This _will_ cause backups to abort - and >> th

Re: [Bacula-users] Problem with missing EOD/EOF on LTO-5 Tape

2021-02-24 Thread Alan Brown
Is the OP using lin_tape driver by any chance? On 24/02/2021 11:42, Martin Simmons wrote: > That is a strange error. ERR=Erfolg (Success) means that ioctl returned > non-zero but didn't set any errno. > > Is there anything logged in the syslog (e.g. /var/log/messages or the system > console)? >

Re: [Bacula-users] Problem with missing EOD/EOF on LTO-5 Tape

2021-02-26 Thread Alan Brown
On 25/02/2021 16:01, Christian Lehmann wrote: > Hi Alan, > > not sure how to answer your question as I do not understand it *sorry* > > How can I find out? > lsmod | grep st lsmod | grep lin These are kernel modules and they will not coexist in the same machine, you need to use one or the other

Re: [Bacula-users] Problem with missing EOD/EOF on LTO-5 Tape

2021-02-26 Thread Alan Brown
On 25/02/2021 16:15, Heitor Faria wrote: > Hello Christian, > Spool Directory = /srv/ag_dudziak/bacula-spool/LTO-5-1M Maximum Block Size = 128K Where is the "control device" parameter? Here's what an equivalent entry on my system Device { ### library physical position -1,1 ### This

Re: [Bacula-users] Problem with missing EOD/EOF on LTO-5 Tape

2021-02-26 Thread Alan Brown
On 26/02/2021 13:47, Martin Simmons wrote: > If you do: > > lsscsi -d > > then it will print the major:minor device numbers after /dev/st0. > > Then: > > ls -l /sys/dev/*/${major}:${minor}/device/driver/ > > might show the name of the driver (module). It's simpler than that: showing /dev/st* or ns

Re: [Bacula-users] Problem with missing EOD/EOF on LTO-5 Tape

2021-03-02 Thread Alan Brown
do you have any st options defined under /etc/modprobe.d/ ? On 02/03/2021 15:47, Christian Lehmann wrote: > Dear Martin, > > this actually did the trick. > > So I added > > "fast-eom=0" to the stinit.def > > and it works. > > But it is interesting as, for me, this looks like switiching off the

Re: [Bacula-users] Unable to Edit bacula-fd.conf and bat.conf on Windows 10 Machine

2021-03-04 Thread Alan Brown
On windows: make sure all the bacula programs are STOPPED before editing the files. Anything holding the file open will prevent edits being saved On 04/03/2021 13:27, Michael Plante wrote: > Why does Bacula store config files in "Program Files" anyway, other > than possibly legacy behavior tha

Re: [Bacula-users] Problem with missing EOD/EOF on LTO-5 Tape

2021-03-05 Thread Alan Brown
On 03/03/2021 10:42, Christian Lehmann wrote: > Dear Alan, > > no nothing defined under /etc/modprobe.d, but here is my stinit.def: > > > # This file contains example definitions for different kinds of tape > # devices. > # > # You can find some examples in /usr/share/doc/mt-st/examples. > # > # Co

Re: [Bacula-users] Someone is sending suspicious replies to posts

2021-03-17 Thread Alan Brown
On 17/03/2021 20:23, Heitor Faria wrote: > I've been in this list for maybe 10 years, never got such emails. someone on the list is using a compromised computer There are a number of pieces of malware which attempt to snarf addressbooks or use CC recipient lists to target the next victim ion th

[Bacula-users] migration between tape pools

2012-12-07 Thread Alan Brown
I need to migrate the entire content of one pool (LTO2) into a new pool (LTO5) Everything I've tried has resulted in "no files to transfer" Has anyone managed to sucessfully do this - and if so, how? -- LogMeIn Resc

Re: [Bacula-users] HEADS UP: FreeBSD changes...

2013-01-09 Thread Alan Brown
On 10/01/13 00:40, Dan Langille wrote: > Oh, it does that. I did not know. Question: What will happen upon > start up if that file does not exist? Nothing. It's only called when you run the "query" command and if query.sql is missing it just complains about it. --

Re: [Bacula-users] Bacula tapes marked FULL too early - VolBytes too low

2013-01-09 Thread Alan Brown
FWIW: I had similar problems with a large batch of LTO5 tapes recently. Discussion with the tech support guys at Overland brought out the information that sometimes they see this on new tapes due to dust contamination during assembly (or insufficient removal of loose particles during manufactur

Re: [Bacula-users] tapes randomly become unrecognizeable

2013-03-12 Thread Alan Brown
On 12/03/13 16:46, mark.berg...@uphs.upenn.edu wrote: > > In my experience, the readability of barcode labels is highly dependant on the > combination of the label and the barcode reader. > What brand/model libraries are you using? Overland (at least) are fairly immune to alignment/placement issu

Re: [Bacula-users] LTO TAPE NOT EJECTED

2013-08-06 Thread Alan Brown
On 05/08/13 14:08, david parada wrote: > Dear friends, > > I am experiencing a problem in one Bacula installation (5.2.12). After the > backup catalog task avery night (that it is made properly), when I try to > make a restore of a data in another tape, although Bacula is asking for me > the rig

Re: [Bacula-users] Is anyone using >128K blocks with LTO-4 or LTO-5 drives?

2013-09-20 Thread Alan Brown
On 20/09/13 13:22, Andreas Koch wrote: > > Many thanks for the data point! When we use Bacula (not just btape) with > larger block sizes (512 KB), our backups abort when bacula fails to read the > tape's header block. > Did you attempt to mix blocksizes on the same physical tape? That will not wo

Re: [Bacula-users] Is anyone using >128K blocks with LTO-4 or LTO-5 drives?

2013-09-20 Thread Alan Brown
On 20/09/13 15:03, Andreas Koch wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > Hi Alan, > > can you let me know what hardware (SAS Controller) and OS (kernel version) > you use? Everything is FC connected using QLA 2430-series controllers. When linux first connects to the drives it

Re: [Bacula-users] Slow backup, how to optimize ?

2013-09-23 Thread Alan Brown
On 23/09/13 07:47, bdelagree wrote: > Hello, > > This summer we invested in a PowerVault TL2000 library with two LTO5 drives > to safeguard our various servers. > > Today two of my servers take to save a lot because they contain many small > files for low volume (see the bottom of post) > All my

Re: [Bacula-users] How to perform Cleaning and Verify Job...???

2013-10-01 Thread Alan Brown
On 01/10/13 16:53, Deepak wrote: > Still looking for some resolution. It will be really helpful if > someone will give an idea about these tasks. Don't put cleaning tapes into LTO drives unless they specifically ask for them.

Re: [Bacula-users] Restoring files from a failed full job?

2013-10-09 Thread Alan Brown
On 09/10/13 10:01, Uwe Schuerkamp wrote: > Hi folks, > > one of our longer-running jobs broke yesterday after saving around 6TB > of data to lto4 tapes, the last 200G or so are probably missing. 6Tb on LTO4 Are you crazy? Break the job into smaller units! As far as bacula's concerned the job is

Re: [Bacula-users] Maximum Changer Wait directive

2014-04-01 Thread Alan Brown
On 01/04/14 18:23, Rao, Uthra R. (GSFC-672.0)[ADNET SYSTEMS INC] wrote: > I am running bacula 5.2.12 on RHEL6 O.S. with IBM TS3200 Tape Library > with two LTO5 drives. Sometimes the autochanger is unable to mount a > required tape as the tape gets stuck in its slot and needs manual > intervension.

Re: [Bacula-users] Maximum Changer Wait directive

2014-04-02 Thread Alan Brown
leds showing? > > Thanks, > Uthra > > > -Original Message- > From: Alan Brown [mailto:a...@mssl.ucl.ac.uk] > Sent: Tuesday, April 01, 2014 2:17 PM > To: Rao, Uthra R. (GSFC-672.0)[ADNET SYSTEMS INC]; > bacula-users@lists.sourceforge.net > Subject: Re: [Ba

Re: [Bacula-users] Maximum Changer Wait directive

2014-04-02 Thread Alan Brown
ppens. > > What shows on the library front panel? > -- "Media attention!" > > Thanks, > Uthra > > > -Original Message- > From: Alan Brown [mailto:a...@mssl.ucl.ac.uk > <mailto:a...@mssl.ucl.ac.uk>] > Sent

Re: [Bacula-users] Maximum Changer Wait directive

2014-04-02 Thread Alan Brown
exit 1; fi # now actually do what is intended to be done! export TA_OK=`cat $TAPEINFO_LOG | grep "TapeAlert: OK" -c` if [ $TA_OK != "1" ]; then # hmm. TapeInfo is not OK. Send an email! $MAIL_BIN -s "$SUBJE

Re: [Bacula-users] MySQL slowness when initializing new disk volume

2014-04-19 Thread Alan Brown
On 18/04/14 23:49, Lloyd Brown wrote: > Are the tables in MyISAM or InnoDB format? > At the moment, MyISAM. I'd wondered if I could safely convert to > InnoDB, since that's generally going to have better locking > characteristics, etc. It's easy enough to change, but How large are the tables?

Re: [Bacula-users] MySQL slowness when initializing new disk volume

2014-04-23 Thread Alan Brown
On 21/04/14 15:25, Lloyd Brown wrote: > Definitely more than I expected. Although, I have to say, RAM usage on > this host isn't really much of a concern. At the moment, the mysqld > process is only using just over 1GB of RAM, and this host has 128G. > Possibly I need to tune MySQL to keep more

Re: [Bacula-users] MySQL slowness when initializing new disk volume

2014-04-24 Thread Alan Brown
On 24/04/14 17:37, Lloyd Brown wrote: > Alan, > > I understand. I've been meaning to get started with learning Postgres > for several years, but there always seems to be something more urgent > that takes my attention away. If you're using RH/Debian/Ubuntu then you can get it running fairly quic

Re: [Bacula-users] rpm repo for CentOS 6 anyone?

2014-05-09 Thread Alan Brown
On 08/05/14 21:29, Dimitri Maziuk wrote: > On 05/08/2014 12:39 PM, compdoc wrote: >>> I just wanted to ask if "43 years" is a typo >> >> Cant imagine data being useful after that amount of time... > > Kids these days... How about data from NASA missions of the 1970's? > Remember when they were look

Re: [Bacula-users] LTO4 Tape End of Medium

2014-05-09 Thread Alan Brown
On 09/05/14 21:20, Clark, Patricia A. wrote: > It could be the drive and it could be the connection to the drive. It can also be a dirty drive. Cleaning tapes can only do so much. Is the cleaning light coming up? What level of error correction is showing in the drive when you query it with smart

Re: [Bacula-users] Reusing a disk volume

2014-05-16 Thread Alan Brown
Use a new volume every day, then cycle them. You won't use any more space, you're just using it differently. On 16/05/14 14:19, Thorsten Kampe wrote: > * John Drescher (Fri, 16 May 2014 09:08:40 -0400) > >>> Maybe use duration of 59 days. Then volume retention in a few hours. >>> If you set use

Re: [Bacula-users] Bareos

2014-05-23 Thread Alan Brown
On 23/05/14 16:41, Kern Sibbald wrote: > Hello Alain, > > I am in the final stages of preparing for a vacation beginning early > tomorrow, so I will get back to you on this next week when I am back. > Thanks for the references to the German legal cases, I will read them > all (really). > > One thin

Re: [Bacula-users] Backup on Tape

2014-08-05 Thread Alan Brown
On 04/08/14 18:54, Nick Allevato wrote: > LTO 2…slow? Slow, but not as slow as mechanical disk drives. What _seriously_ slows down backups is disk seeking (both on the client array and on the spool disks), and tape drive will slow to a crawl if not fed at near-full speed. If you're backing up

Re: [Bacula-users] Upgrade to 3.0.3 Job is waiting for execution

2009-11-17 Thread Alan Brown
On Tue, 17 Nov 2009, Giuseppe De Nicolo' wrote: > Hi All, > > Since the upgrade to 3.0.3 our test server have this strange > behavior , the first job after bacula start up runs fine all others get > in line as "job is waiting execution" and nothing happens, restarting > bacula reset job lists

Re: [Bacula-users] Comments about HP Ultrium Drive on Bacula

2009-11-18 Thread Alan Brown
On Wed, 18 Nov 2009, Joseph L. Casale wrote: > >We're thinking about buy a LTO Ultrium HP external drive. > > FWIW, I have had very bad luck w/ HP branded LTO's, for several years > they had low MTBF and not last long for me... Ditto on HP drives. HP LTO tapes seem to be pretty reliable. ---

Re: [Bacula-users] RFC: backing up hundreds of TB

2009-11-27 Thread Alan Brown
On Fri, 27 Nov 2009, Ralf Gross wrote: > Most files will be written once and maybe never been accessed again. But > the data need to be online and there is a requirement for backup and the > ability to restore deleted files (retention time can be different, going > from 6 months to a couple of yea

Re: [Bacula-users] HP MSL2024 Autochanger "ERR=Device or resource busy."

2010-01-07 Thread Alan Brown
Richard Scobie wrote: >> You probably need to add a wait in the mtx-changer script just after >> the load. This wait will make sure the tape is in the drive and has >> completed the loading process. For some systems the script does not >> wait long enough for the tape drive to finish. >> >> John >>

Re: [Bacula-users] Quantum Scalar i40 and second tape drive

2010-02-15 Thread Alan Brown
On Sat, 13 Feb 2010, Dan Langille wrote: > > Because since Baculas mtx-changer is using mtx, I think I am not able to > > use the second drive. > > 1 - I would start with the OS and talk to your OS's mailing list > regarding this. I don't think using chio or talking to the OS mailing list will he

Re: [Bacula-users] Cancelled job volume still showing "Full"

2010-02-15 Thread Alan Brown
Richard Scobie wrote: > Timo Neuvonen wrote: > >> Cancelling a job does not free the storage that the job occupied before it >> was cancelled. > > Thanks. I guess there is a reason for this but it seems counter > intuitive - I'd expect if something is cancelled, for all resources to > be freed.

[Bacula-users] migrating mysql to postfix.

2010-02-22 Thread Alan Brown
This is quite a bit more painful than it should be, due to the table/column names being different casing in the creation scripts. Mysql doesn't care about case. PostgreSQL DOES. As it stands, the information at http://www.bacula.org/manuals/en/catalog/catalog/Installi_Configur_PostgreS.html#1107

Re: [Bacula-users] Backing up > 100 servers

2010-03-01 Thread Alan Brown
>> We don't backup whole servers, there's no point. So, yes, 120 systems >> may seem like a lot, but for a lot of those, it will only be /etc, >> /opt, /root and perhaps the crontabs. > > Ah, that makes sense. I am using a similar minimal backup for some of my > remote Web servers (I am also bac

[Bacula-users] mysql-> postgres conversion. Problems...

2010-03-19 Thread Alan Brown
bacula 5.0.1, postgres 8.1 Any ideas why I'm getting this? 9-Mar 17:47 msslay-dir JobId 6: Fatal error: sql_create.c:875 Fill Filename table Query failed: INSERT INTO Filename (Name) SELECT a.Name FROM (SELECT DISTINCT Name FROM batch) as a WHERE NOT EXISTS (SELECT Name FROM Filename WHERE Nam

Re: [Bacula-users] mysql-> postgres conversion. Problems...

2010-03-21 Thread Alan Brown
On 21/03/10 20:43, Bruno Friedmann wrote: > On 03/19/2010 06:53 PM, Alan Brown wrote: > >> bacula 5.0.1, postgres 8.1 >> >> Any ideas why I'm getting this? >> >> 9-Mar 17:47 msslay-dir JobId 6: Fatal error: sql_create.c:875 Fill >> Filename

Re: [Bacula-users] restores not working

2010-03-23 Thread Alan Brown
Matija Nalis wrote: > It is probably not hung, but just very, very slow. Yes. You probably need a LOT more ram and to tune mysql's parameters. > We've had a same > issue, with about 500 million records in File (and about 120GB on > disk for File.ibd) on (mostly dedicated to mysql) machine (8gig

Re: [Bacula-users] Label Format = Week-$WeekNumber

2010-03-25 Thread Alan Brown
This comes up so frequently it should be a FAQ. Because Bacula (and other automated backup systems) reuse old volumes and keep track of stats for a tape volume on a long-term basis in order to detect when one may be failing, labelling by date is an INAPPROPRIATE METHOD. Stop trying to bring y

Re: [Bacula-users] PostgreSQL & dbcheck query

2010-03-29 Thread Alan Brown
On Fri, 26 Mar 2010, Xavier Romero wrote: > Hi all, > > I've detected serious problems on my PostgreSQL to manage following query > SELECT Filename.FilenameId,File.FilenameId FROM Filename LEFT OUTER JOIN File > ON (Filename.FilenameId=File.FilenameId) WHERE File.FilenameId IS NULL LIMIT > 3

Re: [Bacula-users] mysql-> postgres conversion. Problems...

2010-03-29 Thread Alan Brown
On Fri, 26 Mar 2010, Matija Nalis wrote: > have you perhaps succeded in transition from MySQL to PostgreSQL for > bacula ? Eventually... > An update to the documentation (or your explanation about problems > and what you did) would be greately appreciated, as we're also being > pinned down with

[Bacula-users] Bug: tapes not in autochanger being recycled.

2010-04-16 Thread Alan Brown
5.0.1 (x86_64, rhel5) http://bugs.bacula.org/view.php?id=1540 As far as I can tell Bacula is ignoring the InChanger status. Is anyone else seeing this? -- Download Intel® Parallel Studio Eval Try the new software too

Re: [Bacula-users] Hardware configuration and off-site backup

2010-05-04 Thread Alan Brown
On Tue, 4 May 2010, Thomas Mueller wrote: > IMHO the backup disks will not be the bottleneck if you go with SATA 7.2k > drives. but check the specs - i'm sure HP is providing performance data > somewhere on the homepage (or ask your dealer) IMHO it's unsafe to back up to a single disk (of any typ

[Bacula-users] 5.0.2 src rpm dependency bug?

2010-05-24 Thread Alan Brown
Scott et al, After building the 5.0.2 packages ()postgres flavour) and trying to install the client package, I got the following errors: Dependencies Resolved Package

Re: [Bacula-users] Does Bacula issue the Prevent Media Removal command?

2010-05-24 Thread Alan Brown
On Mon, 24 May 2010, Robert LeBlanc wrote: > I'm trying to track down the cause of tapes being stuck in our library at > random times. What is the make and model of your library, _and_ your tape drives? I get this semi-regularly here with HP LTO2 drives and MSL6000 changer (Overland Neo 4000) M

Re: [Bacula-users] LTO-4 Drive issues

2010-05-25 Thread Alan Brown
Morty Abzug wrote: > This sort of problem is typical of a speed/duplex mismatch. That is, > either your switch or your server is hardcoding the speed of your > network port, and the other end is using different settings. A lot of network admins still believe the best way to run a network is wit

Re: [Bacula-users] Hitachi Maxell demos 50TB capacity LTO-class tape

2010-05-25 Thread Alan Brown
Brian Debelius wrote: > http://www.theregister.co.uk/2010/05/24/hitach_maxell_perp_tape/ > > Hitachi Maxell has demonstrated a 50TB capacity LTO-class tape using > perpendicular magnetic recording technology. This is 400 per cent more > than the raw capacity of the highest-capacity tape on the

Re: [Bacula-users] LTO-4 Drive issues

2010-05-27 Thread Alan Brown
skipunk wrote: > Your right, your setting is close to mine. I would run 1 backup at a time if > I could pull the speeds that I get from a local backup, so currently I'll be > pushing more backup's at once until I can find the issues causing this. Using concurrent backups and spooling is a _big_

Re: [Bacula-users] 5.0.2 src rpm dependency bug?

2010-05-27 Thread Alan Brown
Martin Simmons wrote: > >> Why is there a postgres dependency in the client package? > > Is the dependency definitely coming from the client package and not > bacula-libs? It could be, but the client package depends on the libs package (why?) > There is a currently an interesting misfeature that

[Bacula-users] Status of rescue CD/USB project?

2010-05-28 Thread Alan Brown
Does anyone know what the current status of the recue CD/USB project is? The last updates seem to be a couple of years old. -- ___ Bacula-users mailing list Bacula-users@li

Re: [Bacula-users] wanted: DLT barcode labels

2010-06-02 Thread Alan Brown
Ralf Brinkmann wrote: > Print yor own barcode labels - e.g. on self-adhesive laser printer paper > - with an Excel sheet and a special free available Windows based true > type font. Avery make specific barcode label sheets (US Letter only) with polymer substrate rather than paper for DLT and L

Re: [Bacula-users] wanted: DLT barcode labels

2010-06-04 Thread Alan Brown
On Wed, 2 Jun 2010, John Drescher wrote: > I use a full sheet of label paper (still letter) and use a paper > cutter to cut out the individual labels. That works for DLT if light card is used, but LTO requires adhesive labels. > For LTO, I am using the script here: > > http://tapelabels.librelog

Re: [Bacula-users] postgres tuning?

2010-06-04 Thread Alan Brown
On Fri, 4 Jun 2010, Stephen Thompson wrote: > > > Correction: > I didn't notice the 8k per unit settings at first with postgres 8.1. > Should read: > effective_cache_size = 786432# 6Gb Assuming this is linux, you need to tweak /etc/sysctl/limits.conf a little: postgres softmemlock

Re: [Bacula-users] postgres tuning?

2010-06-07 Thread Alan Brown
to vacuum yet since >> it's a fresh import). >> >> Stephen >> >> On 06/04/2010 12:16 PM, Alan Brown wrote: >> >> >>> On Fri, 4 Jun 2010, Stephen Thompson wrote: >>> >>> >>> >>>> Correction:

Re: [Bacula-users] postgres tuning?

2010-06-07 Thread Alan Brown
On Mon, 7 Jun 2010, Julien Cigar wrote: > Stephen Thompson wrote: > >centos 5.5 (64bit) > >bacula 5.0.2 (64bit) > >postgresql 8.1.21 (64bit) > > Why 8.1 ..? 8.1 is more than 5 years old ... because that's what is supplied and supported by Redhat for their enterprise versions. Anythi

Re: [Bacula-users] postgres tuning?

2010-06-07 Thread Alan Brown
On 07/06/10 17:28, Stephen Thompson wrote: > > It doesn't sound like I'm doing anything egregiously wrong. > > I am still surprised at how slow postgres is compared to mysql on the > same hardware after all I've read and heard about postgres superiority. > One the scale you're using it should

Re: [Bacula-users] new server, old client ?

2010-06-08 Thread Alan Brown
Daniel Kamm wrote: > sofsof wrote: >> Hi, i would like to say if a 5.0.2 server is compatible with a 2.2 client ? > > Yes, you can use older bacula-fd with newer bacula-sd and bacula-dir. Older clients don't have all the features of the newer ones. In particular the "accurate" function won't wo

Re: [Bacula-users] unload tape error

2010-06-08 Thread Alan Brown
Jeremiah D. Jester wrote: > I'm having problems simply unloading a tape from my changer. Also, not sure > if the 'Hardware Error' is due to me addressing the device incorrectly or if > there is actually an issue. No more info found in the logs. Any ideas? > [r...@monk bacula]# mtx -f /dev/sg3 un

Re: [Bacula-users] 11TB backup run out of memory and dies

2010-06-14 Thread Alan Brown
On Fri, 11 Jun 2010, ekke85 wrote: > Thanks for the fast replies and sorry for my slow response. It seems my > spooling was not working right, but I have it working now. I am not sure > what uses the memory up, but here is my configs: How many files are in the 11Tb and why can't you break it into

Re: [Bacula-users] bare metal windows server 2003 restore

2010-06-14 Thread Alan Brown
On Sat, 12 Jun 2010, James Harper wrote: > You really need a windows live CD (eg bartpe) or else you won't get all > your NTFS ACL's and other stuff restored properly. Reminder to all: NTFS ACL and other filesystem semantics (but not structure) are based on VMS, not Unix. This is a direct result

Re: [Bacula-users] Using HP Storageworks 1/8 G2 with Bacula

2010-06-14 Thread Alan Brown
On Sat, 12 Jun 2010, Daniel Bareiro wrote: > This card uses the module 'cciss' which has been loaded by the kernel: AFAIK cciss only supports disks. -- ThinkGeek and WIRED's GeekDad team up for the Ultimate GeekDad F

Re: [Bacula-users] 11TB backup run out of memory and dies

2010-06-14 Thread Alan Brown
ekke85 wrote: > There is a lot of files that i need to backup. How many? how many are there already in the database? > The other problem that I think might cause it, is that some of the files is > 1.1TB on its own. Does anyone on the list know what bacula tries to do if a file being backed

Re: [Bacula-users] 11TB backup run out of memory and dies

2010-06-14 Thread Alan Brown
On 14/06/10 17:06, ekke85 wrote: > I have 710 files in that directory/nfs share/fileset. There is only > one or two files that is over 1TB, I might try to backup one of those > files on its own and see what it does. > >> how many are there already in the database? >> >> > I am no expert wit

Re: [Bacula-users] 11TB backup run out of memory and dies

2010-06-14 Thread Alan Brown
On 14/06/10 20:39, richard wrote: > For info: > > I do a weekly full backup of 11.5TB (1.5M files) on a very similarly > specced machine. There is no data spooling , (although attribute > spooling is used), - backup is directly off a local RAID5. > > bacula 5.0.2 linux x86_64. > How much ram/swa

<    5   6   7   8   9   10   11   12   >