Re: [Bacula-users] Time for change

2008-12-10 Thread Alan Brown
On Tue, 9 Dec 2008, Jeff Kalchik wrote: > *NEVER* use software RAID if you can avoid it. Software RAID puts a > pretty good hit right on your CPU. That hasn't been true in Linux for a number of years. Given a "modern" machine (less than 2-5 years old) _and sufficient ram_, Linux software raid i

Re: [Bacula-users] Time for change

2008-12-10 Thread Alan Brown
On Tue, 9 Dec 2008, Lukasz Szybalski wrote: > I'm not sure about ubuntu, but if you are installing debian you can > setup raid right there, during installation. It was fairly easy. After > that bacula setup and you are ready to go. Ubuntu _is_ Debian, more or less. There's plenty of configurabil

Re: [Bacula-users] Time for change

2008-12-10 Thread Alan Brown
On Tue, 9 Dec 2008, Brian Debelius wrote: > John Drescher wrote: > > In linux, I find this to be completely wrong. I have 15TB of software > > raid 6 and the most load that it puts on the cpu is around 7% and > > these are raid arrays that net over 200MB/s writes on single core > > systems that ar

Re: [Bacula-users] Time for change

2008-12-17 Thread Alan Brown
On Wed, 10 Dec 2008, Josh Fisher wrote: > > I'm running spooling on a 4 drive software raid0 quite happily on a 4Gb > > 3GHz P4D machine. The limiting factors are disk head seek time(*) when > > running concurrent backups to 2 LTO2 drives and available SATA ports. > > Because of that I'm consideri

Re: [Bacula-users] Time for change

2008-12-17 Thread Alan Brown
Jesper Krogh wrote: >> I'm running spooling on a 4 drive software raid0 quite happily on a 4Gb >> 3GHz P4D machine. The limiting factors are disk head seek time(*) when >> running concurrent backups to 2 LTO2 drives and available SATA ports. >> Because of that I'm considering dropping in solid stat

Re: [Bacula-users] Time for change

2008-12-18 Thread Alan Brown
On Thu, 18 Dec 2008, Jesper Krogh wrote: > > 100-200Gb ram and systems capable of addressing that amount of memory are > > still far more expensive than a stack of flash drives, else I'd use them. > > But do you need to spool a complete tape? In order to avoid doing "evil" stuff > to you tape driv

Re: [Bacula-users] Tape library auto cleaning and Bacula

2008-12-18 Thread Alan Brown
On Thu, 18 Dec 2008, Win Htin wrote: > Hi folks, > > While Bacula backups are running, the library system (IBM TS3200) figures > one of the tape drives requires head cleaning and tries to load the cleaning > tape. Turn that feature off in the tape library's control panel. Bacula can't (currently

Re: [Bacula-users] Time for change

2008-12-19 Thread Alan Brown
On Thu, 18 Dec 2008, Jesper Krogh wrote: > > I'm multiplexing anything up to 20 jobs at a time. To ensure that small > > incremental and diff jobs are dumped in one hit and to ensure that full > > backups are laid in as large chunks as possible, this is the kindof size > > which is required. > > A

[Bacula-users] restores: replacement policy?

2009-01-07 Thread Alan Brown
How does bacula determine the ifolder/ifnewer part of replacements? Is it a matter of conparing the catalog with the restore area, or is it doing it on the fly as it reads each file off the backup volumes? -- Check

Re: [Bacula-users] Bacula is not recycling/pruning/purging automatically

2009-01-07 Thread Alan Brown
On Tue, 6 Jan 2009, Jonathan Larsen wrote: > Is there away to tell it to recycle regardless? That would help me better > determine which tapes i need to put into my autochanger. You can do it manually but I really recommend NOT doing this. I wrote a couple of "query" snippets to find tapes whic

Re: [Bacula-users] Rif: Re: LTO3 performance

2009-01-08 Thread Alan Brown
On Wed, 7 Jan 2009, Craig White wrote: > funny thing is that amanda developers are adamant that you disable > hardware compression and use software compression instead. Amanda devs are adament about a few things and aren't always correct Hardware compression on older technologies left a lot to b

Re: [Bacula-users] Rif: Re: LTO3 performance

2009-01-08 Thread Alan Brown
On Wed, 7 Jan 2009, T. Horsnell wrote: > It seemed to me that hardware compression could result in the tapedrive > mechanism not being fed data fast enough to keep it streaming at full speed, > since the records may be shortened by the compression process, whereupon > it would slow down a bit by

Re: [Bacula-users] Rif: Re: LTO3 performance

2009-01-08 Thread Alan Brown
On Wed, 7 Jan 2009, Chris Hoogendyk wrote: > Most backup software leaves the responsibility for planning more in the > sysadmin's hands. If the software is just writing data to the tape until > it hits the end of tape and then asking for another, hardware > compression is a logical choice. Part o

Re: [Bacula-users] Rif: Re: LTO3 performance

2009-01-08 Thread Alan Brown
On Wed, 7 Jan 2009, John Drescher wrote: > Do they even say this for LTO4? I mean I have not seen a CPU can > compress any where near 120MB/s. I was about to suggest a CUDA setup, but they're only really suitable for massive or embarrassingly parallel setups, not high speed single threading stuff

Re: [Bacula-users] Rif: Re: LTO3 performance

2009-01-09 Thread Alan Brown
On Thu, 8 Jan 2009, Chris Hoogendyk wrote: > In other words the length entered in the tapetype definition is only > used for planning and scheduling. The "error" will normally be the end > of tape "error", which allows for a variable amount of data actually > being written to the tape, which would

Re: [Bacula-users] Can bacula recognise newly added volumes while waiting for another volume?

2009-01-12 Thread Alan Brown
On Fri, 9 Jan 2009, Nils Blanck-Wehde wrote: > Hello everyone! > > Please excuse the crappy topic, I couldn't think of a better one... The answer is "yes" - as long as you add them to the database and run "update slots" to ensure it knows they're in the changer (if applicable) AB ---

Re: [Bacula-users] Exclude file contents

2009-01-19 Thread Alan Brown
On Mon, 12 Jan 2009, Stefan Sorin Nicolin wrote: > I have yet another exclusive configuration need. I'd like to back up a > file _without_ it's contents. I noticed that under Gentoo Linux /dev/ > tty12 takes a lot of useless space. Why are you backing up /dev/ at all? Isn't it a devfs on Gentoo?

Re: [Bacula-users] Volume Relabelling

2009-01-19 Thread Alan Brown
On Mon, 12 Jan 2009, Pasi Kärkkäinen wrote: > > Can a (disk) volume be automatically relabelled when it is recycled? > > > > I don't think that's supported atm.. > > I'd like to have that feature too. It shouldn't be too hard to implement.. A recycled volume is still only a candidate for being wr

Re: [Bacula-users] products based on bacula

2009-01-20 Thread Alan Brown
On Mon, 19 Jan 2009, Mag Gam wrote: > "It comes in the night and sucks the essence from your computers." > > My manager would freak if she sees this... Given that packages with equivalent functionality to Bacula run to at least $30k, why would she freak? --

Re: [Bacula-users] Mixed Drives

2009-01-23 Thread Alan Brown
On Wed, 21 Jan 2009, Ryan Novosielski wrote: > Media type is completely arbitrary. If you want the new drive to be able > to share media with the old drive, you should use the same media type. > If not, you should have them be different. It would be best if you could > make a supported media type

Re: [Bacula-users] New volumes put into "Full" status in succession from single backup

2009-01-23 Thread Alan Brown
On Thu, 22 Jan 2009, Win Htin wrote: > Problem resolved. The FC switch was acting up and due to that, the tape > backups went crazy while doing FC path failover. Replaced the switch and > everything is back to normal. Thanks! What model/firmware revision is the switch? --

Re: [Bacula-users] Configuration reload for bacula-sd

2014-10-24 Thread Alan Brown
On 24/10/14 13:55, Bryn Hughes wrote: > > Things would get really messy really fast, with practically no benefit. > Your SD config likely changes what, once or twice per year? If that? If you have a large setup like ours, it changes regularly. Simply enabling/disabling individual drives within a

Re: [Bacula-users] Configuration reload for bacula-sd

2014-10-24 Thread Alan Brown
On 24/10/14 18:02, Bryn Hughes wrote: > On 14-10-24 09:32 AM, Alan Brown wrote: >> (Why would you want to disable a drive? If it's offline because it >> failed its cleaning cycle, as a f'instance) > So what you need is a feature request to be able to disable a drive v

Re: [Bacula-users] Configuration reload for bacula-sd

2014-10-27 Thread Alan Brown
On 24/10/14 23:27, Ana Emília M. Arruda wrote: > Maybe this could be usefull. But I'm still trying to understand why are > you using disk drives directly in archive device configuration. We don't. We use tape drives. > I also think that backup software cannot be aware of hardware faliures. I _st

Re: [Bacula-users] Configuration reload for bacula-sd

2014-10-28 Thread Alan Brown
On 28/10/14 12:46, Ana Emília M. Arruda wrote: > ​You have autochangers resources (fisical for tape librareis and virtual > for disks) in Bacula. They are a "pool of drives" to be used by your > jobs. I still think about having jobs and pools associated with clients > instead of devices associated

Re: [Bacula-users] Configuration reload for bacula-sd

2014-10-28 Thread Alan Brown
On 28/10/14 14:59, Dmitri Maziuk wrote: > OT comment: I'll probably never understand that, I always thought a > block device is a block device and one of the unix's strong points was > to abstract away the physical differences and let the same code work > with either. Block devices may be block d

Re: [Bacula-users] Configuration reload for bacula-sd

2014-10-28 Thread Alan Brown
On 28/10/14 18:39, Dimitri Maziuk wrote: > There is no reason to see file volumes as dedicated to a client AFAICT; Habit, I suspect. It's a bad one, given there's a database driving everything to tell you what is where. > (As an aside, bacula, specifically, seems to force you to use different >

Re: [Bacula-users] Bacula and SL3000

2015-02-23 Thread Alan Brown
On 23/02/15 09:45, Alfonso Agrafojo wrote: > Good morning, > > We would like to start to use Bacula 7 (probably in a CentOS or > RedHat 6.x server) with an Oracle Storedge Tek SL3000 library but we > do not know if this tape library is compatible with Bacula software. > Could anybody help us with

Re: [Bacula-users] STK SL-3000 experiences

2015-03-09 Thread Alan Brown
On 05/03/15 09:25, tonyalbers wrote: > Now I just need to find out if we can also use the T1D drives we're > considering.. As Simone said: "As long as it's recognized by the system as a tape device/library it is supported by Bacula." Bacula uses standard interfaces, so as long as a tape d

Re: [Bacula-users] Howto remove clients permanently and completely from backup ?

2015-03-31 Thread Alan Brown
On 31/03/15 14:48, Robert Heinzmann wrote: > Hello, > > how can I remove clients and the jobs / volumes etc. from Bacula, once > the client is gone ? > > If I remove the client from the config file, it will not be removed from > catalog. See the purge command > Also if no job is running anymore,

Re: [Bacula-users] Bacula Amazon S3 off-site Backups

2015-05-18 Thread Alan Brown
On 17/05/15 02:22, Ana Emília M. Arruda wrote: > ​I'm aware of a case ​of Bacula working with an Amazon VTL service. We > are having occasional drive timeout issues. IMHO this is causing some > issues with tapes being unloaded to different slots than that they were > originally. If this is the ca

Re: [Bacula-users] Slow Attribute spooling

2015-06-08 Thread Alan Brown
On 08/06/15 10:39, Denis Witt wrote: > Not only that I wasn't able, yet, to get multiple FDs writing Spool-Data > at the same time, my Backup take several hours longer than before, as > Attribute Spooling is very slow. What are you using for spool disk? If it's not fast SSD then you can't run mo

Re: [Bacula-users] Slow Attribute spooling

2015-06-08 Thread Alan Brown
On 08/06/15 11:25, Denis Witt wrote: > On the SD there are about no IO-Operations. iotop shows some 100KB > once in a while. CPU is 100% idle, same on the Director. OK, I missed you were despooling attributes. > The MySQL-Machine writes more or less constant 450KB/sec. to disk > (mysql process).

Re: [Bacula-users] Slow Attribute spooling

2015-06-08 Thread Alan Brown
On 08/06/15 15:58, Dimitri Maziuk wrote: > On 2015-06-08 05:25, Denis Witt wrote: > >> I'm using normal (7.200 RPM) HDDs. But, as pointed out in >> my mail, there is only one job running ("despooling Attributes") at the >> moment. All other jobs are still waiting for execution ("waiting on >> max s

Re: [Bacula-users] Slow Attribute spooling

2015-06-09 Thread Alan Brown
On 08/06/15 21:17, Dimitri Maziuk wrote: > On 06/08/2015 02:52 PM, Denis Witt wrote: > >> Database is about 2.5Gb. Is there an easy way to convert my Catalog to >> use Postgres? > > If you comment out RunAfterJob in BackupCatalog job def you'll get > /var/spool/bacula/bacula.sql. That should be dir

Re: [Bacula-users] Slow Attribute spooling

2015-06-09 Thread Alan Brown
On 08/06/15 20:52, Denis Witt wrote: >> You should consider converting to Postgresql if MySQL has grown >> past about 6-10Gb footprint. > > Database is about 2.5Gb. Is there an easy way to convert my Catalog to > use Postgres? mysqldump in compatible mode and then import into postgresql. --

Re: [Bacula-users] Bacula causing high disk-io on clients

2015-06-25 Thread Alan Brown
On 25/06/15 12:11, SPQR wrote: > I mentioned, that bacula-client causes a high disk-io on the systems, which > are handled on daily backup tasks. Um What did you expect from something which is spinning through every directory and file on the disk? > Is it possible to use something like io

Re: [Bacula-users] Bacula causing high disk-io on clients

2015-06-25 Thread Alan Brown
On 25/06/15 12:46, SPQR wrote: > Hi Alan, > > Wow, this was really fast :-) Thanks for your answer. > > of course I know, that this is a io-consuming-process, but the load is really > too high. Other tasks that are done by the system (log rotation, ...) are not > working correctly and once the se

Re: [Bacula-users] Multiple full backups in same month

2015-06-25 Thread Alan Brown
On 25/06/15 13:21, Silver Salonen wrote: >> But why it upgraded the other incrementals in the queue if the first >> incremental was upgraded to full? Because the algorithm is broken. It should only make that decision when the job exits the queue. I filed a bug against this a long time ago, It s

Re: [Bacula-users] Bacula causing high disk-io on clients

2015-06-25 Thread Alan Brown
On 25/06/15 13:47, SPQR wrote: > Hello again, > > at the moment I'm using compression = gzip; how can I change the level of > compression? > > Can I just write compression = lzo without any problems? Yes, but. If you reduce the compression level then the disk will be hit harder, which means

Re: [Bacula-users] Bacula causing high disk-io on clients

2015-06-27 Thread Alan Brown
On 27/06/15 10:45, Dmitri Maziuk wrote: > Compressing data on the client means fewer bytes to send over the > wire. Block-level compression like bzip2 tends to be completely > cpu-bound and anything bigger than a cellphone tends to have plenty of > cycles to spare. Not entirely true and certainly

Re: [Bacula-users] Migrating from MySQL to Postgres

2015-07-04 Thread Alan Brown
On 04/07/15 13:09, Jari Fredriksson wrote: > > On 29.6.2015 16.47, tballin wrote: >> Hi >> >> I try to migrate from am mysql db to postgres. I am failing to import >> thy mysql dump into the postrgres : >> (according to these instructions: >> http://www.bacula.org/7.0.x-manuals/en/main/Installing_C

Re: [Bacula-users] Activating LTO-4 Compression

2015-07-08 Thread Alan Brown
On 08/07/15 15:03, John Drescher wrote: > Is your dataset already compressed (zip, mp3, mpeg, jpeg ...)? Do you > have bacula software compression enabled? > > How large are the files that bacula is writing to the tape? The default is small, which leads to high overheads. Consider increasing it t

Re: [Bacula-users] Max Wait Time setting

2015-07-09 Thread Alan Brown
On 09/07/15 03:06, Ana Emília M. Arruda wrote: > Hello Brendan, > > If you're working with tape libraries, I would recomend you to slightly > increase this value. There are three device directives (maximum > open/rewind/changer wait) that defaults to 600 seconds. So maybe you're > not giving enough

Re: [Bacula-users] 7.2 mysql issue?

2015-10-14 Thread Alan Brown
On 14/10/15 10:49, Uwe Schuerkamp wrote: > > you might also try giving MariaDB a shot which has been performing > fine as a drop-in mysql replacement for us for the last few years with > catalogs of similar size. > Speaking as a mysql affectionado and one who's using both DBs regularly in various

Re: [Bacula-users] 350TB backup

2015-10-19 Thread Alan Brown
On 19/10/15 22:08, Dimitri Maziuk wrote: > On 10/19/2015 03:53 PM, Thing wrote: >> Hi, >> >> Is anyone backing total volumes of this order? and if so, what sort of >> scaling, design, hardware? > I take it, that's the size of your filesystems? Not the estimated size > of the backup set (i.e. all c

Re: [Bacula-users] Typical tape write performance

2015-11-30 Thread Alan Brown
On 30/11/15 15:32, Christoph Litauer wrote: > Andrew, > > many thanks for this hint. I installed the IBM driver and found the tape > drive testing tool itdt, too. > Now, using itdt and the new driver there is an improvement: > LTO6: 158 MB/s without compression, 177MB/s with compression > LTO4: 27

Re: [Bacula-users] Typical tape write performance

2015-11-30 Thread Alan Brown
e there are SSDs and suddenly discovered a lot more IO performance than we were getting up to now. >> Am 30.11.2015 um 17:00 schrieb Alan Brown : >> >> On 30/11/15 15:32, Christoph Litauer wrote: >>> Andrew, >>> >>> many thanks for this hint. I install

Re: [Bacula-users] Typical tape write performance

2015-11-30 Thread Alan Brown
The claims were made in the context of "discouraging" the use of the mount flag and no mention was made that they were silently ignoring the thing if it was set anyway. As a result of this discovery I've added fstrim crontabs everywhere there are SSDs and suddenly discov

Re: [Bacula-users] Typical tape write performance

2015-12-02 Thread Alan Brown
>> For LTO, the Spool disk MUST be at least least one SSD, preferably a stripe of them on as fast a controller as you can afford. Standard disks simply can't keep up with tape drives. > I had not considered that. In my case, I backup to local HDD (ZFS array) for long term storage. Right after thos

Re: [Bacula-users] Typical tape write performance

2015-12-02 Thread Alan Brown
On 02/12/15 12:14, Paul Elliott wrote: >> Maximum block size = 2M > > Have you experienced any issues with that block size? Only when the drives/tapes are dirty and then you get excess errors on all block sizes anyway. Because entire blocks are rewritten if there is an error, "tape waste"

Re: [Bacula-users] Bacula 7.2.0 hangs with "Device doing acquire"

2015-12-08 Thread Alan Brown
On 08/12/15 16:40, Heitor Faria wrote: >> I'll look into their usage further, in the meantime it would be nice >> if bacula wouldn't lock up for days using the "acquire" dance ;) You have to know why it's locked that way and that means turning up the debug levels/looking at logs. > Sorry Uwe: n

Re: [Bacula-users] Bacula 7.2.0 hangs with "Device doing acquire"

2015-12-08 Thread Alan Brown
On 08/12/15 14:36, Heitor Faria wrote: > > Uwe: if your tape library has a bar code header please use that for your own > benefit. You can generate your own labels using some online free web services. You can generate bar codes which most readers are happy with using a Dymo or Brother laminated

Re: [Bacula-users] Bacula backup speed

2015-12-15 Thread Alan Brown
On 14/12/15 22:19, Lewis, Dave wrote: > We are running MySQL, and the database is on the same server as the director. > The disk that the database is on is a 7200 RPM, 3 Gb/s SATA disk. What size is your database? ("select count(*) from File;") What write speeds are you actually achieving to the

Re: [Bacula-users] Bacula backup speed

2015-12-15 Thread Alan Brown
On 15/12/15 13:20, Heitor Faria wrote: > Suggestion: http://bacula.us/tuning/ Whilst that page is a good starting point, a couple of points are flat out wrong: EG: setting maximum block size in tapes - DON'T SET THIS - EVER (unless the driver manufacturer advises it) Compression should only _

Re: [Bacula-users] Bacula massive security impact on network

2015-12-18 Thread Alan Brown
tl;dr: RTFM Bacula Enterprise has full restricted-user controls, if desired. ie: User X can only access a subset of backups, user Y can only access a different subset. That's also there in community version 7.2 - see section 20.4 of the main reference manual. HOWEVER: In a network with "hundr

Re: [Bacula-users] Fwd: Re: Bacula massive security impact on network

2015-12-18 Thread Alan Brown
On 18/12/15 18:01, H. Steuer wrote: > > In fact the whole discussion breaks down to a very simple question: > / > //Is the director password thats stored in the file daemon > configuration on a client machine the same password that gains me > administrative access to the director using bconsole./ >

Re: [Bacula-users] Volumes are not being recycled?

2016-02-18 Thread Alan Brown
Add the attached queries to query.sql They are postgresql-specific and may not work first time on Mysql (but they started out as mysql queries) I have a few ancilliary (nasty, horrible spaghetti code) bash scripts which will load/unload a changer from/to the magazine/IOslots(*) and to tell op

Re: [Bacula-users] [MTX Tape Changer] Error While Unloading Tape from Drive

2016-02-18 Thread Alan Brown
On 18/02/16 07:48, Kern Sibbald wrote: > I can imagine several possible problems: So can I. Under normal circumstances this error is what you see if a physical tape library is not ready or offline. I submitted some patches to Baculasystems for the mtx-changer script a few months back which test

Re: [Bacula-users] Hardware Specs & Sizing for Bacula?

2016-02-19 Thread Alan Brown
On 19/02/16 18:12, paul.hutchings wrote: We're new to Bacula and are still considering if it's viable for us. Our test environment is quite small (it is a test environment) and when I read the docs I'm not sure how recent they are when they relate to hardware specs. For example if I were to su

Re: [Bacula-users] Hardware Specs & Sizing for Bacula?

2016-02-19 Thread Alan Brown
On 19/02/16 19:10, paul.hutchings wrote: > Alan thanks, I omitted that we have a Spectra LTO6 library which would > be SAS attached to the server in question but I didn't mention it as > my initial query was more about the hardware specs. It all ties together. > > The rough plan would be D2D2T an

Re: [Bacula-users] Hardware Specs & Sizing for Bacula?

2016-02-21 Thread Alan Brown
On 20/02/16 09:46, paul.hutchings wrote: > Wow that's quite a guide - appreciate that :) > > I have to say that so far I've been very impressed with Bacula, my > biggest struggle has been finding the time to dedicate to it, and not > trying to do everything using the product we currently use as a >

Re: [Bacula-users] [MTX Tape Changer] Error While Unloading Tape from Drive

2016-02-22 Thread Alan Brown
;t see ready/not ready results with that tool) > Best regards, > Kern > > On 02/18/2016 11:08 PM, Alan Brown wrote: >> On 18/02/16 07:48, Kern Sibbald wrote: >>> I can imagine several possible problems: >> >> So can I. Under normal circumstances this error i

Re: [Bacula-users] Bacula LTO3 error

2016-03-04 Thread Alan Brown
On 04/03/16 13:06, mauser1 wrote: > root@house:~# mt -f /dev/st0 status > SCSI 2 tape drive: > File number=-1, block number=-1, partition=0. > Tape block size 0 bytes. Density code 0x0 (default). > Soft error count since last status=0 > General status bits on (5): > DR_OPEN IM_REP_EN try "mt

Re: [Bacula-users] Bacula LTO3 error

2016-03-04 Thread Alan Brown
On 04/03/16 15:16, mauser1 wrote: > root@house:~# mtx status > cannot open SCSI device '/dev/changer' - No such file or directory > > root@house:~# tapeinfo -f /dev/changer > cannot open SCSI device '/dev/changer' - No such file or directory > > root@house:~# loaderinfo -f /dev/changer > cannot ope

Re: [Bacula-users] Copy disk to tape is 4x slower than tar

2016-03-11 Thread Alan Brown
On 11/03/16 20:14, Simon Templar wrote: > In my case using spooling didn’t prevent shoe-shining; it just > introduced long pauses while data was spooled. I think all this means > is that I can read from my data sources faster than my tape can write. Unless you are using DAT, do not use mechanical

Re: [Bacula-users] Copy disk to tape is 4x slower than tar

2016-03-14 Thread Alan Brown
On 13/03/16 21:48, Dan Langille wrote: >> As well as increasing max file size you need to boost the tape buffer size >> from the 64kB default. I use 2MB > This is a hardware setting? No, it's a bacula-sd setting > I tried Minimum block size & Maximum block size on my tape drive, but need to > t

Re: [Bacula-users] Copy disk to tape is 4x slower than tar

2016-03-18 Thread Alan Brown
On 12/03/16 00:14, Heitor Faria wrote: > >> SSD is the only way to fly. After having tested with a PCIe NVMe drive, I'd >> say >> that's preferred, but a _fast_ SATA2/3 or SAS2 drive will work too (The old >> spool was a stripe of Intel SLC SSDs, the new one is a DC3700 card) > I never got this sp

[Bacula-users] tape migration (within a pool)

2016-04-13 Thread Alan Brown
For various reasons I've ended up with a large number of tapes that only have a few GB on them (tape drive issues caused by a contaminated tape(*)) and this is burning up pool spares. I want to migrate the files on those tapes to newer tapes within the same pool, then recyle the original tapes

Re: [Bacula-users] tape migration (within a pool)

2016-04-15 Thread Alan Brown
On 14/04/16 14:32, Heitor Faria wrote: >>> >>> Hello, Alan. Migrate and copy jobs support a Selection Type = Volume, that >>> combines with the Selection Pattern directive, that receives a RegExp for >>> the Volume names you want to migrate. >> Are you sure that does what Alan wants? I think migra

Re: [Bacula-users] Backing Up A Large Disk

2016-04-15 Thread Alan Brown
On 15/04/16 15:05, Daniel Davidson wrote: > I am trying to back up a large disk that is greater than the size of > the disk that I save my data to (eventually it gets migrated to tape). Back it up in smaller chunks.

Re: [Bacula-users] LTO-7 tape drive settings in bacula 7.4.0

2016-05-27 Thread Alan Brown
To rule out a bad tape: Before removing the tape from the drive use smartctl -A /dev/sg(generic of drive) to count the corrected errors You can do this whilst the tape is being written to. If the numbers are increasing rapidly, either the tape or the drive is dirty. If it keeps occuring on oth

Re: [Bacula-users] Bacula Webmin module will not start

2016-07-27 Thread Alan Brown
On 27/07/16 15:39, Phil Stracchino wrote: > >> I strongly recommend you to move to MySQL or Postgresql. Please let us >> know if you really need SQLite. I would say that SQLite in Bacula is >> almost "deprecated". > "Almost"? I thought SQLite support had already been removed, or at > least was unm

Re: [Bacula-users] Bacula Version 5.2.6 Stuck on "Ready to read from volume"

2016-08-02 Thread Alan Brown
On 02/08/16 09:51, Kern Sibbald wrote: > Hello, > > Four points: > > 1. Bacula version 5.2.6 is *very* old. It was released 17 February 2012. By > any standards that is *very* old. Of course, you are probably running the > version released by Ubuntu -- too bad. I know this is not helpful, but y

Re: [Bacula-users] Bacula defaulting to SQLite

2016-08-17 Thread Alan Brown
On 17/08/16 00:32, Heitor Faria wrote: > > apt-get update > apt-get -y mysql-server > apt-get -y install bacula-director-mysql bacula-sd-mysql bacula-fd > bacula-console postfix mt-st mtx If you have a tape drive, I'd _strongly_ urge installing sg3-utils and sg3-utils-udev If you don't have thes

Re: [Bacula-users] CPU load of "pigz"

2016-11-09 Thread Alan Brown
On 09/11/16 14:17, Ralf Brinkmann wrote: > I just checked the use of the multicore compression program "gzip" on > one file-daemon side. It did use 32 cores out of 48 possible. > > I think even for LTO tape drives the use of a multicore compression tool > could be a win on time and storage space. B

Re: [Bacula-users] SCSI Errors in LTO External Drive

2016-11-11 Thread Alan Brown
On 10/11/16 08:33, Alberto Brosich wrote: > Hi, > > my experience. > I had strange scsi errors. > Finally, after months of investigation and headache, I moved the scsi > controller to another pci slot and then worked all fine. This happens depressingly regularly if there are PCI bridges involved

Re: [Bacula-users] Pruning is taking too long; downside of force update status to recycle.

2016-12-09 Thread Alan Brown
On 07/12/16 12:44, Martin Simmons wrote: > The output shows that Bacula repeatedly tried to prune the same volume and > apparently failed to recycle it, which suggests that there were still jobs > associated with it somehow (or the catalog was already in a broken state). Assuming the catalog isn't

Re: [Bacula-users] Pruning is taking too long; downside of force update status to recycle.

2016-12-12 Thread Alan Brown
On 09/12/16 21:12, Josip Deanovic wrote: > > Good point. > When did you start to use SSD drives for spooling in your setups? About 7 years ago (Intel X25E) > I believe the SSD still suffer from faster wear effect when compared to > the classic rotational disks although they have improved on that

Re: [Bacula-users] {SPAM?} ULTRIUM-HH6 Block Size Limits with Adaptec 78165 or Other Issue?

2016-12-22 Thread Alan Brown
On 22/12/16 14:31, Drew Von Spreecken wrote: > Greetings, > > I have run into an issue and am looking for input. I have a SAS tape > autoloader with an IBM HH-LTO6 drive running the newest firmware. > It is currently connected to a Adaptec 78165 HBA/Raid controller via SAS. The maximum block size

Re: [Bacula-users] {SPAM?} Re: {SPAM?} ULTRIUM-HH6 Block Size Limits with Adaptec 78165 or Other Issue?

2016-12-23 Thread Alan Brown
he more I write this the more I am convincing myself it probably has > nothing to do with Bacula (rip-off version) or the configuration. I > was just hoping someone has run into something similar before. > > Regards, > > drewv > > > > On 12/22/2016 11:15 AM, Alan Brow

Re: [Bacula-users] Tape full before it should.

2017-01-09 Thread Alan Brown
On 09/01/17 13:45, Kern Sibbald wrote: Hello, The status Bacula received was -1, which means that the tape drive reported a hardware end of tape (i.e. an end of tape marker was seen. This can happen for the following reasons: 1. You reached the hardware end of tape marker at 150GB, but the

Re: [Bacula-users] How to fix Bacula after tape autoloader dysfunction?

2017-01-09 Thread Alan Brown
On 09/01/17 14:47, Charles wrote: > > Hello bacula-users :-) > > Are any tools available to mend Bacula after almost certainly spurious > errors reported by a tape autoloader? > > Within a few minutes of Bacula starting to use an autoloader which had > been subject to an abrupt power outage, the au

Re: [Bacula-users] How to fix Bacula after tape autoloader dysfunction?

2017-01-10 Thread Alan Brown
On 10/01/17 06:04, Charles wrote: > > Have modified /etc/init.d/bacula-sd (Debian Jessie), adding mt rewoffl > and > mtx unload commands immediately before bacula-sd is started. > That should do the trick, although I'd add mt unlock to make absolutely sure. >> ... >> Other than that: update vol

Re: [Bacula-users] bacula-sd file storage question

2017-01-10 Thread Alan Brown
On 09/01/17 23:01, Dimitri Maziuk wrote: > > What are you trying to achieve? I agree that "virtual autochanger" is a > mind boggle with no obvious practical use, but why are you looking at it > in the first place? The primary advantage of the virtual autochanger is you can more easily use removab

Re: [Bacula-users] How to fix Bacula after tape autoloader dysfunction?

2017-01-11 Thread Alan Brown
On 11/01/17 05:16, Charles wrote: > > According to both the man pages and experimentation, Debian Jessie's > mt and mtx do not support an unlock command. Whilst other debian versions do # mt --version mt-st v. 1.3 default tape device: '/dev/tape' lock (SCSI tapes) Lock the tape drive d

Re: [Bacula-users] correct strategy for mysql innodb and myisam backup

2017-01-12 Thread Alan Brown
On 12/01/17 14:14, Josip Deanovic wrote: > So if one is for some reason locked to specific old version of a > specific old proprietary application one can't do much than continue > with the MyISAM as innodb is not an option and external search engines > are not supported either. I've had to deal w

Re: [Bacula-users] Tape full before it should.

2017-01-19 Thread Alan Brown
On Mon, Jan 9, 2017 at 11:04 PM, Alan Brown mailto:a...@mssl.ucl.ac.uk>> wrote: On 09/01/17 13:45, Kern Sibbald wrote: Hello, The status Bacula received was -1, which means that the tape drive reported a hardware end of tape (i.e. an end of tape

Re: [Bacula-users] btape multivolume fill test fails on 7.4.4 but succeeds on 5.2.13

2017-01-27 Thread Alan Brown
On 27/01/17 00:36, Caribe Schreiber wrote: > Hi all, > > I'm hoping someone can help point me in the right direction to get the > btape multivolume fill test to work under bacula-7.4.4. You can't. It's broken. It was fixed recently but that fix hasn't rolled into the public release stream yet (a

Re: [Bacula-users] Dell TL1000 IBM3850-HH7

2017-03-18 Thread Alan Brown
On 18/03/17 07:41, Kern Sibbald wrote: > Hello Jim, > > I am checking with a tape drive "expert" perhaps he has some ideas. My > problem is time, not money. I'm no expert, just someone who's had to debug things :) Thankfully all ultrium(LTO) drives behave the same no matter who they're made by

Re: [Bacula-users] Dell TL1000 IBM3850-HH7

2017-03-21 Thread Alan Brown
On 19/03/17 17:02, Jim Richardson wrote: >I am not interested in the IBM driver if I can get the ST to work. I can understand why, but There would be significant advantage in using the IBMtape driver over the generic ST driver if Bacula could be modified to handle its oddity on forwar

Re: [Bacula-users] Fwd: Re: Bandwidth in Bacula (slow rate)

2017-03-22 Thread Alan Brown
FWIW: There is virtually no benefit in network compression for link speeds of 1Gb/s or faster. It's a net benefit on WAN links or on 100Mb/s networks, but I found it had a tendency to slow things down (and use a lot of CPU!) on 1Gb/s networks vs letting the networking traffic run uncompress

Re: [Bacula-users] Dell TL1000 IBM3850-HH7

2017-03-31 Thread Alan Brown
e move to a solution >> that everyone can make work. Unless Bacula's Team officially >> supports it, I won't force it :) > I agree, but it's in everyone's interest for Bacula to support the driver. (Think of it like mysql vs postgres support, etc) > Good

Re: [Bacula-users] Optimize Mysql

2017-06-01 Thread Alan Brown
On 01/06/17 14:49, Petar Kozić wrote: Yes, how to use ? dbcheck checks the integrity of the databases, not the tuning of them. With regard to tuning of mysql - bear in mind that I'm saying this from the point of view of having spent years doing exactly that for Bacula. DON'T DO IT. I

Re: [Bacula-users] Bacula LTO-5

2017-06-01 Thread Alan Brown
On 01/06/17 15:02, Steven Hammond wrote: Oh, should I do hardware compression or software compression? Reason I ask, I tried just hardware but didn't seem to get much out of the tape (1.7TB). However, with client side compression, my file server was compressed nearly 80+%. I assume the LTO-5

Re: [Bacula-users] Configuring autochanger with SAS LTO-5 drives

2017-06-05 Thread Alan Brown
On 05/06/17 11:57, Cejka Rudolf wrote: Hi, I do use 16 GB. Every EOF mark means around 3 seconds delay. So if you have over 200 files on the tape using 8 GB, it is around 10 minutes extra per tape. Hi, small fix. It seems that it is even around 5-6 seconds delay resulting in extra 20 minutes p

Re: [Bacula-users] Configuring autochanger with SAS LTO-5 drives

2017-06-08 Thread Alan Brown
On 05/06/17 15:48, Alan Brown wrote: IMHO: The best thing to do with LTO is use the largest block size bacula will accept and a file size of 16GB or larger - and make sure your (ssd) spool is large enough to avoid filling it up. Don't forget: If you alter the block size, you MUST clos

[Bacula-users] LTO tape users beware: Use of MAXELL media harmful to your drives.

2017-10-02 Thread Alan Brown
(I've been working on this issue for several years. The industry has not been overly cooperative and I thank HPE for finally admitting issues) If you have MAXELL LTO media, you should discontinue use of it ASAP. (NB: MAXELL no longer produce LTO media of any kind and stopped doing so about 2 y

Re: [Bacula-users] 300k+ orphaned file and path records

2017-10-16 Thread Alan Brown
On 16/10/17 16:01, Adam Weremczuk wrote: Hi Radoslaw, Our Bacula db is now over 13GB in size and I feel at least half of it is junk. Most likely it also suffers a performance penalty. Switch to postgresql asap. You will breathe a LOT easier once you've done that. MySQL is good at what it

Re: [Bacula-users] 300k+ orphaned file and path records

2017-10-17 Thread Alan Brown
On 17/10/17 08:27, Adam Weremczuk wrote: > On 16/10/2017 16:23, Alan Brown wrote: >> >> use the dbcheck utility to cleanup the database. That's what it's >> there for (make sure nothing else is running!) > > Hi Alan, > > I have no problem being patient

<    4   5   6   7   8   9   10   11   12   >