Re: [Bacula-users] Unable to restore jobs created on one client, on another

2010-10-22 Thread Richard Scobie
Richard Scobie wrote: > Bacula 5.0.2 Linux. Summary: Backup of Box A was done to Storage Daemon backup1 Update slots performed after tape removal Tape was then moved to Storage Daemon flash Fatal errors when attempting to restore files and requested tape mounted: 21-Oct 12:01 library1-dir Jo

Re: [Bacula-users] Unable to restore jobs created on one client, on another

2010-10-20 Thread Richard Scobie
Dan Langille wrote: > Instead, what you're saying is: > > - backup of Box A was done to Storage Daemon backup1 > - tape was then moved to Storage Daemon flash Yes, sorry for the confusion. > Does the Director know that the tape has moved from one system to another? Only in the sense that once t

Re: [Bacula-users] Unable to restore jobs created on one client, on another

2010-10-20 Thread Richard Scobie
Dan Langille wrote: >> I don't understand here why it attempts to use "Drive-1", which is the >> drive on the creation host, backup1. > > My guess: because that's where the Catalog says is it? A "list media" for the Archive pool shows the "In changer" and "Slot" flag for AR0030L4 to be 0. Regar

[Bacula-users] Unable to restore jobs created on one client, on another

2010-10-20 Thread Richard Scobie
Bacula 5.0.2 Linux. I have a number of Jobs, written to LTO4 tape on a host, backup1, which I am trying to restore from with the tapes loaded in a host called flash. Director is running on host library1. These restores are failing with either an error: "RestoreFiles.2010-10-21_13.54.01_08

Re: [Bacula-users] Ideas for a backup strategy

2010-09-16 Thread Richard Scobie
David Noriega wrote: > Its an idea, but not what I asked. I would have gone with a completely > disked based backup, but that kind of hardware is expensive to do it > right. I asked about multiplexing. I figure I could take /home and My apologies, I distinctly thought you said "as much data as the

Re: [Bacula-users] Ideas for a backup strategy

2010-09-16 Thread Richard Scobie
David Noriega wrote: > both drives and 2) has as much data as these drives can take pouring > into them, since this is taking too long to do a backup. I've read a One solution to feed your drives at full speed, is to build a low cost server containing an array of SATA drives, sufficient to hold

Re: [Bacula-users] Autochanger weakness

2010-09-06 Thread Richard Scobie
Richard Scobie wrote: > Device status: > Device "FileStorage" (/mnt/exp1/bacula) is not open. > Device "flash_LTO-4" (/dev/nst0) is mounted with: > Volume: AR0030L4 > Pool:*unknown* > Media type: LTO-4 > Total Bytes R

Re: [Bacula-users] Autochanger weakness

2010-09-06 Thread Richard Scobie
Dan Langille wrote: >> Surely if a tape is mounted in a drive and the label is read, this >> should become the new location for this tape? > > Are you issuing a mount command after inserting the tape into the other drive? Yes and when the restore job is submitted, here are the results. Restore j

[Bacula-users] Autochanger weakness

2010-09-05 Thread Richard Scobie
Unless I have missed something, it appears that if you have an autochanger full of tapes and it becomes unavailable for whatever reason - say the PSU fails, there is no way of accessing the tapes in another drive, as the system thinks are still loaded in the library and will not allow a restore

[Bacula-users] Modifying tape location

2010-09-02 Thread Richard Scobie
I have a tape I am trying to restore from on a local LTO drive. It was created at a remote location, in a library which is no longer attached to the SD there and the "update slots" command was not done after this tape was removed, so the Director still sees the tape as residing in the remote li

Re: [Bacula-users] new bacula installation

2010-08-12 Thread Richard Scobie
Jeremiah D. Jester wrote: > I'm confused. The tapeinfo output for /dev/sg1 says it is a 'Tape Drive' and > of type 'TD4' or LT04, the new supported capacity. Sg0 is the hard drive. I > get no output for devices sg3-sg10. Please explain. What is the output of: cat /proc/scsi/sg/device_strs On

Re: [Bacula-users] Quantum Scalar i500 slow write speed

2010-08-09 Thread Richard Scobie
Paul Mather wrote: > By definition, random data are not compressible. It's my understanding that > the "compressed capacity" of tapes is based explicitly on an expected 2:1 > compression ratio for source data (and this is usually cited somewhere in the > small print). That is a reasonable est

Re: [Bacula-users] Label barcodes

2010-07-25 Thread Richard Scobie
John Drescher wrote: >> Also, in this scenario, are the tapes labeled in ascending slot order or >> ascending barcode order? > > The latter. Actually it is labeling them in slot order which is annoying. In future I will remember to load all the tapes with ascendinging barcode numbers in ascendi

[Bacula-users] Label barcodes

2010-07-25 Thread Richard Scobie
I have just added 10 unlabeled, barcoded tape to a library that contains 10 labeled, barcoded tapes. From the bat application, I have issued the following commands: update slots label barcodes At this point the bat console shows a list of the tapes that will be labelled, but this includes th

[Bacula-users] Extend Retention time

2010-07-18 Thread Richard Scobie
I have a weekly backup set which has a retention time of 13 days. I have just been asked to keep a set that was written 12 days ago. Can someone please tell me how I can extend the retention time for this job? Regards, Richard ---

Re: [Bacula-users] LTO-4 Drive issues

2010-05-24 Thread Richard Scobie
skipunk wrote: > > What would it take to clear up the network bottleneck. I was looking at > another server that came with our gaming system. Same server (memory, hd, > etc) and tape library, running on win2k3 and netbackup with no issues. The > only difference is, it's running 4 nic's. So it's

Re: [Bacula-users] LTO-4 Drive issues

2010-05-24 Thread Richard Scobie
skipunk wrote: > > After returning to my office this morning, I had found the server was > connected to a 10/100 switch. I had moved it to the rack and connected it to > the switch 10/100/1000 and nic 1 pulls 1000 on ethtools > nic 2 pulls 100 on ethtools. > > After futher investigation, it look

Re: [Bacula-users] LTO-4 Drive issues

2010-05-22 Thread Richard Scobie
skipunk wrote: > Status update. I just finished the first backup job which was 3.6 Gb. It > took 2.5 hours to run. avg speeds finished around 500k/s. > > I've gone as far again to reboot the library and the server and still no > changes. I'm not sure what i'm over looking. I have 1T of data t

Re: [Bacula-users] I need to buy a Tape Library

2010-05-17 Thread Richard Scobie
Simone Martina wrote: > Someone, from this ML, has bought a new tape library working with Linux > and mtx-changer? While not on the scale you require, I am having very good results with an HP MSL2024 with a single LTO-4 1840 drive fitted. I imagine the larger family members will be no different

Re: [Bacula-users] Restores via bat version browser very slow.

2010-05-12 Thread Richard Scobie
Gary R. Schmidt wrote: > I think I'll hold off updating for a bit longer. Sigh. I have just discovered the issue of bat being unusably slow restoring on 5.0.X is known about by the developers and is being worked on. Regards, Richard ---

Re: [Bacula-users] Restores via bat version browser very slow.

2010-05-12 Thread Richard Scobie
Gary R. Schmidt wrote: > I think I'll hold off updating for a bit longer. Sigh. Another bat bug I have just discovered going from 3.0.3 to 5.0.2, is mounting tapes in an autochanger from the command window: bat output in console pane: mount Select Storage resource (1-3): Automatically selecte

[Bacula-users] Restores via bat version browser very slow.

2010-05-11 Thread Richard Scobie
I installed 3.0.3 a month or so prior to 5.0.0 being released, with a view to using bat for restores, as it made life much easier for commandline-phobes, and it performed very well. It was then updated to 5.0.1 and restores of anything more than a handfull of files became unusably slow. I noted

Re: [Bacula-users] volume/file size and speed

2010-05-11 Thread Richard Scobie
Joseph Spenner wrote: > Ok, I just used bconsole and recovered a directory in little time at all. > So, bat is the problem. I can use bconsole instead. I might try to go back > to using 1TB files and see how it performs as well. > Thanks for the tip! I can confirm this and will post more ful

[Bacula-users] Restore not loading tape

2010-04-26 Thread Richard Scobie
Bacula 5.0.1 and an HP MSL2024 changer. The drive is empty and the tape I wish to restore from is resident in the library. After choosing some files to restore, I get the following: restore jobid="163" client="backup1-fd_arc" file="?restore_476707713_20" done 3 files selected to be restored.

Re: [Bacula-users] [Bacula-devel] Idea/suggestion for dedicated disk-based sd

2010-04-08 Thread Richard Scobie
Gary R. Schmidt wrote: > And using the 64-bit XFS will also better[1] than the standard 32-bit XFS. That would be using the "inode64" mount option. Regards, Richard -- Download IntelĀ® Parallel Studio Eval Try the new s

Re: [Bacula-users] [Bacula-devel] Idea/suggestion for dedicated disk-based sd

2010-04-08 Thread Richard Scobie
Craig Ringer wrote: > I'm interested in ext3, ext4 and xfs. I should probably look at zfs too, > but don't have any hosts that it runs on usefully and don't really have > any personal interest in it. You may find the XFS mount directive, "filestreams" of benefit here. There is not much documenta

Re: [Bacula-users] Idea/suggestion for dedicated disk-based sd

2010-04-07 Thread Richard Scobie
Phil Stracchino wrote: >> Most practical disk backup setups will involve large RAID-5, RAID-6 or >> RAID-10 arrays. These tend to be striped across the spindles anyway, and >> the file system is rarely properly aware of how this striping occurs. > > *nod* Indeed. Nor should it care, since for ge

Re: [Bacula-users] Possibility of parallelising encryption?

2010-04-07 Thread Richard Scobie
Craig Ringer wrote: Snip interesting crypto discussion... >> I'd use the hardware encryption (which presumably has no performance >> impact), that is an option on this autochanger, except they want $2500 >> for it... > > Probably because it has a custom ASIC for the crypto algorithm in use to > a

[Bacula-users] Possibility of parallelising encryption?

2010-03-28 Thread Richard Scobie
I have a 2.8GHz Core i7 machine backing up uncompressable data spooled onto an 8 drive RAID5, to LTO-4 tape. Our requirements now dictate that data encryption must be used on the tapes and having configured this, it seems that one core is saturated encrypting the data and the result is that tap

Re: [Bacula-users] Automatic labelling from barcodes ?

2010-03-18 Thread Richard Scobie
John Drescher wrote: > I think you can update slots with the single drive running jobs. You > can not label barcodes however. I can confirm this, as I did this a couple of days ago, although watch out for the size of the emailed job report, which for me was just under 4MB and contained thousand

Re: [Bacula-users] Bacula Enhancements Request

2010-03-16 Thread Richard Scobie
Bob Cousins wrote: > - Tape verification option -- verify that the bits read back from the > tape are the same as those originally written. Spooling to disk makes > this easier. Also, if a tape fails verification, it should be easy to > restart the write/verify cycle with new media. I used to do

Re: [Bacula-users] Cancelled job volume still showing "Full"

2010-02-15 Thread Richard Scobie
Alan Brown wrote: > As Timo said, in a tape, jobs may be interleaved. Because of that it's > dangerous to automatically purge one because of a job failure. That makes sense. > Note that if you delete the failed JobId from the database and that job > is the only one on the tape, it will free up f

Re: [Bacula-users] Cancelled job volume still showing "Full"

2010-02-15 Thread Richard Scobie
Timo Neuvonen wrote: > Cancelling a job does not free the storage that the job occupied before it > was cancelled. Thanks. I guess there is a reason for this but it seems counter intuitive - I'd expect if something is cancelled, for all resources to be freed. Regards, Richard ---

[Bacula-users] Cancelled job volume still showing "Full"

2010-02-15 Thread Richard Scobie
Is there an extra command that needs to be run, in order to free volume space after a job is cancelled? A job was started on an appendable LTO4 tape and for various reasons it was decided to cancel it after it reached the end and was requesting a new volume to be loaded. After the cancelation

Re: [Bacula-users] Write ordering?

2010-02-11 Thread Richard Scobie
Phil Stracchino wrote: > If that's a backup of a single host, that sounds ... bizarre. The only > explanation I can think of is that there's a directory tree sitting in > somewhere between those seven files in the directory, that contains a > vast quantity of data. If you look at your filesyste

[Bacula-users] Write ordering?

2010-02-11 Thread Richard Scobie
I am just testing bacula prior to deployment and restored 7 files from one directory from a backup of 3TB. This backup is stored on 3 LTO4 volumes and in order to restore these 7 files, it read from the first and third LTO4 volumes, when I would have expected them to all be adjacent to one anot

[Bacula-users] Conserving catalog space

2010-02-09 Thread Richard Scobie
Can someone please confirm or not, whether Catalog entries are duplicated when a job of type "Copy" is run, or do both the original and the copy share the same catalog data? Regards, Richard -- SOLARIS 10 is the OS for

Re: [Bacula-users] [Bacula-devel] bug in autolabel code in 5.0.0?

2010-02-04 Thread Richard Scobie
Bob Hetzel wrote: > The auto test passed, but I now cannot mount any tape from within > bacula, either completely new (i.e. unlabeled) or filled completely with > bacula backups. It always thinks the tape is not labeled, giving errors > like these: This is exactly what I was seeing and the proble

Re: [Bacula-users] [Bacula-devel] bug in autolabel code in 5.0.0?

2010-02-04 Thread Richard Scobie
Bob Hetzel wrote: > My next thought was to try use "tar" to read and write from a tape. That > works fine: I've been able to back up an entire directory and restore > files from it. I've also back up a single file and restored that file, > comparing it to the original file and no differences we

Re: [Bacula-users] [Bacula-devel] bug in autolabel code in 5.0.0?

2010-02-03 Thread Richard Scobie
Bob Hetzel wrote: > > Has anybody gotten 5.0.0 to label tapes properly? I upgraded to 5.0.0 a > couple days ago and backups worked that first night until they ran out of > appendable (i.e. already partially written) media. Since that point, I've > been completely stuck. Is bacula the only thing

Re: [Bacula-users] Questions about the Scratch pool directive

2010-02-03 Thread Richard Scobie
Robert Hartzell wrote: > What I didnt expect to happen is that if a volume is moved from the > scratch pool to another pool and then update volume from pool is run the > RecyclePool attribute is set to *None*. That seems to contradict the > above explanation unless that is what is meant by "modify

Re: [Bacula-users] Questions about the Scratch pool directive

2010-02-03 Thread Richard Scobie
Robert Hartzell wrote: > I know everything can be manually changed... Just trying to get a clear > understanding of what exactly happens to a volumes attributes as bacula > moves it in and out of the scratch pool. After filing the observed behaviour of a scratch volume not inheriting the "Recycl

Re: [Bacula-users] Questions about the Scratch pool directive

2010-02-02 Thread Richard Scobie
Robert Hartzell wrote: > Which says to me that RecyclePool should be defined in the scratch pool > and not the Full pool. I guess this would work if you never label media as anything other than Scratch. > Does this mean that the RecyclePool attribute is > attached to the volume when it's initia

Re: [Bacula-users] Questions about the Scratch pool directive

2010-02-02 Thread Richard Scobie
Richard Scobie wrote: > Robert Hartzell wrote: > >> hmmm... looks like I need to do some testing. Do you have any volumes >> that have been recycled and moved back to the scratch pool? >> > > Yes. A tape that was initially labeled in the "Full" pool has

Re: [Bacula-users] Questions about the Scratch pool directive

2010-02-02 Thread Richard Scobie
Robert Hartzell wrote: > hmmm... looks like I need to do some testing. Do you have any volumes > that have been recycled and moved back to the scratch pool? > Yes. A tape that was initially labeled in the "Full" pool has been recycled back into Scratch and is showing "Scratch" as its recycle poo

Re: [Bacula-users] Questions about the Scratch pool directive

2010-02-02 Thread Richard Scobie
Robert Hartzell wrote: > It would seem reasonable (to me anyways) that the attributes would be > updated to reflect the current pool. There isn't much in the way of > documentation regarding this feature so hopefully someone can verify one > way or the other and I dont have to set up a test to fin

Re: [Bacula-users] Character Substitution

2010-02-02 Thread Richard Scobie
ganiuszka wrote: > In "Client Run After Job" directive "%v" will not be replaced because it > can be replaced only on Director side. > So if you has: > > Client Run After Job = "/path/script.sh %i %v" > > than > > %v will be empty. OK thanks. I actually have the "%i_%v" inside the shell script, s

[Bacula-users] Character Substitution

2010-02-01 Thread Richard Scobie
I have a "Client Run After Job" which runs a bash script which ends up writing a file on the client, "%i_%v.txt" It all works except the substitution is not occuring and it is literally writing the file %i_%v.txt. Is this expected? Regards, Richard --

Re: [Bacula-users] Problem with bat 5.0.0, not seeing console output

2010-01-27 Thread Richard Scobie
John Drescher wrote: > I believe other users mentioned that restarting bat fixed the issue. > And the issue only occurred on the first run of bat. I have to date been unable to see the console on one bat install and have a bug open: http://bugs.bacula.org/view.php?id=1468 (username/password an

Re: [Bacula-users] Bat 5.0.0 not showing Console

2010-01-26 Thread Richard Scobie
Marc Schiffbauer wrote: > Yes, I saw this here, too. Then on another startup of bat, it worked > properly. > > So now, If that happens, I close bat and start it again until the > console is there... > > Using QT4.6.1 here. Still looking into it here. One machine with qt-4.5.3-9.fc11.i586 never s

[Bacula-users] Bat 5.0.0 not showing Console

2010-01-25 Thread Richard Scobie
Have just updated all components to 5.0.0 and a remote bat connection does not display the console window - it just stays on the last selected page. When starting bat, it just goes up with a blank page, but all other pages display correctly. Anyone else seeing this? Regards, Richard ---

[Bacula-users] Cloned Jobs

2010-01-21 Thread Richard Scobie
I note that it is possible to run clone jobs by using "Run = in the Job resource. What I would like to do is make 2 tapes (Volumes) that are exact copies, but with only one catalog entry, used if either tape is restored. 1. Does cloning acheive this? 2. Can cloning be performed on a single dri

Re: [Bacula-users] Bacula hangs "waiting for execution"...

2010-01-20 Thread Richard Scobie
Daniel wrote: > Hello, > > I am having a problem where all jobs but the first immediately after starting > bacula-dir hang "waiting for execution.". I have no further information on > why they are waiting, nor what they are waiting on. They have waited nearly > a week. All jobs I queue after

Re: [Bacula-users] Can't find the tape changer

2010-01-19 Thread Richard Scobie
Dan Langille wrote: > Fusion MPT SPI Host driver 3.12.19.00rh > ACPI: PCI Interrupt :11:08.0[A] -> GSI 16 (level, low) -> IRQ 169 > mptbase: Initiating ioc0 bringup > ioc0: 53C1030: Capabilities={Initiator,Target} > scsi2 : ioc0: LSI53C1030, FwRev=01032700h, Ports=1, MaxQ=255, IRQ=169 > Vendor

Re: [Bacula-users] Can't find the tape changer

2010-01-19 Thread Richard Scobie
Dan Langille wrote: > ganiuszka wrote: >> Here is a instruction about Dell PowerVault 124T and LUNs under Linux. >> >> http://support.dell.com/support/edocs/stor-sys/124t/en/124tvs16/install.html#enabling_lun_linux >> >> Subject "Enabling LUN Support in Linux" >> >> Maybe this is the solution. > >

Re: [Bacula-users] HP MSL2024 Autochanger "ERR=Device or resource busy."

2010-01-18 Thread Richard Scobie
Richard Scobie wrote: > Thanks for the followup, but after finding the thread referenced below > yesterday, I switch the SCSI HBA and library into another box (different > motherboard) and it is humming along fine using the same config files. > > Granted this box is runnin

Re: [Bacula-users] Can't find the tape changer

2010-01-18 Thread Richard Scobie
Dan Langille wrote: > Dan Langille wrote: > >>I'm helping a client with a Linux system. I see the tape drive, but >>cannot find the tape changer. Clues please. >> >> From dmesg: > > > Also: > > Linux version 2.6.9-78.0.8.plus.c4smp (mockbu...@builder10.centos.org) > (gcc version 3.4.6 20060

Re: [Bacula-users] HP MSL2024 Autochanger "ERR=Device or resource busy."

2010-01-10 Thread Richard Scobie
Brian Debelius wrote: > > Humor me if you will. Go back to default. Make sure your tape drive is > set to variable blocks using mt -f /dev/nst0 setblk 0, then load a tape, > and use tapeinfo -f /dev/nst0 to verify it is set to zero. Now comment > out the Maximum Block Size from the sd. Test it

Re: [Bacula-users] HP MSL2024 Autochanger "ERR=Device or resource busy."

2010-01-09 Thread Richard Scobie
John Drescher wrote: > Have you tried to stop bacula-sd and then execute the mtx-changer > script directly from the shell? You will probably have to look at the > code for the parameters. Hi John, Yes, I have successfully been able to do this a number of times and also run through the "btape

Re: [Bacula-users] HP MSL2024 Autochanger "ERR=Device or resource busy."

2010-01-08 Thread Richard Scobie
Brian Debelius wrote: > Try turning on debug in mtx-changer. Modify the wait_for_drive() > function to add another debug statement to confirm that the device is > ready, and that the function did not just time out. > > wait_for_drive() { > i=0 > while [ $i -le 300 ]; do # Wait max 300 seconds > if

Re: [Bacula-users] HP MSL2024 Autochanger "ERR=Device or resource busy."

2010-01-07 Thread Richard Scobie
ext-daniel.haw...@nokia.com wrote: > Hi Richard, > >> >> Anyone else running this library I can compare notes with? >> > > Not anymore :) Used to use an SAS LTO3 based MSL2024 on a project I worked > at a while back. TBH it *just worked* and worked well too. Would recommend > one to anyone that

Re: [Bacula-users] HP MSL2024 Autochanger "ERR=Device or resource busy."

2010-01-06 Thread Richard Scobie
Richard Scobie wrote: > >> >> You probably need to add a wait in the mtx-changer script just after >> the load. This wait will make sure the tape is in the drive and has >> completed the loading process. For some systems the script does not >> wait long en

Re: [Bacula-users] HP MSL2024 Autochanger "ERR=Device or resource busy."

2010-01-06 Thread Richard Scobie
> > You probably need to add a wait in the mtx-changer script just after > the load. This wait will make sure the tape is in the drive and has > completed the loading process. For some systems the script does not > wait long enough for the tape drive to finish. > > John Thanks John. I already hav

[Bacula-users] HP MSL2024 Autochanger "ERR=Device or resource busy."

2010-01-06 Thread Richard Scobie
I have an MSL2024 library I have been battling to get running for the last couple of days and am about out of ideas. It is the parallel SCSI attached LTO-4 version, connected to an HP LSI based HBA. I have bacula configured and it passes the mtx-changer test commands recommended in the manual a

Re: [Bacula-users] LTO3 tape capacity lower than expected

2010-01-05 Thread Richard Scobie
Brian Debelius wrote: > That would be 16M. Isn't the SD hard limited to 1M? > "The maximun size-in-bytes possible is 2,000,000" From the SD Configuration Maximum block size directive. Regards, Richard -- This SF.Net

Re: [Bacula-users] LTO-3 getting the lead out.

2010-01-04 Thread Richard Scobie
Brian Debelius wrote: > Shamless bump. Does anyone have any insight into this? > > Thanks > brian- The difference between the dd tests and bacula backups is that catalog writes are occuring in the latter. Perhaps you have a database bottleneck? Is the database stored on the RAID also? Regards

Re: [Bacula-users] Multi Volume Archives

2009-12-14 Thread Richard Scobie
Bob Hetzel wrote: > 1) Bacula is indeed able to seek within a tape. If you're having trouble > with this functionality you need to look at the storage daemon options at Thanks Bob, I had misinterpreted something I read earlier. > > 2) If you pick a file that's on one of the other 9 tapes in you

[Bacula-users] Multi Volume Archives

2009-12-12 Thread Richard Scobie
If a tape is damaged in a multi volume archive, is it possible to recover all the data from the rest of the set? I understand Bacula is not currently able to seek within a tape in order to recover a file - the tape must be read sequentially. In a multi volume archive, does it need to read throu