On 11/03/16 20:14, Simon Templar wrote:
> In my case using spooling didnt prevent shoe-shining; it just
> introduced long pauses while data was spooled. I think all this means
> is that I can read from my data sources faster than my tape can write.
Unless you are using DAT, do not use mechanical drives for spooling -
they can't keep up with the tape drive unless you're using one that's
dedicated and only spooling/despooling for a single job (LTO1-2-3,
incompressible data) or can't keep up at all (As above with any form of
compressible data, or LTO4,5,6,7)
SSD is the only way to fly. After having tested with a PCIe NVMe drive,
I'd say that's preferred, but a _fast_ SATA2/3 or SAS2 drive will work
too (The old spool was a stripe of Intel SLC SSDs, the new one is a
DC3700 card)
Spooling really comes into its own when you're running multiple jobs.
Whilst one job is despooling, others can be spooling. The interleaving
effect means all your jobs complete in a faster period of time.
As well as increasing max file size you need to boost the tape buffer
size from the 64kB default. I use 2MB
>
> So far the only change I made to help with shoe-shining was to set Max
> File Size to a large number (mine is now set to 20g, after first
> trying 3gb then 5gb). This one change alone is probably responsible
> for most of the performance increase that Ive been able to achieve
> thus far. Id like to test and tune more, but Im still wrestling with
> things like tape mount timeouts (no 3rd shift operators), job run time
> timeouts, etc
>
> -Simon
>
>
>> On Mar 10, 2016, at 11:09 PM, Kern Sibbald <k...@sibbald.com
>> <mailto:k...@sibbald.com>> wrote:
>>
>> I have not tried this, but one thing that may help a lot is to turn on
>> data spooling for the tape device. This will probably not speed up the
>> process but should prevent that tape shoe-shine (start and stopping).
>
>
>
> ------------------------------------------------------------------------------
> Transform Data into Opportunity.
> Accelerate data analysis in your applications with
> Intel Data Analytics Acceleration Library.
> Click to learn more.
> http://pubads.g.doubleclick.net/gampad/clk?id=278785111&iu=/4140
>
>
> _______________________________________________
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
------------------------------------------------------------------------------
Transform Data into Opportunity.
Accelerate data analysis in your applications with
Intel Data Analytics Acceleration Library.
Click to learn more.
http://pubads.g.doubleclick.net/gampad/clk?id=278785111&iu=/4140
_______________________________________________
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
