On 11/09/2016 03:00 PM, Heitor Faria wrote: > Hello, Alan, Ralf, Phil: pgzip would be nice for disk backup storage > and huge uncompressed files copy (e.g.: VM exports, DB dumps etc.), > but there is no reason to replace hardware tape native virtually no > downside compression for any software one (IMHO).
As it happens I've just gone through the exercise of enabling cgroups and setting up blkio write limit on our compute cluster: it turns out that, say, 16 (# cores) jobs gunzipping more than a few megabytes of data at the same time will choke the disk and effectively kill the machine. Daemons time out writing to log files, "hung task" kernel oops, and other fun stuff. This is on unzip + write, but I expect with lower compression levels you could easily achieve that with multicore zip + write too. -- Dimitri Maziuk Programmer/sysadmin BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu
signature.asc
Description: OpenPGP digital signature
------------------------------------------------------------------------------ Developer Access Program for Intel Xeon Phi Processors Access to Intel Xeon Phi processor-based developer platforms. With one year of Intel Parallel Studio XE. Training and support from Colfax. Order your platform today. http://sdm.link/xeonphi
_______________________________________________ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
