On Wednesday 2016-11-09 15:16:52 Dimitri Maziuk wrote: > On 11/09/2016 03:00 PM, Heitor Faria wrote: > > Hello, Alan, Ralf, Phil: pgzip would be nice for disk backup storage > > and huge uncompressed files copy (e.g.: VM exports, DB dumps etc.), > > but there is no reason to replace hardware tape native virtually no > > downside compression for any software one (IMHO). > > As it happens I've just gone through the exercise of enabling cgroups > and setting up blkio write limit on our compute cluster: it turns out > that, say, 16 (# cores) jobs gunzipping more than a few megabytes of > data at the same time will choke the disk and effectively kill the > machine. Daemons time out writing to log files, "hung task" kernel oops, > and other fun stuff. This is on unzip + write, but I expect with lower > compression levels you could easily achieve that with multicore zip + > write too.
Hi Dimitri, Can you confirm that you didn't experience the memory exhaustion at the same time (heavy swapping)? -- Josip Deanovic ------------------------------------------------------------------------------ Developer Access Program for Intel Xeon Phi Processors Access to Intel Xeon Phi processor-based developer platforms. With one year of Intel Parallel Studio XE. Training and support from Colfax. Order your platform today. http://sdm.link/xeonphi _______________________________________________ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
