Oh well.  I built LZO, and can't seem to link it in the lzop build, despite
correctly setting the FLAGS variables they say in the INSTALL file.  I'd
love to provide an lzop comparison, but can't get it.  I give up ...  Also,
can't build python-lzo.  Also would be sweet, but hey.

For whoever cares, here is the comparison that I do have:

I'm doing a "zfs send" of my rpool, piping through the named compressor, and
dump to /dev/null.  rpool is on a 2-disk mirror, SATA 7200
2 sockets 4 core Xeons (total 8 cores, capable of 16 threads)
System idle in all respects, except this activity.

Threadzip is using zlib (similar or same as gzip) breaking stream into 5M
chunks and parallel threading the compression of those chunks.

------------------------------------------- pass1
9.52GB  2m14.578s-------no compression
5.69GB  2m15.963s-------threadzip 32 threads --fast
5.69GB  2m13.609s-------threadzip 16 threads --fast
5.69GB  2m21.968s-------threadzip 8 threads --fast
(Above, "zfs send" is the bottleneck.  Don't know if compressor can go
faster.)
(Below, the compressor is the bottleneck.)
5.69GB  3m17.789s-------threadzip 4 threads --fast
5.56GB  3m29.619s-------threadzip 16 threads --best
5.56GB  4m24.761s-------threadzip 8 threads --best
5.44GB  5m13.139s-------pbzip2 auto
5.44GB  5m21.030s-------pbzip2 16 processes
5.44GB  6m4.915s--------pbzip2 8 processes
5.70GB  7m41.209s-------gzip --fast
------------------------------------------- pass2
9.52GB  2m17.858s-------no compression
5.69GB  2m13.446s-------threadzip 32 threads --fast
5.69GB  2m9.842s--------threadzip 16 threads --fast
5.69GB  2m22.388s-------threadzip 8 threads --fast
(Above, "zfs send" is the bottleneck.  Don't know if compressor can go
faster.)
(Below, the compressor is the bottleneck.)
5.69GB  3m10.701s-------threadzip 4 threads --fast
5.56GB  3m27.772s-------threadzip 16 threads --best
5.56GB  4m22.409s-------threadzip 8 threads --best
5.44GB  5m15.247s-------pbzip2 auto
5.44GB  5m21.089s-------pbzip2 16 processes
5.44GB  6m5.412s--------pbzip2 8 processes
5.70GB  7m22.505s-------gzip --fast

_______________________________________________
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

Reply via email to