FYI There is another thread named -- " GPU acceleration of ZFS" in this list to discuss the possibility to utilize the power of GPGPU. I posted here:
Good day, I think ZFS can take advantage of using GPU for sha256 calculation, encryption and maybe compression. Modern video card, like 5xxx or 6xxx ATI HD Series can do calculation of sha256 50-100 times faster than modern 4 cores CPU. kgpu project for linux shows nice results. 'zfs scrub' would work freely on high performance ZFS pools. The only problem that there is no AMD/Nvidia drivers for Solaris that support hardware-assisted OpenCL. Is anyone interested in it? Best regards, Anatoly Legkodymov. On Tue, May 10, 2011 at 11:29 AM, Anatoly <legko...@fastmail.fm> wrote: > Good day, > > I think ZFS can take advantage of using GPU for sha256 calculation, > encryption and maybe compression. Modern video card, like 5xxx or 6xxx > ATI HD Series can do calculation of sha256 50-100 times faster than > modern 4 cores CPU. Ignoring optimizations from SIMD extensions like SSE and friends, this is probably true. However, the GPU also has to deal with the overhead of data transfer to itself before it can even begin crunching data. Granted, a Gen. 2 x16 link is quite speedy, but is CPU performance really that poor where a GPU can still out-perform it? My undergrad thesis dealt with computational acceleration utilizing CUDA, and the datasets had to scale quite a ways before there was a noticeable advantage in using a Tesla or similar over a bog-standard i7-920. > The only problem that there is no AMD/Nvidia drivers for Solaris that > support hardware-assisted OpenCL. This, and keep in mind that most of the professional users here will likely be using professional hardware, where a simple 8MB Rage XL gets the job done thanks to the magic of out-of-band management cards and other such facilities. Even as a home user, I have not placed a high-end videocard into my machine, I use a $5 ATI PCI videocard that saw about a hour of use whilst I installed Solaris 11. -- --khd IMHO, zfs need to run in all kind of HW T-series CMT server that can help sha calculation since T1 day, did not see any work in ZFS to take advantage it On 5/10/2011 11:29 AM, Anatoly wrote: > Good day, > > I think ZFS can take advantage of using GPU for sha256 calculation, > encryption and maybe compression. Modern video card, like 5xxx or 6xxx > ATI HD Series can do calculation of sha256 50-100 times faster than > modern 4 cores CPU. > > kgpu project for linux shows nice results. > > 'zfs scrub' would work freely on high performance ZFS pools. > > The only problem that there is no AMD/Nvidia drivers for Solaris that > support hardware-assisted OpenCL. > > Is anyone interested in it? > > Best regards, > Anatoly Legkodymov. On Tue, May 10, 2011 at 10:29 PM, Anatoly <legko...@fastmail.fm> wrote: > Good day, > > I think ZFS can take advantage of using GPU for sha256 calculation, > encryption and maybe compression. Modern video card, like 5xxx or 6xxx > ATI HD Series can do calculation of sha256 50-100 times faster than > modern 4 cores CPU. > > kgpu project for linux shows nice results. > > 'zfs scrub' would work freely on high performance ZFS pools. > > The only problem that there is no AMD/Nvidia drivers for Solaris that > support hardware-assisted OpenCL. > > Is anyone interested in it? This isn't technically true. The NVIDIA drivers support compute, but there's other parts of the toolchain missing. /* I don't know about ATI/AMD, but I'd guess they likely don't support compute across platforms */ /* Disclaimer - The company I work for has a working HMPP compiler for Solaris/FreeBSD and we may soon support CUDA */ On 10 May 2011, at 16:44, Hung-Sheng Tsao (LaoTsao) Ph. D. wrote: > > IMHO, zfs need to run in all kind of HW T-series CMT server that can > help sha calculation since T1 day, did not see any work in ZFS to take > advantage it That support would be in the crypto framework though, not ZFS per se. So I think the OP might consider how best to add GPU support to the crypto framework. Chris _______________________________________________ Thanks. Fred > -----Original Message----- > From: zfs-discuss-boun...@opensolaris.org [mailto:zfs-discuss- > boun...@opensolaris.org] On Behalf Of David Magda > Sent: 星期二, 六月 28, 2011 9:23 > To: Bill Sommerfeld > Cc: zfs-discuss@opensolaris.org > Subject: Re: [zfs-discuss] Encryption accelerator card recommendations. > > On Jun 27, 2011, at 18:32, Bill Sommerfeld wrote: > > > On 06/27/11 15:24, David Magda wrote: > >> Given the amount of transistors that are available nowadays I think > >> it'd be simpler to just create a series of SIMD instructions right > >> in/on general CPUs, and skip the whole co-processor angle. > > > > see: http://en.wikipedia.org/wiki/AES_instruction_set > > > > Present in many current Intel CPUs; also expected to be present in > AMD's > > "Bulldozer" based CPUs. > > Now compare that with the T-series stuff that also handles 3DES, RC4, > RSA2048, DSA, DH, ECC, MD5, SHA1, SHA2, as well as a hardware RNG: > > http://en.wikipedia.org/wiki/UltraSPARC_T2 > http://blogs.oracle.com/BestPerf/entry/20100920_sparc_t3_pk11rsap > erf > > The initial TLS/SSL set up is actually the expensive part (20-58% of > the time spent of the 'transaction'), and that AES can be performed > decently even on non-AESNI CPUs: simply adding an RSA accelerator can > double performance without session caching, and even ~20% with it. SSL > session caching alone can help improve throughput by a factor of more > than two. > > "Performance Analysis of TLS Web Servers" > http://www.cs.rice.edu/~dwallach/pub/tls-tocs.pdf > http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.16.1403 > > AESNI is certain better than nothing, but RSA, SHA, and the RNG would > be nice as well. It'd also be handy for ZFS crypto in addition to all > the network IO stuff. > > _______________________________________________ > zfs-discuss mailing list > zfs-discuss@opensolaris.org > http://mail.opensolaris.org/mailman/listinfo/zfs-discuss _______________________________________________ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
