Hi Radim,
With SSE4.2 support, the iSCSI CRC32C is the fastest method available. As
of HDFS 2, we use that method by default for new files.
-Todd
On Sun, Nov 25, 2012 at 6:58 PM, Radim Kolar wrote:
> its not that big speed difference in this test:
>
> http://www.strchr.com/hash_**functions#res
its not that big speed difference in this test:
http://www.strchr.com/hash_functions#results
asm version of CRC32 on i5 is fastest, but Java8 switched to murmur3 for
hashing strings, i didnt get why they use it instead of
*java.util.zip.CRC32. The collisions seems to be about same.*
i just tested C version and murmur3 32_le is about 4 times faster then
CRC32. I submitted yesterday murmur3 hash support.
What it takes to change checksum method, does .metadata information what
hash type is used inside?
