Todd Lipcon created HDFS-3528: --------------------------------- Summary: Use native CRC32 in DFS write path Key: HDFS-3528 URL: https://issues.apache.org/jira/browse/HDFS-3528 Project: Hadoop HDFS Issue Type: Improvement Components: data-node, hdfs client, performance Affects Versions: 2.0.0-alpha Reporter: Todd Lipcon Assignee: Todd Lipcon
HDFS-2080 improved the CPU efficiency of the read path by using native SSE-enabled code for CRC verification. Benchmarks of the write path show that it's often CPU bound by checksums as well, so we should make the same improvement there. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira