gaodayue opened a new pull request #1753: Use crc32c checksum for segment v2 URL: https://github.com/apache/incubator-doris/pull/1753 The following error is encountered when testing V2 table. ``` Page checksum mismatch, actual=3372108349 vs expect=3375987274 ``` The reasons are that `HashUtil::crc_hash` doesn't generate standard CRC-32 checksum and produces wrong checksum on vector of Slice. I have changed V2 to use CRC-32C checksum, which is the de factor file checksum algorithm nowadays that is being used in storage systems like RocksDB, Ceph, etc.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
