Bogdan Raducanu created SPARK-21271:
---------------------------------------
Summary: UnsafeRow.hashCode assertion when sizeInBytes not
multiple of 8
Key: SPARK-21271
URL: https://issues.apache.org/jira/browse/SPARK-21271
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 2.2.0
Reporter: Bogdan Raducanu
The method is:
{code}
public int hashCode() {
return Murmur3_x86_32.hashUnsafeWords(baseObject, baseOffset, sizeInBytes,
42);
}
{code}
but sizeInBytes is not always a multiple of 8 (in which case hashUnsafeWords
throws assertion) - for example here:
{code}FixedLengthRowBasedKeyValueBatch.appendRow{code}
The fix could be to use hashUnsafeBytes or to use hashUnsafeWords but on a
prefix that is multiple of 8.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
