Jonathan Albrecht created SPARK-51042:
-----------------------------------------

             Summary: Read and write CalendarIntervals using one call to 
get/putLong consistently
                 Key: SPARK-51042
                 URL: https://issues.apache.org/jira/browse/SPARK-51042
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 3.5.4, 4.0.0
            Reporter: Jonathan Albrecht


In commit ac07cea234f4fb687442aafa8b6d411695110a4e there was a performance 
improvement to reading a writing CalendarIntervals in UnsafeRow. This same 
change can be applied to UnsafeArrayData and UnsafeWriter.

This would also fix big endian platforms where the current and proposed methods 
of reading and writing CalendarIntervals do not order the bytes in the same 
way. Currently CalendarInterval related tests in Catalyst and SQL are failing 
on big endian platforms.

There would be no effect on little endian platforms (byte order is not 
affected) except for performance improvement.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to