jonathan-albrecht-ibm opened a new pull request, #49773:
URL: https://github.com/apache/spark/pull/49773

   ### What changes were proposed in this pull request?
   In UnsafeRowUtils.validateStructuralIntegrityWithReasonImpl, when checking 
if the unused bits in the field are all zeros for fixed length fields, add 
functions that work on big endian platforms.
   
   ### Why are the changes needed?
   The current checks only work on little endian platforms. This change detects 
the platform endianness once when the getPadding* functions are initialized and 
sets it to the proper implementation for the platform so there should be no 
significant change in performance.
   
   ### Does this PR introduce _any_ user-facing change?
   No
   
   ### How was this patch tested?
   This was tested on amd64 (little-endian) and s390x (big-endian) with 
existing unit tests. On s390x, many existing tests fail in the SQL projects.
   
   ### Was this patch authored or co-authored using generative AI tooling?
   No
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

Reply via email to