Re: [I] Use sha2 implementation from datafusion-spark crate [datafusion-comet]

2025-06-08 Thread via GitHub
andygrove commented on issue #1820: URL: https://github.com/apache/datafusion-comet/issues/1820#issuecomment-2954102662 Thanks for working on this @rishvin. You are correct that Spark doesn't support UInt32 because it is JVM-based. JVM only has signed ints. The upper-case output seem

Re: [I] Use sha2 implementation from datafusion-spark crate [datafusion-comet]

2025-06-07 Thread via GitHub
rishvin commented on issue #1820: URL: https://github.com/apache/datafusion-comet/issues/1820#issuecomment-2953616585 Hi @andygrove, I tried the following approach and looks like there is some discrepancy in the Datafusion's `SparkSha2` output with Spark. **This is what I attempted**

Re: [I] Use sha2 implementation from datafusion-spark crate [datafusion-comet]

2025-06-05 Thread via GitHub
andygrove commented on issue #1820: URL: https://github.com/apache/datafusion-comet/issues/1820#issuecomment-2945503093 Thanks @rishvin. I assigned the issue to you. Let me know if you have any questions. -- This is an automated message from the Apache Git Service. To respond to the mess

Re: [I] Use sha2 implementation from datafusion-spark crate [datafusion-comet]

2025-06-05 Thread via GitHub
rishvin commented on issue #1820: URL: https://github.com/apache/datafusion-comet/issues/1820#issuecomment-2945492404 @andygrove I can work on this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[I] Use sha2 implementation from datafusion-spark crate [datafusion-comet]

2025-05-30 Thread via GitHub
andygrove opened a new issue, #1820: URL: https://github.com/apache/datafusion-comet/issues/1820 ### What is the problem the feature request solves? The `datafusion-spark` crate now provides a sha2 implementation (https://github.com/apache/datafusion/pull/16168), so we should be able