Kontinuation opened a new pull request, #2499: URL: https://github.com/apache/sedona/pull/2499
## Did you read the Contributor Guide? - Yes, I have read the [Contributor Rules](https://sedona.apache.org/latest/community/rule/) and [Contributor Development Guide](https://sedona.apache.org/latest/community/develop/) ## Is this PR related to a ticket? - Yes, and the PR name follows the format `[GH-XXX] my subject`. Closes #2472 ## What changes were proposed in this PR? This patch fixes 2 compatibility issues with DBR 17.3 LTS (Spark 4.0.0): 1. [`Unevaluable` extends from `FoldableUnevaluable`](https://github.com/apache/spark/blob/v4.0.1/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Expression.scala#L404) since Spark 4.0, but `FoldableUnevaluable` is not defined in DBR 17.3 LTS. Sedona geo-stats classes extend `Unevaluable`, which brings binary incompatibility on DBR. There's no easy way to fix this, so we make geo-stats functions optional, and the rest of Sedona will continue to work even when geo-stats functions fail to load. 2. `ExtractSedonaUDFRule` also uses an API that is not binary compatible with DBR 17.3 LTS. We've met this problem before for DBR 16.4 LTS (https://github.com/apache/sedona/pull/2301). ## How was this patch tested? Tested on DBR 17.3 LTS using scripts in https://github.com/wherobots/sedona-cloud-vendor-tester/tree/master/databricks-tester ## Did this PR include necessary documentation updates? - No, this PR does not affect any public API so no need to change the documentation. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
