mjohns-databricks commented on issue #2472: URL: https://github.com/apache/sedona/issues/2472#issuecomment-3523486969
> Apache Sedona 1.8.0 has some known compatibility issues with DBR 17.x runtimes. As of now 17.3 LTS is out, I'll take some time to investigate and fix those compatibility issues. @Kontinuation some notes: - DBR17.x (Spark 4.0) only supports Scala 2.13 (not 2.12), see [here](https://docs.databricks.com/aws/en/release-notes/runtime/17.3lts#system-environment) Can you please update Sedona docs for install on Databricks to reflect this? - Also, it is probably worth noting that [Spark Cluster Configs](https://docs.databricks.com/aws/en/compute/configure#spark-configuration) that setup Kryo serializer are most likely going to have issue when a user selects a photon enabled cluster, so for compatibility, they can [uncheck photon](https://docs.databricks.com/aws/en/compute/configure#use-photon-acceleration) when setting up the cluster for Sedona. - And, we would recommend that users use [Dedicated Access Mode](https://docs.databricks.com/aws/en/compute/configure#access-modes) for their classic cluster -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
