kazuyukitanimura commented on code in PR #1580: URL: https://github.com/apache/datafusion-comet/pull/1580#discussion_r2021761404
########## docs/source/user-guide/installation.md: ########## @@ -30,22 +30,32 @@ Make sure the following requirements are met and software installed on your mach ### Supported Spark Versions -Comet currently supports the following versions of Apache Spark: +Comet currently supports the following versions of Apache Spark. Note that this documentation is for the main +branch. Please refer to the version of this documentation in the appropriate GitHub release branch for released +Comet versions. -- 3.4.x (Java 8/11/17, Scala 2.12/2.13) -- 3.5.x (Java 8/11/17, Scala 2.12/2.13) +We recommend only using Comet with Spark versions where we currently have both Comet and Spark tests enabled in CI. +Other versions may work well enough for development and evaluation purposes. + +| Spark Version | Java Version | Scala Version | Comet Tests in CI | Spark Tests in CI | +| ------------- | ------------ | ------------- | ----------------- | ----------------- | +| 3.4.3 | 8/11/17 | 2.12/2.13 | Yes | Yes | +| 3.5.4 | 8/11/17 | 2.12/2.13 | No | Yes | +| 3.5.5 | 8/11/17 | 2.12/2.13 | Yes | Yes | Experimental support is provided for the following versions of Apache Spark and is intended for development/testing use only and should not be used in production yet. -- 4.0.0-preview1 (Java 17/21, Scala 2.13) +| Spark Version | Java Version | Scala Version | Comet Tests in CI | Spark Tests in CI | +| -------------- | ------------ | ------------- | ----------------- | ----------------- | +| 4.0.0-preview1 | 11/17 | 2.13 | Yes | Yes | Review Comment: I think we only test with Java 17 for Spark 4.0 right now -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org