[Question] Apache Beam Spark Runner Support - Spark 3.5 Environment

2023-11-02 Thread Sri Ganesh Venkataraman
Does Apache Beam version (2.41.0) or latest (2.51.0) support Spark 3.5 environment for spark runner ? Apache Beam - Spark Runner Documentation states - The Spark runner currently supports Spark’s 3.2.x branch Thanks Sri Ganesh V

[Question] Apache Beam Spark Runner Support - Spark 3.5, Scala 2.13 Environment

2024-03-22 Thread Sri Ganesh Venkataraman
Hello, Does the latest Apache Beam version support Spark 3.5, Scala 2.13 environment for spark runner ? Based on initial analysis - Spark runner supports Spark 3.5.0 version *Reference*: https://github.com/apache/beam/blob/f660f49b6cf5d241285b156ccc4a5f52d82cfa63/runners/spark/3/build.gradle#L36