Does Apache Beam version (2.41.0) or latest (2.51.0) support Spark 3.5
environment for spark runner ?
Apache Beam - Spark Runner Documentation states -
The Spark runner currently supports Spark’s 3.2.x branch
Thanks
Sri Ganesh V
Hello,
Does the latest Apache Beam version support Spark 3.5, Scala 2.13
environment for spark runner ?
Based on initial analysis -
Spark runner supports Spark 3.5.0 version
*Reference*:
https://github.com/apache/beam/blob/f660f49b6cf5d241285b156ccc4a5f52d82cfa63/runners/spark/3/build.gradle#L36