Hi Beam community,

As Beam repo CI/CD has moved to Java 11 [1], I would like to bring up
attention to two outstanding open Issues that could affect Spark and Samza
runner users [2, 3]

For Spark Runner issue, currently Spark runner does not support Spark
3.4.0+ with Java11. This is due to Spark 3.4.0 upgraded to use slf4j 2.
However the same Spark version still runs fine with Java8.

For Samza Runner, currently it does not support Java11. Newer Samza does
support Java11, however, the upgrade appears nontrivial.

It would be great if someone actively using Spark and Samza runner could
volunteer to add or complete Java 11 support, or share their solution for
these issues.

Thanks for your attention,

Yi

[1] https://github.com/apache/beam/issues/31677
[2] https://github.com/apache/beam/issues/32207
[3] https://github.com/apache/beam/issues/32208

Reply via email to