Re: [ANNOUNCE] Apache Beam 2.41.0 Released

Hi Team, Looking forward to trying and testing the new version, It's always fascinating. On Fri, 26 Aug 2022 at 03:45, Pablo Estrada via user wrote: > Thank you Kiley! > > On Thu, Aug 25, 2022 at 10:55 AM Kiley Sok wrote: > >> The Apache Beam team is pleased to announce the release of version

RE: [x-post from dev] Java object serialization error, java.io.InvalidClassException: org.apache.spark.deploy.ApplicationDescription; local class incompatible

So, it turns out this was a Spark version mismatch between the Beam JobServer and the Spark platform. I'm running both Beam and Spark on Docker; the Spark image [0] provided version 3.3.0 and Scala version 2.12, but I used apache/beam_spark_job_server:2.41.0 [1] which provides Spark 2.4.x librarie