Perhaps you also need to upgrade Scala?
Clay Stevens
From: Hanyu Huang
Sent: Wednesday, 15 November, 2023 1:15 AM
To: user@spark.apache.org
Subject: The job failed when we upgraded from spark 3.3.1 to spark3.4.1
Caution, this email may be from a sender outside Wolters Kluwer. Verify the
The version our job originally ran was spark 3.3.1 and Apache Iceberg to
1.2.0， But since we upgraded to spark3.4.1 and Apache Iceberg to 1.3.1,
jobs started to fail frequently， We tried to upgrade only iceberg without
upgrading spark, and the job did not report an error.
Detailed description：
The version our job originally ran was spark 3.3.1 and Apache Iceberg to
1.2.0， But since we upgraded to spark3.4.1 and Apache Iceberg to 1.3.1,
jobs started to fail frequently， We tried to upgrade only iceberg without
upgrading spark, and the job did not report an error.
Detailed description：
The version our job originally ran was spark 3.3.1 and Apache Iceberg to
1.2.0， But since we upgraded to spark3.4.1 and Apache Iceberg to 1.3.1,
jobs started to fail frequently， We tried to upgrade only iceberg without
upgrading spark, and the job did not report an error.
Detailed description：
