Hello, I am trying to upgrade the Avro dependency on Hive to version 1.9.1. More details in https://issues.apache.org/jira/browse/HIVE-21737
The Hive CI tests for my patch failed because of some class issue then I tried to tackle this by upgrading the Spark version installed during the IT tests from 2.3.0 to version 2.4.4. However I discovered that the Jenkins job was failing to download the Spark version from some AWS storage bucket https://github.com/apache/hive/blob/209096a71b25a3d75dca1930f825c8c10b99d2b9/itests/bin/download-spark.sh#L37 It seems this version is somehow a different from upstream Spark. Does anyone know more about why we use that version? And more important, any chance this version can be upgraded to version 2.4.x (with the hope this may unblock my upgrade issue). Regards, Ismaël
