Hello, Which Hadoop version or versions are compatible with Spark 2.4.3 and Scala 2.12?
The binary distribution spark-2.4.3-bin-without-hadoop-scala-2.12.tgz is missing avro-1.8.2.jar, so when attempting to run with Hadoop 2.7.7 there are classpath conflicts at runtime, as Hadoop 2.7.7 includes avro-1.7.4.jar. https://issues.apache.org/jira/browse/SPARK-27781 <https://issues.apache.org/jira/browse/SPARK-27781> michael