Hi,
I am new to Iceberg. I just built master branch and ran the jars on EMR
cluster spark-shell 2.3.0.
spark-shell --jars
gradle-wrapper.jar,iceberg-api-66fa048.jar,iceberg-common-66fa048.jar,iceberg-core-66fa048.jar,iceberg-data-66fa048.jar,iceberg-hive-66fa048.jar,iceberg-hive-66fa048-tests.jar,iceberg-orc-66fa048.jar,iceberg-parquet-66fa048.jar,iceberg-pig-66fa048.jar,iceberg-spark-66fa048.jar,iceberg-spark-runtime-66fa048.jar
Below is the error:
import spark.implicits._
val someDF = Seq(
(8, "bat"),
(64, "mouse"),
(-27, "horse")
).toDF("number", "word")
someDF.write.format("iceberg").mode("overwrite").save("/tmp/hello.table")
java.lang.NoSuchMethodError:
com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V
at
org.apache.iceberg.spark.source.IcebergSource.createWriter(IcebergSource.java:
72)
at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:254)
at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:225)
... 53 elided
Any idea why this error? Does it mean master branch does not work with
spark 2.3.0?
Thanks for any clue!