Hi,

I am new to Iceberg. I just built master branch and ran the jars on EMR
cluster spark-shell 2.3.0.


spark-shell --jars
 
gradle-wrapper.jar,iceberg-api-66fa048.jar,iceberg-common-66fa048.jar,iceberg-core-66fa048.jar,iceberg-data-66fa048.jar,iceberg-hive-66fa048.jar,iceberg-hive-66fa048-tests.jar,iceberg-orc-66fa048.jar,iceberg-parquet-66fa048.jar,iceberg-pig-66fa048.jar,iceberg-spark-66fa048.jar,iceberg-spark-runtime-66fa048.jar


Below is the error:


import spark.implicits._

val someDF = Seq(
  (8, "bat"),
  (64, "mouse"),
  (-27, "horse")
).toDF("number", "word")

someDF.write.format("iceberg").mode("overwrite").save("/tmp/hello.table")


java.lang.NoSuchMethodError:
com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V
  at
org.apache.iceberg.spark.source.IcebergSource.createWriter(IcebergSource.java:
72)
  at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:254)
  at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:225)
  ... 53 elided

Any idea why this error? Does it mean master branch does not work with
spark 2.3.0?

Thanks for any clue!

Reply via email to