Hi The master branch is compatible with spark-2.4.0 as its statement here: https://github.com/apache/incubator-iceberg#compatibility.
Lian Jiang <[email protected]> 于2019年7月25日周四 下午2:17写道： > Hi, > > I am new to Iceberg. I just built master branch and ran the jars on EMR > cluster spark-shell 2.3.0. > > > spark-shell --jars > > gradle-wrapper.jar,iceberg-api-66fa048.jar,iceberg-common-66fa048.jar,iceberg-core-66fa048.jar,iceberg-data-66fa048.jar,iceberg-hive-66fa048.jar,iceberg-hive-66fa048-tests.jar,iceberg-orc-66fa048.jar,iceberg-parquet-66fa048.jar,iceberg-pig-66fa048.jar,iceberg-spark-66fa048.jar,iceberg-spark-runtime-66fa048.jar > > > Below is the error: > > > import spark.implicits._ > > val someDF = Seq( > (8, "bat"), > (64, "mouse"), > (-27, "horse") > ).toDF("number", "word") > > someDF.write.format("iceberg").mode("overwrite").save("/tmp/hello.table") > > > java.lang.NoSuchMethodError: > com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V > at > org.apache.iceberg.spark.source.IcebergSource.createWriter(IcebergSource.java: > 72) > at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:254) > at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:225) > ... 53 elided > > Any idea why this error? Does it mean master branch does not work with > spark 2.3.0? > > Thanks for any clue! >
