@Szehon: This failure looks to be the same as #6060. I did report two flaky tests 3 weeks ago. But we didn't investigate it I guess. https://github.com/apache/iceberg/issues/6060 https://github.com/apache/iceberg/issues/5986
Thanks, Ajantha On Thu, Nov 17, 2022 at 10:09 PM Szehon Ho <szehon.apa...@gmail.com> wrote: > +1 (non-binding) > 1. Verify signature > 2. Verify checksum > 3. License RAT check > > > 4. Run unit test, Actually got a failure: > > org.apache.iceberg.spark.extensions.TestCopyOnWriteDelete > > testDeleteWithSnapshotIsolation[catalogName = spark_catalog, implementation > = org.apache.iceberg.spark.SparkSessionCatalog, config = {type=hive, > default-namespace=default, clients=1, parquet-enabled=false, > cache-enabled=false}, format = avro, vectorized = false, distributionMode = > range] FAILED > java.util.concurrent.ExecutionException: > java.lang.IllegalStateException: Runtime file filtering is not possible: > the table has been concurrently modified. Row-level operation scan snapshot > ID: 3904024863143561157, current table snapshot ID: 6400925136398165989. If > multiple threads modify the table, use independent Spark sessions in each > thread. > at java.util.concurrent.FutureTask.report(FutureTask.java:122) > at java.util.concurrent.FutureTask.get(FutureTask.java:192) > at > org.apache.iceberg.spark.extensions.TestDelete.testDeleteWithSnapshotIsolation(TestDelete.java:873) > > But I think its a concurrency issue and not worth stopping RC for (will > file a issue) > > 5. Check with spark 3.3, create table and query data, metadata tables. > > The convenience binaries > https://repository.apache.org/content/repositories/orgapacheiceberg-1111/org/apache/iceberg/ > have spark 3.2 jar but not spark 3.3, is that intentional? Anyway > built spark 3.3 runtime to verify, and works. > > Thanks > Szehon > > On Thu, Nov 17, 2022 at 11:30 AM Gabor Kaszab <gaborkas...@apache.org> > wrote: > >> Hi Everyone, >> >> I propose that we release the following RC as the official Apache Iceberg >> 1.1.0 release. >> >> The commit ID is b3eaf0c6cb9cf6357a925c7443baadd54515a971 >> * This corresponds to the tag: apache-iceberg-1.1.0-rc2 >> * https://github.com/apache/iceberg/commits/apache-iceberg-1.1.0-rc2 >> * >> https://github.com/apache/iceberg/tree/b3eaf0c6cb9cf6357a925c7443baadd54515a971 >> >> The release tarball, signature, and checksums are here: >> * https://dist.apache.org/repos/dist/dev/iceberg/apache-iceberg-1.1.0-rc2 >> >> You can find the KEYS file here: >> * https://dist.apache.org/repos/dist/dev/iceberg/KEYS >> >> Convenience binary artifacts are staged on Nexus. The Maven repository URL >> is: >> * https://repository.apache.org/content/repositories/orgapacheiceberg-1111/ >> >> Please download, verify, and test. >> >> Please vote in the next 72 hours. >> >> [ ] +1 Release this as Apache Iceberg 1.1.0 >> [ ] +0 >> [ ] -1 Do not release this because... >> >> Again, thanks to *Fokko* for running the RC creation steps for me! >> >>