This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 640d92d3f Publish built docs triggered by
dd6a4d563e78f965c8cb771d958544a6a7dfc3b9
640d92d3f is described below
commit 640d92d3f3c9521203db374f3185df1898071a5e
Author: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
AuthorDate: Wed Mar 25 21:43:16 2026 +0000
Publish built docs triggered by dd6a4d563e78f965c8cb771d958544a6a7dfc3b9
---
.../contributor-guide/iceberg-spark-tests.md.txt | 16 ++--
_sources/contributor-guide/index.md.txt | 1 +
contributor-guide/adding_a_new_expression.html | 1 +
contributor-guide/adding_a_new_operator.html | 1 +
contributor-guide/benchmarking.html | 1 +
contributor-guide/contributing.html | 1 +
contributor-guide/debugging.html | 1 +
contributor-guide/development.html | 1 +
contributor-guide/ffi.html | 1 +
contributor-guide/iceberg-spark-tests.html | 87 ++++++++++++++++++----
contributor-guide/index.html | 9 +++
contributor-guide/jvm_shuffle.html | 1 +
contributor-guide/native_shuffle.html | 1 +
contributor-guide/parquet_scans.html | 1 +
contributor-guide/plugin_overview.html | 1 +
contributor-guide/profiling_native_code.html | 1 +
contributor-guide/release_process.html | 1 +
contributor-guide/roadmap.html | 1 +
contributor-guide/spark-sql-tests.html | 7 +-
contributor-guide/sql-file-tests.html | 7 +-
contributor-guide/tracing.html | 1 +
searchindex.js | 2 +-
22 files changed, 115 insertions(+), 29 deletions(-)
diff --git a/_sources/contributor-guide/iceberg-spark-tests.md.txt
b/_sources/contributor-guide/iceberg-spark-tests.md.txt
index 5cc5690f4..38becc020 100644
--- a/_sources/contributor-guide/iceberg-spark-tests.md.txt
+++ b/_sources/contributor-guide/iceberg-spark-tests.md.txt
@@ -51,7 +51,7 @@ Clone Apache Iceberg locally and apply the diff file from
Comet against the matc
git clone [email protected]:apache/iceberg.git apache-iceberg
cd apache-iceberg
git checkout apache-iceberg-1.8.1
-git apply ../datafusion-comet/dev/diffs/iceberg-rust/1.8.1.diff
+git apply ../datafusion-comet/dev/diffs/iceberg/1.8.1.diff
```
## 3. Run Iceberg Spark Tests
@@ -64,9 +64,11 @@ ENABLE_COMET=true ./gradlew -DsparkVersions=3.5
-DscalaVersion=2.13 -DflinkVersi
The three Gradle targets tested in CI are:
-- `:iceberg-spark:iceberg-spark-<sparkVersion>_<scalaVersion>:test`
-- `:iceberg-spark:iceberg-spark-extensions-<sparkVersion>_<scalaVersion>:test`
--
`:iceberg-spark:iceberg-spark-runtime-<sparkVersion>_<scalaVersion>:integrationTest`
+| Gradle Target | What It Covers
|
+| --------------------------------------------- |
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|
+| `iceberg-spark-<ver>:test` | Core read/write paths
(Parquet, Avro, ORC, vectorized), scan operations, filtering, bloom filters,
runtime filtering, deletion handling, structured streaming, DDL/DML
(create/alter/drop, writes, deletes), filter and aggregate pushdown, actions
(snapshot expiration, file rewriting, orphan cleanup, table migration),
serialization, and data format conversions. |
+| `iceberg-spark-extensions-<ver>:test` | SQL extensions: stored
procedures (migrate, snapshot, cherrypick, rollback, rewrite-data-files,
rewrite-manifests, expire-snapshots, remove-orphan-files, etc.), row-level
operations (copy-on-write and merge-on-read update/delete/merge), DDL
extensions (branches, tags, alter schema, partition fields), changelog
tables/views, metadata tables, and views. |
+| `iceberg-spark-runtime-<ver>:integrationTest` | A single smoke test
(`SmokeTest.java`) that validates the shaded runtime JAR. The `spark-runtime`
module has no main source — it packages Iceberg and all dependencies into a
shaded uber-JAR. The smoke test exercises basic create, insert, merge, query,
partition field, and sort order operations to confirm the shaded JAR works
end-to-end. |
## Updating Diffs
@@ -76,14 +78,14 @@ regenerate:
```shell
cd apache-iceberg
git reset --hard apache-iceberg-1.8.1 && git clean -fd
-git apply ../datafusion-comet/dev/diffs/iceberg-rust/1.8.1.diff
+git apply ../datafusion-comet/dev/diffs/iceberg/1.8.1.diff
# Make changes, then run spotless to fix formatting
./gradlew spotlessApply
# Stage any new or deleted files, then generate the diff
git add -A
-git diff apache-iceberg-1.8.1 >
../datafusion-comet/dev/diffs/iceberg-rust/1.8.1.diff
+git diff apache-iceberg-1.8.1 >
../datafusion-comet/dev/diffs/iceberg/1.8.1.diff
```
Repeat for each Iceberg version (1.8.1, 1.9.1, 1.10.0). The file contents
differ between versions, so each
@@ -93,4 +95,4 @@ diff must be generated against its own tag.
The `iceberg_spark_test.yml` workflow applies these diffs and runs the three
Gradle targets above against
each Iceberg version. The test matrix covers Spark 3.4 and 3.5 across Iceberg
1.8.1, 1.9.1, and 1.10.0
-with Java 11 and 17. The workflow only runs when the PR title contains
`[iceberg]`.
+with Java 11 and 17. The workflow runs on all pull requests and pushes to the
main branch.
diff --git a/_sources/contributor-guide/index.md.txt
b/_sources/contributor-guide/index.md.txt
index 2b6842e44..c0751c68a 100644
--- a/_sources/contributor-guide/index.md.txt
+++ b/_sources/contributor-guide/index.md.txt
@@ -37,6 +37,7 @@ Adding a New Expression <adding_a_new_expression>
Tracing <tracing>
Profiling Native Code <profiling_native_code>
Spark SQL Tests <spark-sql-tests.md>
+Iceberg Spark Tests <iceberg-spark-tests.md>
SQL File Tests <sql-file-tests.md>
Roadmap <roadmap.md>
Release Process <release_process>
diff --git a/contributor-guide/adding_a_new_expression.html
b/contributor-guide/adding_a_new_expression.html
index 6366bce73..ad306e0ef 100644
--- a/contributor-guide/adding_a_new_expression.html
+++ b/contributor-guide/adding_a_new_expression.html
@@ -368,6 +368,7 @@ under the License.
<li class="toctree-l2"><a class="reference internal"
href="tracing.html">Tracing</a></li>
<li class="toctree-l2"><a class="reference internal"
href="profiling_native_code.html">Profiling Native Code</a></li>
<li class="toctree-l2"><a class="reference internal"
href="spark-sql-tests.html">Spark SQL Tests</a></li>
+<li class="toctree-l2"><a class="reference internal"
href="iceberg-spark-tests.html">Iceberg Spark Tests</a></li>
<li class="toctree-l2"><a class="reference internal"
href="sql-file-tests.html">SQL File Tests</a></li>
<li class="toctree-l2"><a class="reference internal"
href="roadmap.html">Roadmap</a></li>
<li class="toctree-l2"><a class="reference internal"
href="release_process.html">Release Process</a></li>
diff --git a/contributor-guide/adding_a_new_operator.html
b/contributor-guide/adding_a_new_operator.html
index 544aa3896..c15526273 100644
--- a/contributor-guide/adding_a_new_operator.html
+++ b/contributor-guide/adding_a_new_operator.html
@@ -368,6 +368,7 @@ under the License.
<li class="toctree-l2"><a class="reference internal"
href="tracing.html">Tracing</a></li>
<li class="toctree-l2"><a class="reference internal"
href="profiling_native_code.html">Profiling Native Code</a></li>
<li class="toctree-l2"><a class="reference internal"
href="spark-sql-tests.html">Spark SQL Tests</a></li>
+<li class="toctree-l2"><a class="reference internal"
href="iceberg-spark-tests.html">Iceberg Spark Tests</a></li>
<li class="toctree-l2"><a class="reference internal"
href="sql-file-tests.html">SQL File Tests</a></li>
<li class="toctree-l2"><a class="reference internal"
href="roadmap.html">Roadmap</a></li>
<li class="toctree-l2"><a class="reference internal"
href="release_process.html">Release Process</a></li>
diff --git a/contributor-guide/benchmarking.html
b/contributor-guide/benchmarking.html
index 91b96683a..2425a3850 100644
--- a/contributor-guide/benchmarking.html
+++ b/contributor-guide/benchmarking.html
@@ -368,6 +368,7 @@ under the License.
<li class="toctree-l2"><a class="reference internal"
href="tracing.html">Tracing</a></li>
<li class="toctree-l2"><a class="reference internal"
href="profiling_native_code.html">Profiling Native Code</a></li>
<li class="toctree-l2"><a class="reference internal"
href="spark-sql-tests.html">Spark SQL Tests</a></li>
+<li class="toctree-l2"><a class="reference internal"
href="iceberg-spark-tests.html">Iceberg Spark Tests</a></li>
<li class="toctree-l2"><a class="reference internal"
href="sql-file-tests.html">SQL File Tests</a></li>
<li class="toctree-l2"><a class="reference internal"
href="roadmap.html">Roadmap</a></li>
<li class="toctree-l2"><a class="reference internal"
href="release_process.html">Release Process</a></li>
diff --git a/contributor-guide/contributing.html
b/contributor-guide/contributing.html
index 12a67f5ed..174aca6ed 100644
--- a/contributor-guide/contributing.html
+++ b/contributor-guide/contributing.html
@@ -368,6 +368,7 @@ under the License.
<li class="toctree-l2"><a class="reference internal"
href="tracing.html">Tracing</a></li>
<li class="toctree-l2"><a class="reference internal"
href="profiling_native_code.html">Profiling Native Code</a></li>
<li class="toctree-l2"><a class="reference internal"
href="spark-sql-tests.html">Spark SQL Tests</a></li>
+<li class="toctree-l2"><a class="reference internal"
href="iceberg-spark-tests.html">Iceberg Spark Tests</a></li>
<li class="toctree-l2"><a class="reference internal"
href="sql-file-tests.html">SQL File Tests</a></li>
<li class="toctree-l2"><a class="reference internal"
href="roadmap.html">Roadmap</a></li>
<li class="toctree-l2"><a class="reference internal"
href="release_process.html">Release Process</a></li>
diff --git a/contributor-guide/debugging.html b/contributor-guide/debugging.html
index b54cff842..a2fb99b4d 100644
--- a/contributor-guide/debugging.html
+++ b/contributor-guide/debugging.html
@@ -368,6 +368,7 @@ under the License.
<li class="toctree-l2"><a class="reference internal"
href="tracing.html">Tracing</a></li>
<li class="toctree-l2"><a class="reference internal"
href="profiling_native_code.html">Profiling Native Code</a></li>
<li class="toctree-l2"><a class="reference internal"
href="spark-sql-tests.html">Spark SQL Tests</a></li>
+<li class="toctree-l2"><a class="reference internal"
href="iceberg-spark-tests.html">Iceberg Spark Tests</a></li>
<li class="toctree-l2"><a class="reference internal"
href="sql-file-tests.html">SQL File Tests</a></li>
<li class="toctree-l2"><a class="reference internal"
href="roadmap.html">Roadmap</a></li>
<li class="toctree-l2"><a class="reference internal"
href="release_process.html">Release Process</a></li>
diff --git a/contributor-guide/development.html
b/contributor-guide/development.html
index 41da38181..6ea16e525 100644
--- a/contributor-guide/development.html
+++ b/contributor-guide/development.html
@@ -368,6 +368,7 @@ under the License.
<li class="toctree-l2"><a class="reference internal"
href="tracing.html">Tracing</a></li>
<li class="toctree-l2"><a class="reference internal"
href="profiling_native_code.html">Profiling Native Code</a></li>
<li class="toctree-l2"><a class="reference internal"
href="spark-sql-tests.html">Spark SQL Tests</a></li>
+<li class="toctree-l2"><a class="reference internal"
href="iceberg-spark-tests.html">Iceberg Spark Tests</a></li>
<li class="toctree-l2"><a class="reference internal"
href="sql-file-tests.html">SQL File Tests</a></li>
<li class="toctree-l2"><a class="reference internal"
href="roadmap.html">Roadmap</a></li>
<li class="toctree-l2"><a class="reference internal"
href="release_process.html">Release Process</a></li>
diff --git a/contributor-guide/ffi.html b/contributor-guide/ffi.html
index 2dc8136d4..72ed52277 100644
--- a/contributor-guide/ffi.html
+++ b/contributor-guide/ffi.html
@@ -368,6 +368,7 @@ under the License.
<li class="toctree-l2"><a class="reference internal"
href="tracing.html">Tracing</a></li>
<li class="toctree-l2"><a class="reference internal"
href="profiling_native_code.html">Profiling Native Code</a></li>
<li class="toctree-l2"><a class="reference internal"
href="spark-sql-tests.html">Spark SQL Tests</a></li>
+<li class="toctree-l2"><a class="reference internal"
href="iceberg-spark-tests.html">Iceberg Spark Tests</a></li>
<li class="toctree-l2"><a class="reference internal"
href="sql-file-tests.html">SQL File Tests</a></li>
<li class="toctree-l2"><a class="reference internal"
href="roadmap.html">Roadmap</a></li>
<li class="toctree-l2"><a class="reference internal"
href="release_process.html">Release Process</a></li>
diff --git a/contributor-guide/iceberg-spark-tests.html
b/contributor-guide/iceberg-spark-tests.html
index da65f546b..c49742166 100644
--- a/contributor-guide/iceberg-spark-tests.html
+++ b/contributor-guide/iceberg-spark-tests.html
@@ -65,6 +65,8 @@ under the License.
<script async="true" defer="true"
src="https://buttons.github.io/buttons.js"></script>
<link rel="index" title="Index" href="../genindex.html" />
<link rel="search" title="Search" href="../search.html" />
+ <link rel="next" title="SQL File Tests" href="sql-file-tests.html" />
+ <link rel="prev" title="Running Spark SQL Tests"
href="spark-sql-tests.html" />
<meta name="viewport" content="width=device-width, initial-scale=1"/>
<meta name="docsearch:language" content="en"/>
<meta name="docsearch:version" content="" />
@@ -161,7 +163,7 @@ under the License.
</li>
-<li class="nav-item ">
+<li class="nav-item current active">
<a class="nav-link nav-internal" href="index.html">
Contributor Guide
</a>
@@ -243,8 +245,6 @@ under the License.
-
-
<dialog id="pst-primary-sidebar-modal"></dialog>
<div id="pst-primary-sidebar" class="bd-sidebar-primary bd-sidebar">
@@ -275,7 +275,7 @@ under the License.
</li>
-<li class="nav-item ">
+<li class="nav-item current active">
<a class="nav-link nav-internal" href="index.html">
Contributor Guide
</a>
@@ -349,10 +349,32 @@ under the License.
<nav class="bd-links" id="bd-docs-nav" aria-label="Main navigation">
<div class="bd-toc-item active">
<p aria-level="2" class="caption" role="heading"><span
class="caption-text">Index</span></p>
-<ul>
+<ul class="current">
<li class="toctree-l1"><a class="reference internal"
href="../about/index.html">Comet Overview</a></li>
<li class="toctree-l1"><a class="reference internal"
href="../user-guide/index.html">User Guide</a></li>
-<li class="toctree-l1"><a class="reference internal"
href="index.html">Contributor Guide</a></li>
+<li class="toctree-l1 current"><a class="reference internal"
href="index.html">Contributor Guide</a><ul class="current">
+<li class="toctree-l2"><a class="reference internal"
href="contributing.html">Getting Started</a></li>
+<li class="toctree-l2"><a class="reference internal"
href="plugin_overview.html">Comet Plugin Architecture</a></li>
+<li class="toctree-l2"><a class="reference internal"
href="plugin_overview.html#plugin-components">Plugin Components</a></li>
+<li class="toctree-l2"><a class="reference internal" href="ffi.html">Arrow
FFI</a></li>
+<li class="toctree-l2"><a class="reference internal"
href="jvm_shuffle.html">JVM Shuffle</a></li>
+<li class="toctree-l2"><a class="reference internal"
href="native_shuffle.html">Native Shuffle</a></li>
+<li class="toctree-l2"><a class="reference internal"
href="parquet_scans.html">Parquet Scans</a></li>
+<li class="toctree-l2"><a class="reference internal"
href="development.html">Development Guide</a></li>
+<li class="toctree-l2"><a class="reference internal"
href="debugging.html">Debugging Guide</a></li>
+<li class="toctree-l2"><a class="reference internal"
href="benchmarking.html">Benchmarking Guide</a></li>
+<li class="toctree-l2"><a class="reference internal"
href="adding_a_new_operator.html">Adding a New Operator</a></li>
+<li class="toctree-l2"><a class="reference internal"
href="adding_a_new_expression.html">Adding a New Expression</a></li>
+<li class="toctree-l2"><a class="reference internal"
href="tracing.html">Tracing</a></li>
+<li class="toctree-l2"><a class="reference internal"
href="profiling_native_code.html">Profiling Native Code</a></li>
+<li class="toctree-l2"><a class="reference internal"
href="spark-sql-tests.html">Spark SQL Tests</a></li>
+<li class="toctree-l2 current"><a class="current reference internal"
href="#">Iceberg Spark Tests</a></li>
+<li class="toctree-l2"><a class="reference internal"
href="sql-file-tests.html">SQL File Tests</a></li>
+<li class="toctree-l2"><a class="reference internal"
href="roadmap.html">Roadmap</a></li>
+<li class="toctree-l2"><a class="reference internal"
href="release_process.html">Release Process</a></li>
+<li class="toctree-l2"><a class="reference external"
href="https://github.com/apache/datafusion-comet">Github and Issue
Tracker</a></li>
+</ul>
+</li>
<li class="toctree-l1"><a class="reference internal"
href="../asf/index.html">ASF Links</a></li>
</ul>
@@ -396,6 +418,9 @@ under the License.
<i class="fa-solid fa-home"></i>
</a>
</li>
+
+ <li class="breadcrumb-item"><a href="index.html" class="nav-link">Comet
Contributor Guide</a></li>
+
<li class="breadcrumb-item active" aria-current="page"><span
class="ellipsis">Running Iceberg Spark Tests</span></li>
</ul>
</nav>
@@ -458,7 +483,7 @@ plugin and shuffle manager</p></li>
<div class="highlight-shell notranslate"><div
class="highlight"><pre><span></span>git<span class="w"> </span>clone<span
class="w"> </span>[email protected]:apache/iceberg.git<span class="w">
</span>apache-iceberg
<span class="nb">cd</span><span class="w"> </span>apache-iceberg
git<span class="w"> </span>checkout<span class="w"> </span>apache-iceberg-1.8.1
-git<span class="w"> </span>apply<span class="w">
</span>../datafusion-comet/dev/diffs/iceberg-rust/1.8.1.diff
+git<span class="w"> </span>apply<span class="w">
</span>../datafusion-comet/dev/diffs/iceberg/1.8.1.diff
</pre></div>
</div>
</section>
@@ -470,11 +495,25 @@ git<span class="w"> </span>apply<span class="w">
</span>../datafusion-comet/dev/
</pre></div>
</div>
<p>The three Gradle targets tested in CI are:</p>
-<ul class="simple">
-<li><p><code class="docutils literal notranslate"><span
class="pre">:iceberg-spark:iceberg-spark-<sparkVersion>_<scalaVersion>:test</span></code></p></li>
-<li><p><code class="docutils literal notranslate"><span
class="pre">:iceberg-spark:iceberg-spark-extensions-<sparkVersion>_<scalaVersion>:test</span></code></p></li>
-<li><p><code class="docutils literal notranslate"><span
class="pre">:iceberg-spark:iceberg-spark-runtime-<sparkVersion>_<scalaVersion>:integrationTest</span></code></p></li>
-</ul>
+<div class="pst-scrollable-table-container"><table class="table">
+<thead>
+<tr class="row-odd"><th class="head"><p>Gradle Target</p></th>
+<th class="head"><p>What It Covers</p></th>
+</tr>
+</thead>
+<tbody>
+<tr class="row-even"><td><p><code class="docutils literal notranslate"><span
class="pre">iceberg-spark-<ver>:test</span></code></p></td>
+<td><p>Core read/write paths (Parquet, Avro, ORC, vectorized), scan
operations, filtering, bloom filters, runtime filtering, deletion handling,
structured streaming, DDL/DML (create/alter/drop, writes, deletes), filter and
aggregate pushdown, actions (snapshot expiration, file rewriting, orphan
cleanup, table migration), serialization, and data format conversions.</p></td>
+</tr>
+<tr class="row-odd"><td><p><code class="docutils literal notranslate"><span
class="pre">iceberg-spark-extensions-<ver>:test</span></code></p></td>
+<td><p>SQL extensions: stored procedures (migrate, snapshot, cherrypick,
rollback, rewrite-data-files, rewrite-manifests, expire-snapshots,
remove-orphan-files, etc.), row-level operations (copy-on-write and
merge-on-read update/delete/merge), DDL extensions (branches, tags, alter
schema, partition fields), changelog tables/views, metadata tables, and
views.</p></td>
+</tr>
+<tr class="row-even"><td><p><code class="docutils literal notranslate"><span
class="pre">iceberg-spark-runtime-<ver>:integrationTest</span></code></p></td>
+<td><p>A single smoke test (<code class="docutils literal notranslate"><span
class="pre">SmokeTest.java</span></code>) that validates the shaded runtime
JAR. The <code class="docutils literal notranslate"><span
class="pre">spark-runtime</span></code> module has no main source — it packages
Iceberg and all dependencies into a shaded uber-JAR. The smoke test exercises
basic create, insert, merge, query, partition field, and sort order operations
to confirm the shaded JAR works end-to-end.< [...]
+</tr>
+</tbody>
+</table>
+</div>
</section>
<section id="updating-diffs">
<h2>Updating Diffs<a class="headerlink" href="#updating-diffs" title="Link to
this heading">#</a></h2>
@@ -482,14 +521,14 @@ git<span class="w"> </span>apply<span class="w">
</span>../datafusion-comet/dev/
regenerate:</p>
<div class="highlight-shell notranslate"><div
class="highlight"><pre><span></span><span class="nb">cd</span><span class="w">
</span>apache-iceberg
git<span class="w"> </span>reset<span class="w"> </span>--hard<span class="w">
</span>apache-iceberg-1.8.1<span class="w"> </span><span
class="o">&&</span><span class="w"> </span>git<span class="w">
</span>clean<span class="w"> </span>-fd
-git<span class="w"> </span>apply<span class="w">
</span>../datafusion-comet/dev/diffs/iceberg-rust/1.8.1.diff
+git<span class="w"> </span>apply<span class="w">
</span>../datafusion-comet/dev/diffs/iceberg/1.8.1.diff
<span class="c1"># Make changes, then run spotless to fix formatting</span>
./gradlew<span class="w"> </span>spotlessApply
<span class="c1"># Stage any new or deleted files, then generate the
diff</span>
git<span class="w"> </span>add<span class="w"> </span>-A
-git<span class="w"> </span>diff<span class="w">
</span>apache-iceberg-1.8.1<span class="w"> </span>><span class="w">
</span>../datafusion-comet/dev/diffs/iceberg-rust/1.8.1.diff
+git<span class="w"> </span>diff<span class="w">
</span>apache-iceberg-1.8.1<span class="w"> </span>><span class="w">
</span>../datafusion-comet/dev/diffs/iceberg/1.8.1.diff
</pre></div>
</div>
<p>Repeat for each Iceberg version (1.8.1, 1.9.1, 1.10.0). The file contents
differ between versions, so each
@@ -499,7 +538,7 @@ diff must be generated against its own tag.</p>
<h2>Running Tests in CI<a class="headerlink" href="#running-tests-in-ci"
title="Link to this heading">#</a></h2>
<p>The <code class="docutils literal notranslate"><span
class="pre">iceberg_spark_test.yml</span></code> workflow applies these diffs
and runs the three Gradle targets above against
each Iceberg version. The test matrix covers Spark 3.4 and 3.5 across Iceberg
1.8.1, 1.9.1, and 1.10.0
-with Java 11 and 17. The workflow only runs when the PR title contains <code
class="docutils literal notranslate"><span
class="pre">[iceberg]</span></code>.</p>
+with Java 11 and 17. The workflow runs on all pull requests and pushes to the
main branch.</p>
</section>
</section>
@@ -513,6 +552,24 @@ with Java 11 and 17. The workflow only runs when the PR
title contains <code cla
<footer class="prev-next-footer d-print-none">
<div class="prev-next-area">
+ <a class="left-prev"
+ href="spark-sql-tests.html"
+ title="previous page">
+ <i class="fa-solid fa-angle-left"></i>
+ <div class="prev-next-info">
+ <p class="prev-next-subtitle">previous</p>
+ <p class="prev-next-title">Running Spark SQL Tests</p>
+ </div>
+ </a>
+ <a class="right-next"
+ href="sql-file-tests.html"
+ title="next page">
+ <div class="prev-next-info">
+ <p class="prev-next-subtitle">next</p>
+ <p class="prev-next-title">SQL File Tests</p>
+ </div>
+ <i class="fa-solid fa-angle-right"></i>
+ </a>
</div>
</footer>
diff --git a/contributor-guide/index.html b/contributor-guide/index.html
index 45fbd4035..61d17dca2 100644
--- a/contributor-guide/index.html
+++ b/contributor-guide/index.html
@@ -368,6 +368,7 @@ under the License.
<li class="toctree-l2"><a class="reference internal"
href="tracing.html">Tracing</a></li>
<li class="toctree-l2"><a class="reference internal"
href="profiling_native_code.html">Profiling Native Code</a></li>
<li class="toctree-l2"><a class="reference internal"
href="spark-sql-tests.html">Spark SQL Tests</a></li>
+<li class="toctree-l2"><a class="reference internal"
href="iceberg-spark-tests.html">Iceberg Spark Tests</a></li>
<li class="toctree-l2"><a class="reference internal"
href="sql-file-tests.html">SQL File Tests</a></li>
<li class="toctree-l2"><a class="reference internal"
href="roadmap.html">Roadmap</a></li>
<li class="toctree-l2"><a class="reference internal"
href="release_process.html">Release Process</a></li>
@@ -570,6 +571,14 @@ under the License.
<li class="toctree-l2"><a class="reference internal"
href="spark-sql-tests.html#running-tests-in-ci">Running Tests in CI</a></li>
</ul>
</li>
+<li class="toctree-l1"><a class="reference internal"
href="iceberg-spark-tests.html">Iceberg Spark Tests</a><ul>
+<li class="toctree-l2"><a class="reference internal"
href="iceberg-spark-tests.html#install-comet">1. Install Comet</a></li>
+<li class="toctree-l2"><a class="reference internal"
href="iceberg-spark-tests.html#clone-iceberg-and-apply-diff">2. Clone Iceberg
and Apply Diff</a></li>
+<li class="toctree-l2"><a class="reference internal"
href="iceberg-spark-tests.html#run-iceberg-spark-tests">3. Run Iceberg Spark
Tests</a></li>
+<li class="toctree-l2"><a class="reference internal"
href="iceberg-spark-tests.html#updating-diffs">Updating Diffs</a></li>
+<li class="toctree-l2"><a class="reference internal"
href="iceberg-spark-tests.html#running-tests-in-ci">Running Tests in CI</a></li>
+</ul>
+</li>
<li class="toctree-l1"><a class="reference internal"
href="sql-file-tests.html">SQL File Tests</a><ul>
<li class="toctree-l2"><a class="reference internal"
href="sql-file-tests.html#running-the-tests">Running the tests</a></li>
<li class="toctree-l2"><a class="reference internal"
href="sql-file-tests.html#test-file-location">Test file location</a></li>
diff --git a/contributor-guide/jvm_shuffle.html
b/contributor-guide/jvm_shuffle.html
index 5856508c5..23097133c 100644
--- a/contributor-guide/jvm_shuffle.html
+++ b/contributor-guide/jvm_shuffle.html
@@ -368,6 +368,7 @@ under the License.
<li class="toctree-l2"><a class="reference internal"
href="tracing.html">Tracing</a></li>
<li class="toctree-l2"><a class="reference internal"
href="profiling_native_code.html">Profiling Native Code</a></li>
<li class="toctree-l2"><a class="reference internal"
href="spark-sql-tests.html">Spark SQL Tests</a></li>
+<li class="toctree-l2"><a class="reference internal"
href="iceberg-spark-tests.html">Iceberg Spark Tests</a></li>
<li class="toctree-l2"><a class="reference internal"
href="sql-file-tests.html">SQL File Tests</a></li>
<li class="toctree-l2"><a class="reference internal"
href="roadmap.html">Roadmap</a></li>
<li class="toctree-l2"><a class="reference internal"
href="release_process.html">Release Process</a></li>
diff --git a/contributor-guide/native_shuffle.html
b/contributor-guide/native_shuffle.html
index f08406ee5..3602154c8 100644
--- a/contributor-guide/native_shuffle.html
+++ b/contributor-guide/native_shuffle.html
@@ -368,6 +368,7 @@ under the License.
<li class="toctree-l2"><a class="reference internal"
href="tracing.html">Tracing</a></li>
<li class="toctree-l2"><a class="reference internal"
href="profiling_native_code.html">Profiling Native Code</a></li>
<li class="toctree-l2"><a class="reference internal"
href="spark-sql-tests.html">Spark SQL Tests</a></li>
+<li class="toctree-l2"><a class="reference internal"
href="iceberg-spark-tests.html">Iceberg Spark Tests</a></li>
<li class="toctree-l2"><a class="reference internal"
href="sql-file-tests.html">SQL File Tests</a></li>
<li class="toctree-l2"><a class="reference internal"
href="roadmap.html">Roadmap</a></li>
<li class="toctree-l2"><a class="reference internal"
href="release_process.html">Release Process</a></li>
diff --git a/contributor-guide/parquet_scans.html
b/contributor-guide/parquet_scans.html
index 1ec838f49..85d9fb4f6 100644
--- a/contributor-guide/parquet_scans.html
+++ b/contributor-guide/parquet_scans.html
@@ -368,6 +368,7 @@ under the License.
<li class="toctree-l2"><a class="reference internal"
href="tracing.html">Tracing</a></li>
<li class="toctree-l2"><a class="reference internal"
href="profiling_native_code.html">Profiling Native Code</a></li>
<li class="toctree-l2"><a class="reference internal"
href="spark-sql-tests.html">Spark SQL Tests</a></li>
+<li class="toctree-l2"><a class="reference internal"
href="iceberg-spark-tests.html">Iceberg Spark Tests</a></li>
<li class="toctree-l2"><a class="reference internal"
href="sql-file-tests.html">SQL File Tests</a></li>
<li class="toctree-l2"><a class="reference internal"
href="roadmap.html">Roadmap</a></li>
<li class="toctree-l2"><a class="reference internal"
href="release_process.html">Release Process</a></li>
diff --git a/contributor-guide/plugin_overview.html
b/contributor-guide/plugin_overview.html
index 13b246f05..c5c1a0864 100644
--- a/contributor-guide/plugin_overview.html
+++ b/contributor-guide/plugin_overview.html
@@ -368,6 +368,7 @@ under the License.
<li class="toctree-l2"><a class="reference internal"
href="tracing.html">Tracing</a></li>
<li class="toctree-l2"><a class="reference internal"
href="profiling_native_code.html">Profiling Native Code</a></li>
<li class="toctree-l2"><a class="reference internal"
href="spark-sql-tests.html">Spark SQL Tests</a></li>
+<li class="toctree-l2"><a class="reference internal"
href="iceberg-spark-tests.html">Iceberg Spark Tests</a></li>
<li class="toctree-l2"><a class="reference internal"
href="sql-file-tests.html">SQL File Tests</a></li>
<li class="toctree-l2"><a class="reference internal"
href="roadmap.html">Roadmap</a></li>
<li class="toctree-l2"><a class="reference internal"
href="release_process.html">Release Process</a></li>
diff --git a/contributor-guide/profiling_native_code.html
b/contributor-guide/profiling_native_code.html
index c4a40a39c..cd0ce9512 100644
--- a/contributor-guide/profiling_native_code.html
+++ b/contributor-guide/profiling_native_code.html
@@ -368,6 +368,7 @@ under the License.
<li class="toctree-l2"><a class="reference internal"
href="tracing.html">Tracing</a></li>
<li class="toctree-l2 current"><a class="current reference internal"
href="#">Profiling Native Code</a></li>
<li class="toctree-l2"><a class="reference internal"
href="spark-sql-tests.html">Spark SQL Tests</a></li>
+<li class="toctree-l2"><a class="reference internal"
href="iceberg-spark-tests.html">Iceberg Spark Tests</a></li>
<li class="toctree-l2"><a class="reference internal"
href="sql-file-tests.html">SQL File Tests</a></li>
<li class="toctree-l2"><a class="reference internal"
href="roadmap.html">Roadmap</a></li>
<li class="toctree-l2"><a class="reference internal"
href="release_process.html">Release Process</a></li>
diff --git a/contributor-guide/release_process.html
b/contributor-guide/release_process.html
index 69fd7e451..cbdca2ee1 100644
--- a/contributor-guide/release_process.html
+++ b/contributor-guide/release_process.html
@@ -368,6 +368,7 @@ under the License.
<li class="toctree-l2"><a class="reference internal"
href="tracing.html">Tracing</a></li>
<li class="toctree-l2"><a class="reference internal"
href="profiling_native_code.html">Profiling Native Code</a></li>
<li class="toctree-l2"><a class="reference internal"
href="spark-sql-tests.html">Spark SQL Tests</a></li>
+<li class="toctree-l2"><a class="reference internal"
href="iceberg-spark-tests.html">Iceberg Spark Tests</a></li>
<li class="toctree-l2"><a class="reference internal"
href="sql-file-tests.html">SQL File Tests</a></li>
<li class="toctree-l2"><a class="reference internal"
href="roadmap.html">Roadmap</a></li>
<li class="toctree-l2 current"><a class="current reference internal"
href="#">Release Process</a></li>
diff --git a/contributor-guide/roadmap.html b/contributor-guide/roadmap.html
index 9e5256a2b..5203b4f85 100644
--- a/contributor-guide/roadmap.html
+++ b/contributor-guide/roadmap.html
@@ -368,6 +368,7 @@ under the License.
<li class="toctree-l2"><a class="reference internal"
href="tracing.html">Tracing</a></li>
<li class="toctree-l2"><a class="reference internal"
href="profiling_native_code.html">Profiling Native Code</a></li>
<li class="toctree-l2"><a class="reference internal"
href="spark-sql-tests.html">Spark SQL Tests</a></li>
+<li class="toctree-l2"><a class="reference internal"
href="iceberg-spark-tests.html">Iceberg Spark Tests</a></li>
<li class="toctree-l2"><a class="reference internal"
href="sql-file-tests.html">SQL File Tests</a></li>
<li class="toctree-l2 current"><a class="current reference internal"
href="#">Roadmap</a></li>
<li class="toctree-l2"><a class="reference internal"
href="release_process.html">Release Process</a></li>
diff --git a/contributor-guide/spark-sql-tests.html
b/contributor-guide/spark-sql-tests.html
index f09713a9b..579fbeebc 100644
--- a/contributor-guide/spark-sql-tests.html
+++ b/contributor-guide/spark-sql-tests.html
@@ -65,7 +65,7 @@ under the License.
<script async="true" defer="true"
src="https://buttons.github.io/buttons.js"></script>
<link rel="index" title="Index" href="../genindex.html" />
<link rel="search" title="Search" href="../search.html" />
- <link rel="next" title="SQL File Tests" href="sql-file-tests.html" />
+ <link rel="next" title="Running Iceberg Spark Tests"
href="iceberg-spark-tests.html" />
<link rel="prev" title="Profiling Native Code"
href="profiling_native_code.html" />
<meta name="viewport" content="width=device-width, initial-scale=1"/>
<meta name="docsearch:language" content="en"/>
@@ -368,6 +368,7 @@ under the License.
<li class="toctree-l2"><a class="reference internal"
href="tracing.html">Tracing</a></li>
<li class="toctree-l2"><a class="reference internal"
href="profiling_native_code.html">Profiling Native Code</a></li>
<li class="toctree-l2 current"><a class="current reference internal"
href="#">Spark SQL Tests</a></li>
+<li class="toctree-l2"><a class="reference internal"
href="iceberg-spark-tests.html">Iceberg Spark Tests</a></li>
<li class="toctree-l2"><a class="reference internal"
href="sql-file-tests.html">SQL File Tests</a></li>
<li class="toctree-l2"><a class="reference internal"
href="roadmap.html">Roadmap</a></li>
<li class="toctree-l2"><a class="reference internal"
href="release_process.html">Release Process</a></li>
@@ -615,11 +616,11 @@ new version.</p>
</div>
</a>
<a class="right-next"
- href="sql-file-tests.html"
+ href="iceberg-spark-tests.html"
title="next page">
<div class="prev-next-info">
<p class="prev-next-subtitle">next</p>
- <p class="prev-next-title">SQL File Tests</p>
+ <p class="prev-next-title">Running Iceberg Spark Tests</p>
</div>
<i class="fa-solid fa-angle-right"></i>
</a>
diff --git a/contributor-guide/sql-file-tests.html
b/contributor-guide/sql-file-tests.html
index 22acaafa2..a8628a562 100644
--- a/contributor-guide/sql-file-tests.html
+++ b/contributor-guide/sql-file-tests.html
@@ -66,7 +66,7 @@ under the License.
<link rel="index" title="Index" href="../genindex.html" />
<link rel="search" title="Search" href="../search.html" />
<link rel="next" title="Comet Roadmap" href="roadmap.html" />
- <link rel="prev" title="Running Spark SQL Tests"
href="spark-sql-tests.html" />
+ <link rel="prev" title="Running Iceberg Spark Tests"
href="iceberg-spark-tests.html" />
<meta name="viewport" content="width=device-width, initial-scale=1"/>
<meta name="docsearch:language" content="en"/>
<meta name="docsearch:version" content="" />
@@ -368,6 +368,7 @@ under the License.
<li class="toctree-l2"><a class="reference internal"
href="tracing.html">Tracing</a></li>
<li class="toctree-l2"><a class="reference internal"
href="profiling_native_code.html">Profiling Native Code</a></li>
<li class="toctree-l2"><a class="reference internal"
href="spark-sql-tests.html">Spark SQL Tests</a></li>
+<li class="toctree-l2"><a class="reference internal"
href="iceberg-spark-tests.html">Iceberg Spark Tests</a></li>
<li class="toctree-l2 current"><a class="current reference internal"
href="#">SQL File Tests</a></li>
<li class="toctree-l2"><a class="reference internal"
href="roadmap.html">Roadmap</a></li>
<li class="toctree-l2"><a class="reference internal"
href="release_process.html">Release Process</a></li>
@@ -786,12 +787,12 @@ file and config combination, and executes them using
<code class="docutils liter
<div class="prev-next-area">
<a class="left-prev"
- href="spark-sql-tests.html"
+ href="iceberg-spark-tests.html"
title="previous page">
<i class="fa-solid fa-angle-left"></i>
<div class="prev-next-info">
<p class="prev-next-subtitle">previous</p>
- <p class="prev-next-title">Running Spark SQL Tests</p>
+ <p class="prev-next-title">Running Iceberg Spark Tests</p>
</div>
</a>
<a class="right-next"
diff --git a/contributor-guide/tracing.html b/contributor-guide/tracing.html
index be8bb705e..f9a9f7b74 100644
--- a/contributor-guide/tracing.html
+++ b/contributor-guide/tracing.html
@@ -368,6 +368,7 @@ under the License.
<li class="toctree-l2 current"><a class="current reference internal"
href="#">Tracing</a></li>
<li class="toctree-l2"><a class="reference internal"
href="profiling_native_code.html">Profiling Native Code</a></li>
<li class="toctree-l2"><a class="reference internal"
href="spark-sql-tests.html">Spark SQL Tests</a></li>
+<li class="toctree-l2"><a class="reference internal"
href="iceberg-spark-tests.html">Iceberg Spark Tests</a></li>
<li class="toctree-l2"><a class="reference internal"
href="sql-file-tests.html">SQL File Tests</a></li>
<li class="toctree-l2"><a class="reference internal"
href="roadmap.html">Roadmap</a></li>
<li class="toctree-l2"><a class="reference internal"
href="release_process.html">Release Process</a></li>
diff --git a/searchindex.js b/searchindex.js
index cc7a1fa85..ff6a33efc 100644
--- a/searchindex.js
+++ b/searchindex.js
@@ -1 +1 @@
-Search.setIndex({"alltitles": {"1. Format Your Code": [[12,
"format-your-code"]], "1. Install Comet": [[14, "install-comet"], [23,
"install-comet"]], "1. Native Operators (nativeExecs map)": [[4,
"native-operators-nativeexecs-map"]], "2. Build and Verify": [[12,
"build-and-verify"]], "2. Clone Iceberg and Apply Diff": [[14,
"clone-iceberg-and-apply-diff"]], "2. Clone Spark and Apply Diff": [[23,
"clone-spark-and-apply-diff"]], "2. Sink Operators (sinks map)": [[4,
"sink-operators-sinks-m [...]
\ No newline at end of file
+Search.setIndex({"alltitles": {"1. Format Your Code": [[12,
"format-your-code"]], "1. Install Comet": [[14, "install-comet"], [23,
"install-comet"]], "1. Native Operators (nativeExecs map)": [[4,
"native-operators-nativeexecs-map"]], "2. Build and Verify": [[12,
"build-and-verify"]], "2. Clone Iceberg and Apply Diff": [[14,
"clone-iceberg-and-apply-diff"]], "2. Clone Spark and Apply Diff": [[23,
"clone-spark-and-apply-diff"]], "2. Sink Operators (sinks map)": [[4,
"sink-operators-sinks-m [...]
\ No newline at end of file
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]