This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 106b4c229 Publish built docs triggered by
45b670a2a967d042722bea58a0768e17d905614a
106b4c229 is described below
commit 106b4c22912d3e218f649185b76a97cf754c803b
Author: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
AuthorDate: Fri Feb 20 23:48:56 2026 +0000
Publish built docs triggered by 45b670a2a967d042722bea58a0768e17d905614a
---
_sources/about/gluten_comparison.md.txt | 2 +-
.../contributor-guide/benchmark-results/tpc-ds.md.txt | 2 +-
_sources/contributor-guide/benchmark-results/tpc-h.md.txt | 2 +-
_sources/contributor-guide/benchmarking.md.txt | 2 +-
_sources/contributor-guide/benchmarking_aws_ec2.md.txt | 15 ++++++++++-----
about/gluten_comparison.html | 2 +-
contributor-guide/benchmark-results/tpc-ds.html | 2 +-
contributor-guide/benchmark-results/tpc-h.html | 2 +-
contributor-guide/benchmarking.html | 2 +-
contributor-guide/benchmarking_aws_ec2.html | 14 +++++++++-----
searchindex.js | 2 +-
11 files changed, 28 insertions(+), 19 deletions(-)
diff --git a/_sources/about/gluten_comparison.md.txt
b/_sources/about/gluten_comparison.md.txt
index 492479bb9..40c6c2741 100644
--- a/_sources/about/gluten_comparison.md.txt
+++ b/_sources/about/gluten_comparison.md.txt
@@ -86,7 +86,7 @@ on your existing Spark jobs.
-The scripts that were used to generate these results can be found
[here](https://github.com/apache/datafusion-comet/tree/main/dev/benchmarks).
+The scripts that were used to generate these results can be found
[here](https://github.com/apache/datafusion-comet/tree/main/benchmarks/tpc).
## Ease of Development & Contributing
diff --git a/_sources/contributor-guide/benchmark-results/tpc-ds.md.txt
b/_sources/contributor-guide/benchmark-results/tpc-ds.md.txt
index 66ff2e51a..bea254cc0 100644
--- a/_sources/contributor-guide/benchmark-results/tpc-ds.md.txt
+++ b/_sources/contributor-guide/benchmark-results/tpc-ds.md.txt
@@ -46,4 +46,4 @@ The raw results of these benchmarks in JSON format is
available here:
- [Spark](spark-3.5.3-tpcds.json)
- [Comet](comet-0.11.0-tpcds.json)
-The scripts that were used to generate these results can be found
[here](https://github.com/apache/datafusion-comet/tree/main/dev/benchmarks).
+The scripts that were used to generate these results can be found
[here](https://github.com/apache/datafusion-comet/tree/main/benchmarks/tpc).
diff --git a/_sources/contributor-guide/benchmark-results/tpc-h.md.txt
b/_sources/contributor-guide/benchmark-results/tpc-h.md.txt
index 4424d9eac..2170426c0 100644
--- a/_sources/contributor-guide/benchmark-results/tpc-h.md.txt
+++ b/_sources/contributor-guide/benchmark-results/tpc-h.md.txt
@@ -46,4 +46,4 @@ The raw results of these benchmarks in JSON format is
available here:
- [Spark](spark-3.5.3-tpch.json)
- [Comet](comet-0.11.0-tpch.json)
-The scripts that were used to generate these results can be found
[here](https://github.com/apache/datafusion-comet/tree/main/dev/benchmarks).
+The scripts that were used to generate these results can be found
[here](https://github.com/apache/datafusion-comet/tree/main/benchmarks/tpc).
diff --git a/_sources/contributor-guide/benchmarking.md.txt
b/_sources/contributor-guide/benchmarking.md.txt
index 768089c95..49af73376 100644
--- a/_sources/contributor-guide/benchmarking.md.txt
+++ b/_sources/contributor-guide/benchmarking.md.txt
@@ -21,7 +21,7 @@ under the License.
To track progress on performance, we regularly run benchmarks derived from
TPC-H and TPC-DS.
-The benchmarking scripts are contained at
[https://github.com/apache/datafusion-comet/tree/main/dev/benchmarks](https://github.com/apache/datafusion-comet/tree/main/dev/benchmarks).
+The benchmarking scripts are contained
[here](https://github.com/apache/datafusion-comet/tree/main/benchmarks/tpc).
Data generation scripts are available in the [DataFusion
Benchmarks](https://github.com/apache/datafusion-benchmarks) GitHub repository.
diff --git a/_sources/contributor-guide/benchmarking_aws_ec2.md.txt
b/_sources/contributor-guide/benchmarking_aws_ec2.md.txt
index 922b0379f..81f15d64e 100644
--- a/_sources/contributor-guide/benchmarking_aws_ec2.md.txt
+++ b/_sources/contributor-guide/benchmarking_aws_ec2.md.txt
@@ -109,23 +109,23 @@ export
COMET_JAR=/home/ec2-user/datafusion-comet/spark/target/comet-spark-spark3
## Run Benchmarks
-Use the scripts in `dev/benchmarks` in the Comet repository.
+Use the scripts in `benchmarks/tpc` in the Comet repository.
```shell
-cd dev/benchmarks
+cd benchmarks/tpc
export TPCH_QUERIES=/home/ec2-user/datafusion-benchmarks/tpch/queries/
```
Run Spark benchmark:
```shell
-./spark-tpch.sh
+python3 run.py --engine spark --benchmark tpch
```
Run Comet benchmark:
```shell
-./comet-tpch.sh
+python3 run.py --engine comet --benchmark tpch
```
## Running Benchmarks with S3
@@ -164,4 +164,9 @@ Modify the scripts to add the following configurations.
--conf
spark.hadoop.fs.s3a.aws.credentials.provider=com.amazonaws.auth.DefaultAWSCredentialsProviderChain
\
```
-Now run the `spark-tpch.sh` and `comet-tpch.sh` scripts.
+Now run the benchmarks:
+
+```shell
+python3 run.py --engine spark --benchmark tpch
+python3 run.py --engine comet --benchmark tpch
+```
diff --git a/about/gluten_comparison.html b/about/gluten_comparison.html
index 5463289a6..5bb9342a9 100644
--- a/about/gluten_comparison.html
+++ b/about/gluten_comparison.html
@@ -486,7 +486,7 @@ real-world queries, especially for ETL use cases. For
example, there are no comp
manipulation, regular expressions, or other advanced expressions. We recommend
running your own benchmarks based
on your existing Spark jobs.</p>
<p><img alt="tpch_allqueries_comet_gluten.png"
src="../_images/tpch_allqueries_comet_gluten.png" /></p>
-<p>The scripts that were used to generate these results can be found <a
class="reference external"
href="https://github.com/apache/datafusion-comet/tree/main/dev/benchmarks";>here</a>.</p>
+<p>The scripts that were used to generate these results can be found <a
class="reference external"
href="https://github.com/apache/datafusion-comet/tree/main/benchmarks/tpc";>here</a>.</p>
</section>
<section id="ease-of-development-contributing">
<h2>Ease of Development & Contributing<a class="headerlink"
href="#ease-of-development-contributing" title="Link to this heading">#</a></h2>
diff --git a/contributor-guide/benchmark-results/tpc-ds.html
b/contributor-guide/benchmark-results/tpc-ds.html
index 717a7357b..bdec15e2c 100644
--- a/contributor-guide/benchmark-results/tpc-ds.html
+++ b/contributor-guide/benchmark-results/tpc-ds.html
@@ -450,7 +450,7 @@ and we encourage you to run these benchmarks in your own
environments.</p>
<li><p><a class="reference download internal" download=""
href="../../_downloads/691c4d0de20912f9bfe9bc93cc4c0322/spark-3.5.3-tpcds.json"><span
class="xref download myst">Spark</span></a></p></li>
<li><p><a class="reference download internal" download=""
href="../../_downloads/e99da73332ec78f8d5352d7a97633676/comet-0.11.0-tpcds.json"><span
class="xref download myst">Comet</span></a></p></li>
</ul>
-<p>The scripts that were used to generate these results can be found <a
class="reference external"
href="https://github.com/apache/datafusion-comet/tree/main/dev/benchmarks";>here</a>.</p>
+<p>The scripts that were used to generate these results can be found <a
class="reference external"
href="https://github.com/apache/datafusion-comet/tree/main/benchmarks/tpc";>here</a>.</p>
</section>
diff --git a/contributor-guide/benchmark-results/tpc-h.html
b/contributor-guide/benchmark-results/tpc-h.html
index 486916d78..6ee1c99b1 100644
--- a/contributor-guide/benchmark-results/tpc-h.html
+++ b/contributor-guide/benchmark-results/tpc-h.html
@@ -450,7 +450,7 @@ and we encourage you to run these benchmarks in your own
environments.</p>
<li><p><a class="reference download internal" download=""
href="../../_downloads/d04daf16cce1beaaea0838b85a43681f/spark-3.5.3-tpch.json"><span
class="xref download myst">Spark</span></a></p></li>
<li><p><a class="reference download internal" download=""
href="../../_downloads/630e0c756aee2808a8601fb18b5a990b/comet-0.11.0-tpch.json"><span
class="xref download myst">Comet</span></a></p></li>
</ul>
-<p>The scripts that were used to generate these results can be found <a
class="reference external"
href="https://github.com/apache/datafusion-comet/tree/main/dev/benchmarks";>here</a>.</p>
+<p>The scripts that were used to generate these results can be found <a
class="reference external"
href="https://github.com/apache/datafusion-comet/tree/main/benchmarks/tpc";>here</a>.</p>
</section>
diff --git a/contributor-guide/benchmarking.html
b/contributor-guide/benchmarking.html
index 8407a523c..91b96683a 100644
--- a/contributor-guide/benchmarking.html
+++ b/contributor-guide/benchmarking.html
@@ -458,7 +458,7 @@ under the License.
<section id="comet-benchmarking-guide">
<h1>Comet Benchmarking Guide<a class="headerlink"
href="#comet-benchmarking-guide" title="Link to this heading">#</a></h1>
<p>To track progress on performance, we regularly run benchmarks derived from
TPC-H and TPC-DS.</p>
-<p>The benchmarking scripts are contained at <a class="github reference
external"
href="https://github.com/apache/datafusion-comet/tree/main/dev/benchmarks";>apache/datafusion-comet</a>.</p>
+<p>The benchmarking scripts are contained <a class="reference external"
href="https://github.com/apache/datafusion-comet/tree/main/benchmarks/tpc";>here</a>.</p>
<p>Data generation scripts are available in the <a class="reference external"
href="https://github.com/apache/datafusion-benchmarks";>DataFusion
Benchmarks</a> GitHub repository.</p>
<section id="current-benchmark-results">
<h2>Current Benchmark Results<a class="headerlink"
href="#current-benchmark-results" title="Link to this heading">#</a></h2>
diff --git a/contributor-guide/benchmarking_aws_ec2.html
b/contributor-guide/benchmarking_aws_ec2.html
index 17939e671..d2ab8cff4 100644
--- a/contributor-guide/benchmarking_aws_ec2.html
+++ b/contributor-guide/benchmarking_aws_ec2.html
@@ -510,17 +510,17 @@ make<span class="w"> </span>release
</section>
<section id="run-benchmarks">
<h2>Run Benchmarks<a class="headerlink" href="#run-benchmarks" title="Link to
this heading">#</a></h2>
-<p>Use the scripts in <code class="docutils literal notranslate"><span
class="pre">dev/benchmarks</span></code> in the Comet repository.</p>
-<div class="highlight-shell notranslate"><div
class="highlight"><pre><span></span><span class="nb">cd</span><span class="w">
</span>dev/benchmarks
+<p>Use the scripts in <code class="docutils literal notranslate"><span
class="pre">benchmarks/tpc</span></code> in the Comet repository.</p>
+<div class="highlight-shell notranslate"><div
class="highlight"><pre><span></span><span class="nb">cd</span><span class="w">
</span>benchmarks/tpc
<span class="nb">export</span><span class="w"> </span><span
class="nv">TPCH_QUERIES</span><span
class="o">=</span>/home/ec2-user/datafusion-benchmarks/tpch/queries/
</pre></div>
</div>
<p>Run Spark benchmark:</p>
-<div class="highlight-shell notranslate"><div
class="highlight"><pre><span></span>./spark-tpch.sh
+<div class="highlight-shell notranslate"><div
class="highlight"><pre><span></span>python3<span class="w"> </span>run.py<span
class="w"> </span>--engine<span class="w"> </span>spark<span class="w">
</span>--benchmark<span class="w"> </span>tpch
</pre></div>
</div>
<p>Run Comet benchmark:</p>
-<div class="highlight-shell notranslate"><div
class="highlight"><pre><span></span>./comet-tpch.sh
+<div class="highlight-shell notranslate"><div
class="highlight"><pre><span></span>python3<span class="w"> </span>run.py<span
class="w"> </span>--engine<span class="w"> </span>comet<span class="w">
</span>--benchmark<span class="w"> </span>tpch
</pre></div>
</div>
</section>
@@ -550,7 +550,11 @@ wget<span class="w">
</span>https://repo1.maven.org/maven2/com/amazonaws/aws-jav
--conf<span class="w">
</span>spark.hadoop.fs.s3a.aws.credentials.provider<span
class="o">=</span>com.amazonaws.auth.DefaultAWSCredentialsProviderChain<span
class="w"> </span><span class="se">\</span>
</pre></div>
</div>
-<p>Now run the <code class="docutils literal notranslate"><span
class="pre">spark-tpch.sh</span></code> and <code class="docutils literal
notranslate"><span class="pre">comet-tpch.sh</span></code> scripts.</p>
+<p>Now run the benchmarks:</p>
+<div class="highlight-shell notranslate"><div
class="highlight"><pre><span></span>python3<span class="w"> </span>run.py<span
class="w"> </span>--engine<span class="w"> </span>spark<span class="w">
</span>--benchmark<span class="w"> </span>tpch
+python3<span class="w"> </span>run.py<span class="w"> </span>--engine<span
class="w"> </span>comet<span class="w"> </span>--benchmark<span class="w">
</span>tpch
+</pre></div>
+</div>
</section>
</section>
diff --git a/searchindex.js b/searchindex.js
index 47b3eb6a1..7a4ca8d25 100644
--- a/searchindex.js
+++ b/searchindex.js
@@ -1 +1 @@
-Search.setIndex({"alltitles": {"1. Format Your Code": [[12,
"format-your-code"]], "1. Install Comet": [[22, "install-comet"]], "1. Native
Operators (nativeExecs map)": [[4, "native-operators-nativeexecs-map"]], "2.
Build and Verify": [[12, "build-and-verify"]], "2. Clone Spark and Apply Diff":
[[22, "clone-spark-and-apply-diff"]], "2. Sink Operators (sinks map)": [[4,
"sink-operators-sinks-map"]], "3. Comet JVM Operators": [[4,
"comet-jvm-operators"]], "3. Run Clippy (Recommended)": [[12 [...]
\ No newline at end of file
+Search.setIndex({"alltitles": {"1. Format Your Code": [[12,
"format-your-code"]], "1. Install Comet": [[22, "install-comet"]], "1. Native
Operators (nativeExecs map)": [[4, "native-operators-nativeexecs-map"]], "2.
Build and Verify": [[12, "build-and-verify"]], "2. Clone Spark and Apply Diff":
[[22, "clone-spark-and-apply-diff"]], "2. Sink Operators (sinks map)": [[4,
"sink-operators-sinks-map"]], "3. Comet JVM Operators": [[4,
"comet-jvm-operators"]], "3. Run Clippy (Recommended)": [[12 [...]
\ No newline at end of file
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
