andygrove commented on PR #1654:
URL:
https://github.com/apache/datafusion-comet/pull/1654#issuecomment-3001260436
Working on this has not been a priority lately, so I'll close this for now.
Thanks for the collaboration @anuragmantri.
--
This is an automated message from the Apache Git S
andygrove closed pull request #1654: [wip] Add scripts for running benchmarks
on EC2
URL: https://github.com/apache/datafusion-comet/pull/1654
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the spe
andygrove commented on code in PR #1654:
URL: https://github.com/apache/datafusion-comet/pull/1654#discussion_r2073781405
##
dev/benchmarks/setup.sh:
##
@@ -0,0 +1,44 @@
+#!/bin/bash
+#
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license
andygrove commented on code in PR #1654:
URL: https://github.com/apache/datafusion-comet/pull/1654#discussion_r2073780545
##
dev/benchmarks/setup.sh:
##
@@ -0,0 +1,44 @@
+#!/bin/bash
+#
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license
andygrove commented on code in PR #1654:
URL: https://github.com/apache/datafusion-comet/pull/1654#discussion_r2073775557
##
dev/benchmarks/setup.sh:
##
@@ -0,0 +1,44 @@
+#!/bin/bash
+#
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license
anuragmantri commented on code in PR #1654:
URL: https://github.com/apache/datafusion-comet/pull/1654#discussion_r2069180747
##
dev/benchmarks/setup.sh:
##
@@ -0,0 +1,44 @@
+#!/bin/bash
+#
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor licen
anuragmantri commented on code in PR #1654:
URL: https://github.com/apache/datafusion-comet/pull/1654#discussion_r2069177697
##
dev/benchmarks/setup.sh:
##
@@ -0,0 +1,44 @@
+#!/bin/bash
+#
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor licen
parthchandra commented on PR #1654:
URL:
https://github.com/apache/datafusion-comet/pull/1654#issuecomment-2810825234
That is very odd. We don't see the same in an EKS cluster with S3 storage.
Is this consistently bad? Not a noisy neighbor issue, I hope?
--
This is an automated message f
andygrove commented on PR #1654:
URL:
https://github.com/apache/datafusion-comet/pull/1654#issuecomment-2810381769
The current status is that Comet is slower than Spark. Both Spark and Comet
take an extremely long time to complete the benchmark (~50 minutes compared to
10 minutes for Spark
codecov-commenter commented on PR #1654:
URL:
https://github.com/apache/datafusion-comet/pull/1654#issuecomment-2809855816
##
[Codecov](https://app.codecov.io/gh/apache/datafusion-comet/pull/1654?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_ca
andygrove opened a new pull request, #1654:
URL: https://github.com/apache/datafusion-comet/pull/1654
## Which issue does this PR close?
Part of https://github.com/apache/datafusion-comet/issues/1636
## Rationale for this change
Make it easier for anyone t
11 matches
Mail list logo
