alamb commented on code in PR #14604:
URL: https://github.com/apache/datafusion/pull/14604#discussion_r1950709829
##########
.github/workflows/extended.yml:
##########
@@ -52,28 +52,30 @@ jobs:
cargo check --profile ci --all-targets
cargo clean
- # Run extended tests (with feature 'extended_tests')
- linux-test-extended:
- name: cargo test 'extended_tests' (amd64)
- needs: linux-build-lib
- runs-on: ubuntu-latest
- container:
- image: amd64/rust
- steps:
- - uses: actions/checkout@v4
- with:
- submodules: true
- fetch-depth: 1
- - name: Setup Rust toolchain
- uses: ./.github/actions/setup-builder
- with:
- rust-version: stable
- - name: Run tests (excluding doctests)
- run: cargo test --profile ci --exclude datafusion-examples --exclude
datafusion-benchmarks --workspace --lib --tests --bins --features
avro,json,backtrace,extended_tests
- - name: Verify Working Directory Clean
- run: git diff --exit-code
- - name: Cleanup
- run: cargo clean
+# # Run extended tests (with feature 'extended_tests')
+# # Disabling as it is running out of disk space
+# # see https://github.com/apache/datafusion/issues/14576
+# linux-test-extended:
Review Comment:
This test was added by @2010YOUY01 in
- #14142
It started failing after
- https://github.com/apache/datafusion/pull/14483
I suspect something about the test is using too much disk space
Note when I ran
```shell
cargo test --profile ci --exclude datafusion-examples --exclude
datafusion-benchmarks --workspace --lib --tests --bins --features
avro,json,backtrace,extended_tests
```
Locally, my target directory was 4GB
However, after `extended_tests` ran, the target directory was 14GB
```
$ du -s -h target
14G target
14G target
```
I suspect what is happening is that sort mem validation call is somehow
recompiling the entire workspace
https://github.com/apache/datafusion/blob/0283077c63d7b9a7464bc75f0686774cd5d10924/datafusion/core/tests/memory_limit/memory_limit_validation/sort_mem_validation.rs#L81-L95
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
