Sruhvx-jpg opened a new pull request, #26902:
URL: https://github.com/apache/datafusion/pull/26902

   # Which issue does this PR close?
   
   Closes part of #26759.
   
   # Rationale for this change
   
   In CI extended runs, `leaf_pushdown_fuzz_extended` bottlenecks runners for 
~230 seconds by sequentially running 5,000 in-memory cases followed by 1,000 
Parquet cases on a single thread.
   
   Per maintainer feedback in #26843, this PR splits the extended test into 
smaller, parallel sub-tests rather than adding internal concurrency machinery.
   
   # What changes are included in this PR?
   
   - Splits the 5,000 in-memory cases of `leaf_pushdown_fuzz_extended` into 4 
partitioned test targets (1,250 cases each with disjoint seed ranges).
   - Isolates the 1,000 Parquet cases into 
`leaf_pushdown_fuzz_extended_parquet`.
   - Relies on Cargo's native test runner to execute the sub-tests concurrently 
across available cores.
   - `async fn run(...)` remains unchanged. Total case count and deterministic 
seed reproduction are fully preserved.
   
   # Are these changes tested?
   
   Yes, tested via `cargo test --features extended_tests --test extended_tests 
-- leaf_pushdown`.
   
   Locally, total wall-clock runtime for the extended suite dropped from 
**141.2s** down to **47.5s** (-66% time) with all 8 tests passing.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to