This is a bit of a usability papercut as I also hit this. I filed a ticket about making it better[1]
[1] https://github.com/apache/datafusion/issues/17194 On Thu, Aug 14, 2025 at 11:24 AM Marko Milenković <milenkovi...@gmail.com> wrote: > Thanks Tim, > Looks like number of open files are in 512 to 1024 range :) > > +1 (non binding) MacOS15.6 M4 > > Thanks Andrew! > > > -- > Marko Milenković > > > > > > On 14 Aug 2025, at 16:03, Tim Saucer <timsau...@gmail.com> wrote: > > > > Hi Marko, > > > > I regularly get this failure on my mac m4 also. I added `ulimit -n 4096` > to > > my .zshrc to avoid it. > > > > Best, > > Tim > > > > On Thu, Aug 14, 2025 at 10:59 AM Marko Milenković < > milenkovi...@gmail.com> > > wrote: > > > >> I’m getting > >> > >> ---- fuzz_cases::sort_fuzz::test_sort_10k_mem stdout ---- > >> > >> thread 'fuzz_cases::sort_fuzz::test_sort_10k_mem' panicked at > >> datafusion/core/tests/fuzz_cases/sort_fuzz.rs:269:63: > >> called `Result::unwrap()` on an `Err` value: Execution("Failed to create > >> partition file at > >> > \"/var/folders/h_/cdg2zx090212402xhrwhv62w0000gn/T/.tmpdhEV7B/.tmpIhvMHc\": > >> Os { code: 24, kind: Uncategorized, message: \"Too many open files\" }") > >> note: run with `RUST_BACKTRACE=1` environment variable to display a > >> backtrace > >> > >> > >> failures: > >> fuzz_cases::sort_fuzz::test_sort_10k_mem > >> > >> test result: FAILED. 75 passed; 1 failed; 0 ignored; 0 measured; 0 > >> filtered out; finished in 73.00s > >> > >> MacOS15.6 M4 > >> > >> I’ve tried few times with same error, > >> I guess it could be changed if open file limit is increased > >> > >> > >> > >> -- > >> Marko Milenković > >> > >> > >> > >> > >>> On 14 Aug 2025, at 15:43, Andy Grove <andygrov...@gmail.com> wrote: > >>> > >>> I downloaded the tarball, verified the checksum, ran the release > >>> verification script from the downloaded source, and saw the following > >> test > >>> failure: > >>> > >>> External error: 1 errors in file > >>> > >> > /tmp/datafusion-49.0.1.RnL9I/apache-datafusion-49.0.1/datafusion/sqllogictest/test_files/joins.slt > >>> > >>> 1. query result mismatch: > >>> [SQL] SELECT t1_id, t1_name, t2_name FROM t1 CROSS JOIN t2 ORDER BY > t1_id > >>> [Diff] (-expected|+actual) > >>> - 11 a z > >>> - 11 a y > >>> 11 a x > >>> 11 a w > >>> + 11 a z > >>> + 11 a y > >>> + 22 b x > >>> + 22 b w > >>> 22 b z > >>> 22 b y > >>> - 22 b x > >>> - 22 b w > >>> + 33 c x > >>> + 33 c w > >>> 33 c z > >>> 33 c y > >>> - 33 c x > >>> - 33 c w > >>> - 44 d z > >>> - 44 d y > >>> 44 d x > >>> - 44 d w > >>> + 44 d w > >>> + 44 d z > >>> + 44 d y > >>> at > >>> > >> > /tmp/datafusion-49.0.1.RnL9I/apache-datafusion-49.0.1/datafusion/sqllogictest/test_files/joins.slt:727 > >>> > >>> > >>> On Thu, Aug 14, 2025 at 8:28 AM Andrew Lamb <andrewlam...@gmail.com> > >> wrote: > >>> > >>>> Hi, > >>>> > >>>> I would like to propose a release of Apache DataFusion version 49.0.1. > >>>> > >>>> This release candidate is based on commit: > >>>> d1a6e9a6558300115d913a54bbea27e141156606 [1] > >>>> The proposed release tarball and signatures are hosted at [2]. > >>>> The changelog is located at [3]. > >>>> > >>>> Please download, verify checksums and signatures, run the unit tests, > >> and > >>>> vote > >>>> on the release. The vote will be open for at least 72 hours. > >>>> > >>>> Only votes from PMC members are binding, but all members of the > >> community > >>>> are > >>>> encouraged to test the release and vote with "(non-binding)". > >>>> > >>>> The standard verification procedure is documented at > >>>> > >>>> > >> > https://github.com/apache/datafusion/blob/main/dev/release/README.md#verifying-release-candidates > >>>> . > >>>> > >>>> [ ] +1 Release this as Apache DataFusion 49.0.1 > >>>> [ ] +0 > >>>> [ ] -1 Do not release this as Apache DataFusion 49.0.1 because... > >>>> > >>>> Here is my vote: > >>>> > >>>> +1 > >>>> > >>>> [1]: > >>>> > >>>> > >> > https://github.com/apache/datafusion/tree/d1a6e9a6558300115d913a54bbea27e141156606 > >>>> [2]: > >>>> > >>>> > >> > https://dist.apache.org/repos/dist/dev/datafusion/apache-datafusion-49.0.1-rc1 > >>>> [3]: > >>>> > >>>> > >> > https://github.com/apache/datafusion/blob/d1a6e9a6558300115d913a54bbea27e141156606/CHANGELOG.md > >>>> > >> > >> > >> --------------------------------------------------------------------- > >> To unsubscribe, e-mail: dev-unsubscr...@datafusion.apache.org > >> For additional commands, e-mail: dev-h...@datafusion.apache.org > >> > >> > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: dev-unsubscr...@datafusion.apache.org > For additional commands, e-mail: dev-h...@datafusion.apache.org > >
