Thanks to David's help, a likely fix for this issue has been merged: https://github.com/apache/arrow/pull/9593
On Sat, Feb 20, 2021 at 8:52 AM Andrew Lamb <al...@influxdata.com> wrote: > Thanks Davd. I have filed > https://issues.apache.org/jira/browse/ARROW-11717 to track > > On Fri, Feb 19, 2021 at 5:12 PM David Li <apa...@lidavidm.me> wrote: > >> @mrkn submitted a PR to add backtraces which was merged recently: >> https://github.com/apache/arrow/pull/9524 >> >> However I think the abort is a red herring - the C++ integration client >> aborts when anything fails. The UNAVAILABLE makes me think that the C++ >> client is starting and running before the Rust server has started >> listening, and then it fails. Either the harness should wait-for-ready or >> the C++ client should perhaps retry a few times on UNAVAILABLE. (One thing >> I would like to do, but never got around to, is changing servers to bind to >> port 0 and printing the actual port; then the harness would wait for the >> port to be printed before continuing. That would fix this, assuming my >> guess is correct, and would also avoid occasional failures where we bind to >> a port already in use for some reason.) >> >> Best, >> David >> >> On Fri, Feb 19, 2021, at 11:26, Andrew Lamb wrote: >> > I noticed that the Rust/CPP integration tests are failing seemingly >> > intermittently on master (and on Rust PRs). Is anyone else was looking >> into >> > this? I will have time tomorrow, but likely not today. >> > >> > There didn't seem to be any obviously open PRs or JIRA >> > >> > There are several commits that the little red `X` meaning that CI >> didn't >> > pass >> > https://github.com/apache/arrow/commits/master >> > >> > Here are some Some example CI runs that are failing >> > https://github.com/apache/arrow/runs/1935673508 >> > https://github.com/apache/arrow/runs/1926705212 >> > >> > Here is an example: >> > >> > Testing file auth:basic_proto >> > 9201 <https://github.com/apache/arrow/runs/1926705212#step:8:9201 >> >========================================================== >> > >> > 9202 <https://github.com/apache/arrow/runs/1926705212#step:8:9202 >> >Traceback >> > (most recent call last): >> > 9203 <https://github.com/apache/arrow/runs/1926705212#step:8:9203 >> >################# >> > FAILURES ################# >> > 9204 <https://github.com/apache/arrow/runs/1926705212#step:8:9204> File >> > "/arrow/dev/archery/archery/integration/util.py", line 139, in run_cmd >> > 9205 <https://github.com/apache/arrow/runs/1926705212#step:8:9205> >> output = >> > subprocess.check_output(cmd, stderr=subprocess.STDOUT) >> > 9206 <https://github.com/apache/arrow/runs/1926705212#step:8:9206> File >> > "/opt/conda/envs/arrow/lib/python3.8/subprocess.py", line 411, in >> > check_output >> > 9207 <https://github.com/apache/arrow/runs/1926705212#step:8:9207> >> return >> > run(*popenargs, stdout=PIPE, timeout=timeout, check=True, >> > 9208 <https://github.com/apache/arrow/runs/1926705212#step:8:9208> File >> > "/opt/conda/envs/arrow/lib/python3.8/subprocess.py", line 512, in run >> > 9209 <https://github.com/apache/arrow/runs/1926705212#step:8:9209> >> raise >> > CalledProcessError(retcode, process.args, >> > 9210 <https://github.com/apache/arrow/runs/1926705212#step:8:9210 >> >subprocess.CalledProcessError: >> > Command '['/build/cpp/debug/flight-test-integration-client', '-host', >> > 'localhost', '-port=45809', '-scenario', 'auth:basic_proto']' died with >> > <Signals.SIGABRT: 6>. >> > 9211 <https://github.com/apache/arrow/runs/1926705212#step:8:9211> >> > 9212 <https://github.com/apache/arrow/runs/1926705212#step:8:9212 >> >During >> > handling of the above exception, another exception occurred: >> > 9213 <https://github.com/apache/arrow/runs/1926705212#step:8:9213> >> > 9214 <https://github.com/apache/arrow/runs/1926705212#step:8:9214 >> >Traceback >> > (most recent call last): >> > 9215 <https://github.com/apache/arrow/runs/1926705212#step:8:9215> File >> > "/arrow/dev/archery/archery/integration/runner.py", line 308, in >> > _run_flight_test_case >> > 9216 <https://github.com/apache/arrow/runs/1926705212#step:8:9216> >> > consumer.flight_request(port, **client_args) >> > 9217 <https://github.com/apache/arrow/runs/1926705212#step:8:9217> File >> > "/arrow/dev/archery/archery/integration/tester_cpp.py", line 116, in >> > flight_request >> > 9218 <https://github.com/apache/arrow/runs/1926705212#step:8:9218> >> > run_cmd(cmd) >> > 9219 <https://github.com/apache/arrow/runs/1926705212#step:8:9219> File >> > "/arrow/dev/archery/archery/integration/util.py", line 148, in run_cmd >> > 9220 <https://github.com/apache/arrow/runs/1926705212#step:8:9220> >> raise >> > RuntimeError(sio.getvalue()) >> > 9221 <https://github.com/apache/arrow/runs/1926705212#step:8:9221 >> >RuntimeError: >> > Command failed: /build/cpp/debug/flight-test-integration-client -host >> > localhost -port=45809 -scenario auth:basic_proto >> > 9222 <https://github.com/apache/arrow/runs/1926705212#step:8:9222>With >> > output: >> > 9223 <https://github.com/apache/arrow/runs/1926705212#step:8:9223 >> >-------------- >> > >> > 9224 <https://github.com/apache/arrow/runs/1926705212#step:8:9224>-- >> Arrow >> > Fatal Error -- >> > 9225 <https://github.com/apache/arrow/runs/1926705212#step:8:9225 >> >Invalid: >> > Expected UNAUTHENTICATED but got Unavailable >> > 9226 <https://github.com/apache/arrow/runs/1926705212#step:8:9226> >> > >> >
