andygrove commented on issue #1786: URL: https://github.com/apache/datafusion-comet/issues/1786#issuecomment-2907932180
> Here is an example CI Failure: > > * https://github.com/apache/datafusion-comet/actions/runs/15201820724/job/42757252219 > > > [@andygrove](https://github.com/andygrove) can you help me understand what the symptom is? I am not familiar with spark tests and I couldn't figure out how to see what the actual error is. All I found was > > ``` > [INFO] ------------------------------------------------------- > [INFO] T E S T S > [INFO] ------------------------------------------------------- > [INFO] Running org.apache.comet.parquet.TestFileReader > [INFO] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.709 s -- in org.apache.comet.parquet.TestFileReader > [INFO] Running org.apache.comet.parquet.TestColumnReader > 25/05/23 03:52:58 INFO core/src/lib.rs: Comet native library version 0.9.0 initialized > [INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.118 s -- in org.apache.comet.parquet.TestColumnReader > [INFO] Running org.apache.comet.parquet.TestCometInputFile > [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 s -- in org.apache.comet.parquet.TestCometInputFile > [INFO] > [INFO] Results: > ``` Thanks for looking at this @alamb. The symptom is that the tests appear to start slowing down massively (tests that should take 3 seconds take 9 minutes) and then GitHub kills the process because it is unable to communicate with it. Here is example output: ``` Sat, 24 May 2025 02:45:30 GMT - columnar shuffle on map [float] (3 seconds, 751 milliseconds) Sat, 24 May 2025 02:45:34 GMT - columnar shuffle on map [double] (3 seconds, 776 milliseconds) Sat, 24 May 2025 02:45:42 GMT - columnar shuffle on map [date] (7 seconds, 957 milliseconds) Sat, 24 May 2025 02:54:54 GMT - columnar shuffle on map [timestamp] (9 minutes, 11 seconds) Sat, 24 May 2025 03:05:03 GMT [INFO] ------------------------------------------------------------------------ Sat, 24 May 2025 03:05:03 GMT [INFO] Reactor Summary for Comet Project Parent POM 0.9.0-SNAPSHOT: ``` These tests usually take 3 seconds each. Currently the issue consistently happens during these particular tests, but sometimes they run without issue. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
