Omega359 commented on issue #13813:
URL: https://github.com/apache/datafusion/issues/13813#issuecomment-2556243727

   I've managed to knock some time off of the ci runs on a sidebranch (need to 
rebase off of main before pushing a PR) bu here is what I've managed to get to 
so far:
   
   an example of a PR run now:
   
![image](https://github.com/user-attachments/assets/c9f0cb07-e69e-4f08-bd3b-1f9efc419026)
   
   my sidebranch on the second run (cache populated)
   
![image](https://github.com/user-attachments/assets/9d79c863-f380-4dc8-a297-4045bc1b41a7)
   
   cargo test doc and hash collisions are the two ones right now that take the 
most time and much of that is DF compilation that can't really be cached (would 
blow out the 10GB cache limit I think).
   
   Most of the improvement is better caching, splitting up the linux build test 
into multiple jobs (it's all cargo checks), and switching to nextest for many 
tests. I also disabled the intel mac build test.
   
   I hope to submit a PR this weekend for this. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For additional commands, e-mail: github-h...@datafusion.apache.org

Reply via email to