potiuk opened a new issue, #42999:
URL: https://github.com/apache/airflow/issues/42999

   It looks like after the provider move in #42505, "main" tip caching for 
airflow is broken. Before the change installing airflow had use two stages 
caching:
   
   1) Airflow has been installed from main first (which allowed to perform 
pre-installation without invalidation of docker layer)
   2) Then additional installation was done after copying latest sources and 
pyproject.toml/hatch
   
   This allowed for very fast rebuilds of the image using remote cache built on 
ghcr.io, when only source files or dependencies of airlfow changed.
   
   It usually took 2-5 seconds to rebuild such image. Currently it looks like 
second installation step is running again full installation of airlfow (it 
takes about 2 minutes), which means that likely some mechanism of caching is 
broken.
   
   
![Image](https://github.com/user-attachments/assets/d4ef2d3e-4136-4586-ac9b-1b0b7b50eb6b)
   
   We should review and updated Dockerfile.ci and scripts to bring the speed 
back.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to