Re: [DISCUSS] What we do with extras for Airflow 3

2024-10-18 Thread Jarek Potiuk
BTW, I am planning to turn the doc into a blog post on Airflow Medium (I think it provides a nice description on the extra usage for Airflow) - so I want to make a blog about "Airflow 2 how to use extras" - following with "Airflow 3 how to use extras" once we come to conclusions re: packaging and

Re: [DISCUSS] Airflow debugging survey report & action items

2024-10-18 Thread Kaxil Naik
Great work here Omkar, Iliya & Amogh for all your hard work on this 👏🏻 On Fri, 18 Oct 2024 at 23:25, Omkar P wrote: > Hey all, > > Hope you are doing great! > > So recently the Airflow debugging survey made the rounds and we've > received a total of 69 responses. > > We've analyzed those respons

[DISCUSS] Airflow debugging survey report & action items

2024-10-18 Thread Omkar P
Hey all, Hope you are doing great! So recently the Airflow debugging survey made the rounds and we've received a total of 69 responses. We've analyzed those responses and created a report which we can refer to for creation of GH issues to improve Airflow. There's a new GH project created today

Re: [DISCUSS] Airflow debugging survey report & action items

2024-10-18 Thread Vikram Koka
+1 Excellent work, Omkar, lliya, and Amogh. Really appreciate the details in the report. It was fascinating reading! Looking forward to seeing the changes in response. Vikram On Fri, Oct 18, 2024 at 4:15 PM Kaxil Naik wrote: > Great work here Omkar, Iliya & Amogh for all your hard work on thi

Re: [DISCUSS] Create community "Apache YuniKorn" executor ?

2024-10-18 Thread Shubham Raj
Hi Jarek, Amogh, and everyone, I wanted to share my thoughts on the proposal to integrate YuniKorn, and I'm definitely on board with it! As others mentioned, adding YuniKorn as another executor could really enhance our scheduling capabilities, especially for the more complex scenarios that Celery