Re: [VOTE] Airflow Providers prepared on May 26, 2024

+1 non binding Tested my changes for Hive Provider and things work fine. Thanks & Regards, Amogh Desai On Tue, May 28, 2024 at 8:40 AM Josh Fell wrote: > +1 (non-binding) > > On Mon, May 27, 2024 at 7:24 PM Wei Lee wrote: > > > -1 (non-binding) for apache-airflow-providers-cncf-kubernetes, a

Re: Airflow 3 Dev Calls: Registration + Schedule

Lovely! Looking forward to it. Btw, as Jarek mentioned, many folks would be travelling for Community Over Code, next week and we also have some public holidays in some countries. Could we revise based on that? Btw, @Kaxil Naik , the calendar link: https://astronomer.zoom.us/meeting/tZAsde2vqDwpE9

Re: [DISCUSS] Proposal to enhance Backfills

Good proposal! I like the idea here but again talking in terms of timelines, do we make it in Airflow 2 if it's that critical or can it wait till Airflow 3? I think we should scope this out and add some technical data to back this up before making this an AIP. Thanks & Regards, Amogh Desai On S

Re: [VOTE] Airflow Providers prepared on May 26, 2024

+1 (non-binding) On Mon, May 27, 2024 at 7:24 PM Wei Lee wrote: > -1 (non-binding) for apache-airflow-providers-cncf-kubernetes, as Rahul > found an issue. > The issue is fixed in , as > mentioned. > > Best, > Wei > > > > On May 28, 2024, at 12:17 AM

[DISCUSS] Proposal for Synchronous (aka Interactive) DAG Execution

Fellow Airflowers, I am following up on some of the proposed changes in the Airflow 3 proposal , where more information was requested by the community. One specific topic was "Interactive DAG runs". This is not yet

Re: [VOTE] Airflow Providers prepared on May 26, 2024

-1 (non-binding) for apache-airflow-providers-cncf-kubernetes, as Rahul found an issue. The issue is fixed in , as mentioned. Best, Wei > On May 28, 2024, at 12:17 AM, Vincent Beck wrote: > > +1 non binding. All AWS system tests are running succe

Re: Airflow 3 Dev Calls: Registration + Schedule

Just a note - the first meeting is on 30th of May which is holiday in quite a number of countries (Corpus Cristi) https://www.officeholidays.com/holidays/corpus-christi - and taking into account it's always Thursday, usually people bridge it with weekend :). I personally will not ne available. Ma

Re: [VOTE] Airflow Providers prepared on May 26, 2024

+1 non binding. All AWS system tests are running successfully against apache-airflow-providers-amazon==8.23.0rc1. You can see the results here: https://aws-mwaa.github.io/#/open-source/system-tests/version/98c5a3a2c6d1df722d56bb3748dfbc810d5952aa_8.23.0rc1.html On 2024/05/27 14:01:48 Rahul Vats

Re: [VOTE] Airflow Providers prepared on May 26, 2024

-1 (non-binding) for cncf-kubernetes-provider. Our example DAGs are failing due to an unexpected argument 'pod' in the read_namespaced_pod_log call. Thanks to Wei for raising the fix PR . Regards, Rahul Vats 9953794332 On Mon, 27 May 2024 at 01:31, J

Re: [DISCUSS] AIP-71 Generalizing DAG Loader and Processor for Ephemeral Storage

> It's a long long read @Jarek Potiuk ... You did invite people to comment :). Those were all the areas that came to my mind :) > In summary, moving to pathlib.Path enhances flexibility and makes future integrations, like AIP-63, more manageable while not forcing any immediate changes to current

Re: [DISCUSS] AIP-71 Generalizing DAG Loader and Processor for Ephemeral Storage

It's a long long read @Jarek Potiuk ... In general, you are right. The intention is to eliminate the need for an external sync, which is beneficial for Kubernetes (k8s) workers. They would only need to load one DAG and its resources, rather than syncing the entire DAG folder. This can be done sel