Re: [ANNOUNCE] New committers: Rom Sharon & Shahar Epstein

2024-07-15 Thread Bowrna Prabhakaran
Congratulations Rom and Shahar :) On Tue, Jul 16, 2024 at 1:08 AM rom sharon wrote: > Thank you all for the warm welcome as Shahar and I become committers. The > Apache Airflow community has been an incredible place to grow as an > open-source developer. I've learned so much from the code and th

Re: Operator Templating in Airflow 3

2024-07-15 Thread Bas Harenslak
+1 for this change! I especially had lots of trouble with template files with templated filenames and this would solve it. Few comments/questions: "improved debuggability when things go wrong": Could you elaborate on how this proposal improves debuggability? "better discoverability of whether a

Re: More ruff style rules

2024-07-15 Thread Tzu-ping Chung
+1 to enforcing E731, using lambdas is objectively worse in every way except you save two lines and a few characters at most. The lambda is only “needed” in the sense that you can’t do (say) functool.partial due to variable scoping. A nested function does exactly the same thing. -- Sent from my

Opportunity to Contribute to Airflow 3.0: Own a Workstream!

2024-07-15 Thread Kaxil Naik
Hello all, We have several workstreams[1] that still need owners. This is a fantastic opportunity for you to take ownership of a key part of Airflow 3 and make a bigger impact. I have also added those items to this meta GitHub issue [2] for easy reference. Airflow 3 is set to bring numerous impro

Re: [ANNOUNCE] New committers: Rom Sharon & Shahar Epstein

2024-07-15 Thread rom sharon
Thank you all for the warm welcome as Shahar and I become committers. The Apache Airflow community has been an incredible place to grow as an open-source developer. I've learned so much from the code and the people here, enriching both my contributions and my professional life. A special thanks to

Re: [DISCUSS] To AIP-44 or not to AIP-44

2024-07-15 Thread Amogh Desai
I'd prefer to move it completely to Airflow 3, because I don't really see spending cycles on developing something for the short term here. With Airflow 3, it would come out more complete and something that could be usable by users without having to put a halt to it and starting it again. I unders

Re: [VOTE] AIP-72: Task Execution Interface aka Task SDK

2024-07-15 Thread Amogh Desai
+1 binding This AIP will finally attempt to solve some of the tough scaling challenges and despite the fact that it will break a few things here and there, this is something that needs to be done sooner rather than later. Thanks & Regards, Amogh Desai On Fri, Jul 12, 2024 at 2:55 PM Michał Modr

Re: [ANNOUNCE] New committers: Rom Sharon & Shahar Epstein

2024-07-15 Thread Vikram Koka
Congratulations Rom and Shahar! Vikram On Mon, Jul 15, 2024 at 9:26 AM Ferruzzi, Dennis wrote: > Congrats! > > > - ferruzzi > > > > From: Shahar Epstein > Sent: Monday, July 15, 2024 8:30 AM > To: dev@airflow.apache.org > Subject: RE: [EXT] [ANNOUNCE] New com

[RESULT][VOTE] Release Airflow 2.9.3 from 2.9.3rc1

2024-07-15 Thread Utkarsh Sharma
Hello, Apache Airflow 2.9.3 (based on RC1) has been accepted. 4 "+1" binding votes received: - Kaxil Naik - Jarek Potiuk - Hussein Awala - Ephraim Anierobi 4 "+1" non-binding votes received: - Amogh Desai - Aritra Basu - Rahul Vats - Scheffler Jens Vote thread:https://lists.apache.org/thread/tt

Re: [DISCUSS] AIP-78 scheduler-managed backfill

2024-07-15 Thread Daniel Standish
As I see it, minischeduler is unrelated and not what this AIP is about, and basically does not matter for this AIP. And the broader discussion about locking, while interesting, is also beyond this AIP and I'm not sure it makes sense to have here. Side note, there is currently locking in more than

Re: [ANNOUNCE] New committers: Rom Sharon & Shahar Epstein

2024-07-15 Thread Ferruzzi, Dennis
Congrats! - ferruzzi From: Shahar Epstein Sent: Monday, July 15, 2024 8:30 AM To: dev@airflow.apache.org Subject: RE: [EXT] [ANNOUNCE] New committers: Rom Sharon & Shahar Epstein CAUTION: This email originated from outside of the organization. Do not click l

Re: More ruff style rules

2024-07-15 Thread Ferruzzi, Dennis
I forgot the formatting was going to get stripped on the email, sorry about that. How do we feel about these two? "E731", Use a method instead of a lambda when declaring a variable, currently 3 violations Seems easy enough, just replace a lambda with a getter function but someone would need

Re: [ANNOUNCE] New committers: Rom Sharon & Shahar Epstein

2024-07-15 Thread Shahar Epstein
I'd like to thank you all for your support, and I hope to serve you well as a committer :) Airflow is a very welcoming community for open-source developers, and I've experienced this since I started contributing. I've learnt a lot so far, from people and their code, which helps me become a bette

Re: [DISCUSS] AIP-67 Multi-team deployment of Airflow components (reloaded)

2024-07-15 Thread Jarek Potiuk
I got the transcript and chat from the last call (thanks Kaxil!) and it allowed me to answer a few questions that were asked during my presentation about AIP-67. I updated the AIP document but here is summary: 1) What about Pools (asked by Elad and Jed, Jorrick): I thought about it and I propose t

RE: [VOTE] Release Airflow 2.9.3 from 2.9.3rc1

2024-07-15 Thread Scheffler Jens (XC-AS/EAE-ADA-T)
Hi, weh ave tested 2.9.3rc1 today and found no issues during upgrade. All looks good. +1 non-binding from my side. Mit freundlichen Grüßen / Best regards Jens Scheffler Alliance: Enabler - Tech Lead (XC-AS/EAE-ADA-T) Robert Bosch GmbH | Hessbruehlstraße 21 | 70565 Stuttgart-Vaihingen | GERMAN

Re: [ANNOUNCE] New committers: Rom Sharon & Shahar Epstein

2024-07-15 Thread Vincent Beck
Congrats!! On 2024/07/15 14:53:14 Buğra Öztürk wrote: > Congrats ! 🎉 > > On Mon, 15 Jul 2024, 16:49 Poorvi Rohidekar, > wrote: > > > Congratulations! 🎉 > > > > On Mon, 15 Jul 2024 at 19:04, Bishundeo, Rajeshwar > > wrote: > > > > > Congratulations Rom & Sharan!!! > > > > > > -- Rajesh > > > >

Re: [ANNOUNCE] New committers: Rom Sharon & Shahar Epstein

2024-07-15 Thread Buğra Öztürk
Congrats ! 🎉 On Mon, 15 Jul 2024, 16:49 Poorvi Rohidekar, wrote: > Congratulations! 🎉 > > On Mon, 15 Jul 2024 at 19:04, Bishundeo, Rajeshwar > wrote: > > > Congratulations Rom & Sharan!!! > > > > -- Rajesh > > > > > > > > > > > > > > On 2024-07-15, 9:33 AM, "Abhishek Bhakat" > > > abhishek.bh

Re: [ANNOUNCE] New committers: Rom Sharon & Shahar Epstein

2024-07-15 Thread Poorvi Rohidekar
Congratulations! 🎉 On Mon, 15 Jul 2024 at 19:04, Bishundeo, Rajeshwar wrote: > Congratulations Rom & Sharan!!! > > -- Rajesh > > > > > > > On 2024-07-15, 9:33 AM, "Abhishek Bhakat" > abhishek.bha...@astronomer.io.inva>LID> wrote: > > > CAUTION: This email originated from outside of the organiz

Re: [DISCUSS] AIP-78 scheduler-managed backfill

2024-07-15 Thread Jarek Potiuk
Also coming back to mini-scheduler (Vikram - and still waiting for Ash to comment): I was thinking quite a bit about I think it was generally a good idea to prioritize queuing "next eligible" task after one of the tasks completed. I just think that that we should not lock the database when prioriti

Re: [ANNOUNCE] New committers: Rom Sharon & Shahar Epstein

2024-07-15 Thread Bishundeo, Rajeshwar
Congratulations Rom & Sharan!!! -- Rajesh On 2024-07-15, 9:33 AM, "Abhishek Bhakat" mailto:abhishek.bha...@astronomer.io.inva>LID> wrote: CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you can confirm the sender and know th

Re: [ANNOUNCE] New committers: Rom Sharon & Shahar Epstein

2024-07-15 Thread Wei Lee
Congratulations! 🎉 🙌 Best regards, Wei > On Jul 15, 2024, at 9:31 PM, Abhishek Bhakat > wrote: > > Congrats Rom & Sharan 🥳 > > On Mon, Jul 15, 2024 at 1:28 PM utkarsh sharma > wrote: > >> Congratulations! 🎉🎉. >> >> Thanks, >> Utkarsh Sharma >> >> On Mon, Jul 15, 2024 at 6:38 PM Jarek Poti

Re: [ANNOUNCE] New committers: Rom Sharon & Shahar Epstein

2024-07-15 Thread Abhishek Bhakat
Congrats Rom & Sharan 🥳 On Mon, Jul 15, 2024 at 1:28 PM utkarsh sharma wrote: > Congratulations! 🎉🎉. > > Thanks, > Utkarsh Sharma > > On Mon, Jul 15, 2024 at 6:38 PM Jarek Potiuk wrote: > > > Wooohooo! Congrats! > > > > On Mon, Jul 15, 2024 at 2:29 PM Pavankumar Gopidesu < > > gopidesupa...@gma

Re: [ANNOUNCE] New committers: Rom Sharon & Shahar Epstein

2024-07-15 Thread utkarsh sharma
Congratulations! 🎉🎉. Thanks, Utkarsh Sharma On Mon, Jul 15, 2024 at 6:38 PM Jarek Potiuk wrote: > Wooohooo! Congrats! > > On Mon, Jul 15, 2024 at 2:29 PM Pavankumar Gopidesu < > gopidesupa...@gmail.com> > wrote: > > > Congratulations Rom and Shahar 🎉🎉. > > > > Regards, > > Pavan > > > > On Mon,

Re: [ANNOUNCE] New committers: Rom Sharon & Shahar Epstein

2024-07-15 Thread Jarek Potiuk
Wooohooo! Congrats! On Mon, Jul 15, 2024 at 2:29 PM Pavankumar Gopidesu wrote: > Congratulations Rom and Shahar 🎉🎉. > > Regards, > Pavan > > On Mon, Jul 15, 2024 at 1:24 PM Pankaj Koti > wrote: > > > Congratulations both 🎉🎉🎉 > > > > > > Best regards, > > > > *Pankaj Koti* > > Senior Software En

Re: [VOTE] Release Airflow 2.9.3 from 2.9.3rc1

2024-07-15 Thread Rahul Vats
+1 (non-binding): Verified running regression example DAG. Regards, Rahul Vats 9953794332 On Mon, 15 Jul 2024 at 18:20, Ephraim Anierobi wrote: > +1 binding: Checked reproducibility, checksums and licenses > > On Mon, 15 Jul 2024 at 13:21, Kaxil Naik wrote: > > > +1 binding: Checked signs, c

Re: [VOTE] Release Airflow 2.9.3 from 2.9.3rc1

2024-07-15 Thread Ephraim Anierobi
+1 binding: Checked reproducibility, checksums and licenses On Mon, 15 Jul 2024 at 13:21, Kaxil Naik wrote: > +1 binding: Checked signs, checksums & licenses > > > > On Mon, 15 Jul 2024 at 14:22, Jarek Potiuk wrote: > > > +1 (binding): Checked reproducibility, signatures, checksums, licences, >

Re: [VOTE] Release Airflow 2.9.3 from 2.9.3rc1

2024-07-15 Thread Hussein Awala
+1 (binding) On Monday, July 15, 2024, Aritra Basu wrote: > +1 non-binding > Tested my changes and they seem to be working as expected > -- > Regards, > Aritra Basu > > On Mon, Jul 15, 2024, 6:03 PM Kaxil Naik wrote: > > > +1 binding: Checked signs, checksums & licenses > > > > > > > > On Mon,

Re: [VOTE] Release Airflow 2.9.3 from 2.9.3rc1

2024-07-15 Thread Aritra Basu
+1 non-binding Tested my changes and they seem to be working as expected -- Regards, Aritra Basu On Mon, Jul 15, 2024, 6:03 PM Kaxil Naik wrote: > +1 binding: Checked signs, checksums & licenses > > > > On Mon, 15 Jul 2024 at 14:22, Jarek Potiuk wrote: > > > +1 (binding): Checked reproducibilit

Re: [ANNOUNCE] New committers: Rom Sharon & Shahar Epstein

2024-07-15 Thread Pavankumar Gopidesu
Congratulations Rom and Shahar 🎉🎉. Regards, Pavan On Mon, Jul 15, 2024 at 1:24 PM Pankaj Koti wrote: > Congratulations both 🎉🎉🎉 > > > Best regards, > > *Pankaj Koti* > Senior Software Engineer (Airflow OSS Engineering team) > Location: Pune, Maharashtra, India > Timezone: Indian Standard Time (

Re: [ANNOUNCE] New committers: Rom Sharon & Shahar Epstein

2024-07-15 Thread Pankaj Koti
Congratulations both 🎉🎉🎉 Best regards, *Pankaj Koti* Senior Software Engineer (Airflow OSS Engineering team) Location: Pune, Maharashtra, India Timezone: Indian Standard Time (IST) On Mon, Jul 15, 2024 at 5:52 PM Pankaj Singh wrote: > Congratulations 🎉🎉 > > On Mon, Jul 15, 2024 at 5:50 PM Ka

Re: [ANNOUNCE] New committers: Rom Sharon & Shahar Epstein

2024-07-15 Thread Pankaj Singh
Congratulations 🎉🎉 On Mon, Jul 15, 2024 at 5:50 PM Kaxil Naik wrote: > Congrats Rom & Sharan > > On Mon, 15 Jul 2024 at 17:46, Amogh Desai > wrote: > > > This is awesome news! > > > > Congratulations Rom and Shahar 🎊! Well deserved! > > > > Thanks & Regards, > > Amogh Desai > > > > > > On Mon,

Re: [ANNOUNCE] New committers: Rom Sharon & Shahar Epstein

2024-07-15 Thread Kaxil Naik
Congrats Rom & Sharan On Mon, 15 Jul 2024 at 17:46, Amogh Desai wrote: > This is awesome news! > > Congratulations Rom and Shahar 🎊! Well deserved! > > Thanks & Regards, > Amogh Desai > > > On Mon, Jul 15, 2024 at 5:33 PM Elad Kalif wrote: > > > The Project Management Committee (PMC) for Apache

Re: [VOTE] Release Airflow 2.9.3 from 2.9.3rc1

2024-07-15 Thread Kaxil Naik
+1 binding: Checked signs, checksums & licenses On Mon, 15 Jul 2024 at 14:22, Jarek Potiuk wrote: > +1 (binding): Checked reproducibility, signatures, checksums, licences, run > a few test cases, checked all the "tooling" upgrades that are properly > applied. All good. > > I found an issue wit

Re: [ANNOUNCE] New committers: Rom Sharon & Shahar Epstein

2024-07-15 Thread Amogh Desai
This is awesome news! Congratulations Rom and Shahar 🎊! Well deserved! Thanks & Regards, Amogh Desai On Mon, Jul 15, 2024 at 5:33 PM Elad Kalif wrote: > The Project Management Committee (PMC) for Apache Airflow > has invited Rom Sharon & Shahar Epstein to become a committers and we are > plea

Re: [VOTE] Release Airflow 2.9.3 from 2.9.3rc1

2024-07-15 Thread Amogh Desai
+1 non binding. Tested my changes, and ran a couple of tests as well. It looks good Thanks & Regards, Amogh Desai On Mon, Jul 15, 2024 at 2:22 PM Jarek Potiuk wrote: > +1 (binding): Checked reproducibility, signatures, checksums, licences, run > a few test cases, checked all the "tooling" upg

[ANNOUNCE] New committers: Rom Sharon & Shahar Epstein

2024-07-15 Thread Elad Kalif
The Project Management Committee (PMC) for Apache Airflow has invited Rom Sharon & Shahar Epstein to become a committers and we are pleased to announce that they have accepted. Congratulations Rom & Shahar and welcome!

[ANNOUNCE] Apache Airflow Providers prepared on July 12, 2024 are released

2024-07-15 Thread Elad Kalif
Dear Airflow community, I'm happy to announce that new versions of Airflow Providers packages prepared on July 12, 2024 were just released. Full list of PyPI packages released is added at the end of the message. The source release, as well as the binary releases, are available here: https://airf

[RESULT][VOTE] Airflow Providers - release of July 12, 2024

2024-07-15 Thread Elad Kalif
Hello, Apache Airflow Providers prepared on July 12, 2024 have been accepted. providers amazon and weaviate are excluded from this release. 3 "+1" binding votes received: - Elad Kalif - Jarek Potiuk - Hussein Awala 3 "+1" non-binding votes received: - Vincent Beck - Rahul Vats - Wei Lee Vote t

Re: [PROPOSE] Agree and document Ad-hoc release process for providers

2024-07-15 Thread Eugen Kosteev
+1 to this On Mon, Jul 15, 2024 at 11:24 AM Jarek Potiuk wrote: > Ok. If there are no more comments - I will now do some more work on the > release process (I am going to finally look at the "Trusted Publishing" > change for PyPI, and i will review and update the processes and along the > way wi

Re: [PROPOSE] Agree and document Ad-hoc release process for providers

2024-07-15 Thread Jarek Potiuk
Ok. If there are no more comments - I will now do some more work on the release process (I am going to finally look at the "Trusted Publishing" change for PyPI, and i will review and update the processes and along the way will mark and double check if the release process steps can be made by non-PM

Re: [VOTE] Release Airflow 2.9.3 from 2.9.3rc1

2024-07-15 Thread Jarek Potiuk
+1 (binding): Checked reproducibility, signatures, checksums, licences, run a few test cases, checked all the "tooling" upgrades that are properly applied. All good. I found an issue with latest FAB provider that it had check for <= 2.9.2 for CSRF protection on logout, but we have not cherry-picke