Re: Using AI / Dosu to help us with triaging issues

2024-06-26 Thread Aritra Basu
Hmm I guess as long as there is an actual human approval before every bot/ai answer (ie a triage team member or maintainer has actually verified that the answer fits the question) I am onboard with the idea. It should hopefully reduce some of the load on them. I guess it's too early to discuss wha

Re: [DISCUSS][AIP-38 Modern Web Application]

2024-06-26 Thread Jarek Potiuk
+1. It could also be used to improve the multi-team approach. Not having this feature in the UI, was one of the missing pieces for being able to have multi-team more feature-full (think a user that belongs to two teams). On Thu, Jun 27, 2024 at 8:02 AM Aritra Basu wrote: > I love this idea, I th

Re: Using AI / Dosu to help us with triaging issues

2024-06-26 Thread Jarek Potiuk
Julian - anyone has a voice here :) .. We are not yet voting on it - I already see that lazy consensus will be enough - but even with voting, non-committers are encouraged to vote anyway (their votes are non-binding, but included in the results). Aritra/Amogh - I very much share your perspective t

Re: [DISCUSS][AIP-38 Modern Web Application]

2024-06-26 Thread Aritra Basu
I love this idea, I think it would really help with organising dags and categorising them. Thanks and Regards, Aritra Basu On Thu, Jun 27, 2024 at 10:08 AM Amogh Desai wrote: > I like this idea too. > > The ability to extend filtering at this level would be fantastic. IIUC, the > filtering is

Re: [VOTE] June 2024 PR of the Month

2024-06-26 Thread Amogh Desai
My vote would definitely go to https://github.com/apache/airflow/pull/39355! Developers love dark mode, and I mean it is done fantastically! Thanks & Regards, Amogh Desai On Thu, Jun 27, 2024 at 3:57 AM Kaxil Naik wrote: > My vote would be biased to #39355 because it is DARK MODE : > https://

Re: Using AI / Dosu to help us with triaging issues

2024-06-26 Thread Amogh Desai
Agreed with Aritra here. I personally would love to have the "auto" labelling portion, which would ensure that issues get immediate "right" labels, without relying too much on the triaging team but I personally am not too comfortable with a bot answering my questions for two reasons: 1. Maintaine

Re: [DISCUSS][AIP-38 Modern Web Application]

2024-06-26 Thread Amogh Desai
I like this idea too. The ability to extend filtering at this level would be fantastic. IIUC, the filtering is at a "UI" only level and is transient too. Moving this logic to the backend using a new API (or existing ones) and grouping the dags would be a nice feature to have, making Airflow UI muc

Re: [PROPOSAL] Use Trusted Publishing workflow for Airflow releases to PyPI

2024-06-26 Thread Amogh Desai
Excellent proposal! I see no down-side to the proposal Good investigation on the higher level implementation part as well. Thanks & Regards, Amogh Desai On Wed, Jun 26, 2024 at 10:28 AM Poorvi Rohidekar < poorvirohidekar@gmail.com> wrote: > Looks like a good proposal. > > Regards, > Poorvi

Re: Using AI / Dosu to help us with triaging issues

2024-06-26 Thread Aritra Basu
I'm a bit averse to having it answer questions (the similar issues part) as I believe that's a slippery slope to where it could start being used to provide actual answers. I personally would be more comfortable with answering still being restricted to maintainers/contributors and maybe restricting

Re: [VOTE] June 2024 PR of the Month

2024-06-26 Thread Kaxil Naik
My vote would be biased to #39355 because it is DARK MODE : https://github.com/apache/airflow/pull/39355 :) On Wed, 26 Jun 2024 at 21:28, Jarek Potiuk wrote: > IF (and only IF) the votes from Jens and Vincent go to > https://github.com/apache/airflow/pull/39355 (#39*3*55) then it's my +1 as > we

Re: Using AI / Dosu to help us with triaging issues

2024-06-26 Thread Julian LaNeve
Not sure if I get an official vote here but we've been working with Devin and the Dosu team for Cosmos ( https://github.com/astronomer/astronomer-cosmos ) and it's been working great. Excited to see this in Airflow itself! Plus they use Airflow to power their data platform behind the scenes so t

Re: Using AI / Dosu to help us with triaging issues

2024-06-26 Thread Vikram Koka
+1 Love it! On Wed, Jun 26, 2024 at 1:23 PM Vincent Beck wrote: > Fantastic idea! > > On 2024/06/26 20:12:43 Jarek Potiuk wrote: > > Hello everyone, > > > > Together with Elad, Kaxil, and the Dosu team [1], we’ve been looking into > > employing AI / Natural Language processing to help us triage

Re: [VOTE] June 2024 PR of the Month

2024-06-26 Thread Jarek Potiuk
IF (and only IF) the votes from Jens and Vincent go to https://github.com/apache/airflow/pull/39355 (#39*3*55) then it's my +1 as well. Otherwise I am NOT voting for https://github.com/apache/airflow/pull/39555 but https://github.com/apache/airflow/pull/39355 has still my vote :P On Wed, Jun 26,

Re: Using AI / Dosu to help us with triaging issues

2024-06-26 Thread Vincent Beck
Fantastic idea! On 2024/06/26 20:12:43 Jarek Potiuk wrote: > Hello everyone, > > Together with Elad, Kaxil, and the Dosu team [1], we’ve been looking into > employing AI / Natural Language processing to help us triage issues for > Apache Airflow. We do not want to go “all-in” into getting a chatb

RE: [VOTE] June 2024 PR of the Month

2024-06-26 Thread Vincent Beck
Same! +1 for #39555. Quite an impactful contribution for a first time contributor!! On 2024/06/26 20:17:47 "Scheffler Jens (XC-AS/EAE-ADA-T)" wrote: > Thanks for the proposals... > > There was a "late arrival" and month is not over... as it was a long runner > and we had a first-time contribu

RE: [VOTE] June 2024 PR of the Month

2024-06-26 Thread Scheffler Jens (XC-AS/EAE-ADA-T)
Thanks for the proposals... There was a "late arrival" and month is not over... as it was a long runner and we had a first-time contributor with a long breath making it to the finish line "never gonna give you up" (--> https://www.youtube.com/watch?v=dQw4w9WgXcQ)... I'd like to add and +1 vote

Using AI / Dosu to help us with triaging issues

2024-06-26 Thread Jarek Potiuk
Hello everyone, Together with Elad, Kaxil, and the Dosu team [1], we’ve been looking into employing AI / Natural Language processing to help us triage issues for Apache Airflow. We do not want to go “all-in” into getting a chatbot to respond to all our issues because we believe this is not how the

Airflow Summit 2024: Sessions are ready!

2024-06-26 Thread Teyza Ponce
[image: Airflow Summit 2024] *Hello, Airflow Community! * Have you heard the news? The list of sessions for Airflow Summit 2024 is ready, take a look at them and save your spot to celebrate with us the 10th anniversary of Apache Airflow! Airflow Summit 2024 sessions <

[Lazy Concensus] Remove "Experimental' banner for OpenTelemetry Traces

2024-06-26 Thread Ferruzzi, Dennis
Hi all. Following last week's lazy consensus, I'd also like to remove the "Experimental" banner for OTel Traces. Based on discussion with Jarek and others, we feel that it wasn't necessary to have those two banners in the first place, so I may as well remove this one alongside the Metrics one.

Re: [Lazy Concensus] Remove "Experimental' banner for OpenTelemetry Metrics

2024-06-26 Thread Ferruzzi, Dennis
No comments in a week, I think it's safe to say this is good to go. - ferruzzi From: Ferruzzi, Dennis Sent: Tuesday, June 18, 2024 9:23 AM To: dev@airflow.apache.org Subject: [Lazy Concensus] Remove "Experimental' banner for OpenTelemetry Metrics Hi all. We

Re: [DISCUSS][AIP-38 Modern Web Application]

2024-06-26 Thread Constance Martineau
I love it and 100% agree. Thinking "Dag Groups", where you can group dags (static & dynamic) into a subfolder. Tags are great for filtering, but they aren't a replacement for dirs especially at a large scale. We have some deployments with 20k dags and as designed today, it's not navigable at that s

[DISCUSS][AIP-38 Modern Web Application]

2024-06-26 Thread Blain David
Beside the new interface and getting rid off FAB in Airflow 3.0, a cool and handy feature would be to be able to group multiple DAG's so you could order them by like domain or whatever grouping you want to achieve. Okay, you can achieve the same with filtering, and maybe the we could use that fe

Re: Re: [DISCUSS] Implement common.dataframe (or similar) provider based on Ibis

2024-06-26 Thread Jarek Potiuk
Vikram - no core changes needed. Provider will be enough Daniel: yes I was also considering that. Main reason why I think common.dataframe will be better is that it will follow the same pattern we have with common providers - SQL and Io. Namely that we use connections (and Hooks) coning feon vario