Wooohohoo! This is fantastic! We also have it now added to our "ecosystem" page: https://airflow.apache.org/ecosystem/#airflow-provider-system-test-dashboards for easier finding.
One comment - something that not everyone might be aware of. This one generally completes *AIP-4*: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=93324355 that I created in *September 2018(!)*: "AIP-4 Automation of System Tests [Deps: AIP-47]". It had never been voted formally because we did not know if this would be possible, but it's been followed by AIP-47 and a number of other smaller or bigger updates in our code, policies (Mixed Governance model) and smaller or bigger improvements in our development framework. The AIP-4 is one of the oldest AIPs. It required a lot of effort and coordination and engagement of the big stakeholders - Amazon, Google, Astronomer. But finally all three of our stakeholders now manage and operate the System test dashboards that give us much more certainty that our important integrations are working fine with external services. I have no hard data to back it up but with those three dashboards we have, we are going to prevent regressions for way more than 70% of the usage of all the "service" community providers (including those who use managed and on premise Airflow) One of the first comment of Ash in the AIP was: "The main blocker to being able to run integration tests against a live GCP in any kind of automated fashion is cost: we'd have to get Google (or someone else) to sponsor us with GCP credits." As it turned out, over the years we found a solution where we have a joint effort between the stakeholders and PMC and this main blocker is solved quite differently. I really hope it will help us to keep the quality of our important service integrations, and that others will follow with their own dashboards. And yes - that means that I would love the Azure team to finally show up and do this as the first step. They are pretty much completely absent in the community, but it would be great if they actually care and are willing to be part of the community). Astronomer, Google and Amazon clearly paved the way for them. J. On Wed, Jun 12, 2024 at 11:54 AM Freddy Demiane <fdemi...@google.com.invalid> wrote: > Hi Team, > > At Google Cloud Composer, we developed a public dashboard that shows the > results of the System Tests of the head revision of the Google Provider > Package against the head revision of Apache Airflow. This will help detect > regressions caused by modifying an operator or a system test. At the > moment, the system tests are executed every 6 hours. Here is the link for > the dashboard: > https://storage.googleapis.com/providers-dashboard-html/dashboard.html . > We hope this eases the development process! > > Best, > Freddy >
