I ran the AWS system tests using the 9.5.0rc1 and current Airflow main/head
(e1f9151). example_redshift_s3_transfers is failing, but I haven't found a
root cause for it yet
Traceback (most recent call last):
File "/opt/airflow/airflow/models/taskinstance.py", line 730, in _execute_task
result = _execute_callable(context=context, **execute_callable_kwargs)
File "/opt/airflow/airflow/models/taskinstance.py", line 696, in
_execute_callable
return ExecutionCallableRunner(
File "/opt/airflow/airflow/utils/operator_helpers.py", line 261, in run
return func(*args, **kwargs)
File "/opt/airflow/task-sdk/src/airflow/sdk/definitions/baseoperator.py",
line 373, in wrapper
return func(self, *args, **kwargs)
File
"/usr/local/lib/python3.9/site-packages/airflow/providers/amazon/aws/transfers/s3_to_redshift.py",
line 152, in execute
conn = S3Hook.get_connection(conn_id=self.aws_conn_id) if self.aws_conn_id
else None
File "/opt/airflow/airflow/hooks/base.py", line 64, in get_connection
conn = Connection.get_connection_from_secrets(conn_id)
File "/opt/airflow/airflow/models/connection.py", line 490, in
get_connection_from_secrets
raise AirflowNotFoundException(f"The conn_id `{conn_id}` isn't defined")
airflow.exceptions.AirflowNotFoundException: The conn_id `aws_default` isn't
defined
Full run results:
https://aws-mwaa.github.io/#/open-source/system-tests/version/e1f9151_9.5.0rc1.html
Is it possible for the Amazon provider to be excluded from this release cycle
while I sort this out?
- ferruzzi
________________________________
From: Ephraim Anierobi <ephraimanier...@gmail.com>
Sent: Monday, March 10, 2025 2:03 AM
To: dev@airflow.apache.org
Subject: RE: [EXT] [VOTE] Airflow Providers prepared on March 09, 2025
CAUTION: This email originated from outside of the organization. Do not click
links or open attachments unless you can confirm the sender and know the
content is safe.
AVERTISSEMENT: Ce courrier électronique provient d’un expéditeur externe. Ne
cliquez sur aucun lien et n’ouvrez aucune pièce jointe si vous ne pouvez pas
confirmer l’identité de l’expéditeur et si vous n’êtes pas certain que le
contenu ne présente aucun risque.
+1 (binding) - Checked signatures, licences and checked reproducibility.
Also checked the files in the providers
On Mon, 10 Mar 2025 at 07:20, Amogh Desai <amoghdesai....@gmail.com> wrote:
> +1 non binding.
>
> Tested all my changes:
>
> 1. https://github.com/apache/airflow/pull/47375
> 2. https://github.com/apache/airflow/pull/47336 (was overridden by
> https://github.com/apache/airflow/pull/47338 but that's good too)
> 3. https://github.com/apache/airflow/pull/47254
> 4. https://github.com/apache/airflow/pull/47255
> 5. https://github.com/apache/airflow/pull/47262
>
> All of them work fine 👍🏽.
>
> In addition to this, I ran my general set of example dags and they seem to
> work well too.
>
> Thanks & Regards,
> Amogh Desai
>
>
> On Sun, Mar 9, 2025 at 11:33 PM Jarek Potiuk <ja...@potiuk.com> wrote:
>
> > +1 (binding) - Checked SVN, reproducible builds, checksums, signatures,
> > checked all my changes, installed a few providers in breeze's start
> airflow
> > 2.10.5 all looks good :)
> >
> > On Sun, Mar 9, 2025 at 5:55 PM Jens Scheffler <j_scheff...@gmx.de.invalid
> >
> > wrote:
> >
> > > +1 (binding) - Checked SVN, Check in Docker, Reproducible package
> build,
> > > Licenses, Signatures
> > >
> > > On 09.03.25 16:19, Elad Kalif wrote:
> > > > Hey all,
> > > >
> > > > I have just cut the new wave Airflow Providers packages. This email
> is
> > > > calling a vote on the release, which will last for 72 hours - which
> > means
> > > > that it will end on March 12, 2025 15:15 PM UTC and until 3 binding
> +1
> > > > votes have been received.
> > > >
> > > > Consider this my (binding) +1.
> > > >
> > > > Airflow Providers are available at:
> > > > https://dist.apache.org/repos/dist/dev/airflow/providers/
> > > >
> > > > *apache-airflow-providers-<PROVIDER>-*.tar.gz* are the binary
> > > > Python "sdist" release - they are also official "sources" for the
> > > provider
> > > > packages.
> > > >
> > > > *apache_airflow_providers_<PROVIDER>-*.whl are the binary
> > > > Python "wheel" release.
> > > >
> > > > The test procedure for PMC members is described in
> > > >
> > >
> >
> https://github.com/apache/airflow/blob/main/dev/README_RELEASE_PROVIDER_PACKAGES.md#verify-the-release-candidate-by-pmc-members
> > > >
> > > > The test procedure for and Contributors who would like to test this
> RC
> > is
> > > > described in:
> > > >
> > >
> >
> https://github.com/apache/airflow/blob/main/dev/README_RELEASE_PROVIDER_PACKAGES.md#verify-the-release-candidate-by-contributors
> > > >
> > > >
> > > > Public keys are available at:
> > > > https://dist.apache.org/repos/dist/release/airflow/KEYS
> > > >
> > > > Please vote accordingly:
> > > >
> > > > [ ] +1 approve
> > > > [ ] +0 no opinion
> > > > [ ] -1 disapprove with the reason
> > > >
> > > > Only votes from PMC members are binding, but members of the community
> > are
> > > > encouraged to test the release and vote with "(non-binding)".
> > > >
> > > > Please note that the version number excludes the 'rcX' string.
> > > > This will allow us to rename the artifact without modifying
> > > > the artifact checksums when we actually release.
> > > >
> > > > The status of testing the providers by the community is kept here:
> > > > https://github.com/apache/airflow/issues/47549
> > > >
> > > > The issue is also the easiest way to see important PRs included in
> the
> > RC
> > > > candidates.
> > > > Detailed changelog for the providers will be published in the
> > > documentation
> > > > after the
> > > > RC candidates are released.
> > > >
> > > > You can find the RC packages in PyPI following these links:
> > > >
> > > > https://pypi.org/project/apache-airflow-providers-airbyte/5.0.1rc1/
> > > > https://pypi.org/project/apache-airflow-providers-alibaba/3.0.1rc1/
> > > > https://pypi.org/project/apache-airflow-providers-amazon/9.5.0rc1/
> > > >
> > https://pypi.org/project/apache-airflow-providers-apache-beam/6.0.3rc1/
> > > >
> > >
> >
> https://pypi.org/project/apache-airflow-providers-apache-cassandra/3.7.1rc1/
> > > >
> > https://pypi.org/project/apache-airflow-providers-apache-drill/3.0.1rc1/
> > > >
> > https://pypi.org/project/apache-airflow-providers-apache-druid/4.1.0rc1/
> > > >
> > https://pypi.org/project/apache-airflow-providers-apache-flink/1.6.1rc1/
> > > >
> > https://pypi.org/project/apache-airflow-providers-apache-hdfs/4.7.1rc1/
> > > >
> > https://pypi.org/project/apache-airflow-providers-apache-hive/9.0.3rc1/
> > > >
> > >
> >
> https://pypi.org/project/apache-airflow-providers-apache-iceberg/1.2.1rc1/
> > > >
> > >
> >
> https://pypi.org/project/apache-airflow-providers-apache-impala/1.6.1rc1/
> > > >
> > https://pypi.org/project/apache-airflow-providers-apache-kylin/3.8.1rc1/
> > > >
> > https://pypi.org/project/apache-airflow-providers-apache-livy/4.2.1rc1/
> > > >
> https://pypi.org/project/apache-airflow-providers-apache-pig/4.6.1rc1/
> > > >
> > https://pypi.org/project/apache-airflow-providers-apache-pinot/4.7.0rc1/
> > > >
> > https://pypi.org/project/apache-airflow-providers-apache-spark/5.0.1rc1/
> > > > https://pypi.org/project/apache-airflow-providers-apprise/2.0.1rc1/
> > > > https://pypi.org/project/apache-airflow-providers-arangodb/2.7.3rc1/
> > > > https://pypi.org/project/apache-airflow-providers-asana/2.9.1rc1/
> > > >
> > >
> >
> https://pypi.org/project/apache-airflow-providers-atlassian-jira/3.0.1rc1/
> > > > https://pypi.org/project/apache-airflow-providers-celery/3.10.3rc1/
> > > > https://pypi.org/project/apache-airflow-providers-cloudant/4.1.1rc1/
> > > >
> > >
> >
> https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/10.3.1rc1/
> > > > https://pypi.org/project/apache-airflow-providers-cohere/1.4.3rc1/
> > > >
> > >
> >
> https://pypi.org/project/apache-airflow-providers-common-compat/1.5.1rc1/
> > > >
> https://pypi.org/project/apache-airflow-providers-common-io/1.5.1rc1/
> > > >
> > https://pypi.org/project/apache-airflow-providers-common-sql/1.24.0rc1/
> > > >
> https://pypi.org/project/apache-airflow-providers-databricks/7.2.1rc1/
> > > > https://pypi.org/project/apache-airflow-providers-datadog/3.8.3rc1/
> > > >
> https://pypi.org/project/apache-airflow-providers-dbt-cloud/4.2.1rc1/
> > > > https://pypi.org/project/apache-airflow-providers-dingding/3.7.3rc1/
> > > > https://pypi.org/project/apache-airflow-providers-discord/3.9.3rc1/
> > > > https://pypi.org/project/apache-airflow-providers-docker/4.2.1rc1/
> > > >
> > >
> >
> https://pypi.org/project/apache-airflow-providers-elasticsearch/6.2.1rc1/
> > > > https://pypi.org/project/apache-airflow-providers-exasol/4.7.3rc1/
> > > > https://pypi.org/project/apache-airflow-providers-facebook/3.7.1rc1/
> > > > https://pypi.org/project/apache-airflow-providers-ftp/3.12.3rc1/
> > > > https://pypi.org/project/apache-airflow-providers-github/2.8.3rc1/
> > > > https://pypi.org/project/apache-airflow-providers-grpc/3.7.3rc1/
> > > >
> https://pypi.org/project/apache-airflow-providers-hashicorp/4.1.0rc1/
> > > > https://pypi.org/project/apache-airflow-providers-http/5.2.1rc1/
> > > > https://pypi.org/project/apache-airflow-providers-imap/3.8.3rc1/
> > > > https://pypi.org/project/apache-airflow-providers-influxdb/2.8.3rc1/
> > > > https://pypi.org/project/apache-airflow-providers-jdbc/5.0.1rc1/
> > > > https://pypi.org/project/apache-airflow-providers-jenkins/4.0.3rc1/
> > > >
> > >
> >
> https://pypi.org/project/apache-airflow-providers-microsoft-azure/12.2.1rc1/
> > > >
> > >
> >
> https://pypi.org/project/apache-airflow-providers-microsoft-mssql/4.2.1rc1/
> > > >
> > >
> >
> https://pypi.org/project/apache-airflow-providers-microsoft-psrp/3.0.1rc1/
> > > >
> > >
> >
> https://pypi.org/project/apache-airflow-providers-microsoft-winrm/3.9.1rc1/
> > > > https://pypi.org/project/apache-airflow-providers-mongo/5.0.2rc1/
> > > > https://pypi.org/project/apache-airflow-providers-mysql/6.2.0rc1/
> > > > https://pypi.org/project/apache-airflow-providers-neo4j/3.8.2rc1/
> > > > https://pypi.org/project/apache-airflow-providers-odbc/4.9.1rc1/
> > > > https://pypi.org/project/apache-airflow-providers-openai/1.5.2rc1/
> > > > https://pypi.org/project/apache-airflow-providers-openfaas/3.7.1rc1/
> > > >
> > https://pypi.org/project/apache-airflow-providers-openlineage/2.1.1rc1/
> > > >
> https://pypi.org/project/apache-airflow-providers-opensearch/1.6.2rc1/
> > > > https://pypi.org/project/apache-airflow-providers-opsgenie/5.8.2rc1/
> > > > https://pypi.org/project/apache-airflow-providers-oracle/4.0.2rc1/
> > > >
> https://pypi.org/project/apache-airflow-providers-pagerduty/4.0.2rc1/
> > > >
> https://pypi.org/project/apache-airflow-providers-papermill/3.9.2rc1/
> > > > https://pypi.org/project/apache-airflow-providers-pgvector/1.4.1rc1/
> > > > https://pypi.org/project/apache-airflow-providers-pinecone/2.2.2rc1/
> > > > https://pypi.org/project/apache-airflow-providers-postgres/6.1.1rc1/
> > > > https://pypi.org/project/apache-airflow-providers-presto/5.8.2rc1/
> > > > https://pypi.org/project/apache-airflow-providers-qdrant/1.3.2rc1/
> > > > https://pypi.org/project/apache-airflow-providers-redis/4.0.2rc1/
> > > >
> > https://pypi.org/project/apache-airflow-providers-salesforce/5.10.1rc1/
> > > > https://pypi.org/project/apache-airflow-providers-samba/4.9.2rc1/
> > > > https://pypi.org/project/apache-airflow-providers-segment/3.7.2rc1/
> > > > https://pypi.org/project/apache-airflow-providers-sendgrid/4.0.1rc1/
> > > > https://pypi.org/project/apache-airflow-providers-sftp/5.1.1rc1/
> > > >
> > https://pypi.org/project/apache-airflow-providers-singularity/3.7.1rc1/
> > > > https://pypi.org/project/apache-airflow-providers-slack/9.0.2rc1/
> > > > https://pypi.org/project/apache-airflow-providers-smtp/2.0.1rc1/
> > > >
> https://pypi.org/project/apache-airflow-providers-snowflake/6.1.1rc1/
> > > > https://pypi.org/project/apache-airflow-providers-sqlite/4.0.1rc1/
> > > > https://pypi.org/project/apache-airflow-providers-ssh/4.0.1rc1/
> > > > https://pypi.org/project/apache-airflow-providers-standard/0.1.1rc1/
> > > > https://pypi.org/project/apache-airflow-providers-tableau/5.0.2rc1/
> > > > https://pypi.org/project/apache-airflow-providers-telegram/4.7.2rc1/
> > > > https://pypi.org/project/apache-airflow-providers-teradata/3.0.2rc1/
> > > > https://pypi.org/project/apache-airflow-providers-trino/6.1.0rc1/
> > > > https://pypi.org/project/apache-airflow-providers-vertica/4.0.1rc1/
> > > > https://pypi.org/project/apache-airflow-providers-weaviate/3.0.2rc1/
> > > > https://pypi.org/project/apache-airflow-providers-yandex/4.0.2rc1/
> > > > https://pypi.org/project/apache-airflow-providers-ydb/2.1.1rc1/
> > > > https://pypi.org/project/apache-airflow-providers-zendesk/4.9.1rc1/
> > > >
> > > > Cheers,
> > > > Elad Kalif
> > > >
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: dev-unsubscr...@airflow.apache.org
> > > For additional commands, e-mail: dev-h...@airflow.apache.org
> > >
> > >
> >
>
