The GitHub Actions job "Tests AMD" on 
airflow.git/ramitkataria/fix-remote-exec-aws-var-fetcher has failed.
Run started by GitHub user ramitkataria (triggered by ramitkataria).

Head commit for run:
d2c6da0c58359891dd4d748e5be8858a963cae9b / Ramit Kataria <[email protected]>
Fix AWS `StopIteration` error in `variable_fetcher` when using remote executor

In `_get_test_name()` called by `set_env_id()`, the call stack is used
to determine the name of the current test. After #50571, `set_env_id()`
was being called from a `PythonOperator` (in addition to another call
from the `SystemTestContextBuilder`) which changed the call stack to not
include the name of the dag. As an example, here's all the files
included in the call stack when called from `SystemTestContextBuilder`:
```
[
    '/opt/airflow/providers/amazon/tests/system/amazon/aws/utils/__init__.py',
    '/opt/airflow/providers/amazon/tests/system/amazon/aws/utils/__init__.py',
    '/opt/airflow/providers/amazon/tests/system/amazon/aws/example_mwaa.py', 
'<frozen importlib._bootstrap>',
    '<frozen importlib._bootstrap_external>', 
'/opt/airflow/airflow-core/src/airflow/models/dagbag.py',
    '/opt/airflow/airflow-core/src/airflow/models/dagbag.py',
    '/opt/airflow/airflow-core/src/airflow/models/dagbag.py',
    '/opt/airflow/airflow-core/src/airflow/models/dagbag.py',
    '/opt/airflow/airflow-core/src/airflow/models/dagbag.py',
    '/opt/airflow/task-sdk/src/airflow/sdk/execution_time/task_runner.py',
    '/opt/airflow/task-sdk/src/airflow/sdk/execution_time/task_runner.py',
    '/opt/airflow/task-sdk/src/airflow/sdk/execution_time/task_runner.py',
    '/opt/airflow/task-sdk/src/airflow/sdk/execution_time/supervisor.py',
    '/opt/airflow/task-sdk/src/airflow/sdk/execution_time/supervisor.py',
    '/opt/airflow/task-sdk/src/airflow/sdk/execution_time/supervisor.py',
    '/opt/airflow/task-sdk/src/airflow/sdk/execution_time/supervisor.py',
    '/opt/airflow/task-sdk/src/airflow/sdk/execution_time/supervisor.py',
    '/opt/airflow/task-sdk/src/airflow/sdk/execution_time/execute_workload.py',
    '/opt/airflow/task-sdk/src/airflow/sdk/execution_time/execute_workload.py',
    '/opt/airflow/task-sdk/src/airflow/sdk/execution_time/execute_workload.py', 
'<frozen runpy>',
    '<frozen runpy>'
]
```
and from the `PythonOperator`:
```
[
    '/opt/airflow/providers/amazon/tests/system/amazon/aws/utils/__init__.py',
    '/opt/airflow/providers/amazon/tests/system/amazon/aws/utils/__init__.py',
    '/opt/airflow/providers/amazon/tests/system/amazon/aws/utils/__init__.py',
    '/opt/airflow/providers/amazon/tests/system/amazon/aws/utils/__init__.py',
    '/opt/airflow/providers/amazon/tests/system/amazon/aws/utils/__init__.py',
    '/opt/airflow/task-sdk/src/airflow/sdk/execution_time/callback_runner.py',
    
'/opt/airflow/providers/standard/src/airflow/providers/standard/operators/python.py',
    
'/opt/airflow/providers/standard/src/airflow/providers/standard/operators/python.py',
    '/opt/airflow/task-sdk/src/airflow/sdk/bases/operator.py',
    '/opt/airflow/task-sdk/src/airflow/sdk/bases/decorator.py',
    '/opt/airflow/task-sdk/src/airflow/sdk/bases/operator.py',
    '/opt/airflow/task-sdk/src/airflow/sdk/execution_time/task_runner.py',
    '/opt/airflow/task-sdk/src/airflow/sdk/execution_time/task_runner.py',
    '/opt/airflow/task-sdk/src/airflow/sdk/execution_time/task_runner.py',
    '/opt/airflow/task-sdk/src/airflow/sdk/execution_time/supervisor.py',
    '/opt/airflow/task-sdk/src/airflow/sdk/execution_time/supervisor.py',
    '/opt/airflow/task-sdk/src/airflow/sdk/execution_time/supervisor.py',
    '/opt/airflow/task-sdk/src/airflow/sdk/execution_time/supervisor.py',
    '/opt/airflow/task-sdk/src/airflow/sdk/execution_time/supervisor.py',
    '/opt/airflow/task-sdk/src/airflow/sdk/execution_time/execute_workload.py',
    '/opt/airflow/task-sdk/src/airflow/sdk/execution_time/execute_workload.py',
    '/opt/airflow/task-sdk/src/airflow/sdk/execution_time/execute_workload.py', 
'<frozen runpy>',
    '<frozen runpy>'
]
```

So the `StopIteration` error was being caused because it couldn't find
the name of the test (in this case `example_mwaa`) in the call stack.
This PR fixes this by using the test name already computed earlier in
the `SystemTestContextBuilder`, in the `PythonOperator` for
`variable_fetcher`.

Report URL: https://github.com/apache/airflow/actions/runs/15282163663

With regards,
GitHub Actions via GitBox


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to