[GitHub] [airflow] yuanke7 commented on issue #18422: No response from request api(longer than 30min) while using SimpleHttpOperator

2021-10-08 Thread GitBox
yuanke7 commented on issue #18422: URL: https://github.com/apache/airflow/issues/18422#issuecomment-939239304 > Can you please share the python code of your DAG? I'll see if I can replicate the issue. Do you have any idea by now ? -- This is an automated message from the Apache Gi

[GitHub] [airflow] kimyen commented on pull request #18272: Allow Airflow UI to create worker pod via Clear > Run

2021-10-08 Thread GitBox
kimyen commented on pull request #18272: URL: https://github.com/apache/airflow/pull/18272#issuecomment-939232862 Thanks @potiuk ! The docker image build still failed. But the error is not related to this change: ``` ERROR: Cannot install apache-airflow[devel-ci]==2.2.0.dev0

[GitHub] [airflow] jameslamb commented on pull request #18219: add more type hints in CeleryKubernetesExecutor

2021-10-08 Thread GitBox
jameslamb commented on pull request #18219: URL: https://github.com/apache/airflow/pull/18219#issuecomment-939228301 Sorry for taking so long to return to this. I just updated this to latest `main`. -- This is an automated message from the Apache Git Service. To respond to the message, p

[GitHub] [airflow] jameslamb commented on pull request #17953: add more information to PodLauncher timeout error

2021-10-08 Thread GitBox
jameslamb commented on pull request #17953: URL: https://github.com/apache/airflow/pull/17953#issuecomment-939227912 @ephraimbuddy ok, I think this is ready for review! Sorry for the delay in responding to your request. I'm new to contributing to Airflow, so it took me a little while

[GitHub] [airflow] anaynayak commented on pull request #18807: Update S3PrefixSensor to support checking multiple prefixes within a bucket

2021-10-08 Thread GitBox
anaynayak commented on pull request #18807: URL: https://github.com/apache/airflow/pull/18807#issuecomment-939226870 @uranusjr thank you for reviewing the PR. Few points from the summary which I wanted to clarify: 1. Removal of `self.full_url` from the class hopefully doesn't requ

[GitHub] [airflow] anaynayak commented on a change in pull request #18807: Update S3PrefixSensor to support checking multiple prefixes within a bucket

2021-10-08 Thread GitBox
anaynayak commented on a change in pull request #18807: URL: https://github.com/apache/airflow/pull/18807#discussion_r725432280 ## File path: airflow/providers/amazon/aws/sensors/s3_prefix.py ## @@ -58,7 +58,7 @@ def __init__( self, *, bucket_name: st

[GitHub] [airflow] anaynayak commented on a change in pull request #18807: Update S3PrefixSensor to support checking multiple prefixes within a bucket

2021-10-08 Thread GitBox
anaynayak commented on a change in pull request #18807: URL: https://github.com/apache/airflow/pull/18807#discussion_r72543 ## File path: airflow/providers/amazon/aws/sensors/s3_prefix.py ## @@ -33,7 +33,7 @@ class S3PrefixSensor(BaseSensorOperator): :param bucket_name

[GitHub] [airflow] subkanthi commented on a change in pull request #18563: Test kubernetes refresh config

2021-10-08 Thread GitBox
subkanthi commented on a change in pull request #18563: URL: https://github.com/apache/airflow/pull/18563#discussion_r725420157 ## File path: tests/kubernetes/test_refresh_config.py ## @@ -35,3 +41,60 @@ def test_parse_timestamp_should_convert_regular_timezone_to_unix_timestam

[GitHub] [airflow] subkanthi commented on a change in pull request #18161: Duplicate Connection: Added logic to query if a connection id exists before creating one

2021-10-08 Thread GitBox
subkanthi commented on a change in pull request #18161: URL: https://github.com/apache/airflow/pull/18161#discussion_r725416651 ## File path: airflow/www/views.py ## @@ -3414,34 +3414,60 @@ def action_mulduplicate(self, connections, session=None): for selected_conn in

[GitHub] [airflow] aa1371 edited a comment on issue #11451: AttributeError: Can't pickle local object 'DaskExecutor.execute_async..airflow_run'

2021-10-08 Thread GitBox
aa1371 edited a comment on issue #11451: URL: https://github.com/apache/airflow/issues/11451#issuecomment-939202583 Could also just pass check_call directly to submit without needing to define the extra function. This works in a plugin I have defined. ``` future = self.client.subm

[GitHub] [airflow] aa1371 commented on issue #11451: AttributeError: Can't pickle local object 'DaskExecutor.execute_async..airflow_run'

2021-10-08 Thread GitBox
aa1371 commented on issue #11451: URL: https://github.com/apache/airflow/issues/11451#issuecomment-939202583 Could also just pass check_call directly to submit without needing to define the extra function. This works in a plugin I have defined. ``` future = self.client

[GitHub] [airflow] aa1371 removed a comment on issue #11451: AttributeError: Can't pickle local object 'DaskExecutor.execute_async..airflow_run'

2021-10-08 Thread GitBox
aa1371 removed a comment on issue #11451: URL: https://github.com/apache/airflow/issues/11451#issuecomment-939201903 @esc's fix works for me. However, any reason we need to use this closure? https://github.com/apache/airflow/blob/1df9a512c284f2585ce01bb77ac91d550f6ccaa3/airflow/execu

[GitHub] [airflow] aa1371 commented on issue #11451: AttributeError: Can't pickle local object 'DaskExecutor.execute_async..airflow_run'

2021-10-08 Thread GitBox
aa1371 commented on issue #11451: URL: https://github.com/apache/airflow/issues/11451#issuecomment-939201903 @esc's fix works for me. However, any reason we need to use this closure? https://github.com/apache/airflow/blob/1df9a512c284f2585ce01bb77ac91d550f6ccaa3/airflow/executors/das

[GitHub] [airflow] uranusjr commented on a change in pull request #18807: Update S3PrefixSensor to support checking multiple prefixes within a bucket

2021-10-08 Thread GitBox
uranusjr commented on a change in pull request #18807: URL: https://github.com/apache/airflow/pull/18807#discussion_r725410179 ## File path: airflow/providers/amazon/aws/sensors/s3_prefix.py ## @@ -58,7 +58,7 @@ def __init__( self, *, bucket_name: str

[GitHub] [airflow] uranusjr commented on a change in pull request #18847: Handle leading slash in samba path

2021-10-08 Thread GitBox
uranusjr commented on a change in pull request #18847: URL: https://github.com/apache/airflow/pull/18847#discussion_r725409759 ## File path: airflow/providers/samba/hooks/samba.py ## @@ -80,7 +80,7 @@ def __exit__(self, exc_type, exc_value, traceback): self._connection

[GitHub] [airflow] fredthomsen opened a new pull request #18847: Handle leading slash in samba path

2021-10-08 Thread GitBox
fredthomsen opened a new pull request #18847: URL: https://github.com/apache/airflow/pull/18847 Fix issue that occurs when the path to a file on a samba share has a slash prepended to it, then the `SambaHook` will treat the path as the host instead likely resulting trying to connect to

[GitHub] [airflow] mariotaddeucci closed pull request #18821: Remove duplicate code on dbapi hook

2021-10-08 Thread GitBox
mariotaddeucci closed pull request #18821: URL: https://github.com/apache/airflow/pull/18821 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commi

[GitHub] [airflow] uranusjr edited a comment on issue #18634: Pendulum 1.x -> 2.x with Airflow 1.x -> 2.x Documentation Updates

2021-10-08 Thread GitBox
uranusjr edited a comment on issue #18634: URL: https://github.com/apache/airflow/issues/18634#issuecomment-939187798 The `format` function in Pendulum 2.x does not accept the `formatter` argument at all. In 1.x, the formatter can be specified as either `classic` or `alternative, which sel

[GitHub] [airflow] uranusjr edited a comment on issue #18634: Pendulum 1.x -> 2.x with Airflow 1.x -> 2.x Documentation Updates

2021-10-08 Thread GitBox
uranusjr edited a comment on issue #18634: URL: https://github.com/apache/airflow/issues/18634#issuecomment-939187798 The `format` function in Pendulum 2.x does not accept the `formatter` argument at all. In 1.x, the formatter can be specified as either `classic` or `alternative, which sel

[GitHub] [airflow] uranusjr commented on issue #18634: Pendulum 1.x -> 2.x with Airflow 1.x -> 2.x Documentation Updates

2021-10-08 Thread GitBox
uranusjr commented on issue #18634: URL: https://github.com/apache/airflow/issues/18634#issuecomment-939187798 The `format` function in Pendulum 2.x does not accept the `formatter` argument at all. -- This is an automated message from the Apache Git Service. To respond to the message, pl

[GitHub] [airflow] uranusjr edited a comment on issue #18717: Add possibility to refresh list of DAGs

2021-10-08 Thread GitBox
uranusjr edited a comment on issue #18717: URL: https://github.com/apache/airflow/issues/18717#issuecomment-938327714 Considering the complexity of the current index page, re-implementing it to support in-page refresh like the graph view is not worth it IMO, unless we can do it in a way th

[GitHub] [airflow] uranusjr commented on pull request #18844: Remove extra prostgres dependency from AWS Provider

2021-10-08 Thread GitBox
uranusjr commented on pull request #18844: URL: https://github.com/apache/airflow/pull/18844#issuecomment-939184760 Re-triggering CI. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [airflow] uranusjr closed pull request #18844: Remove extra prostgres dependency from AWS Provider

2021-10-08 Thread GitBox
uranusjr closed pull request #18844: URL: https://github.com/apache/airflow/pull/18844 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-uns

[GitHub] [airflow] alex-astronomer edited a comment on pull request #18820: Remove deprecated usage of init_role() from API

2021-10-08 Thread GitBox
alex-astronomer edited a comment on pull request #18820: URL: https://github.com/apache/airflow/pull/18820#issuecomment-939184181 Not sure how to request permission to add to this PR but will you please add this test to confirm that #18813 was fixed? ``` def test_patch_updates

[GitHub] [airflow] alex-astronomer commented on pull request #18820: Remove deprecated usage of init_role() from API

2021-10-08 Thread GitBox
alex-astronomer commented on pull request #18820: URL: https://github.com/apache/airflow/pull/18820#issuecomment-939184181 Not sure how to request permission to add to this PR but will you please add this test to confirm that #18813 was fixed? ``` def test_patch_updates_correc

[GitHub] [airflow] uranusjr commented on issue #18845: Facebook Ads Provider uses a deprecated version of the API

2021-10-08 Thread GitBox
uranusjr commented on issue #18845: URL: https://github.com/apache/airflow/issues/18845#issuecomment-939184200 Assigned 🙂 Feel free to submit a PR! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [airflow] tazimmerman edited a comment on issue #16389: SLAs for only one task in a DAG

2021-10-08 Thread GitBox
tazimmerman edited a comment on issue #16389: URL: https://github.com/apache/airflow/issues/16389#issuecomment-939135249 It appears that commit https://github.com/apache/airflow/commit/2fd3f27ebd2a4f695968fb7cc5d119e087820928 will resolve the issue. -- This is an automated message from

[GitHub] [airflow] tazimmerman edited a comment on issue #16389: SLAs for only one task in a DAG

2021-10-08 Thread GitBox
tazimmerman edited a comment on issue #16389: URL: https://github.com/apache/airflow/issues/16389#issuecomment-939135249 It appears that commit https://github.com/apache/airflow/commit/2fd3f27ebd2a4f695968fb7cc5d119e087820928#diff-3101df8e7c54fe1b9305774befb54b31edfe84cb81425a300e70142bc076

[GitHub] [airflow] uranusjr commented on pull request #18622: Use seconds for schedule_delay metric

2021-10-08 Thread GitBox
uranusjr commented on pull request #18622: URL: https://github.com/apache/airflow/pull/18622#issuecomment-939181879 You need to first fix the static checks and tests. Looks like your Union import is breaking things. -- This is an automated message from the Apache Git Service. To respond

[GitHub] [airflow] coinzerge commented on pull request #18622: Use seconds for schedule_delay metric

2021-10-08 Thread GitBox
coinzerge commented on pull request #18622: URL: https://github.com/apache/airflow/pull/18622#issuecomment-939180381 @uranusjr anything else i need to do to merge the PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and us

[GitHub] [airflow] alex-astronomer commented on issue #17686: Xcomms with Taskflow API cause unwanted dependencies in UI

2021-10-08 Thread GitBox
alex-astronomer commented on issue #17686: URL: https://github.com/apache/airflow/issues/17686#issuecomment-939178504 Can someone assign me to this? TY! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[GitHub] [airflow] ephraimbuddy commented on issue #18843: SerializedDagNotFound: DAG not found in serialized_dag table

2021-10-08 Thread GitBox
ephraimbuddy commented on issue #18843: URL: https://github.com/apache/airflow/issues/18843#issuecomment-939154769 We have removed SerializedDagNotFound error in https://github.com/apache/airflow/pull/18554 -- This is an automated message from the Apache Git Service. To respond to the me

[GitHub] [airflow] alex-astronomer commented on issue #18813: /role PATCH endpoint bug when name gets changed to a role that already exists

2021-10-08 Thread GitBox
alex-astronomer commented on issue #18813: URL: https://github.com/apache/airflow/issues/18813#issuecomment-939147130 Actually @uranusjr, the changes that you made for #18820 fixed this issue! I'm going to write some test cases that confirm this behavior as a part of this issue, but other

[GitHub] [airflow] alex-astronomer edited a comment on issue #18813: /role PATCH endpoint bug when name gets changed to a role that already exists

2021-10-08 Thread GitBox
alex-astronomer edited a comment on issue #18813: URL: https://github.com/apache/airflow/issues/18813#issuecomment-939142607 I'll give further reproduction steps with examples from the source for why the problem happens. Sorry about the confusion. Let me reproduce again just to make sure

[GitHub] [airflow] alex-astronomer commented on issue #18813: /role PATCH endpoint bug when name gets changed to a role that already exists

2021-10-08 Thread GitBox
alex-astronomer commented on issue #18813: URL: https://github.com/apache/airflow/issues/18813#issuecomment-939142607 I'll give further reproduction steps with examples from the source for why the problem happens. Sorry about the confusion. Let me reproduce again just to make sure and th

[GitHub] [airflow] uranusjr commented on pull request #18820: Remove deprecated usage of init_role() from API

2021-10-08 Thread GitBox
uranusjr commented on pull request #18820: URL: https://github.com/apache/airflow/pull/18820#issuecomment-939140113 I just realised instead of `"name" not in data`, this should check for emptiness and equality like the user endpoint. -- This is an automated message from the Apache Git Se

[GitHub] [airflow] hpatel-higi commented on issue #18846: Scheduler stops running: psycopg2.OperationalError: SSL SYSCALL error: EOF detected

2021-10-08 Thread GitBox
hpatel-higi commented on issue #18846: URL: https://github.com/apache/airflow/issues/18846#issuecomment-939140110 We just upgraded to version 2.1.4 from 1.10.8 and upgrade postgres to version 11. Issue happens in Azure App Service that uses Azuse Postgresql instance. -- This is an auto

[GitHub] [airflow] hpatel-higi opened a new issue #18846: Scheduler stops running: psycopg2.OperationalError: SSL SYSCALL error: EOF detected

2021-10-08 Thread GitBox
hpatel-higi opened a new issue #18846: URL: https://github.com/apache/airflow/issues/18846 ### Apache Airflow version 2.1.4 (latest released) ### Operating System Linux ### Versions of Apache Airflow Providers adal==1.2.7 alembic==1.7.1 anyio==3.3.1

[GitHub] [airflow] tazimmerman commented on issue #16389: SLAs for only one task in a DAG

2021-10-08 Thread GitBox
tazimmerman commented on issue #16389: URL: https://github.com/apache/airflow/issues/16389#issuecomment-939135249 It appears that commit [2fd3f27e](https://github.com/apache/airflow/commit/2fd3f27ebd2a4f695968fb7cc5d119e087820928#diff-3101df8e7c54fe1b9305774befb54b31edfe84cb81425a300e70142b

[GitHub] [airflow] ageofneil opened a new issue #18845: Facebook Ads Provider uses a deprecated version of the API

2021-10-08 Thread GitBox
ageofneil opened a new issue #18845: URL: https://github.com/apache/airflow/issues/18845 ### Apache Airflow Provider(s) facebook ### Versions of Apache Airflow Providers 2.0.1 ### Apache Airflow version 2.1.1 ### Operating System Ubuntu 20.04

[GitHub] [airflow] boring-cyborg[bot] commented on issue #18845: Facebook Ads Provider uses a deprecated version of the API

2021-10-08 Thread GitBox
boring-cyborg[bot] commented on issue #18845: URL: https://github.com/apache/airflow/issues/18845#issuecomment-939129038 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the mess

[GitHub] [airflow] tazimmerman commented on issue #16389: SLAs for only one task in a DAG

2021-10-08 Thread GitBox
tazimmerman commented on issue #16389: URL: https://github.com/apache/airflow/issues/16389#issuecomment-939127691 > > > To add some more findings from my personal testing - this seems to only appear when using the context manager style of defining a DAG (e.g. `with DAG(...) as dag:

[GitHub] [airflow] mariotaddeucci opened a new pull request #18844: Remove extra prostgres dependency

2021-10-08 Thread GitBox
mariotaddeucci opened a new pull request #18844: URL: https://github.com/apache/airflow/pull/18844 Removed postgres provider specific versions dependency generated on #18027. Using the `RedshiftSQLHook ` introduced on #18447 and replicating the method `get_table_primary_key` to it. Th

[GitHub] [airflow] KulykDmytro opened a new issue #18843: SerializedDagNotFound: DAG not found in serialized_dag table

2021-10-08 Thread GitBox
KulykDmytro opened a new issue #18843: URL: https://github.com/apache/airflow/issues/18843 ### Apache Airflow version 2.1.4 (latest released) ### Operating System Linux 5.4.149-73.259.amzn2.x86_64 ### Versions of Apache Airflow Providers _No response_

[GitHub] [airflow] mariotaddeucci closed pull request #18821: Remove duplicate code on dbapi hook

2021-10-08 Thread GitBox
mariotaddeucci closed pull request #18821: URL: https://github.com/apache/airflow/pull/18821 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commi

[GitHub] [airflow] baryluk edited a comment on issue #17063: botocore.exceptions.ClientError: An error occurred (403) when calling the HeadObject operation: Forbidden

2021-10-08 Thread GitBox
baryluk edited a comment on issue #17063: URL: https://github.com/apache/airflow/issues/17063#issuecomment-939077168 @m0zart89 That will not work either I think. Try `?region_name=us-east-1` instead. ``` s3://access_key:secret_access_key@/?region_name=us-east-1 ```

[GitHub] [airflow] baryluk commented on issue #17063: botocore.exceptions.ClientError: An error occurred (403) when calling the HeadObject operation: Forbidden

2021-10-08 Thread GitBox
baryluk commented on issue #17063: URL: https://github.com/apache/airflow/issues/17063#issuecomment-939077168 @m0zart89 That will not work either I think. Try `?region_name=us-east-1` instead. ``` s3://access_key:secret_access_key@/ ``` Is the best. Do not specif

[GitHub] [airflow] flolas commented on pull request #17329: Split sql statements in DbApi run

2021-10-08 Thread GitBox
flolas commented on pull request #17329: URL: https://github.com/apache/airflow/pull/17329#issuecomment-939052887 @potiuk done -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

[jira] [Commented] (AIRFLOW-6912) Airflow unable to run concurrent ssh tasks (up to 27) in a single dag

2021-10-08 Thread Ian WIlson (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17426325#comment-17426325 ] Ian WIlson commented on AIRFLOW-6912: - [~phuc] [~ash] I hit this issue but resolv

[GitHub] [airflow] 1nF0rmed commented on issue #18634: Pendulum 1.x -> 2.x with Airflow 1.x -> 2.x Documentation Updates

2021-10-08 Thread GitBox
1nF0rmed commented on issue #18634: URL: https://github.com/apache/airflow/issues/18634#issuecomment-939002571 What errors do `execution_date.format('-MM-DD HH:mm:ss', formatter='alternative')` throw at the moment? Also, could you point me where `execution_date.format('-MM-DD

[GitHub] [airflow] john-jac commented on issue #18835: Status of testing Amzon Provider 2.3.0rc2 that was prepared on October 08, 2021

2021-10-08 Thread GitBox
john-jac commented on issue #18835: URL: https://github.com/apache/airflow/issues/18835#issuecomment-939001294 #17609, #18156, and #18211 work as expected. From: Jarek Potiuk ***@***.***> Reply-To: apache/airflow ***@***.***> Date: Friday, October 8, 2021 at 6:52 AM To: apach

[GitHub] [airflow] potiuk commented on issue #18717: Add possibility to refresh list of DAGs

2021-10-08 Thread GitBox
potiuk commented on issue #18717: URL: https://github.com/apache/airflow/issues/18717#issuecomment-938984548 Understood. Makes perfect sense -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] bbovenzi commented on issue #18731: Chart in Task Duration is too narrow

2021-10-08 Thread GitBox
bbovenzi commented on issue #18731: URL: https://github.com/apache/airflow/issues/18731#issuecomment-938968014 This also happens on the far right and far left. https://user-images.githubusercontent.com/4600967/136600716-f94342d6-0fbd-451b-a336-0fc00a65791b.png";> -- This is an

[GitHub] [airflow] mariotaddeucci commented on issue #18835: Status of testing Amzon Provider 2.3.0rc2 that was prepared on October 08, 2021

2021-10-08 Thread GitBox
mariotaddeucci commented on issue #18835: URL: https://github.com/apache/airflow/issues/18835#issuecomment-938912310 #18027 works as expected o/ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [airflow] bbovenzi commented on issue #18717: Add possibility to refresh list of DAGs

2021-10-08 Thread GitBox
bbovenzi commented on issue #18717: URL: https://github.com/apache/airflow/issues/18717#issuecomment-938900511 @potiuk Yes and no. I do want to refactor other parts of the app. But many are too tightly linked to FAB that it would be so much more effort to build vs from scratch. So we will

[GitHub] [airflow] m0zart89 commented on issue #17063: botocore.exceptions.ClientError: An error occurred (403) when calling the HeadObject operation: Forbidden

2021-10-08 Thread GitBox
m0zart89 commented on issue #17063: URL: https://github.com/apache/airflow/issues/17063#issuecomment-938895498 I have the same problem. Also when I add region as postfix to my bucket name (_bucketname.us-east-1_) I see another behaviour: An error occurred (**404**) when calling the HeadO

[GitHub] [airflow] kaxil commented on pull request #18804: Ensure that dag_id, run_id and execution_date are non-null on DagRun

2021-10-08 Thread GitBox
kaxil commented on pull request #18804: URL: https://github.com/apache/airflow/pull/18804#issuecomment-938863632 Yup this is now already part of v2-2-test and part of 2.2.0 rc1. https://github.com/apache/airflow/commits/v2-2-test -- This is an automated message from the Apache Git

[GitHub] [airflow] john-jac opened a new pull request #18842: Add Callbacks Section to Logging & Monitoring

2021-10-08 Thread GitBox
john-jac opened a new pull request #18842: URL: https://github.com/apache/airflow/pull/18842 Airflow users often ask for an easy way to monitor the success or failure of tasks and/or DAGs. The use of callbacks, such as on_success_callback, helps users monitor DAG runs in an easily configu

[GitHub] [airflow] potiuk edited a comment on issue #18841: GCP module is not installable locally

2021-10-08 Thread GitBox
potiuk edited a comment on issue #18841: URL: https://github.com/apache/airflow/issues/18841#issuecomment-938828345 Please use constraints to install airflow as specified in the instructions: https://airflow.apache.org/docs/apache-airflow/stable/installation/installing-from-pypi.html (just

[GitHub] [airflow] potiuk commented on issue #18841: GCP module is not installable locally

2021-10-08 Thread GitBox
potiuk commented on issue #18841: URL: https://github.com/apache/airflow/issues/18841#issuecomment-938828345 Please use constraints to install airflow as specified in the instructions: https://airflow.apache.org/docs/apache-airflow/stable/installation/installing-from-pypi.html -- This is

[GitHub] [airflow] potiuk closed issue #18841: GCP module is not installable locally

2021-10-08 Thread GitBox
potiuk closed issue #18841: URL: https://github.com/apache/airflow/issues/18841 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr..

[GitHub] [airflow] potiuk closed issue #16544: Redshift postgres hook usage

2021-10-08 Thread GitBox
potiuk closed issue #16544: URL: https://github.com/apache/airflow/issues/16544 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr..

[airflow] branch main updated (22768ff -> 1df9a51)

2021-10-08 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 22768ff Removed duplicated code on S3ToRedshiftOperator (#18671) add 1df9a51 Add RedshiftSQLHook, RedshiftSQLOp

[GitHub] [airflow] potiuk closed issue #16355: Operator and Hook for Amazon Redshift Statement Execution and Federated User Authentication

2021-10-08 Thread GitBox
potiuk closed issue #16355: URL: https://github.com/apache/airflow/issues/16355 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr..

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #18447: Add RedshiftSQLHook, RedshiftSQLOperator

2021-10-08 Thread GitBox
boring-cyborg[bot] commented on pull request #18447: URL: https://github.com/apache/airflow/pull/18447#issuecomment-938821536 Awesome work, congrats on your first merged pull request! -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [airflow] potiuk merged pull request #18447: Add RedshiftSQLHook, RedshiftSQLOperator

2021-10-08 Thread GitBox
potiuk merged pull request #18447: URL: https://github.com/apache/airflow/pull/18447 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsub

[GitHub] [airflow] widewing commented on issue #18487: 2.1.3/4 queued dag runs changes catchup=False behaviour

2021-10-08 Thread GitBox
widewing commented on issue #18487: URL: https://github.com/apache/airflow/issues/18487#issuecomment-938818049 @ephraimbuddy thanks I'll try this out. I can accept it as workaround, but still it's conflicting with the idea of catch-up. -- This is an automated message from the Apache Git

[GitHub] [airflow] boring-cyborg[bot] commented on issue #18841: GCP module is not installable locally

2021-10-08 Thread GitBox
boring-cyborg[bot] commented on issue #18841: URL: https://github.com/apache/airflow/issues/18841#issuecomment-938815865 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the mess

[GitHub] [airflow] ruslankrivoshein opened a new issue #18841: GCP module is not installable locally

2021-10-08 Thread GitBox
ruslankrivoshein opened a new issue #18841: URL: https://github.com/apache/airflow/issues/18841 ### Apache Airflow version main (development) ### Operating System Ubuntu 20.04 ### Versions of Apache Airflow Providers _No response_ ### Deployment

[GitHub] [airflow] pmalafosse commented on issue #18835: Status of testing Amzon Provider 2.3.0rc2 that was prepared on October 08, 2021

2021-10-08 Thread GitBox
pmalafosse commented on issue #18835: URL: https://github.com/apache/airflow/issues/18835#issuecomment-938812676 Tested https://github.com/apache/airflow/pull/17209 and it works as expected -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [airflow] potiuk commented on issue #18717: Add possibility to refresh list of DAGs

2021-10-08 Thread GitBox
potiuk commented on issue #18717: URL: https://github.com/apache/airflow/issues/18717#issuecomment-938803217 BTW, @bbovenzi - will the approach with Tree view be replicated and we will gradualy replace screen by screen with new reactive approach rather then have a separate UI? Seems that i

[GitHub] [airflow] ron-damon commented on issue #18835: Status of testing Amzon Provider 2.3.0rc2 that was prepared on October 08, 2021

2021-10-08 Thread GitBox
ron-damon commented on issue #18835: URL: https://github.com/apache/airflow/issues/18835#issuecomment-938770707 Tested #18814 and #16796, individually and combined. Both working as expected. -- This is an automated message from the Apache Git Service. To respond to the message, please lo

[airflow] branch constraints-main updated: Updating constraints. Build id:1320680810

2021-10-08 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 02e1b2f Updating const

[GitHub] [airflow] potiuk closed issue #18840: Reading a xcom variable from a task within a task group returns None

2021-10-08 Thread GitBox
potiuk closed issue #18840: URL: https://github.com/apache/airflow/issues/18840 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr..

[GitHub] [airflow] potiuk commented on issue #18840: Reading a xcom variable from a task within a task group returns None

2021-10-08 Thread GitBox
potiuk commented on issue #18840: URL: https://github.com/apache/airflow/issues/18840#issuecomment-938761062 Closing as invalid @mariotaddeucci gave good answer. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

[GitHub] [airflow] anaynayak edited a comment on issue #18835: Status of testing Amzon Provider 2.3.0rc2 that was prepared on October 08, 2021

2021-10-08 Thread GitBox
anaynayak edited a comment on issue #18835: URL: https://github.com/apache/airflow/issues/18835#issuecomment-938752421 Tested #18691 . Working as expected. Screenshot ![image](https://user-images.githubusercontent.com/416211/136587645-b1d4de6e-498d-4e0b-adea-728012b3595a

[GitHub] [airflow] anaynayak commented on issue #18835: Status of testing Amzon Provider 2.3.0rc2 that was prepared on October 08, 2021

2021-10-08 Thread GitBox
anaynayak commented on issue #18835: URL: https://github.com/apache/airflow/issues/18835#issuecomment-938752421 Tested #18691 . Working as expected. ![image](https://user-images.githubusercontent.com/416211/136587645-b1d4de6e-498d-4e0b-adea-728012b3595a.png) -- This is an automate

[GitHub] [airflow] mariotaddeucci edited a comment on issue #18840: Reading a xcom variable from a task within a task group returns None

2021-10-08 Thread GitBox
mariotaddeucci edited a comment on issue #18840: URL: https://github.com/apache/airflow/issues/18840#issuecomment-938741928 @mehmax When your task is within a Task Group, your callable task_id will be the task_id prefixed with the group_id (i.e. `group_id.task_id`). This ensures the unique

[GitHub] [airflow] mariotaddeucci edited a comment on issue #18840: Reading a xcom variable from a task within a task group returns None

2021-10-08 Thread GitBox
mariotaddeucci edited a comment on issue #18840: URL: https://github.com/apache/airflow/issues/18840#issuecomment-938741928 @mehmax When your task is within a Task Group, your callable task_id will be the task_id prefixed with the group_id (i.e. `group_id.task_id`). This ensures the unique

[GitHub] [airflow] mariotaddeucci edited a comment on issue #18840: Reading a xcom variable from a task within a task group returns None

2021-10-08 Thread GitBox
mariotaddeucci edited a comment on issue #18840: URL: https://github.com/apache/airflow/issues/18840#issuecomment-938741928 @mehmax When your task is within a Task Group, your callable task_id will be the task_id prefixed with the group_id (i.e. group_id.task_id). This ensures the uniquene

[GitHub] [airflow] mariotaddeucci commented on issue #18840: Reading a xcom variable from a task within a task group returns None

2021-10-08 Thread GitBox
mariotaddeucci commented on issue #18840: URL: https://github.com/apache/airflow/issues/18840#issuecomment-938741928 @mehmax When your task is within a Task Group, your callable task_id will be the task_id prefixed with the group_id (i.e. group_id.task_id). This ensures the uniqueness of t

[airflow] branch v2-2-stable created (now 5dd690b)

2021-10-08 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a change to branch v2-2-stable in repository https://gitbox.apache.org/repos/asf/airflow.git. at 5dd690b Bump version to 2.2.0 No new revisions were added by this update.

svn commit: r50327 - /dev/airflow/2.2.0rc1/

2021-10-08 Thread jedcunningham
Author: jedcunningham Date: Fri Oct 8 15:00:11 2021 New Revision: 50327 Log: Add artifacts for Airflow 2.2.0rc1 Added: dev/airflow/2.2.0rc1/ dev/airflow/2.2.0rc1/apache-airflow-2.2.0-source.tar.gz (with props) dev/airflow/2.2.0rc1/apache-airflow-2.2.0-source.tar.gz.asc dev/airf

[airflow] annotated tag constraints-2.2.0rc1 updated (844e122 -> 35dbd6a)

2021-10-08 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to annotated tag constraints-2.2.0rc1 in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag constraints-2.2.0rc1 was modified! *** from 844e122 (commit) to 35dbd6a

[GitHub] [airflow] ephraimbuddy commented on a change in pull request #18675: New Tree View

2021-10-08 Thread GitBox
ephraimbuddy commented on a change in pull request #18675: URL: https://github.com/apache/airflow/pull/18675#discussion_r725086052 ## File path: airflow/www/views.py ## @@ -219,6 +219,82 @@ def get_date_time_num_runs_dag_runs_form_data(www_request, session, dag): } +d

[GitHub] [airflow] ephraimbuddy closed pull request #18675: New Tree View

2021-10-08 Thread GitBox
ephraimbuddy closed pull request #18675: URL: https://github.com/apache/airflow/pull/18675 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits

[GitHub] [airflow] zachliu commented on pull request #18764: Enable AWS Secrets Manager backend to retrieve conns using different fields

2021-10-08 Thread GitBox
zachliu commented on pull request #18764: URL: https://github.com/apache/airflow/pull/18764#issuecomment-938704331 > > one question: should we adjust the default behavior of "full_url_mode" to `true`? otherwise this could break existing processes thinking > > It is true by default.

[GitHub] [airflow] mehmax opened a new issue #18840: Reading a xcom variable from a task within a task group returns None

2021-10-08 Thread GitBox
mehmax opened a new issue #18840: URL: https://github.com/apache/airflow/issues/18840 ### Apache Airflow version 2.1.0 ### Operating System CentOs 7 ### Versions of Apache Airflow Providers _No response_ ### Deployment Other ### Deploym

[airflow] branch constraints-2-2 updated (7213d0c -> 844e122)

2021-10-08 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a change to branch constraints-2-2 in repository https://gitbox.apache.org/repos/asf/airflow.git. from 7213d0c Updating constraints. Build id:1314305756 add 8b24315 Updating constraints. Build id:

[GitHub] [airflow] JavierLopezT commented on issue #18835: Status of testing Amzon Provider 2.3.0rc2 that was prepared on October 08, 2021

2021-10-08 Thread GitBox
JavierLopezT commented on issue #18835: URL: https://github.com/apache/airflow/issues/18835#issuecomment-938700513 Tested #17937 and #18764. Both working as expected -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [airflow] bbovenzi commented on issue #18717: Add possibility to refresh list of DAGs

2021-10-08 Thread GitBox
bbovenzi commented on issue #18717: URL: https://github.com/apache/airflow/issues/18717#issuecomment-938696473 Yeah, that was the reason that I didn't do auto-refresh for the home page when I added it to tree view. I did have a basic live-update working in the demo for AIP-38. After the Ne

[GitHub] [airflow] JavierLopezT commented on pull request #18764: Enable AWS Secrets Manager backend to retrieve conns using different fields

2021-10-08 Thread GitBox
JavierLopezT commented on pull request #18764: URL: https://github.com/apache/airflow/pull/18764#issuecomment-938695235 > one question: should we adjust the default behavior of "full_url_mode" to `true`? otherwise this could break existing processes 🤔 It is true by default. -- Th

[GitHub] [airflow] zachliu commented on pull request #18764: Enable AWS Secrets Manager backend to retrieve conns using different fields

2021-10-08 Thread GitBox
zachliu commented on pull request #18764: URL: https://github.com/apache/airflow/pull/18764#issuecomment-938693443 one question: should we adjust the default behavior of "full_url_mode" to `true`? otherwise this could break existing processes :thinking: -- This is an automated mess

[GitHub] [airflow] potiuk commented on pull request #18671: Remove duplicated code on S3ToRedshiftOperator

2021-10-08 Thread GitBox
potiuk commented on pull request #18671: URL: https://github.com/apache/airflow/pull/18671#issuecomment-938683008 BTW. The limit on Postgres is added to the RC2 provider :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[airflow] branch main updated (b8efdac -> 22768ff)

2021-10-08 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from b8efdac Add last items to changelog before 2.2.0rc1 (#18837) add 22768ff Removed duplicated code on S3ToRedshif

[GitHub] [airflow] potiuk merged pull request #18671: Remove duplicated code on S3ToRedshiftOperator

2021-10-08 Thread GitBox
potiuk merged pull request #18671: URL: https://github.com/apache/airflow/pull/18671 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsub

[GitHub] [airflow] potiuk edited a comment on pull request #18804: Ensure that dag_id, run_id and execution_date are non-null on DagRun

2021-10-08 Thread GitBox
potiuk edited a comment on pull request #18804: URL: https://github.com/apache/airflow/pull/18804#issuecomment-938681648 Only after we cut an RC the branches will diverge -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

[GitHub] [airflow] potiuk commented on pull request #18804: Ensure that dag_id, run_id and execution_date are non-null on DagRun

2021-10-08 Thread GitBox
potiuk commented on pull request #18804: URL: https://github.com/apache/airflow/pull/18804#issuecomment-938681648 Only after we cut and RC the branches will diverge -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [airflow] potiuk commented on pull request #18804: Ensure that dag_id, run_id and execution_date are non-null on DagRun

2021-10-08 Thread GitBox
potiuk commented on pull request #18804: URL: https://github.com/apache/airflow/pull/18804#issuecomment-938681320 actually we keep on moving v2-2-test with main but generally speaking this one is marked for 2.2.0 so yeah - it will land in v2-2-test -- This is an automated message from th

[GitHub] [airflow] eladkal edited a comment on issue #10278: Airflow doesn't fail fast in case of invalid executor_config or mutation hook

2021-10-08 Thread GitBox
eladkal edited a comment on issue #10278: URL: https://github.com/apache/airflow/issues/10278#issuecomment-938679779 @Dr-Denzy is there an issue here or we can close as can't reproduce? -- This is an automated message from the Apache Git Service. To respond to the message, please log on t

  1   2   >