Re: [PR] FLINK-36540.[Runtime / Task] Add Support for Hadoop Caller Context when using Flink to operate hdfs. [flink]

2024-10-31 Thread via GitHub
xintongsong commented on PR #25516: URL: https://github.com/apache/flink/pull/25516#issuecomment-2451383721 @liangyu-1 Sorry for the late response. I was on a business travel for the past 2 weeks. I'm not entirely sure about this feature. Why do we need thread level audit logs

Re: [PR] [FLINK-36499][table]Remove deprecated method `SupportsProjectionPushD… [flink]

2024-10-31 Thread via GitHub
RanJinh commented on PR #25594: URL: https://github.com/apache/flink/pull/25594#issuecomment-2451354439 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Created] (FLINK-36648) bump flink version to 2.0-preview1 for Kafka connector

2024-10-31 Thread LvYanquan (Jira)
LvYanquan created FLINK-36648: - Summary: bump flink version to 2.0-preview1 for Kafka connector Key: FLINK-36648 URL: https://issues.apache.org/jira/browse/FLINK-36648 Project: Flink Issue Type:

Re: [PR] [hotfix][tests] Tolerate schema change timeout failure and retry, suppress false alarms [flink-cdc]

2024-10-31 Thread via GitHub
yuxiqian closed pull request #3676: [hotfix][tests] Tolerate schema change timeout failure and retry, suppress false alarms URL: https://github.com/apache/flink-cdc/pull/3676 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and us

Re: [PR] [hotfix][tests] Tolerate schema change timeout failure and retry, suppress false alarms [flink-cdc]

2024-10-31 Thread via GitHub
yuxiqian commented on PR #3676: URL: https://github.com/apache/flink-cdc/pull/3676#issuecomment-2451223322 After some pressure tests, it turns out that job just keeps stuck even after restarts. Seems some special pattern of event mixture will 100% cause FlushEvent to stuck. This won't make

[jira] [Commented] (FLINK-36613) RescaleCheckpointManuallyITCase.testCheckpointRescalingInKeyedState fails on AZP

2024-10-31 Thread Jinhao Ran (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17894752#comment-17894752 ] Jinhao Ran commented on FLINK-36613: here's another one:https://dev.azure.com/apach

Re: [PR] [FLINK-36496][table]Remove deprecated method `CatalogFunction#isGeneric` [flink]

2024-10-31 Thread via GitHub
RanJinh commented on PR #25595: URL: https://github.com/apache/flink/pull/25595#issuecomment-2451177330 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [FLINK-36636][cdc] Timestamp data supports comparison in cdc pipeline transform [flink-cdc]

2024-10-31 Thread via GitHub
yuxiqian commented on code in PR #3677: URL: https://github.com/apache/flink-cdc/pull/3677#discussion_r1825343077 ## docs/content.zh/docs/core-concept/transform.md: ## @@ -131,18 +131,18 @@ Flink CDC uses [Calcite](https://calcite.apache.org/) to parse expressions and [ ## T

Re: [PR] [hotfix][tests] Tolerate schema change timeout failure and retry, suppress false alarms [flink-cdc]

2024-10-31 Thread via GitHub
yuxiqian commented on PR #3676: URL: https://github.com/apache/flink-cdc/pull/3676#issuecomment-2451135558 Low priority but should improve CI passing rate, cc @ruanhang1993 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [PR] [FLINK-36636][cdc] Timestamp data supports comparison in cdc pipeline transform [flink-cdc]

2024-10-31 Thread via GitHub
aiwenmo commented on code in PR #3677: URL: https://github.com/apache/flink-cdc/pull/3677#discussion_r1825342027 ## docs/content/docs/core-concept/transform.md: ## @@ -131,18 +131,18 @@ Flink CDC uses [Calcite](https://calcite.apache.org/) to parse expressions and [ ## Tempo

Re: [PR] [FLINK-36636][cdc] Timestamp data supports comparison in cdc pipeline transform [flink-cdc]

2024-10-31 Thread via GitHub
aiwenmo commented on code in PR #3677: URL: https://github.com/apache/flink-cdc/pull/3677#discussion_r1825341915 ## docs/content.zh/docs/core-concept/transform.md: ## @@ -131,18 +131,18 @@ Flink CDC uses [Calcite](https://calcite.apache.org/) to parse expressions and [ ## Te

Re: [PR] [FLINK-36636][cdc] Timestamp data supports comparison in cdc pipeline transform [flink-cdc]

2024-10-31 Thread via GitHub
yuxiqian commented on code in PR #3677: URL: https://github.com/apache/flink-cdc/pull/3677#discussion_r1825331347 ## flink-cdc-runtime/src/test/java/org/apache/flink/cdc/runtime/operators/transform/PostTransformOperatorTest.java: ## @@ -1483,6 +1496,107 @@ void testCastErrorTran

Re: [PR] [FLINK-36636][cdc] Timestamp data supports comparison in cdc pipeline transform [flink-cdc]

2024-10-31 Thread via GitHub
aiwenmo commented on code in PR #3677: URL: https://github.com/apache/flink-cdc/pull/3677#discussion_r1825341113 ## flink-cdc-runtime/src/main/java/org/apache/flink/cdc/runtime/functions/SystemFunctionUtils.java: ## @@ -645,4 +645,32 @@ private static String castObjectIntoString

Re: [PR] [FLINK-36636][cdc] Timestamp data supports comparison in cdc pipeline transform [flink-cdc]

2024-10-31 Thread via GitHub
aiwenmo commented on code in PR #3677: URL: https://github.com/apache/flink-cdc/pull/3677#discussion_r1825340723 ## flink-cdc-runtime/src/test/java/org/apache/flink/cdc/runtime/operators/transform/PostTransformOperatorTest.java: ## @@ -1483,6 +1496,107 @@ void testCastErrorTrans

Re: [PR] [FLINK-36636][cdc] Timestamp data supports comparison in cdc pipeline transform [flink-cdc]

2024-10-31 Thread via GitHub
yuxiqian commented on code in PR #3677: URL: https://github.com/apache/flink-cdc/pull/3677#discussion_r1825335218 ## docs/content/docs/core-concept/transform.md: ## @@ -131,18 +131,18 @@ Flink CDC uses [Calcite](https://calcite.apache.org/) to parse expressions and [ ## Temp

Re: [PR] [FLINK-36573][cdc-connector][mysql] Add table information of binlog offsets when checkpointing [flink-cdc]

2024-10-31 Thread via GitHub
yuxiqian commented on PR #3656: URL: https://github.com/apache/flink-cdc/pull/3656#issuecomment-2451133207 > Seems that the CI test of `2024-10-30T13:03:29.2042562Z [ERROR] TransformE2eITCase.testHeteroSchemaTransform Time elapsed: 74.649 s <<< ERROR! 2024-10-30T13:03:29.2049354Z java.util.

Re: [PR] [FLINK-36573][cdc-connector][mysql] Add table information of binlog offsets when checkpointing [flink-cdc]

2024-10-31 Thread via GitHub
herunkang2018 commented on PR #3656: URL: https://github.com/apache/flink-cdc/pull/3656#issuecomment-2451129024 Seems that the CI test of `2024-10-30T13:03:29.2042562Z [ERROR] TransformE2eITCase.testHeteroSchemaTransform Time elapsed: 74.649 s <<< ERROR! 2024-10-30T13:03:29.2049354Z ja

[jira] [Commented] (FLINK-36647) Support TimestampDiff function in cdc pipeline transform

2024-10-31 Thread Wenkai Qi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17894746#comment-17894746 ] Wenkai Qi commented on FLINK-36647: --- [~leonard]. I would like to hear your suggestion.

[jira] [Created] (FLINK-36647) Support TimestampDiff function in cdc pipeline transform

2024-10-31 Thread Wenkai Qi (Jira)
Wenkai Qi created FLINK-36647: - Summary: Support TimestampDiff function in cdc pipeline transform Key: FLINK-36647 URL: https://issues.apache.org/jira/browse/FLINK-36647 Project: Flink Issue Type

Re: [PR] [postgres] Remove unnecessary schema fresh to improve performance. [flink-cdc]

2024-10-31 Thread via GitHub
cobolbaby commented on PR #2571: URL: https://github.com/apache/flink-cdc/pull/2571#issuecomment-2451102085 Please take some time to review the PR. Many improvements haven’t been merged yet. @loserwang1024 -- This is an automated message from the Apache Git Service. To respond to t

Re: [PR] [postgres] Remove unnecessary schema fresh to improve performance. [flink-cdc]

2024-10-31 Thread via GitHub
github-actions[bot] commented on PR #2571: URL: https://github.com/apache/flink-cdc/pull/2571#issuecomment-2451043878 This pull request has been closed because it has not had recent activity. You could reopen it if you try to continue your work, and anyone who are interested in it are encou

Re: [PR] [hotfix] [base] Fix the serialization error occurring with table names containing dot [flink-cdc]

2024-10-31 Thread via GitHub
github-actions[bot] closed pull request #2705: [hotfix] [base] Fix the serialization error occurring with table names containing dot URL: https://github.com/apache/flink-cdc/pull/2705 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

Re: [PR] [FLINK-35654][docs] Add CDC release verification & Installation guide [flink-cdc]

2024-10-31 Thread via GitHub
github-actions[bot] closed pull request #3430: [FLINK-35654][docs] Add CDC release verification & Installation guide URL: https://github.com/apache/flink-cdc/pull/3430 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

Re: [PR] [postgres] Remove unnecessary schema fresh to improve performance. [flink-cdc]

2024-10-31 Thread via GitHub
github-actions[bot] closed pull request #2571: [postgres] Remove unnecessary schema fresh to improve performance. URL: https://github.com/apache/flink-cdc/pull/2571 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [FLINK-35654][docs] Add CDC release verification & Installation guide [flink-cdc]

2024-10-31 Thread via GitHub
github-actions[bot] commented on PR #3430: URL: https://github.com/apache/flink-cdc/pull/3430#issuecomment-2451043774 This pull request has been closed because it has not had recent activity. You could reopen it if you try to continue your work, and anyone who are interested in it are encou

Re: [PR] [FLINK-35757][mysql] support dynamically capture new tables [flink-cdc]

2024-10-31 Thread via GitHub
github-actions[bot] commented on PR #3467: URL: https://github.com/apache/flink-cdc/pull/3467#issuecomment-2451043710 This pull request has been closed because it has not had recent activity. You could reopen it if you try to continue your work, and anyone who are interested in it are encou

Re: [PR] [hotfix] [base] Fix the serialization error occurring with table names containing dot [flink-cdc]

2024-10-31 Thread via GitHub
github-actions[bot] commented on PR #2705: URL: https://github.com/apache/flink-cdc/pull/2705#issuecomment-2451043858 This pull request has been closed because it has not had recent activity. You could reopen it if you try to continue your work, and anyone who are interested in it are encou

Re: [PR] [FLINK-35757][mysql] support dynamically capture new tables [flink-cdc]

2024-10-31 Thread via GitHub
github-actions[bot] closed pull request #3467: [FLINK-35757][mysql] support dynamically capture new tables URL: https://github.com/apache/flink-cdc/pull/3467 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

Re: [PR] [FLINK-36460] Refactoring the CI matrix [flink-kubernetes-operator]

2024-10-31 Thread via GitHub
SamBarker commented on PR #893: URL: https://github.com/apache/flink-kubernetes-operator/pull/893#issuecomment-2450957960 I think I've finally got the excludes to align with main. *sigh* That was a lot more fuss than I wanted and doesn't end up as clean as I was hoping. However I think thi

[jira] [Assigned] (FLINK-36645) Gracefully handle null execution plan from autoscaler

2024-10-31 Thread Matyas Orhidi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matyas Orhidi reassigned FLINK-36645: - Assignee: Sai Sharath Dandi > Gracefully handle null execution plan from autoscaler > -

[jira] [Updated] (FLINK-36645) Gracefully handle null execution plan from autoscaler

2024-10-31 Thread Matyas Orhidi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matyas Orhidi updated FLINK-36645: -- Component/s: Kubernetes Operator > Gracefully handle null execution plan from autoscaler > ---

[jira] [Updated] (FLINK-36646) Support Java 17+ job images more conveniently in the operator

2024-10-31 Thread Rob Young (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rob Young updated FLINK-36646: -- Description: Currently if I execute the operator quickstart, but change the FlinkDeployment image to

[jira] [Updated] (FLINK-36646) Support Java 17+ job images more conveniently in the operator

2024-10-31 Thread Rob Young (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rob Young updated FLINK-36646: -- Description: Currently if I execute the operator quickstart (for operator 1.10.0) , but change the Fl

[jira] [Updated] (FLINK-36646) Support Java 17+ job images more conveniently in the operator

2024-10-31 Thread Rob Young (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rob Young updated FLINK-36646: -- Description: Currently if I execute the operator quickstart, but change the FlinkDeployment image to

[jira] [Updated] (FLINK-36646) Support Java 17+ job images more conveniently in the operator

2024-10-31 Thread Rob Young (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rob Young updated FLINK-36646: -- Description: Currently if I execute the operator quickstart, but change the FlinkDeployment image to

[jira] [Created] (FLINK-36646) Support Java 17+ job images more conveniently in the operator

2024-10-31 Thread Rob Young (Jira)
Rob Young created FLINK-36646: - Summary: Support Java 17+ job images more conveniently in the operator Key: FLINK-36646 URL: https://issues.apache.org/jira/browse/FLINK-36646 Project: Flink Issu

[jira] [Updated] (FLINK-36644) TIMESTAMPDIFF can not be string serialized

2024-10-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36644: --- Labels: pull-request-available (was: ) > TIMESTAMPDIFF can not be string serialized > -

Re: [PR] [FLINK-36637] Fix ListShards for large KDS streams [flink-connector-aws]

2024-10-31 Thread via GitHub
hlteoh37 merged PR #178: URL: https://github.com/apache/flink-connector-aws/pull/178 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@

[jira] [Commented] (FLINK-36409) Publish some autoscaler metrics during stabilisation period

2024-10-31 Thread Sai Sharath Dandi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17894700#comment-17894700 ] Sai Sharath Dandi commented on FLINK-36409: --- Hello [~morhidi] , are you workin

[jira] [Created] (FLINK-36645) Gracefully handle null execution plan from autoscaler

2024-10-31 Thread Sai Sharath Dandi (Jira)
Sai Sharath Dandi created FLINK-36645: - Summary: Gracefully handle null execution plan from autoscaler Key: FLINK-36645 URL: https://issues.apache.org/jira/browse/FLINK-36645 Project: Flink

[jira] [Updated] (FLINK-36640) Provide an easy way to reset autoscaling

2024-10-31 Thread Matyas Orhidi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matyas Orhidi updated FLINK-36640: -- Description: FLINK-32589 introduced a feature to carry over parallelism overrides between app

[jira] [Commented] (FLINK-36640) Provide an easy way to reset autoscaling

2024-10-31 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17894670#comment-17894670 ] Gyula Fora commented on FLINK-36640: That was a design choice we made, so max parall

[jira] [Commented] (FLINK-36640) Provide an easy way to reset autoscaling

2024-10-31 Thread Matyas Orhidi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17894667#comment-17894667 ] Matyas Orhidi commented on FLINK-36640: --- We have also seen issues reported that cu

Re: [PR] [FLINK-36615] Support LEAD/LAG functions in Table API [flink]

2024-10-31 Thread via GitHub
twalthr commented on code in PR #25582: URL: https://github.com/apache/flink/pull/25582#discussion_r1824871775 ## flink-table/flink-table-common/src/main/java/org/apache/flink/table/types/inference/strategies/OverTypeStrategy.java: ## @@ -182,18 +204,16 @@ private Optional valid

[jira] [Commented] (FLINK-36640) Provide an easy way to reset autoscaling

2024-10-31 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17894666#comment-17894666 ] Gyula Fora commented on FLINK-36640: [https://nightlies.apache.org/flink/flink-docs-

[jira] [Updated] (FLINK-36639) Use table aliases in Table API asSerializableString

2024-10-31 Thread Dawid Wysakowicz (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dawid Wysakowicz updated FLINK-36639: - Description: Certain operations do not work without explicitly scoping a fieldreference.

[jira] [Resolved] (FLINK-36637) Fix ListShards for Kinesis streams with large number of shards

2024-10-31 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Liang Teoh resolved FLINK-36637. - Resolution: Fixed  merged commit [{{30d32fd}}|https://github.com/apache/flink-connector

Re: [PR] [FLINK-36615] Support LEAD/LAG functions in Table API [flink]

2024-10-31 Thread via GitHub
twalthr commented on code in PR #25582: URL: https://github.com/apache/flink/pull/25582#discussion_r1824689298 ## flink-table/flink-table-api-java/src/main/java/org/apache/flink/table/api/Expressions.java: ## @@ -947,6 +947,120 @@ public static ApiExpression jsonArrayAgg(JsonOnN

[jira] [Assigned] (FLINK-36636) Timestamp data can not be compared in cdc pipeline transform

2024-10-31 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reassigned FLINK-36636: -- Assignee: Wenkai Qi > Timestamp data can not be compared in cdc pipeline transform >

Re: [PR] [FLINK-36615] Support LEAD/LAG functions in Table API [flink]

2024-10-31 Thread via GitHub
dawidwys commented on code in PR #25582: URL: https://github.com/apache/flink/pull/25582#discussion_r1824757089 ## flink-table/flink-table-common/src/main/java/org/apache/flink/table/types/inference/strategies/OverTypeStrategy.java: ## @@ -182,18 +204,16 @@ private Optional vali

Re: [PR] [FLINK-36615] Support LEAD/LAG functions in Table API [flink]

2024-10-31 Thread via GitHub
dawidwys commented on code in PR #25582: URL: https://github.com/apache/flink/pull/25582#discussion_r1824754990 ## flink-table/flink-table-common/src/main/java/org/apache/flink/table/types/inference/strategies/OverTypeStrategy.java: ## @@ -182,18 +204,16 @@ private Optional vali

[jira] [Updated] (FLINK-36643) Upgrade aws-java-sdk-core to 1.12.773+ to fix vulnerability

2024-10-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36643: --- Labels: pull-request-available (was: ) > Upgrade aws-java-sdk-core to 1.12.773+ to fix vuln

Re: [PR] [FLINK-36636][cdc] Timestamp data supports comparison in cdc pipeline transform [flink-cdc]

2024-10-31 Thread via GitHub
aiwenmo commented on PR #3677: URL: https://github.com/apache/flink-cdc/pull/3677#issuecomment-2450240189 PTAL @leonardBang @yuxiqian -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Assigned] (FLINK-36641) Support and Release Connectors for Flink 1.20

2024-10-31 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reassigned FLINK-36641: -- Assignee: LvYanquan > Support and Release Connectors for Flink 1.20 > ---

Re: [PR] [FLINK-36496][table]Remove deprecated method `CatalogFunction#isGeneric` [flink]

2024-10-31 Thread via GitHub
flinkbot commented on PR #25595: URL: https://github.com/apache/flink/pull/25595#issuecomment-2449167467 ## CI report: * fdfd5e2d49d4a18af5b603458f106e92a57f7910 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-36643][filesystems] Update aws-java-sdk-core to 1.12.777 [flink]

2024-10-31 Thread via GitHub
flinkbot commented on PR #25600: URL: https://github.com/apache/flink/pull/25600#issuecomment-2450231843 ## CI report: * d4c6986268474212bb53e762524f7e4e5de36f86 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-36644] TIMESTAMPDIFF can not be string serialized [flink]

2024-10-31 Thread via GitHub
flinkbot commented on PR #25599: URL: https://github.com/apache/flink/pull/25599#issuecomment-2450185146 ## CI report: * bfb5fdfd897de9b790f0516cb00a54315abeccfa UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[PR] [FLINK-36643][filesystems] Update aws-java-sdk-core to 1.12.777 [flink]

2024-10-31 Thread via GitHub
tomncooper opened a new pull request, #25600: URL: https://github.com/apache/flink/pull/25600 ## What is the purpose of the change The current version of `aws-java-sdk-core`, used in the `flink-s3-fs-base` module, has a high severity vulnerability ([CVE-2024-21634](https://nvd.nist.g

[jira] [Updated] (FLINK-36637) Fix ListShards for Kinesis streams with large number of shards

2024-10-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36637: --- Labels: pull-request-available (was: ) > Fix ListShards for Kinesis streams with large numb

[PR] [FLINK-36637] Fix ListShards for large KDS streams [flink-connector-aws]

2024-10-31 Thread via GitHub
elphastori opened a new pull request, #178: URL: https://github.com/apache/flink-connector-aws/pull/178 ## Purpose of the change Fixes ListShards for Kinesis streams with large number of shards ## Verifying this change This change is already covered by existing unit tests

Re: [PR] [FLINK-36624][checkpointing] Log JobID from the SourceCoordinator [flink]

2024-10-31 Thread via GitHub
rkhachatryan commented on code in PR #25598: URL: https://github.com/apache/flink/pull/25598#discussion_r1824687101 ## flink-runtime/src/main/java/org/apache/flink/runtime/source/coordinator/SourceCoordinator.java: ## @@ -166,53 +171,57 @@ public SourceCoordinator( @Visib

[jira] [Updated] (FLINK-36626) Flink SQL temporal lookup JOINs behavior change from Flink 1.15 to Flink 1.20

2024-10-31 Thread Eduardo Breijo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eduardo Breijo updated FLINK-36626: --- Description: There is a behavior change I found when migrating to Flink 1.18 or Flink 1.20

Re: [PR] [FLINK-33722] Fix events ordering in MATCH_RECOGNIZE in batch mode [flink]

2024-10-31 Thread via GitHub
dawidwys commented on PR #24699: URL: https://github.com/apache/flink/pull/24699#issuecomment-2450178329 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[PR] [FLINK-36644] TIMESTAMPDIFF can not be string serialized [flink]

2024-10-31 Thread via GitHub
dawidwys opened a new pull request, #25599: URL: https://github.com/apache/flink/pull/25599 ## What is the purpose of the change Make it possible to string serialize `TIMESTAMPDIFF` ## Verifying this change Added tests in `ExpressionSerializationTest` ## Does t

[jira] [Updated] (FLINK-36643) Upgrade aws-java-sdk-core to 1.12.773+ to fix vulnerability

2024-10-31 Thread Thomas Cooper (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Cooper updated FLINK-36643: -- Affects Version/s: 2.0.0 > Upgrade aws-java-sdk-core to 1.12.773+ to fix vulnerability > -

[jira] [Created] (FLINK-36643) Upgrade aws-java-sdk-core to 1.12.773+ to fix vulnerability

2024-10-31 Thread Thomas Cooper (Jira)
Thomas Cooper created FLINK-36643: - Summary: Upgrade aws-java-sdk-core to 1.12.773+ to fix vulnerability Key: FLINK-36643 URL: https://issues.apache.org/jira/browse/FLINK-36643 Project: Flink

[jira] [Created] (FLINK-36644) TIMESTAMPDIFF can not be string serialized

2024-10-31 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-36644: Summary: TIMESTAMPDIFF can not be string serialized Key: FLINK-36644 URL: https://issues.apache.org/jira/browse/FLINK-36644 Project: Flink Issue Type

[jira] [Updated] (FLINK-36643) Upgrade aws-java-sdk-core to 1.12.773+ to fix vulnerability

2024-10-31 Thread Thomas Cooper (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Cooper updated FLINK-36643: -- Component/s: FileSystems > Upgrade aws-java-sdk-core to 1.12.773+ to fix vulnerability > -

Re: [PR] [FLINK-33977][runtime] Adaptive scheduler may not minimize the number of TMs during downscaling [flink]

2024-10-31 Thread via GitHub
mxm commented on PR #25218: URL: https://github.com/apache/flink/pull/25218#issuecomment-2450152448 The idea of the JobResourceRequirements API is to allow changing the resource profile of jobs. Users expect lower resource requirements to result in fewer TaskManagers, which isn't the case w

[jira] [Created] (FLINK-36642) Table API expressions with several built-in functions are not correctly serialized to SQL

2024-10-31 Thread Fabian Hueske (Jira)
Fabian Hueske created FLINK-36642: - Summary: Table API expressions with several built-in functions are not correctly serialized to SQL Key: FLINK-36642 URL: https://issues.apache.org/jira/browse/FLINK-36642

[PR] [FLINK-36624][checkpointing] Log JobID from the SourceCoordinator [flink]

2024-10-31 Thread via GitHub
pnowojski opened a new pull request, #25598: URL: https://github.com/apache/flink/pull/25598 ## What is the purpose of the change Log JobID from the SourceCoordinator ## Brief change log Log JobID from the SourceCoordinator ## Verifying this change Adds

Re: [PR] [FLINK-33571][table] Backport json-path upgrade to deal with CVE [flink]

2024-10-31 Thread via GitHub
tomncooper commented on PR #25573: URL: https://github.com/apache/flink/pull/25573#issuecomment-2450102032 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[jira] [Updated] (FLINK-36635) PhysicalSlotRequestBulkImpl is not used and can be removed

2024-10-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36635: --- Labels: pull-request-available (was: ) > PhysicalSlotRequestBulkImpl is not used and can be

[jira] [Updated] (FLINK-36626) Flink SQL temporal lookup JOINs behavior change from Flink 1.15 to Flink 1.20

2024-10-31 Thread Eduardo Breijo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eduardo Breijo updated FLINK-36626: --- Summary: Flink SQL temporal lookup JOINs behavior change from Flink 1.15 to Flink 1.20 (was

[jira] [Updated] (FLINK-36626) Flink SQL temporal lookup JOINs behavior change from Flink 1.15 to Flink 1.18+

2024-10-31 Thread Eduardo Breijo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eduardo Breijo updated FLINK-36626: --- Attachment: (was: Flink-SQL-query.txt) > Flink SQL temporal lookup JOINs behavior change

[jira] [Updated] (FLINK-36640) Provide an easy way to reset autoscaling

2024-10-31 Thread Matyas Orhidi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matyas Orhidi updated FLINK-36640: -- Description: FLINK-32589 introduced a feature to carry over parallelism overrides between app

[jira] [Updated] (FLINK-36640) Provide an easy way to reset autoscaling

2024-10-31 Thread Matyas Orhidi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matyas Orhidi updated FLINK-36640: -- Description: FLINK-32589 introduced a feature to carry over parallelism overrides between app

Re: [PR] [FLINK-36639] Use table aliases in Table API asSerializableString [flink]

2024-10-31 Thread via GitHub
snuyanzin commented on code in PR #25597: URL: https://github.com/apache/flink/pull/25597#discussion_r1824531739 ## flink-table/flink-table-api-java/src/main/java/org/apache/flink/table/operations/SourceQueryOperation.java: ## @@ -43,6 +41,7 @@ @Internal public class SourceQue

Re: [PR] [FLINK-36624][checkpointing] Log JobID from the SourceCoordinator [flink]

2024-10-31 Thread via GitHub
flinkbot commented on PR #25598: URL: https://github.com/apache/flink/pull/25598#issuecomment-2449903861 ## CI report: * 122ac9207e0c519886741746ad5f3a0ff561ff96 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-36624) Log JobID in SourceCoordinator

2024-10-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36624: --- Labels: pull-request-available (was: ) > Log JobID in SourceCoordinator > -

[jira] [Updated] (FLINK-36626) Flink SQL temporal lookup JOINs behavior change from Flink 1.15 to Flink 1.18+

2024-10-31 Thread Eduardo Breijo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eduardo Breijo updated FLINK-36626: --- Description: There is a behavior change I found when migrating to Flink 1.18+ from Flink 1.

[jira] [Updated] (FLINK-36626) Flink SQL temporal lookup JOINs behavior change from Flink 1.15 to Flink 1.20

2024-10-31 Thread Eduardo Breijo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eduardo Breijo updated FLINK-36626: --- Description: There is a behavior change I found when migrating to Flink 1.18 or Flink 1.20

[jira] [Updated] (FLINK-36626) Flink SQL temporal lookup JOINs behavior change from Flink 1.15 to Flink 1.20+

2024-10-31 Thread Eduardo Breijo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eduardo Breijo updated FLINK-36626: --- Summary: Flink SQL temporal lookup JOINs behavior change from Flink 1.15 to Flink 1.20+ (wa

[jira] [Updated] (FLINK-36626) Flink SQL temporal lookup JOINs behavior change from Flink 1.15 to Flink 1.18+

2024-10-31 Thread Eduardo Breijo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eduardo Breijo updated FLINK-36626: --- Attachment: Tasks Execution Plan.txt > Flink SQL temporal lookup JOINs behavior change from

[jira] [Updated] (FLINK-36626) Flink SQL temporal lookup JOINs behavior change from Flink 1.15 to Flink 1.18+

2024-10-31 Thread Eduardo Breijo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eduardo Breijo updated FLINK-36626: --- Description: There is a behavior change I found when migrating to Flink 1.18+ from Flink 1.

[jira] [Updated] (FLINK-36640) Provide an easy way to reset autoscaling

2024-10-31 Thread Matyas Orhidi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matyas Orhidi updated FLINK-36640: -- Description: FLINK-32589 introduced a feature to carry over parallelism overrides between app

Re: [PR] [FLINK-36066][runtime] Introducing the AdaptiveGraphManager component [flink]

2024-10-31 Thread via GitHub
noorall commented on code in PR #25414: URL: https://github.com/apache/flink/pull/25414#discussion_r1824264927 ## flink-runtime/src/main/java/org/apache/flink/streaming/api/graph/util/ImmutableStreamNode.java: ## @@ -0,0 +1,70 @@ +/* + * Licensed to the Apache Software Foundatio

[jira] [Updated] (FLINK-36640) Provide an easy way to reset autoscaling

2024-10-31 Thread Matyas Orhidi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matyas Orhidi updated FLINK-36640: -- Description: FLINK-32589 introduced a feature to carry over parallelism overrides between appl

[jira] [Commented] (FLINK-36640) Provide an easy way to reset autoscaling

2024-10-31 Thread Matyas Orhidi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17894574#comment-17894574 ] Matyas Orhidi commented on FLINK-36640: --- I couldn't find the {{jobvertex-paralleli

Re: [PR] [FLINK-36639] Use table aliases in Table API asSerializableString [flink]

2024-10-31 Thread via GitHub
flinkbot commented on PR #25597: URL: https://github.com/apache/flink/pull/25597#issuecomment-2449787647 ## CI report: * ab1906321e0548c6ffafb6c31d198a1a05bad0bc UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-36636) Timestamp data can not be compared in cdc pipeline transform

2024-10-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36636: --- Labels: pull-request-available (was: ) > Timestamp data can not be compared in cdc pipeline

[jira] [Commented] (FLINK-35136) Release flink-connector-hbase v4.0.0 for Flink 1.19

2024-10-31 Thread Ferenc Csaky (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17894555#comment-17894555 ] Ferenc Csaky commented on FLINK-35136: -- [{{35c5d83}}|https://github.com/apache/flin

[jira] [Updated] (FLINK-36639) Use table aliases in Table API asSerializableString

2024-10-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36639: --- Labels: pull-request-available (was: ) > Use table aliases in Table API asSerializableStrin

[PR] [FLINK-36639] Use table aliases in Table API asSerializableString [flink]

2024-10-31 Thread via GitHub
dawidwys opened a new pull request, #25597: URL: https://github.com/apache/flink/pull/25597 ## What is the purpose of the change Scope all references in Table API when converting to a SQL string. ## Verifying this change This change adapted tests in `org.apache.flink

[jira] [Commented] (FLINK-36640) Provide an easy way to reset autoscaling

2024-10-31 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17894558#comment-17894558 ] Gyula Fora commented on FLINK-36640: I don't think that we would need to introduce a

[jira] [Created] (FLINK-36641) Support and Release Connectors for Flink 1.20

2024-10-31 Thread LvYanquan (Jira)
LvYanquan created FLINK-36641: - Summary: Support and Release Connectors for Flink 1.20 Key: FLINK-36641 URL: https://issues.apache.org/jira/browse/FLINK-36641 Project: Flink Issue Type: Improveme

[jira] [Updated] (FLINK-36640) Provide an easy way to reset autoscaling

2024-10-31 Thread Matyas Orhidi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matyas Orhidi updated FLINK-36640: -- Description: FLINK-32589 introduced a feature to carry over parallelism overrides between appl

[jira] [Created] (FLINK-36640) Provide an easy way to reset autoscaling

2024-10-31 Thread Matyas Orhidi (Jira)
Matyas Orhidi created FLINK-36640: - Summary: Provide an easy way to reset autoscaling Key: FLINK-36640 URL: https://issues.apache.org/jira/browse/FLINK-36640 Project: Flink Issue Type: Improv

Re: [PR] [FLINK-35136] Bump connector version to 4.0, adapt CI workflows [flink-connector-hbase]

2024-10-31 Thread via GitHub
ferenc-csaky merged PR #46: URL: https://github.com/apache/flink-connector-hbase/pull/46 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr

[jira] [Assigned] (FLINK-36637) Fix ListShards for Kinesis streams with large number of shards

2024-10-31 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Liang Teoh reassigned FLINK-36637: --- Assignee: Elphas Toringepi > Fix ListShards for Kinesis streams with large number o

  1   2   >