Re: [PR] [FLINK-36474] Support merging timestamp columns when routing [flink-cdc]

2024-10-11 Thread via GitHub
aiwenmo commented on code in PR #3636: URL: https://github.com/apache/flink-cdc/pull/3636#discussion_r1797532737 ## flink-cdc-runtime/src/main/java/org/apache/flink/cdc/runtime/operators/schema/SchemaOperator.java: ## @@ -609,6 +643,34 @@ public Object getFieldOrNull(RecordData

Re: [PR] [FLINK-36474] Support merging timestamp columns when routing [flink-cdc]

2024-10-11 Thread via GitHub
yuxiqian commented on code in PR #3636: URL: https://github.com/apache/flink-cdc/pull/3636#discussion_r1797533354 ## flink-cdc-runtime/src/main/java/org/apache/flink/cdc/runtime/operators/schema/SchemaOperator.java: ## @@ -609,6 +643,34 @@ public Object getFieldOrNull(RecordData

[jira] [Commented] (FLINK-36167) testSinkDisorderChangeLog failed on AZP

2024-10-11 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1705#comment-1705 ] Weijie Guo commented on FLINK-36167: https://dev.azure.com/apache-flink/apache-flink

Re: [PR] Add release announcement for Flink 2.0 Preview. [flink-web]

2024-10-11 Thread via GitHub
zhuzhurk commented on code in PR #754: URL: https://github.com/apache/flink-web/pull/754#discussion_r1797534041 ## docs/content/posts/2024-10-01-release-2.0-preview.md: ## @@ -0,0 +1,1264 @@ +--- +authors: +- xtsong: + name: "Xintong Song" +date: "2024-10-01T08:00:00Z" +subtitl

[jira] [Commented] (FLINK-36446) Refactor Job Submission Process to Use ExecutionPlan Instead of JobGraph

2024-10-11 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1706#comment-1706 ] Junrui Li commented on FLINK-36446: --- [~davidradl]  ExecutionPlan is a generic interfac

Re: [PR] [FLINK-36469] Bump commons-io from 2.11.0 to 2.17.0 [flink-kubernetes-operator]

2024-10-11 Thread via GitHub
1996fanrui merged PR #894: URL: https://github.com/apache/flink-kubernetes-operator/pull/894 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsu

[jira] [Updated] (FLINK-36469) Bump commons-io from 2.11.0 to 2.17.0

2024-10-11 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan updated FLINK-36469: Affects Version/s: kubernetes-operator-1.9.0 (was: kubernetes-operator-1.10.0)

[jira] [Resolved] (FLINK-36469) Bump commons-io from 2.11.0 to 2.17.0

2024-10-11 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan resolved FLINK-36469. - Fix Version/s: kubernetes-operator-1.10.0 Assignee: Siddharth R Resolution: Fixed Merged

Re: [PR] [FLINK-36474] Support merging timestamp columns when routing [flink-cdc]

2024-10-11 Thread via GitHub
aiwenmo commented on code in PR #3636: URL: https://github.com/apache/flink-cdc/pull/3636#discussion_r1797537900 ## flink-cdc-runtime/src/main/java/org/apache/flink/cdc/runtime/operators/schema/SchemaOperator.java: ## @@ -624,4 +672,21 @@ public void snapshotState(StateSnapshotC

[jira] [Updated] (FLINK-36344) Introduce lastCheckpointCompletedTimestamp metrics

2024-10-11 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-36344: --- Fix Version/s: 2.0-preview (was: 2.0.0) > Introduce lastCheckpointCompletedTi

Re: [PR] Add release announcement for Flink 2.0 Preview. [flink-web]

2024-10-11 Thread via GitHub
xintongsong commented on code in PR #754: URL: https://github.com/apache/flink-web/pull/754#discussion_r1797532551 ## docs/content/posts/2024-10-01-release-2.0-preview.md: ## @@ -0,0 +1,1264 @@ +--- +authors: +- xtsong: + name: "Xintong Song" +date: "2024-10-01T08:00:00Z" +subt

[jira] [Updated] (FLINK-31608) Re-evaluate 'min-parallelism-increase' option

2024-10-11 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-31608: --- Fix Version/s: 2.0-preview (was: 2.0.0) > Re-evaluate 'min-parallelism-increa

[jira] [Updated] (FLINK-34085) Remove deprecated string configuration keys in Flink 2.0

2024-10-11 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-34085: --- Fix Version/s: 2.0-preview (was: 2.0.0) > Remove deprecated string configurat

[jira] [Updated] (FLINK-35580) Improvements and fix ingestDB recovery mode related bugs

2024-10-11 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-35580: --- Fix Version/s: 2.0-preview (was: 2.0.0) > Improvements and fix ingestDB recov

[jira] [Updated] (FLINK-36001) Store operator name and UID in state metadata

2024-10-11 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-36001: --- Fix Version/s: 2.0-preview (was: 2.0.0) > Store operator name and UID in stat

[jira] [Updated] (FLINK-36513) A lot of CI failures are caused by Install cert-manager

2024-10-11 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan updated FLINK-36513: Description: A lot of CI failures are caused by Install cert-manager, such as: [https://github.com/apache

[jira] [Created] (FLINK-36513) A lot of CI failures are caused by Install cert-manager

2024-10-11 Thread Rui Fan (Jira)
Rui Fan created FLINK-36513: --- Summary: A lot of CI failures are caused by Install cert-manager Key: FLINK-36513 URL: https://issues.apache.org/jira/browse/FLINK-36513 Project: Flink Issue Type: Tec

[jira] [Updated] (FLINK-36513) A lot of CI failures are caused by Install cert-manager

2024-10-11 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan updated FLINK-36513: Description: A lot of CI failures are caused by Install cert-manager, such as: [https://github.com/apache

[jira] [Updated] (FLINK-36513) A lot of CI failures are caused by Install cert-manager

2024-10-11 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan updated FLINK-36513: Description: A lot of CI failures are caused by Install cert-manager, such as: [https://github.com/apache

Re: [PR] Add release announcement for Flink 2.0 Preview. [flink-web]

2024-10-11 Thread via GitHub
xintongsong commented on code in PR #754: URL: https://github.com/apache/flink-web/pull/754#discussion_r1797532359 ## docs/content/posts/2024-10-01-release-2.0-preview.md: ## @@ -0,0 +1,1264 @@ +--- +authors: +- xtsong: + name: "Xintong Song" +date: "2024-10-01T08:00:00Z" +subt

[jira] [Updated] (FLINK-36389) Fix DelegationTokenReceiverRepository to check if Delegation Token is enabled

2024-10-11 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-36389: --- Fix Version/s: 2.0-preview (was: 2.0.0) > Fix DelegationTokenReceiverReposito

[jira] [Updated] (FLINK-36064) Refactor REST API for Client and Operator Coordinator Communication to Use operatorUid.

2024-10-11 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-36064: --- Fix Version/s: 2.0-preview (was: 2.0.0) > Refactor REST API for Client and Op

Re: [PR] [tests][ci] Refactor ci [flink-cdc]

2024-10-11 Thread via GitHub
yuxiqian commented on code in PR #3626: URL: https://github.com/apache/flink-cdc/pull/3626#discussion_r1797532444 ## .github/workflows/flink_cdc_base.yml: ## @@ -0,0 +1,235 @@ +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor license agreements

[jira] [Updated] (FLINK-35795) FLIP-466: Introduce ProcessFunction Attribute in DataStream API V2

2024-10-11 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-35795: --- Fix Version/s: 2.0-preview (was: 2.0.0) > FLIP-466: Introduce ProcessFunction

Re: [PR] Add release announcement for Flink 2.0 Preview. [flink-web]

2024-10-11 Thread via GitHub
Sxnan commented on code in PR #754: URL: https://github.com/apache/flink-web/pull/754#discussion_r1797603838 ## docs/content/posts/2024-10-01-release-2.0-preview.md: ## @@ -0,0 +1,1264 @@ +--- +authors: +- xtsong: + name: "Xintong Song" +date: "2024-10-01T08:00:00Z" +subtitle:

[jira] [Commented] (FLINK-36377) Support the use of the LAST_VALUE aggregate function on ROW type data

2024-10-11 Thread xuyang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17888569#comment-17888569 ] xuyang commented on FLINK-36377: This feature makes sense to me. BTW, do other complex t

Re: [PR] [FLINK-32176] Exclude snakeyaml from pulsar-client-all to mitigate CVE-2022-1471 [flink-connector-pulsar]

2024-10-11 Thread via GitHub
rorynickolls-skyral commented on PR #51: URL: https://github.com/apache/flink-connector-pulsar/pull/51#issuecomment-2406959137 It looks like pulsar is now on version `3.3.2` but Cassandra is still pinned to `2.11.0`. Is there anything stopping this being upgraded now? -- This is an auto

[jira] [Commented] (FLINK-36470) Bump checkstyle to 10+

2024-10-11 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17888538#comment-17888538 ] Sergey Nuyanzin commented on FLINK-36470: - [~wenjun] they are not 100% interchan

[jira] [Updated] (FLINK-35419) scan.bounded.latest-offset makes queries never finish if the latest message is a EndTxn Kafka marker

2024-10-11 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-35419: Fix Version/s: kafka-3.3.0 > scan.bounded.latest-offset makes queries never finish if the latest m

Re: [PR] Update slack invitation link [flink-web]

2024-10-11 Thread via GitHub
leonardBang merged PR #756: URL: https://github.com/apache/flink-web/pull/756 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.a

Re: [PR] [FLINK-35109] Update version to 3.4-SNAPSHOT [flink-connector-kafka]

2024-10-11 Thread via GitHub
AHeise merged PR #128: URL: https://github.com/apache/flink-connector-kafka/pull/128 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@

[jira] [Commented] (FLINK-35109) Add support for Flink 1.20-SNAPSHOT in Flink Kafka connector and drop support for 1.17 and 1.18

2024-10-11 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17888544#comment-17888544 ] Arvid Heise commented on FLINK-35109: - Also merged [c2e11a6e22f0252cecf0d3d519d9fab

[jira] [Updated] (FLINK-35109) Add support for Flink 1.20-SNAPSHOT in Flink Kafka connector and drop support for 1.17 and 1.18

2024-10-11 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-35109: Fix Version/s: kafka-3.3.0 (was: kafka-4.0.0) > Add support for Flink 1.20-

Re: [PR] [FLINK-36473] Wait for metrics before asserting on them [flink-kubernetes-operator]

2024-10-11 Thread via GitHub
mateczagany commented on code in PR #896: URL: https://github.com/apache/flink-kubernetes-operator/pull/896#discussion_r1796562362 ## flink-autoscaler/src/test/java/org/apache/flink/autoscaler/RestApiMetricsCollectorTest.java: ## @@ -44,18 +44,21 @@ import org.junit.jupiter.ap

Re: [PR] [FLINK-34467] bump flink version to 1.20.0 [flink-connector-kafka]

2024-10-11 Thread via GitHub
HuangZhenQiu commented on code in PR #111: URL: https://github.com/apache/flink-connector-kafka/pull/111#discussion_r1796561541 ## flink-connector-kafka/archunit-violations/86dfd459-67a9-4b26-9b5c-0b0bbf22681a: ## @@ -1,89 +1,5 @@ org.apache.flink.connector.kafka.sink.FlinkKaf

Re: [PR] [FLINK-36241] Table API .plus should support string concatenation [flink]

2024-10-11 Thread via GitHub
dawidwys commented on PR #25298: URL: https://github.com/apache/flink/pull/25298#issuecomment-2406728721 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [FLINK-36473] Wait for metrics before asserting on them [flink-kubernetes-operator]

2024-10-11 Thread via GitHub
SamBarker commented on code in PR #896: URL: https://github.com/apache/flink-kubernetes-operator/pull/896#discussion_r1796623475 ## flink-autoscaler/src/test/java/org/apache/flink/autoscaler/RestApiMetricsCollectorTest.java: ## @@ -44,18 +44,21 @@ import org.junit.jupiter.api.

Re: [PR] [FLINK-36470][build] Bump checkstyle to 10+ [flink]

2024-10-11 Thread via GitHub
snuyanzin commented on PR #25491: URL: https://github.com/apache/flink/pull/25491#issuecomment-2406863945 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[PR] [FLINK-36510][rpc] bump pekko to 1.1.2, remove netty 3 [flink]

2024-10-11 Thread via GitHub
gracegrimwood opened a new pull request, #25494: URL: https://github.com/apache/flink/pull/25494 ## What is the purpose of the change Updates Pekko dependency to 1.1.2 which in turn upgrades Netty 3 to 4 (addressing [FLINK-29065](https://issues.apache.org/jira/browse/FLINK-290

[jira] [Updated] (FLINK-36510) Upgrade Pekko from 1.0.1 to 1.1.2

2024-10-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36510: --- Labels: pull-request-available (was: ) > Upgrade Pekko from 1.0.1 to 1.1.2 > --

[jira] [Created] (FLINK-36510) Upgrade Pekko from 1.0.1 to 1.1.2

2024-10-11 Thread Grace Grimwood (Jira)
Grace Grimwood created FLINK-36510: -- Summary: Upgrade Pekko from 1.0.1 to 1.1.2 Key: FLINK-36510 URL: https://issues.apache.org/jira/browse/FLINK-36510 Project: Flink Issue Type: Technical D

Re: [PR] [FLINK-36510][rpc] bump pekko to 1.1.2, remove netty 3 [flink]

2024-10-11 Thread via GitHub
flinkbot commented on PR #25494: URL: https://github.com/apache/flink/pull/25494#issuecomment-2406920556 ## CI report: * d32181b715e09714a5950257121d583a5589538d UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-36473] Wait for metrics before asserting on them [flink-kubernetes-operator]

2024-10-11 Thread via GitHub
mateczagany commented on code in PR #896: URL: https://github.com/apache/flink-kubernetes-operator/pull/896#discussion_r1796629815 ## flink-autoscaler/src/test/java/org/apache/flink/autoscaler/RestApiMetricsCollectorTest.java: ## @@ -44,18 +44,21 @@ import org.junit.jupiter.ap

Re: [PR] [FLINK-36124][filesystem][s3]Make S3RecoverableFsDataOutputStream.sync not to close the stream [flink]

2024-10-11 Thread via GitHub
gaborgsomogyi commented on PR #25231: URL: https://github.com/apache/flink/pull/25231#issuecomment-2406938944 Just rebased to latest master. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

Re: [PR] [FLINK-36473] Wait for metrics before asserting on them [flink-kubernetes-operator]

2024-10-11 Thread via GitHub
SamBarker commented on code in PR #896: URL: https://github.com/apache/flink-kubernetes-operator/pull/896#discussion_r1796644375 ## flink-autoscaler/src/test/java/org/apache/flink/autoscaler/RestApiMetricsCollectorTest.java: ## @@ -44,18 +44,21 @@ import org.junit.jupiter.api.

[jira] [Commented] (FLINK-36470) Bump checkstyle to 10+

2024-10-11 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17888579#comment-17888579 ] Sergey Nuyanzin commented on FLINK-36470: - {quote} we can directly use checkstyl

Re: [PR] [FLINK-36024] Handle BinaryLogClient exceptions when searching for starting binlog offset [flink-cdc]

2024-10-11 Thread via GitHub
github-actions[bot] commented on PR #3524: URL: https://github.com/apache/flink-cdc/pull/3524#issuecomment-2408252298 This pull request has been automatically marked as stale because it has not had recent activity for 60 days. It will be closed in 30 days if no further activity occurs. --

Re: [PR] [fix][cdc-connector][mysql] Fix NoClassDefFoundError when create new table in mysql cdc source [flink-cdc]

2024-10-11 Thread via GitHub
github-actions[bot] commented on PR #3036: URL: https://github.com/apache/flink-cdc/pull/3036#issuecomment-2408252374 This pull request has been automatically marked as stale because it has not had recent activity for 60 days. It will be closed in 30 days if no further activity occurs. --

Re: [PR] [FLINK-36124][filesystem][s3]Make S3RecoverableFsDataOutputStream.sync not to close the stream [flink]

2024-10-11 Thread via GitHub
gaborgsomogyi commented on PR #25231: URL: https://github.com/apache/flink/pull/25231#issuecomment-2406787915 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

[jira] [Commented] (FLINK-36470) Bump checkstyle to 10+

2024-10-11 Thread Wenjun Ruan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17888557#comment-17888557 ] Wenjun Ruan commented on FLINK-36470: - [~Sergey Nuyanzin] OK, thanks for the patient

[jira] [Commented] (FLINK-35670) Support Postgres CDC Pipeline Source

2024-10-11 Thread ouyangwulin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17888556#comment-17888556 ] ouyangwulin commented on FLINK-35670: - https://issues.apache.org/jira/browse/FLINK-3

[jira] [Commented] (FLINK-35670) Support Postgres CDC Pipeline Source

2024-10-11 Thread ouyangwulin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1703#comment-1703 ] ouyangwulin commented on FLINK-35670: - [~m.orazow]  Have you started the work? I che

Re: [PR] Add release announcement for Flink 2.0 Preview. [flink-web]

2024-10-11 Thread via GitHub
xintongsong commented on code in PR #754: URL: https://github.com/apache/flink-web/pull/754#discussion_r1797530647 ## docs/content/posts/2024-10-01-release-2.0-preview.md: ## @@ -0,0 +1,1264 @@ +--- +authors: +- xtsong: + name: "Xintong Song" +date: "2024-10-01T08:00:00Z" +subt

[jira] [Updated] (FLINK-34255) FLIP-406: Reorganize State & Checkpointing & Recovery Configuration

2024-10-11 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-34255: --- Fix Version/s: 2.0.0 (was: 1.20.0) (was: 2.0-preview)

[jira] [Updated] (FLINK-36455) Sink should commit everything on notifyCheckpointCompleted

2024-10-11 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-36455: --- Fix Version/s: 2.0.0 (was: 2.0-preview) > Sink should commit everything on no

[jira] [Updated] (FLINK-32483) RescaleCheckpointManuallyITCase.testCheckpointRescalingOutKeyedState fails on AZP

2024-10-11 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-32483: --- Fix Version/s: 2.0.0 (was: 2.0-preview) > RescaleCheckpointManuallyITCase.tes

[jira] [Updated] (FLINK-36135) Remove the TableSource and TableSink ecosystem APIs like TableFactory, DefinedFieldMapping, FilterableTableSource, etc.

2024-10-11 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-36135: --- Fix Version/s: 2.0.0 (was: 2.0-preview) > Remove the TableSource and TableSin

[jira] [Updated] (FLINK-36136) Remove TableSource & TableSink impl and utils, docs and etc.

2024-10-11 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-36136: --- Fix Version/s: 2.0.0 (was: 2.0-preview) > Remove TableSource & TableSink impl

[jira] [Updated] (FLINK-36134) Remove the classes associated with TableSource and TableSink as part of the optimization process.

2024-10-11 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-36134: --- Fix Version/s: 2.0.0 (was: 2.0-preview) > Remove the classes associated with

[jira] [Updated] (FLINK-35573) [FLIP-447] Upgrade FRocksDB from 6.20.3 to 8.10.0

2024-10-11 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-35573: --- Fix Version/s: 2.0.0 (was: 2.0-preview) > [FLIP-447] Upgrade FRocksDB from 6.

[jira] [Updated] (FLINK-36133) Remove subclass implementations of TableSource and TableSink, along with their corresponding Factory classes.

2024-10-11 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-36133: --- Fix Version/s: 2.0.0 (was: 2.0-preview) > Remove subclass implementations of

[jira] [Resolved] (FLINK-36265) List and track the deprecated APIs for the 2.0-preview release.

2024-10-11 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo resolved FLINK-36265. Resolution: Done > List and track the deprecated APIs for the 2.0-preview release. > -

[jira] [Updated] (FLINK-36269) Remove `fromTableSource` in python module

2024-10-11 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-36269: --- Fix Version/s: 2.0.0 (was: 2.0-preview) > Remove `fromTableSource` in python

[jira] [Updated] (FLINK-36511) FlinkSecurityManager#checkExit StackOverFlow if haltOnSystemExit is enabled

2024-10-11 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-36511: --- Fix Version/s: 2.0.0 (was: 2.0-preview) > FlinkSecurityManager#checkExit Stac

[jira] [Updated] (FLINK-36378) type extraction problem between java BigDecimal and sql decimal

2024-10-11 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-36378: --- Fix Version/s: 2.0.0 (was: 2.0-preview) > type extraction problem between jav

[jira] [Updated] (FLINK-36511) FlinkSecurityManager#checkExit StackOverFlow if haltOnSystemExit is enabled

2024-10-11 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler updated FLINK-36511: - Description: The halt() call in checkExit() will again cause checkExit() to be called si

[jira] [Updated] (FLINK-35749) Kafka sink component will lose data when kafka cluster is unavailable for a while

2024-10-11 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-35749: Release Note: Fixed a race condition in the Kafka sink, which may lose data when kafka cluster is

[jira] [Updated] (FLINK-34961) GitHub Actions runner statistcs can be monitored per workflow name

2024-10-11 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-34961: Fix Version/s: kafka-3.2.0 (was: kafka-3.3.0) > GitHub Actions runner stati

Re: [PR] [FLINK-31380][table] Support enhanced show catalogs syntax [flink]

2024-10-11 Thread via GitHub
chucheng92 commented on PR #22179: URL: https://github.com/apache/flink/pull/22179#issuecomment-2407206608 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[jira] [Updated] (FLINK-34470) Transactional message + Table api kafka source with 'latest-offset' scan bound mode causes indefinitely hanging

2024-10-11 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-34470: Release Note: Fixed hanging of bounded Kafka source with 'latest-offset' when reading from transac

[jira] [Updated] (FLINK-22748) Allow dynamic target topic selection in SQL Kafka sinks

2024-10-11 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-22748: Release Note: SQL Kafka sinks can now dynamically specify the target topic using the input record

[jira] [Updated] (FLINK-35228) DynamicKafkaSource does not read re-added topic for the same cluster

2024-10-11 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-35228: Release Note: DynamicKafkaSource can now re-add a topic for the same cluster > DynamicKafkaSource

Re: [PR] [FLINK-36424][yarn] Update deprecated YARN RM/NM callback handlers in YarnResourceManagerDriver [flink]

2024-10-11 Thread via GitHub
ferenc-csaky merged PR #25453: URL: https://github.com/apache/flink/pull/25453 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.

[jira] [Updated] (FLINK-36424) Update deprecated YARN RM/NM callback handlers

2024-10-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36424: --- Labels: pull-request-available (was: ) > Update deprecated YARN RM/NM callback handlers > -

[jira] [Updated] (FLINK-36424) Update deprecated YARN RM/NM callback handlers

2024-10-11 Thread Ferenc Csaky (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferenc Csaky updated FLINK-36424: - Affects Version/s: 1.18.1 > Update deprecated YARN RM/NM callback handlers > ---

Re: [PR] [FLINK-36241] Table API .plus should support string concatenation [flink]

2024-10-11 Thread via GitHub
snuyanzin commented on code in PR #25298: URL: https://github.com/apache/flink/pull/25298#discussion_r1797059992 ## flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/functions/StringFunctionsITCase.java: ## @@ -44,10 +45,33 @@ Stream getTestSetSpecs()

[jira] [Created] (FLINK-36512) Make rescale trigger based on failed checkpoints depend on the cause

2024-10-11 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-36512: - Summary: Make rescale trigger based on failed checkpoints depend on the cause Key: FLINK-36512 URL: https://issues.apache.org/jira/browse/FLINK-36512 Project: Flink

Re: [PR] [FLINK-31380][table] Support enhanced show catalogs syntax [flink]

2024-10-11 Thread via GitHub
snuyanzin commented on code in PR #22179: URL: https://github.com/apache/flink/pull/22179#discussion_r1797339593 ## flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/operations/SqlOtherOperationConverterTest.java: ## @@ -528,8 +558,8 @@ void testClearC

Re: [PR] [FLINK-36449] Bump apache-rat-plugin [flink-kubernetes-operator]

2024-10-11 Thread via GitHub
gyfora commented on PR #890: URL: https://github.com/apache/flink-kubernetes-operator/pull/890#issuecomment-2407224414 @r-sidd you have about 5 PRs open with one-liner changes, please put them together so we don't need to run the e2es again and again. -- This is an automated message fro

Re: [PR] [FLINK-36158][runtime] Refactor Job Recovery Process to Use ExecutionPlan Instead of JobGraph. [flink]

2024-10-11 Thread via GitHub
zhuzhurk commented on code in PR #25492: URL: https://github.com/apache/flink/pull/25492#discussion_r1796834424 ## flink-runtime/src/main/java/org/apache/flink/runtime/jobmanager/DefaultExecutionPlanStore.java: ## @@ -109,153 +110,163 @@ public void stop() throws Exception {

[PR] Upgrade Kafka connector to 3.3.0 [flink-web]

2024-10-11 Thread via GitHub
AHeise opened a new pull request, #757: URL: https://github.com/apache/flink-web/pull/757 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mai

Re: [PR] [FLINK-36158][runtime] Refactor Job Recovery Process to Use ExecutionPlan Instead of JobGraph. [flink]

2024-10-11 Thread via GitHub
JunRuiLee commented on code in PR #25492: URL: https://github.com/apache/flink/pull/25492#discussion_r1796842931 ## flink-runtime/src/main/java/org/apache/flink/runtime/jobmanager/DefaultExecutionPlanStore.java: ## @@ -109,153 +110,163 @@ public void stop() throws Exception {

Re: [PR] [FLINK-31380][table] Support enhanced show catalogs syntax [flink]

2024-10-11 Thread via GitHub
snuyanzin commented on code in PR #22179: URL: https://github.com/apache/flink/pull/22179#discussion_r1796852205 ## flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/operations/SqlOtherOperationConverterTest.java: ## @@ -183,8 +184,37 @@ void testUseMu

[PR] [FLINK-36474] Support merging timestamp columns when routing [flink-cdc]

2024-10-11 Thread via GitHub
yuxiqian opened a new pull request, #3636: URL: https://github.com/apache/flink-cdc/pull/3636 This closes FLINK-36474. For now, it's not possible to merge timestamp-family data (including `Timestamp`, `ZonedTimestamp`, and `LocalZonedTimestamp`) unless some awkward transform and expl

Re: [PR] [FLINK-34853] Draft: Submit CDC Job To Flink K8S Native Application Mode [flink-cdc]

2024-10-11 Thread via GitHub
levrik commented on PR #3093: URL: https://github.com/apache/flink-cdc/pull/3093#issuecomment-2407258028 Is there any information on how to use this? It seems to be part of the 3.2.0 release but I couldn't find any documentation for it. -- This is an automated message from the Apache Git

Re: [PR] [FLINK-31380][table] Support enhanced show catalogs syntax [flink]

2024-10-11 Thread via GitHub
snuyanzin commented on code in PR #22179: URL: https://github.com/apache/flink/pull/22179#discussion_r1796852736 ## flink-table/flink-sql-parser/src/test/java/org/apache/flink/sql/parser/FlinkSqlParserImplTest.java: ## @@ -52,6 +52,24 @@ public SqlParserFixture fixture() {

Re: [PR] [FLINK-31380][table] Support enhanced show catalogs syntax [flink]

2024-10-11 Thread via GitHub
snuyanzin commented on code in PR #22179: URL: https://github.com/apache/flink/pull/22179#discussion_r1796853268 ## flink-table/flink-sql-parser/src/test/java/org/apache/flink/sql/parser/FlinkSqlParserImplTest.java: ## @@ -52,6 +52,24 @@ public SqlParserFixture fixture() {

[jira] [Updated] (FLINK-36474) YAML Table-merging route should accept more type widening cases

2024-10-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36474: --- Labels: pull-request-available (was: ) > YAML Table-merging route should accept more type w

[jira] [Updated] (FLINK-36446) Refactor Job Submission Process to Use ExecutionPlan Instead of JobGraph

2024-10-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36446: --- Labels: pull-request-available (was: ) > Refactor Job Submission Process to Use ExecutionPl

Re: [PR] [FLINK-36474] Support merging timestamp columns when routing [flink-cdc]

2024-10-11 Thread via GitHub
yuxiqian commented on PR #3636: URL: https://github.com/apache/flink-cdc/pull/3636#issuecomment-2407268860 Could @lvyanquan @aiwenmo please take a look? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[PR] [FLINK-36446][runtime] Refactor Job Submission Process to Use ExecutionPlan Instead of JobGraph. [flink]

2024-10-11 Thread via GitHub
JunRuiLee opened a new pull request, #25498: URL: https://github.com/apache/flink/pull/25498 ## What is the purpose of the change [FLINK-36446][runtime] Refactor Job Submission Process to Use ExecutionPlan Instead of JobGraph. ## Brief change log [FLINK-36446

Re: [PR] [hotfix][test] Fix TypeHintITCase if adaptive scheduler enabled [flink]

2024-10-11 Thread via GitHub
reswqa commented on PR #25493: URL: https://github.com/apache/flink/pull/25493#issuecomment-2407275835 Thanks for the review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [hotfix][test] Fix TypeHintITCase if adaptive scheduler enabled [flink]

2024-10-11 Thread via GitHub
reswqa merged PR #25493: URL: https://github.com/apache/flink/pull/25493 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache

Re: [PR] [FLINK-36510][rpc] bump pekko to 1.1.2, remove netty 3 [flink]

2024-10-11 Thread via GitHub
gracegrimwood commented on PR #25494: URL: https://github.com/apache/flink/pull/25494#issuecomment-2407473348 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

[jira] [Updated] (FLINK-36511) FlinkSecurityManager#checkExit StackOverFlow if haltOnSystemExit is enabled

2024-10-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36511: --- Labels: pull-request-available (was: ) > FlinkSecurityManager#checkExit StackOverFlow if ha

Re: [PR] [FLINK-33977][runtime] Adaptive scheduler may not minimize the number of TMs during downscaling [flink]

2024-10-11 Thread via GitHub
1996fanrui commented on PR #25218: URL: https://github.com/apache/flink/pull/25218#issuecomment-2407068060 Thanks @ztison for the good point, and @XComp for the feedback! Overall sounds make sense. > which spreads the workload across as many workers as possible? May I know that

Re: [PR] [FLINK-36158][runtime] Refactor Job Recovery Process to Use ExecutionPlan Instead of JobGraph. [flink]

2024-10-11 Thread via GitHub
JunRuiLee commented on PR #25492: URL: https://github.com/apache/flink/pull/25492#issuecomment-2407249422 Thanks @zhuzhurk, I've updated this pr accordingly, PTAL. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

Re: [PR] [FLINK-36266][table] Insert into as select * behaves incorrect [flink]

2024-10-11 Thread via GitHub
snuyanzin commented on PR #25316: URL: https://github.com/apache/flink/pull/25316#issuecomment-2407516038 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [FLINK-34467] bump flink version to 1.20.0 [flink-connector-kafka]

2024-10-11 Thread via GitHub
HuangZhenQiu commented on code in PR #111: URL: https://github.com/apache/flink-connector-kafka/pull/111#discussion_r1797032115 ## flink-connector-kafka/archunit-violations/86dfd459-67a9-4b26-9b5c-0b0bbf22681a: ## @@ -1,89 +1,5 @@ org.apache.flink.connector.kafka.sink.FlinkKaf

Re: [PR] [1.20][FLINK-36511] Prevent StackOverflow in FlinkSecurityManager [flink]

2024-10-11 Thread via GitHub
flinkbot commented on PR #25497: URL: https://github.com/apache/flink/pull/25497#issuecomment-2407054866 ## CI report: * 98c0c90195d10904fb7add25749c30b0b95c6425 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

  1   2   >