Re: [PR] [FLINK-35808] Let `ConsumerConfig.(KEY|VALUE)_DESERIALIZER_CLASS_CONFIG` be overridable by user in `KafkaSourceBuilder` [flink-connector-kafka]

2024-07-15 Thread via GitHub
fapaul commented on code in PR #108: URL: https://github.com/apache/flink-connector-kafka/pull/108#discussion_r1678856214 ## flink-connector-kafka/src/test/java/org/apache/flink/connector/kafka/source/KafkaSourceBuilderTest.java: ## @@ -191,6 +196,53 @@ public void testSettingC

[jira] [Commented] (FLINK-35576) FRocksDB cherry pick IngestDB related commits

2024-07-15 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17866259#comment-17866259 ] Yue Ma commented on FLINK-35576: [~roman] I've finished the cherry-pick and fixed all th

[jira] [Updated] (FLINK-35852) When used through the transform function, the decimal(10,2) type field value in the MySQL source table becomes 100 times the original value after being transferred to th

2024-07-15 Thread zheng_shengsheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zheng_shengsheng updated FLINK-35852: - Attachment: (was: sp20240716_144344_710.png) > When used through the transform funct

[jira] [Updated] (FLINK-35852) When used through the transform function, the decimal(10,2) type field value in the MySQL source table becomes 100 times the original value after being transferred to th

2024-07-15 Thread zheng_shengsheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zheng_shengsheng updated FLINK-35852: - Attachment: (was: sp20240716_144157_519.png) > When used through the transform funct

[jira] [Updated] (FLINK-35852) When used through the transform function, the decimal(10,2) type field value in the MySQL source table becomes 100 times the original value after being transferred to th

2024-07-15 Thread zheng_shengsheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zheng_shengsheng updated FLINK-35852: - Description: When I use CDC's yaml mode to collect MySQL data to Doris, I use the latest

[jira] [Updated] (FLINK-35852) When used through the transform function, the decimal(10,2) type field value in the MySQL source table becomes 100 times the original value after being transferred to th

2024-07-15 Thread zheng_shengsheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zheng_shengsheng updated FLINK-35852: - Attachment: image-2024-07-16-14-48-07-981.png > When used through the transform function

[jira] [Updated] (FLINK-35852) When used through the transform function, the decimal(10,2) type field value in the MySQL source table becomes 100 times the original value after being transferred to th

2024-07-15 Thread zheng_shengsheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zheng_shengsheng updated FLINK-35852: - Attachment: image-2024-07-16-14-46-53-982.png > When used through the transform function

[jira] [Commented] (FLINK-35852) When used through the transform function, the decimal(10,2) type field value in the MySQL source table becomes 100 times the original value after being transferred to

2024-07-15 Thread yux (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17866255#comment-17866255 ] yux commented on FLINK-35852: - Thanks for [~zheng_shengsheng]'s detailed report, I will nves

[jira] [Created] (FLINK-35852) When used through the transform function, the decimal(10,2) type field value in the MySQL source table becomes 100 times the original value after being transferred to th

2024-07-15 Thread zheng_shengsheng (Jira)
zheng_shengsheng created FLINK-35852: Summary: When used through the transform function, the decimal(10,2) type field value in the MySQL source table becomes 100 times the original value after being transferred to the target table.

[jira] [Comment Edited] (FLINK-33186) CheckpointAfterAllTasksFinishedITCase.testRestoreAfterSomeTasksFinished fails on AZP

2024-07-15 Thread Samrat Deb (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17866247#comment-17866247 ] Samrat Deb edited comment on FLINK-33186 at 7/16/24 6:35 AM: -

[jira] [Updated] (FLINK-35851) autoscaler standlone mode use `GlobalConfiguration.loadConfiguration` load config

2024-07-15 Thread yuanfenghu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuanfenghu updated FLINK-35851: --- Description: We should use GlobalConfiguration.loadConfiguration to load the autocaler configuratio

[jira] [Commented] (FLINK-33186) CheckpointAfterAllTasksFinishedITCase.testRestoreAfterSomeTasksFinished fails on AZP

2024-07-15 Thread Samrat Deb (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17866247#comment-17866247 ] Samrat Deb commented on FLINK-33186: 1.20 build fail :  [https://github.com/apache/f

[jira] [Created] (FLINK-35851) autoscaler standlone mode use `GlobalConfiguration.loadConfiguration` load config

2024-07-15 Thread yuanfenghu (Jira)
yuanfenghu created FLINK-35851: -- Summary: autoscaler standlone mode use `GlobalConfiguration.loadConfiguration` load config Key: FLINK-35851 URL: https://issues.apache.org/jira/browse/FLINK-35851 Project

[jira] [Updated] (FLINK-35851) autoscaler standlone mode use `GlobalConfiguration.loadConfiguration` load config

2024-07-15 Thread yuanfenghu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuanfenghu updated FLINK-35851: --- Description: 我们应该使用 > autoscaler standlone mode use `GlobalConfiguration.loadConfiguration` load >

Re: [PR] [docs] Add schema evolution type supporting status for pipeline sink connectors [flink-cdc]

2024-07-15 Thread via GitHub
yuxiqian commented on PR #3475: URL: https://github.com/apache/flink-cdc/pull/3475#issuecomment-2230113889 I'll leave it as draft since FLINK-35243 is expected to add more schema change events. More revision is needed on this. -- This is an automated message from the Apache Git Service. T

[PR] [docs] Add schema evolution type supporting status for pipeline sink connectors [flink-cdc]

2024-07-15 Thread via GitHub
yuxiqian opened a new pull request, #3475: URL: https://github.com/apache/flink-cdc/pull/3475 Currently, not all pipeline sink connectors support every schema change events, and some have extra limitations when applying schema evolution events. Explicitly stating them in documentations shou

[jira] [Resolved] (FLINK-35847) [Release-1.20] Propose a pull request for website updates

2024-07-15 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo resolved FLINK-35847. Fix Version/s: 1.20.0 (was: 1.17.0) Resolution: Done > [Release-1.20

[jira] [Commented] (FLINK-35848) [Release-1.20] Vote on the release candidate

2024-07-15 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17866238#comment-17866238 ] Weijie Guo commented on FLINK-35848: The voting mail has been sent. > [Release-1.20

Re: [PR] [FLINK-34545][cdc-pipeline-connector]Add OceanBase pipeline connector to Flink CDC [flink-cdc]

2024-07-15 Thread via GitHub
yuanoOo commented on PR #3360: URL: https://github.com/apache/flink-cdc/pull/3360#issuecomment-2230080527 @GOODBOY008 After version 3.2 is released, flink-cdc-pipeline-connector-oceanbase-3.2.0.jar will be distributed and the dead link will be activated. I think this issue can be ignored fo

Re: [PR] [FLINK-35072][doris] Support applying AlterColumnTypeEvent to Doris sink [flink-cdc]

2024-07-15 Thread via GitHub
yuxiqian commented on PR #3473: URL: https://github.com/apache/flink-cdc/pull/3473#issuecomment-2230073960 > LGTM. But we seem to lack documentation describing what table schema changes we supported in https://nightlies.apache.org/flink/flink-cdc-docs-release-3.1/docs/connectors/pipeline-co

Re: [PR] [FLINK-35072][doris] Support applying AlterColumnTypeEvent to Doris sink [flink-cdc]

2024-07-15 Thread via GitHub
lvyanquan commented on PR #3473: URL: https://github.com/apache/flink-cdc/pull/3473#issuecomment-2230069988 LGTM. But we seem to lack documentation describing what table schema changes we support, which could be added later. -- This is an automated message from the Apache Git Service.

Re: [PR] [FLINK-34545][cdc-pipeline-connector]Add OceanBase pipeline connector to Flink CDC [flink-cdc]

2024-07-15 Thread via GitHub
GOODBOY008 commented on PR #3360: URL: https://github.com/apache/flink-cdc/pull/3360#issuecomment-2230043015 @yuanoOo Please fix dead link in doc , refer : https://github.com/apache/flink-cdc/actions/runs/9869322624/job/27277822806?pr=3360#step:4:721 -- This is an automated message from t

Re: [PR] [FLINK-35072][doris] Support applying AlterColumnTypeEvent to Doris sink [flink-cdc]

2024-07-15 Thread via GitHub
yuxiqian commented on code in PR #3473: URL: https://github.com/apache/flink-cdc/pull/3473#discussion_r1678766110 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-doris/pom.xml: ## @@ -44,7 +44,7 @@ limitations under the License.

Re: [PR] [FLINK-35847] Add 1.20 release announcement [flink-web]

2024-07-15 Thread via GitHub
Zakelly commented on code in PR #751: URL: https://github.com/apache/flink-web/pull/751#discussion_r1678740196 ## docs/content/posts/2024-07-15-release-1.20.0.md: ## @@ -0,0 +1,510 @@ +--- +authors: +- reswqa: + name: "Weijie Guo" + twitter: "WeijieGuo12" +- 1996fanrui: + nam

Re: [PR] [FLINK-35072][doris] Support applying AlterColumnTypeEvent to Doris sink [flink-cdc]

2024-07-15 Thread via GitHub
qg-lin commented on code in PR #3473: URL: https://github.com/apache/flink-cdc/pull/3473#discussion_r1678727491 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-doris/pom.xml: ## @@ -44,7 +44,7 @@ limitations under the License.

Re: [PR] [hotfix][docs] Remove unsupported erroneous example code from documentation [flink-cdc]

2024-07-15 Thread via GitHub
gtk96 commented on PR #3464: URL: https://github.com/apache/flink-cdc/pull/3464#issuecomment-2229964652 @leonardBang @ruanhang1993 PTAL -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[jira] [Assigned] (FLINK-35837) InitOutputPathTest.testErrorOccursUnSynchronized failed in JDK21

2024-07-15 Thread Zhongqiang Gong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongqiang Gong reassigned FLINK-35837: --- Assignee: Zhongqiang Gong > InitOutputPathTest.testErrorOccursUnSynchronized failed

Re: [PR] [FLINK-25537] [JUnit5 Migration] Module: flink-core [flink]

2024-07-15 Thread via GitHub
GOODBOY008 commented on PR #24939: URL: https://github.com/apache/flink/pull/24939#issuecomment-2229916272 > @GOODBOY008 This change makes JDK21 unhappy. see [FLINK-35837](https://issues.apache.org/jira/browse/FLINK-35837). Would you mind taking a look? > > cc @1996fanrui @Jiabao-Sun

Re: [PR] [FLINK-25537] [JUnit5 Migration] Module: flink-core [flink]

2024-07-15 Thread via GitHub
reswqa commented on PR #24939: URL: https://github.com/apache/flink/pull/24939#issuecomment-2229911712 @GOODBOY008 This change makes JDK21 unhappy. see [FLINK-35837](https://issues.apache.org/jira/browse/FLINK-35837). Would you mind taking a look? -- This is an automated message from the

Re: [PR] [FLINK-35072][doris] Support applying AlterColumnTypeEvent to Doris sink [flink-cdc]

2024-07-15 Thread via GitHub
yuxiqian commented on PR #3473: URL: https://github.com/apache/flink-cdc/pull/3473#issuecomment-2229899392 Flink doris connector 1.6.2 has been released, mark this ready for review. Could @qg-lin @lvyanquan please take a look? -- This is an automated message from the Apache Git Service. T

[jira] [Assigned] (FLINK-35843) Check cp directory empty may fail in file-merging testing

2024-07-15 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan reassigned FLINK-35843: --- Assignee: Zakelly Lan > Check cp directory empty may fail in file-merging testing > ---

[jira] [Assigned] (FLINK-35835) SnapshotFileMergingCompatibilityITCase.testSwitchFromDisablingToEnablingFileMerging failed on AZP

2024-07-15 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan reassigned FLINK-35835: --- Assignee: Zakelly Lan > SnapshotFileMergingCompatibilityITCase.testSwitchFromDisablingToEna

[jira] [Commented] (FLINK-35826) [SQL] Sliding window may produce unstable calculations when processing changelog data.

2024-07-15 Thread xuyang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17866220#comment-17866220 ] xuyang commented on FLINK-35826: I believe this is a more general problem, that is "how

Re: [PR] [FLINK-35847][release] Add release note for version 1.20 [flink]

2024-07-15 Thread via GitHub
1996fanrui commented on code in PR #25091: URL: https://github.com/apache/flink/pull/25091#discussion_r1678676384 ## docs/content.zh/release-notes/flink-1.20.md: ## @@ -0,0 +1,434 @@ +--- +title: "Release Notes - Flink 1.20" +--- + + +# Release notes - Flink 1.20 + +These releas

[jira] [Commented] (FLINK-35826) [SQL] Sliding window may produce unstable calculations when processing changelog data.

2024-07-15 Thread xuyang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17866217#comment-17866217 ] xuyang commented on FLINK-35826: cc [~catyee] [~yunta] 👆 > [SQL] Sliding window may pro

[jira] [Commented] (FLINK-35826) [SQL] Sliding window may produce unstable calculations when processing changelog data.

2024-07-15 Thread xuyang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17866216#comment-17866216 ] xuyang commented on FLINK-35826: Hi, let me try to explain the cause for this problem.

[jira] [Commented] (FLINK-35491) [JUnit5 Migration] Module: Flink CDC modules

2024-07-15 Thread yux (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17866214#comment-17866214 ] yux commented on FLINK-35491: - I'd like to take this ticket if needed. > [JUnit5 Migration]

Re: [PR] [FLINK-35843][test] Check only JM acknowledged files in file-merging IT cases [flink]

2024-07-15 Thread via GitHub
Zakelly commented on code in PR #25090: URL: https://github.com/apache/flink/pull/25090#discussion_r1678670379 ## flink-tests/src/test/java/org/apache/flink/test/checkpointing/SnapshotFileMergingCompatibilityITCase.java: ## @@ -319,9 +333,106 @@ private static void verifyCheckpo

[jira] [Resolved] (FLINK-35845) [Release-1.20] Build and stage Java and Python artifacts

2024-07-15 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo resolved FLINK-35845. Fix Version/s: 1.20.0 Resolution: Done > [Release-1.20] Build and stage Java and Python art

[jira] [Resolved] (FLINK-35846) [Release-1.20] Stage source and binary releases on dist.apache.org

2024-07-15 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo resolved FLINK-35846. Fix Version/s: 1.20.0 Resolution: Done > [Release-1.20] Stage source and binary releases on

[jira] [Updated] (FLINK-35846) [Release-1.20] Stage source and binary releases on dist.apache.org

2024-07-15 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-35846: --- Affects Version/s: 1.20.0 > [Release-1.20] Stage source and binary releases on dist.apache.org > ---

[jira] [Updated] (FLINK-35845) [Release-1.20] Build and stage Java and Python artifacts

2024-07-15 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-35845: --- Affects Version/s: 1.20.0 > [Release-1.20] Build and stage Java and Python artifacts > -

[jira] [Commented] (FLINK-34447) ActiveResourceManagerTest#testWorkerRegistrationTimeoutNotCountingAllocationTime still fails on slow machines

2024-07-15 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17866211#comment-17866211 ] Weijie Guo commented on FLINK-34447: https://dev.azure.com/apache-flink/apache-flink

Re: [PR] [cdc-connector][mysql]Mysql add numRecordsOutBySnapshot and numRecordsOutByIncremental metrics [flink-cdc]

2024-07-15 Thread via GitHub
ChengJie1053 commented on code in PR #3456: URL: https://github.com/apache/flink-cdc/pull/3456#discussion_r1678660615 ## flink-cdc-connect/flink-cdc-source-connectors/flink-connector-mysql-cdc/src/main/java/org/apache/flink/cdc/connectors/mysql/source/metrics/MySqlSourceReaderMetrics.ja

Re: [PR] [cdc-connector][mysql]Mysql add numRecordsOutBySnapshot and numRecordsOutByIncremental metrics [flink-cdc]

2024-07-15 Thread via GitHub
ChengJie1053 commented on code in PR #3456: URL: https://github.com/apache/flink-cdc/pull/3456#discussion_r1678659166 ## flink-cdc-connect/flink-cdc-source-connectors/flink-connector-mysql-cdc/src/main/java/org/apache/flink/cdc/connectors/mysql/source/metrics/MySqlSourceReaderMetrics.ja

[jira] [Resolved] (FLINK-35616) Support upsert into sharded collections for MongoRowDataSerializationSchema

2024-07-15 Thread Jiabao Sun (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiabao Sun resolved FLINK-35616. Fix Version/s: mongodb-1.3.0 Resolution: Implemented mongodb-connector main: a2f1083c2b0020

[jira] [Commented] (FLINK-35849) [flink-cdc] Use expose_snapshot to read snapshot splits of postgres cdc connector.

2024-07-15 Thread Jiabao Sun (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17866208#comment-17866208 ] Jiabao Sun commented on FLINK-35849: Thanks [~loserwang1024], assigned to you. > [f

Re: [PR] [FLINK-35616][Connectors/MongoDB] Support upsert into sharded collections [flink-connector-mongodb]

2024-07-15 Thread via GitHub
Jiabao-Sun merged PR #37: URL: https://github.com/apache/flink-connector-mongodb/pull/37 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr

[jira] [Resolved] (FLINK-34990) [feature][cdc-connector][oracle] Oracle cdc support newly add table

2024-07-15 Thread Zhongqiang Gong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongqiang Gong resolved FLINK-34990. - Resolution: Fixed Resolved via master: 2d1eb0aff1b5eba5e68d311e9ea45295fcb3bd64 > [feat

[jira] [Assigned] (FLINK-35849) [flink-cdc] Use expose_snapshot to read snapshot splits of postgres cdc connector.

2024-07-15 Thread Jiabao Sun (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiabao Sun reassigned FLINK-35849: -- Assignee: Hongshun Wang > [flink-cdc] Use expose_snapshot to read snapshot splits of postgres

Re: [PR] [FLINK-35391][cdc-connector][paimon] Bump dependency of Paimon Pipeline connector to 0.8.0 [flink-cdc]

2024-07-15 Thread via GitHub
beryllw commented on PR #3335: URL: https://github.com/apache/flink-cdc/pull/3335#issuecomment-222983 > @beryllw Would you like to bump paimon version to 8.0.2? done(paimon 0.8.2) -- This is an automated message from the Apache Git Service. To respond to the message, please log

Re: [PR] [FLINK-34990][cdc-connector][oracle] Oracle cdc support newly add table [flink-cdc]

2024-07-15 Thread via GitHub
GOODBOY008 merged PR #3203: URL: https://github.com/apache/flink-cdc/pull/3203 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.

Re: [PR] [cdc][mysql]Code optimization extracts constants [flink-cdc]

2024-07-15 Thread via GitHub
ChengJie1053 commented on code in PR #3385: URL: https://github.com/apache/flink-cdc/pull/3385#discussion_r1678647030 ## flink-cdc-connect/flink-cdc-source-connectors/flink-connector-mysql-cdc/src/main/java/io/debezium/connector/mysql/converters/MysqlDebeziumTimeConverter.java:

[jira] [Assigned] (FLINK-35850) Add DATEDIFF function

2024-07-15 Thread dalongliu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dalongliu reassigned FLINK-35850: - Assignee: Dylan He (was: dalongliu) > Add DATEDIFF function > - > >

[jira] [Assigned] (FLINK-35850) Add DATEDIFF function

2024-07-15 Thread dalongliu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dalongliu reassigned FLINK-35850: - Assignee: dalongliu > Add DATEDIFF function > - > > Key: FL

[jira] [Updated] (FLINK-35633) Early verification and clearer error message of pipeline YAML definition

2024-07-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35633: --- Labels: pull-request-available (was: ) > Early verification and clearer error message of pi

Re: [PR] [FLINK-35633][cli] Verify YAML pipeline definitions early [flink-cdc]

2024-07-15 Thread via GitHub
yuxiqian closed pull request #3429: [FLINK-35633][cli] Verify YAML pipeline definitions early URL: https://github.com/apache/flink-cdc/pull/3429 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

Re: [PR] [FLINK-35566] Promote TypeSerializer from PublicEvolving to Public [flink]

2024-07-15 Thread via GitHub
superdiaodiao commented on code in PR #25081: URL: https://github.com/apache/flink/pull/25081#discussion_r1678628800 ## pom.xml: ## @@ -2389,10 +2389,16 @@ under the License. org.apache.flink.configuration.Configur

Re: [PR] [FLINK-35566] Promote TypeSerializer from PublicEvolving to Public [flink]

2024-07-15 Thread via GitHub
superdiaodiao commented on code in PR #25081: URL: https://github.com/apache/flink/pull/25081#discussion_r1678629127 ## pom.xml: ## @@ -2389,10 +2389,16 @@ under the License. org.apache.flink.configuration.Configur

Re: [PR] [FLINK-35566] Promote TypeSerializer from PublicEvolving to Public [flink]

2024-07-15 Thread via GitHub
superdiaodiao commented on code in PR #25081: URL: https://github.com/apache/flink/pull/25081#discussion_r1678628800 ## pom.xml: ## @@ -2389,10 +2389,16 @@ under the License. org.apache.flink.configuration.Configur

Re: [PR] [FLINK-35566] Promote TypeSerializer from PublicEvolving to Public [flink]

2024-07-15 Thread via GitHub
superdiaodiao commented on code in PR #25081: URL: https://github.com/apache/flink/pull/25081#discussion_r1678628800 ## pom.xml: ## @@ -2389,10 +2389,16 @@ under the License. org.apache.flink.configuration.Configur

Re: [PR] [FLINK-35566] Promote TypeSerializer from PublicEvolving to Public [flink]

2024-07-15 Thread via GitHub
JingGe commented on code in PR #25081: URL: https://github.com/apache/flink/pull/25081#discussion_r1678345319 ## pom.xml: ## @@ -2389,10 +2389,16 @@ under the License. org.apache.flink.configuration.Configuration#g

Re: [PR] [FLINK-35808] Let `ConsumerConfig.(KEY|VALUE)_DESERIALIZER_CLASS_CONFIG` be overridable by user in `KafkaSourceBuilder` [flink-connector-kafka]

2024-07-15 Thread via GitHub
klam-shop commented on PR #108: URL: https://github.com/apache/flink-connector-kafka/pull/108#issuecomment-2229110447 Thanks for the review. Parameterized the tests and ready for another look 🙏 -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [PR] [FLINK-35808] Let `ConsumerConfig.(KEY|VALUE)_DESERIALIZER_CLASS_CONFIG` be overridable by user in `KafkaSourceBuilder` [flink-connector-kafka]

2024-07-15 Thread via GitHub
klam-shop commented on code in PR #108: URL: https://github.com/apache/flink-connector-kafka/pull/108#discussion_r1678222384 ## flink-connector-kafka/src/test/java/org/apache/flink/connector/kafka/source/KafkaSourceBuilderTest.java: ## @@ -191,6 +193,72 @@ public void testSetti

Re: [PR] [DRAFT][FLINK-34440][formats][protobuf-confluent] add support for protobuf-confluent [flink]

2024-07-15 Thread via GitHub
anupamaggarwal commented on PR #24482: URL: https://github.com/apache/flink/pull/24482#issuecomment-2229106430 > Thanks @anupamaggarwal, if we have capacity, would you also be open to others picking up this PR? Not sure if we can commit time to the work yet.. but wanted to check with you be

[jira] [Closed] (FLINK-35799) Add CompiledPlan annotations to BatchExecCalc

2024-07-15 Thread Timo Walther (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timo Walther closed FLINK-35799. Fix Version/s: 2.0.0 Resolution: Fixed Fixed in master: 0050e426bc0640858c539d43032a4226eea

Re: [PR] [FLINK-35799] Add CompiledPlan annotations to BatchExecCalc [flink]

2024-07-15 Thread via GitHub
twalthr merged PR #25064: URL: https://github.com/apache/flink/pull/25064 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apach

[jira] [Updated] (FLINK-35267) Documentation and examples for FlinkStateSnapshot CR

2024-07-15 Thread Mate Czagany (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mate Czagany updated FLINK-35267: - Summary: Documentation and examples for FlinkStateSnapshot CR (was: Create documentation for Fl

[jira] [Updated] (FLINK-35560) Support custom query operation validator for sql gateway

2024-07-15 Thread dongwoo.kim (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dongwoo.kim updated FLINK-35560: Description: h3. Summary Hello I'd like to suggest custom pluggable query operation validator sup

[jira] [Updated] (FLINK-35560) Support custom query operation validator for sql gateway

2024-07-15 Thread dongwoo.kim (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dongwoo.kim updated FLINK-35560: Description: h3. Summary Hello I'd like to suggest custom pluggable query operation validator sup

[jira] [Updated] (FLINK-35560) Support custom query operation validator for sql gateway

2024-07-15 Thread dongwoo.kim (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dongwoo.kim updated FLINK-35560: Description: h3. Summary Hello I'd like to suggest custom pluggable query operation validator sup

Re: [PR] [FLINK-35560][Table SQL/Gateway] Support custom query operation validator for sql gateway [flink]

2024-07-15 Thread via GitHub
flinkbot commented on PR #25092: URL: https://github.com/apache/flink/pull/25092#issuecomment-2228582168 ## CI report: * f1abe6c765c4d688519289decf34f650cb195864 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-35560) Support custom query operation validator for sql gateway

2024-07-15 Thread dongwoo.kim (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dongwoo.kim updated FLINK-35560: Summary: Support custom query operation validator for sql gateway (was: Add query validator suppo

[jira] [Updated] (FLINK-35560) Add query validator support to flink sql gateway via spi pattern

2024-07-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35560: --- Labels: pull-request-available (was: ) > Add query validator support to flink sql gateway v

[PR] [FLINK-35560][Table SQL/Gateway] Support custom query operation validator for sql gateway [flink]

2024-07-15 Thread via GitHub
dongwoo6kim opened a new pull request, #25092: URL: https://github.com/apache/flink/pull/25092 ## What is the purpose of the change This pull request introduces the `OperationValidator` interface for Flink SQL Gateway. This pluggable component leverages the [Plugins](http

[jira] [Commented] (FLINK-35836) Some S5 related ITCases failed in JDK17 due to reflection issue

2024-07-15 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17866068#comment-17866068 ] Weijie Guo commented on FLINK-35836: master(2.0) via 91a11acc2a80860c2f6aa7bd54980ff

[jira] [Closed] (FLINK-35836) Some S5 related ITCases failed in JDK17 due to reflection issue

2024-07-15 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo closed FLINK-35836. -- Fix Version/s: 2.0.0 Resolution: Fixed > Some S5 related ITCases failed in JDK17 due to reflect

Re: [PR] [FLINK-35836][fs] Fix reflection issue for s5 ITCase in JDK17 [flink]

2024-07-15 Thread via GitHub
reswqa merged PR #25086: URL: https://github.com/apache/flink/pull/25086 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache

[jira] [Created] (FLINK-35850) Add DATEDIFF function

2024-07-15 Thread Dylan He (Jira)
Dylan He created FLINK-35850: Summary: Add DATEDIFF function Key: FLINK-35850 URL: https://issues.apache.org/jira/browse/FLINK-35850 Project: Flink Issue Type: Sub-task Components: Tabl

[jira] [Commented] (FLINK-35154) Javadoc aggregate fails

2024-07-15 Thread Robert Metzger (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17866065#comment-17866065 ] Robert Metzger commented on FLINK-35154: Thanks a lot for the detailed analysis.

Re: [PR] [FLINK-34572] Support OceanBase Jdbc Catalog [flink-connector-jdbc]

2024-07-15 Thread via GitHub
whhe commented on PR #109: URL: https://github.com/apache/flink-connector-jdbc/pull/109#issuecomment-2228454081 @leonardBang @MartijnVisser @GOODBOY008 Can someone help with the review? -- This is an automated message from the Apache Git Service. To respond to the message, please log on t

Re: [PR] [FLINK-35776] Simplify job status handling [flink-kubernetes-operator]

2024-07-15 Thread via GitHub
gyfora commented on PR #851: URL: https://github.com/apache/flink-kubernetes-operator/pull/851#issuecomment-2228450216 > @gyfora > > > as we have a stable logic to always record the jobID in the status before submission. > > could you point to the related changes (ticket/PR/co

Re: [PR] [FLINK-35847] Add 1.20 release announcement [flink-web]

2024-07-15 Thread via GitHub
reswqa commented on code in PR #751: URL: https://github.com/apache/flink-web/pull/751#discussion_r1677780888 ## docs/data/flink.yml: ## @@ -15,6 +15,16 @@ # specific language governing permissions and limitations # under the License +1.20: Review Comment: Should we remo

[PR] [FLINK-35847] Add 1.20 release announcement [flink-web]

2024-07-15 Thread via GitHub
reswqa opened a new pull request, #751: URL: https://github.com/apache/flink-web/pull/751 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mai

Re: [PR] [FLINK-35847][release] Add release note for version 1.20 [flink]

2024-07-15 Thread via GitHub
flinkbot commented on PR #25091: URL: https://github.com/apache/flink/pull/25091#issuecomment-2228419516 ## CI report: * 81af7bd228d8a196a6da7e64d9699135c65577a7 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-35849) [flink-cdc] Use expose_snapshot to read snapshot splits of postgres cdc connector.

2024-07-15 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-35849: -- Description: In current postgres cdc connector, we use incremental framework to read data[1],

Re: [PR] [FLINK-35843][test] Check only JM acknowledged files in file-merging IT cases [flink]

2024-07-15 Thread via GitHub
flinkbot commented on PR #25090: URL: https://github.com/apache/flink/pull/25090#issuecomment-2228410197 ## CI report: * f5d321133143c77446144b457f89124c8d7a98d2 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-35849) [flink-cdc] Use expose_snapshot to read snapshot splits of postgres cdc connector.

2024-07-15 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-35849: -- Summary: [flink-cdc] Use expose_snapshot to read snapshot splits of postgres cdc connector. (

[jira] [Commented] (FLINK-35849) [flink-cdc] Use expose_snapshot to read snapshot of postgres cdc connector.

2024-07-15 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17866050#comment-17866050 ] Hongshun Wang commented on FLINK-35849: --- I'd like to do it. Please assign this for

Re: [PR] [FLINK-35095][test] Fix unstable tests in `ExecutionEnvironmentImplTest` [flink]

2024-07-15 Thread via GitHub
reswqa merged PR #25085: URL: https://github.com/apache/flink/pull/25085 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache

[PR] [FLINK-35847][release] Add release note for version 1.20 [flink]

2024-07-15 Thread via GitHub
reswqa opened a new pull request, #25091: URL: https://github.com/apache/flink/pull/25091 ## What is the purpose of the change *This pull request adds release note for version 1.20.* ## Brief change log *Add release note for 1.19.* ## Verifying this change

[jira] [Created] (FLINK-35849) [flink-cdc] Use expose_snapshot to read snapshot of postgres cdc connector.

2024-07-15 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35849: - Summary: [flink-cdc] Use expose_snapshot to read snapshot of postgres cdc connector. Key: FLINK-35849 URL: https://issues.apache.org/jira/browse/FLINK-35849 Project

Re: [PR] [FLINK-35843][test] Check only JM acknowledged files in file-merging IT cases [flink]

2024-07-15 Thread via GitHub
fredia commented on code in PR #25090: URL: https://github.com/apache/flink/pull/25090#discussion_r1677754547 ## flink-tests/src/test/java/org/apache/flink/test/checkpointing/SnapshotFileMergingCompatibilityITCase.java: ## @@ -319,9 +333,106 @@ private static void verifyCheckpoi

[PR] [FLINK-35843][test] Check only JM acknowledged files in file-merging IT cases [flink]

2024-07-15 Thread via GitHub
Zakelly opened a new pull request, #25090: URL: https://github.com/apache/flink/pull/25090 ## What is the purpose of the change Currently, the IT cases of file-merging check the existence of files under the checkpoint directory to make sure all the previous files are cleaned as expec

[jira] [Updated] (FLINK-35843) Check cp directory empty may fail in file-merging testing

2024-07-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35843: --- Labels: pull-request-available (was: ) > Check cp directory empty may fail in file-merging

[jira] [Assigned] (FLINK-35844) Build Release Candidate: 1.20.0-rc1

2024-07-15 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo reassigned FLINK-35844: -- Assignee: Weijie Guo (was: Jing Ge) > Build Release Candidate: 1.20.0-rc1 > ---

Re: [PR] [FLINK-34853] Draft: Submit CDC Job To Flink K8S Native Application Mode [flink-cdc]

2024-07-15 Thread via GitHub
yuxiqian commented on PR #3093: URL: https://github.com/apache/flink-cdc/pull/3093#issuecomment-2228371711 Hi @czy006, is there any updates on this? Seems this PR is still in draft stage and not ready for review and merge. Feel free to comment if there's any blockers about this. -- This

[jira] [Updated] (FLINK-35844) Build Release Candidate: 1.20.0-rc1

2024-07-15 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-35844: --- Affects Version/s: 1.20.0 (was: 1.17.0) > Build Release Candidate: 1.20.

[jira] [Assigned] (FLINK-35848) [Release-1.20] Vote on the release candidate

2024-07-15 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo reassigned FLINK-35848: -- Assignee: Weijie Guo (was: Qingsheng Ren) > [Release-1.20] Vote on the release candidate > -

[jira] [Updated] (FLINK-35844) Build Release Candidate: 1.20.0-rc1

2024-07-15 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-35844: --- Fix Version/s: 1.20.0 (was: 1.17.0) > Build Release Candidate: 1.20.0-rc1 >

  1   2   >