[jira] [Commented] (FLINK-37001) Remove all direct uses of `TableEnvironmentInternal#registerTableSinkInternal` in table module

2025-01-16 Thread dalongliu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17913987#comment-17913987 ] dalongliu commented on FLINK-37001: --- Merged in master branch: 6b4385ec17e7ac832d22f048

[jira] [Resolved] (FLINK-37001) Remove all direct uses of `TableEnvironmentInternal#registerTableSinkInternal` in table module

2025-01-16 Thread dalongliu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dalongliu resolved FLINK-37001. --- Assignee: xuyang Resolution: Fixed > Remove all direct uses of > `TableEnvironmentInternal#re

Re: [PR] [FLINK-37001][table] Remove code related to registerTableSinkInternal in tests and remove this method in TableEnvironmentInternal [flink]

2025-01-16 Thread via GitHub
lsyldliu merged PR #25889: URL: https://github.com/apache/flink/pull/25889 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apac

Re: [PR] [FLINK-37133][table] Support Submitting Refresh Tasks of Materialized Table to Yarn/K8s [flink]

2025-01-16 Thread via GitHub
hackergin commented on code in PR #25988: URL: https://github.com/apache/flink/pull/25988#discussion_r1919690980 ## flink-table/flink-sql-gateway/src/main/java/org/apache/flink/table/gateway/service/materializedtable/MaterializedTableManager.java: ## @@ -1244,4 +1278,99 @@ priva

[jira] [Updated] (FLINK-37162) Add Data Sink Documentation

2025-01-16 Thread Yanquan Lv (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanquan Lv updated FLINK-37162: --- Summary: Add Data Sink Documentation (was: Add Data Sources Documentation) > Add Data Sink Document

[jira] [Created] (FLINK-37162) Add Data Sources Documentation

2025-01-16 Thread Yanquan Lv (Jira)
Yanquan Lv created FLINK-37162: -- Summary: Add Data Sources Documentation Key: FLINK-37162 URL: https://issues.apache.org/jira/browse/FLINK-37162 Project: Flink Issue Type: Technical Debt

[jira] [Updated] (FLINK-37162) Add Data Sources Documentation

2025-01-16 Thread Yanquan Lv (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanquan Lv updated FLINK-37162: --- Labels: 2.0-related (was: ) > Add Data Sources Documentation > -- > >

Re: [PR] [FLINK-37158][tests] Introduce ForSt to existing ITCases [flink]

2025-01-16 Thread via GitHub
flinkbot commented on PR #26000: URL: https://github.com/apache/flink/pull/26000#issuecomment-2597619865 ## CI report: * 42d79c108d797a351c2fc83f41bf0fca5935e3bc UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-37098] Fix selecting time attribute from a view [flink]

2025-01-16 Thread via GitHub
dawidwys merged PR #25952: URL: https://github.com/apache/flink/pull/25952 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apac

Re: [PR] [FLINK-37084][python] fix TimerRegistration concurrency bug in pyflink [flink]

2025-01-16 Thread via GitHub
suez1224 commented on PR #25965: URL: https://github.com/apache/flink/pull/25965#issuecomment-2597601633 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [FLINK-37084][python] fix TimerRegistration concurrency bug in pyflink [flink]

2025-01-16 Thread via GitHub
suez1224 commented on PR #25965: URL: https://github.com/apache/flink/pull/25965#issuecomment-2597571178 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [FLINK-36488] [TABLE SQL/API] Remove deprecated methods StreamTableEnvironment.toAppendStream from flink-table-api-java-bridge module [flink]

2025-01-16 Thread via GitHub
sn-12-3 commented on PR #25528: URL: https://github.com/apache/flink/pull/25528#issuecomment-2597571101 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Updated] (FLINK-37136) FLIP-501: Support Window Extension in DataStream V2 API

2025-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-37136: --- Labels: pull-request-available (was: ) > FLIP-501: Support Window Extension in DataStream V

[PR] [WIP][FLINK-37136] Support Window extension for DataStream V2 [flink]

2025-01-16 Thread via GitHub
codenohup opened a new pull request, #26001: URL: https://github.com/apache/flink/pull/26001 ## What is the purpose of the change *(For example: This pull request makes task deployment go through the blob server, rather than through RPC. That way we avoid re-transferring them

[jira] [Updated] (FLINK-37160) Cross-team verification for "Adaptive broadcast join for batch jobs"

2025-01-16 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee updated FLINK-37160: --- Description: This is for cross-team verification of the release 2.0 work item: "Adaptive broadcast

[jira] [Updated] (FLINK-37161) Cross-team verification for "Adaptive skewed join optimization for batch jobs"

2025-01-16 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee updated FLINK-37161: --- Description: This is for cross-team verification of the release 2.0 work item: "Adaptive skewed joi

[jira] [Created] (FLINK-37161) Cross-team verification for "Adaptive skewed join optimization for batch jobs"

2025-01-16 Thread Junrui Lee (Jira)
Junrui Lee created FLINK-37161: -- Summary: Cross-team verification for "Adaptive skewed join optimization for batch jobs" Key: FLINK-37161 URL: https://issues.apache.org/jira/browse/FLINK-37161 Project: F

[jira] [Created] (FLINK-37160) Cross-team verification for "Adaptive broadcast join for batch jobs"

2025-01-16 Thread Junrui Lee (Jira)
Junrui Lee created FLINK-37160: -- Summary: Cross-team verification for "Adaptive broadcast join for batch jobs" Key: FLINK-37160 URL: https://issues.apache.org/jira/browse/FLINK-37160 Project: Flink

[jira] [Updated] (FLINK-37113) Introduce documentation for datastream api v2

2025-01-16 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-37113: --- Summary: Introduce documentation for datastream api v2 (was: Introduce document for datastream api

Re: [PR] [FLINK-36488] [TABLE SQL/API] Remove deprecated methods StreamTableEnvironment.toAppendStream from flink-table-api-java-bridge module [flink]

2025-01-16 Thread via GitHub
sn-12-3 commented on PR #25528: URL: https://github.com/apache/flink/pull/25528#issuecomment-2597508920 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Created] (FLINK-37159) MemoryManagerConcurrentModReleaseTest.testConcurrentModificationWhileReleasing timeout in AZP

2025-01-16 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-37159: -- Summary: MemoryManagerConcurrentModReleaseTest.testConcurrentModificationWhileReleasing timeout in AZP Key: FLINK-37159 URL: https://issues.apache.org/jira/browse/FLINK-37159

Re: [PR] [FLINK-36074][Connectors/mongodb] Support insert overwrite semantics for mongodb table sink [flink-connector-mongodb]

2025-01-16 Thread via GitHub
Jiabao-Sun commented on PR #43: URL: https://github.com/apache/flink-connector-mongodb/pull/43#issuecomment-2597485624 Thanks @GOODBOY008 for the review. Docs added, could you help review it again? -- This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Updated] (FLINK-37158) Introduce ForSt to existing ITCases

2025-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-37158: --- Labels: pull-request-available (was: ) > Introduce ForSt to existing ITCases >

[PR] [FLINK-37158][tests] Introduce ForSt to existing ITCases [flink]

2025-01-16 Thread via GitHub
fredia opened a new pull request, #26000: URL: https://github.com/apache/flink/pull/26000 ## What is the purpose of the change Introduce ForSt to existing IT Cases. ## Brief change log - Enable Async State in `OneInputTransformation` - Introduce forst to `A

[jira] [Commented] (FLINK-35093) Postgres source connector support SPECIFIC_OFFSETS start up mode from an existed replication slot.

2025-01-16 Thread Vinh Pham (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17913966#comment-17913966 ] Vinh Pham commented on FLINK-35093: --- hi [~loserwang1024] , i have a thought about this

[jira] [Created] (FLINK-37158) Introduce ForSt to existing ITCases

2025-01-16 Thread Yanfei Lei (Jira)
Yanfei Lei created FLINK-37158: -- Summary: Introduce ForSt to existing ITCases Key: FLINK-37158 URL: https://issues.apache.org/jira/browse/FLINK-37158 Project: Flink Issue Type: Sub-task

Re: [PR] [FLINK-36488] [TABLE SQL/API] Remove deprecated methods StreamTableEnvironment.toAppendStream from flink-table-api-java-bridge module [flink]

2025-01-16 Thread via GitHub
sn-12-3 commented on PR #25528: URL: https://github.com/apache/flink/pull/25528#issuecomment-2597461441 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Updated] (FLINK-36713) NoSuchMethodError: PostgresConnection with PostgresIncrementalSource at runtime

2025-01-16 Thread Mohsen Rezaei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mohsen Rezaei updated FLINK-36713: -- Summary: NoSuchMethodError: PostgresConnection with PostgresIncrementalSource at runtime (was

Re: [PR] [FLINK-20886] Support printing the thread dump when checkpoint expired [flink]

2025-01-16 Thread via GitHub
Zakelly closed pull request #23347: [FLINK-20886] Support printing the thread dump when checkpoint expired URL: https://github.com/apache/flink/pull/23347 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

Re: [PR] [FLINK-37008] [runtime-web] Flink UI should show the type of checkpoint (full vs incremental) [flink]

2025-01-16 Thread via GitHub
Zakelly commented on code in PR #25899: URL: https://github.com/apache/flink/pull/25899#discussion_r191955 ## flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/CheckpointProperties.java: ## @@ -283,6 +293,39 @@ public String toString() { fa

Re: [PR] [FLINK-32753] Print JVM flags on AZP [flink]

2025-01-16 Thread via GitHub
Zakelly closed pull request #23138: [FLINK-32753] Print JVM flags on AZP URL: https://github.com/apache/flink/pull/23138 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsu

Re: [PR] [FLINK-37120][pipeline-connector/mysql] Add ending split chunk first to avoid TaskManager oom [flink-cdc]

2025-01-16 Thread via GitHub
lvyanquan commented on PR #3856: URL: https://github.com/apache/flink-cdc/pull/3856#issuecomment-2597402903 > I missed this issue #3704, good idea. Maybe support `AssignStrategy` in base module is better? Do we implement this in a future PR or in this PR? My previous PR provided both

[jira] [Updated] (FLINK-35234) Fix NullPointerException of org.apache.flink.cdc.common.configuration.ConfigurationUtils#convertToString

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-35234: -- Fix Version/s: cdc-3.2.0 (was: cdc-3.3.1) > Fix NullPointerException of > org.

[jira] [Resolved] (FLINK-35234) Fix NullPointerException of org.apache.flink.cdc.common.configuration.ConfigurationUtils#convertToString

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang resolved FLINK-35234. --- Resolution: Fixed > Fix NullPointerException of > org.apache.flink.cdc.common.configuration.Configu

[jira] [Updated] (FLINK-35234) Fix NullPointerException of org.apache.flink.cdc.common.configuration.ConfigurationUtils#convertToString

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-35234: -- Fix Version/s: cdc-3.3.1 (was: cdc-3.3.0) > Fix NullPointerException of > org.

[jira] [Updated] (FLINK-35684) Add missing option for DataSource and DataSink

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-35684: -- Fix Version/s: cdc-3.4.0 (was: cdc-3.3.1) > Add missing option for DataSource a

[jira] [Updated] (FLINK-35589) Support MemorySize type in FlinkCDC ConfigOptions

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-35589: -- Fix Version/s: cdc-3.4.0 (was: cdc-3.3.0) > Support MemorySize type in FlinkCDC

[jira] [Updated] (FLINK-35684) Add missing option for DataSource and DataSink

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-35684: -- Fix Version/s: cdc-3.3.1 (was: cdc-3.3.0) > Add missing option for DataSource a

[jira] [Updated] (FLINK-35718) Cherrypick DBZ-5333 to fix frequently failover by EOFException.

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-35718: -- Fix Version/s: cdc-3.4.0 (was: cdc-3.3.0) > Cherrypick DBZ-5333 to fix frequent

[jira] [Updated] (FLINK-35888) Add e2e test for paimon DataSink

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-35888: -- Fix Version/s: cdc-3.3.1 (was: cdc-3.3.0) > Add e2e test for paimon DataSink >

[jira] [Updated] (FLINK-36827) [Docs] Tidy up Flink CDC Doris/MySQL quickstart page

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-36827: -- Fix Version/s: cdc-3.3.1 (was: cdc-3.3.0) > [Docs] Tidy up Flink CDC Doris/MySQ

[jira] [Updated] (FLINK-35834) Update Doris Dependency to 1.6.2 to use group commit.

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-35834: -- Fix Version/s: cdc-3.4.0 (was: cdc-3.3.0) > Update Doris Dependency to 1.6.2 to

[jira] [Updated] (FLINK-35444) Paimon Pipeline Connector support changing column names to lowercase for Hive metastore

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-35444: -- Fix Version/s: cdc-3.4.0 (was: cdc-3.3.0) > Paimon Pipeline Connector support c

[jira] [Updated] (FLINK-35349) Use connection in openJdbcConnection of SqlServerDialect/Db2Dialect/OracleDialect

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-35349: -- Fix Version/s: cdc-3.4.0 (was: cdc-3.3.0) > Use connection in openJdbcConnectio

[jira] [Updated] (FLINK-36111) fix: adjust MultiTableCommittableChannelComputer Topology name

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-36111: -- Fix Version/s: cdc-3.3.1 (was: cdc-3.3.0) > fix: adjust MultiTableCommittableCh

[jira] [Updated] (FLINK-36218) Documentations clean up before CDC 3.2.0 release

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-36218: -- Fix Version/s: cdc-3.3.1 (was: cdc-3.3.0) > Documentations clean up before CDC

[jira] [Updated] (FLINK-35919) The rowkind keyword option for MySQL connector metadata should be changed to op_type keyword

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-35919: -- Fix Version/s: cdc-3.3.1 (was: cdc-3.3.0) > The rowkind keyword option for MySQ

[jira] [Updated] (FLINK-36220) Clean up typo and stale links in docs

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-36220: -- Fix Version/s: cdc-3.3.1 (was: cdc-3.3.0) > Clean up typo and stale links in do

[jira] [Updated] (FLINK-35627) Avoid conflict when pipeline job that used Paimon as sink restart.

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-35627: -- Fix Version/s: cdc-3.4.0 (was: cdc-3.3.0) > Avoid conflict when pipeline job th

[jira] [Updated] (FLINK-34750) "legacy-flink-cdc-sources" Page of Postgresql for Flink CDC Chinese Documentation.

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-34750: -- Fix Version/s: cdc-3.4.0 (was: cdc-3.3.0) > "legacy-flink-cdc-sources" Page of

[jira] [Updated] (FLINK-35090) Doris sink fails to create table when database does not exist

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-35090: -- Fix Version/s: cdc-3.3.1 (was: cdc-3.3.0) > Doris sink fails to create table wh

[jira] [Updated] (FLINK-34904) [Feature] submit Flink CDC pipeline job to yarn application cluster.

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-34904: -- Fix Version/s: cdc-3.4.0 (was: cdc-3.3.0) > [Feature] submit Flink CDC pipeline

[jira] [Updated] (FLINK-34752) "legacy-flink-cdc-sources" Page of TIDB for Flink CDC Chinese Documentation.

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-34752: -- Fix Version/s: cdc-3.4.0 (was: cdc-3.3.0) > "legacy-flink-cdc-sources" Page of

[jira] [Updated] (FLINK-34749) "legacy-flink-cdc-sources" Page of SQLServer for Flink CDC Chinese Documentation.

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-34749: -- Fix Version/s: cdc-3.4.0 (was: cdc-3.3.0) > "legacy-flink-cdc-sources" Page of

[jira] [Updated] (FLINK-36708) Optimize Table Collection Handling Logic to Improve Efficiency

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-36708: -- Fix Version/s: cdc-3.4.0 (was: cdc-3.3.0) > Optimize Table Collection Handling

[jira] [Commented] (FLINK-36167) testSinkDisorderChangeLog failed on AZP

2025-01-16 Thread Shuai Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17913945#comment-17913945 ] Shuai Xu commented on FLINK-36167: -- I would like try to fix it. Could you assign it to

[jira] [Comment Edited] (FLINK-36167) testSinkDisorderChangeLog failed on AZP

2025-01-16 Thread Shuai Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17913945#comment-17913945 ] Shuai Xu edited comment on FLINK-36167 at 1/17/25 3:57 AM: --- I

[jira] [Updated] (FLINK-35873) Add HashFunctionProvider for Paimon DataSink.

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-35873: -- Fix Version/s: cdc-3.4.0 (was: cdc-3.3.0) > Add HashFunctionProvider for Paimon

[jira] [Updated] (FLINK-34735) "Developer Guide - Understanding Flink CDC API" Page for Flink CDC Chinese Documentation

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-34735: -- Fix Version/s: cdc-3.4.0 (was: cdc-3.3.0) > "Developer Guide - Understanding Fl

[jira] [Updated] (FLINK-34747) "legacy-flink-cdc-sources" Page of DB2 for Flink CDC Chinese Documentation.

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-34747: -- Fix Version/s: cdc-3.4.0 (was: cdc-3.3.0) > "legacy-flink-cdc-sources" Page of

[jira] [Updated] (FLINK-34736) "Deployment - Standalone" Page for Flink CDC Chinese Documentation

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-34736: -- Fix Version/s: cdc-3.4.0 (was: cdc-3.3.0) > "Deployment - Standalone" Page for

[jira] [Updated] (FLINK-34748) "legacy-flink-cdc-sources" Page of Oracle for Flink CDC Chinese Documentation.

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-34748: -- Fix Version/s: cdc-3.4.0 (was: cdc-3.3.0) > "legacy-flink-cdc-sources" Page of

[jira] [Updated] (FLINK-36566) Code optimization: always identify DataChangeEvent before SchemaChangeEvent in Operator

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-36566: -- Fix Version/s: cdc-3.4.0 (was: cdc-3.3.0) > Code optimization: always identify

[jira] [Updated] (FLINK-35544) No description of Flink Operator in the Deployment of  Kubernetes document

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-35544: -- Fix Version/s: cdc-3.3.0 (was: cdc-3.3.1) > No description of Flink Operator in

[jira] [Updated] (FLINK-36263) Include only changed columns in old for canal format in Kakfa Sink

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-36263: -- Fix Version/s: cdc-3.4.0 (was: cdc-3.3.0) > Include only changed columns in old

[jira] [Resolved] (FLINK-35544) No description of Flink Operator in the Deployment of  Kubernetes document

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang resolved FLINK-35544. --- Resolution: Fixed > No description of Flink Operator in the Deployment of  Kubernetes document > ---

[jira] [Updated] (FLINK-34730) Translate pages of Flink CDC docs to Chinese

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-34730: -- Fix Version/s: cdc-3.4.0 (was: cdc-3.3.1) > Translate pages of Flink CDC docs t

[jira] [Updated] (FLINK-34730) Translate pages of Flink CDC docs to Chinese

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-34730: -- Fix Version/s: cdc-3.3.1 (was: cdc-3.3.0) > Translate pages of Flink CDC docs t

[jira] [Updated] (FLINK-35544) No description of Flink Operator in the Deployment of  Kubernetes document

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-35544: -- Fix Version/s: cdc-3.3.1 (was: cdc-3.3.0) > No description of Flink Operator in

[jira] [Updated] (FLINK-36023) Flink CDC K8S Native Application Mode add wrong jar url.

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-36023: -- Fix Version/s: cdc-3.2.0 (was: cdc-3.4.0) > Flink CDC K8S Native Application Mo

[jira] [Resolved] (FLINK-36023) Flink CDC K8S Native Application Mode add wrong jar url.

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang resolved FLINK-36023. --- Resolution: Fixed master(3.2-SNAOSHOT):5284df571feb91354248bf0ffac184b89d9db30c > Flink CDC K8S Nat

[jira] [Updated] (FLINK-36023) Flink CDC K8S Native Application Mode add wrong jar url.

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-36023: -- Fix Version/s: cdc-3.4.0 (was: cdc-3.3.0) > Flink CDC K8S Native Application Mo

[jira] [Updated] (FLINK-36219) Add Flink compatibility matrix of CDC releases

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-36219: -- Fix Version/s: cdc-3.3.1 (was: cdc-3.3.0) > Add Flink compatibility matrix of C

Re: [PR] [FLINK-37120][pipeline-connector/mysql] Add ending split chunk first to avoid TaskManager oom [flink-cdc]

2025-01-16 Thread via GitHub
beryllw commented on PR #3856: URL: https://github.com/apache/flink-cdc/pull/3856#issuecomment-2597376945 > What‘s more, could you add this optimization to `MongoDBChunkSplitter`? https://github.com/apache/flink-cdc/pull/3704#discussion_r1864686969 I missed this issue https://gi

[jira] [Updated] (FLINK-36573) Add table information of binlog offsets when checkpointing

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-36573: -- Fix Version/s: cdc-3.4.0 (was: cdc-3.3.0) (was: cdc-3.2.1

[jira] [Updated] (FLINK-34467) Implement Lineage Interface in Jdbc Connector

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-34467: -- Fix Version/s: (was: cdc-3.3.0) > Implement Lineage Interface in Jdbc Connector >

[jira] [Updated] (FLINK-35849) [flink-cdc] Use expose_snapshot to read snapshot splits of postgres cdc connector.

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-35849: -- Fix Version/s: cdc-3.4.0 (was: cdc-3.3.0) > [flink-cdc] Use expose_snapshot to

[jira] [Updated] (FLINK-36041) Eliminate Calcite dependency during runtime

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-36041: -- Issue Type: Improvement (was: Technical Debt) > Eliminate Calcite dependency during runtime > ---

[jira] [Updated] (FLINK-36844) Postgres CDC document add mapping from postgres timestamp_tz to flink timestamp ltz

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-36844: -- Fix Version/s: cdc-3.3.1 (was: cdc-3.3.0) > Postgres CDC document add mapping f

[jira] [Updated] (FLINK-36041) Eliminate Calcite dependency during runtime

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-36041: -- Fix Version/s: cdc-3.3.1 (was: cdc-3.3.0) > Eliminate Calcite dependency during

[jira] [Updated] (FLINK-36546) Handle batch sources in DataSinkTranslator

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-36546: -- Fix Version/s: cdc-3.4.0 (was: cdc-3.3.0) > Handle batch sources in DataSinkTra

[jira] [Updated] (FLINK-35671) Support Iceberg CDC Pipeline Sink

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-35671: -- Fix Version/s: cdc-3.4.0 (was: cdc-3.3.0) > Support Iceberg CDC Pipeline Sink >

[jira] [Updated] (FLINK-35173) Debezium for Mysql connector Custom Time Serializer

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-35173: -- Fix Version/s: cdc-3.4.0 (was: cdc-3.1.0) (was: cdc-3.3.0

[jira] [Updated] (FLINK-35760) [docs] Add scan.newly-added-table.enabled to docs.

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-35760: -- Fix Version/s: cdc-3.3.1 (was: cdc-3.3.0) > [docs] Add scan.newly-added-table.e

[jira] [Updated] (FLINK-35693) Change variable specificOffsetFile, specificOffsetPos and startupTimestampMillis to Offset in StartupOptions

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-35693: -- Fix Version/s: cdc-3.4.0 (was: cdc-3.3.0) > Change variable specificOffsetFile,

[jira] [Updated] (FLINK-36036) CDC remove unused dependency jar from calcite-core

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-36036: -- Fix Version/s: cdc-3.3.1 (was: cdc-3.3.0) > CDC remove unused dependency jar fr

[jira] [Updated] (FLINK-36036) CDC remove unused dependency jar from calcite-core

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-36036: -- Issue Type: Technical Debt (was: Improvement) > CDC remove unused dependency jar from calcite-core >

[jira] [Updated] (FLINK-36163) Kafka cdc pipeline source supports protobuf format.

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-36163: -- Fix Version/s: cdc-3.4.0 (was: cdc-3.3.0) > Kafka cdc pipeline source supports

[jira] [Updated] (FLINK-35664) Flink CDC pipeline transform supports mask function

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-35664: -- Fix Version/s: cdc-3.4.0 (was: cdc-3.3.0) > Flink CDC pipeline transform suppor

[jira] [Updated] (FLINK-35586) Detected conflict when using Paimon as pipeline sink with parallelism > 1

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-35586: -- Fix Version/s: cdc-3.3.1 (was: cdc-3.3.0) > Detected conflict when using Paimon

[jira] [Updated] (FLINK-35586) Detected conflict when using Paimon as pipeline sink with parallelism > 1

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-35586: -- Fix Version/s: cdc-3.4.0 (was: cdc-3.3.1) > Detected conflict when using Paimon

[jira] [Updated] (FLINK-35567) CDC BinaryWriter cast NullableSerializerWrapper error

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-35567: -- Fix Version/s: cdc-3.3.1 (was: cdc-3.3.0) > CDC BinaryWriter cast NullableSeria

[jira] [Resolved] (FLINK-35344) Move same code from multiple subclasses to JdbcSourceChunkSplitter

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang resolved FLINK-35344. --- Resolution: Fixed master(3.3-SNAOSHT) :47f5660055016460719bc8a9a72cee868e9aa6fe > Move same code fr

[jira] [Updated] (FLINK-35344) Move same code from multiple subclasses to JdbcSourceChunkSplitter

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-35344: -- Issue Type: Technical Debt (was: Improvement) > Move same code from multiple subclasses to JdbcSource

Re: [PR] [FLINK-37133][table] Support Submitting Refresh Tasks of Materialized Table to Yarn/K8s [flink]

2025-01-16 Thread via GitHub
hackergin commented on code in PR #25988: URL: https://github.com/apache/flink/pull/25988#discussion_r1919510180 ## flink-end-to-end-tests/test-scripts/test_kubernetes_materialized_table.sh: ## @@ -0,0 +1,242 @@ +#!/usr/bin/env bash +# +# Licensed to the Apache Software Foundati

[jira] [Updated] (FLINK-35459) Use Incremental Source Framework in Flink CDC TiKV Source Connector

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-35459: -- Fix Version/s: cdc-3.4.0 (was: cdc-3.3.0) > Use Incremental Source Framework in

[jira] [Updated] (FLINK-35450) Introduce Tikv pipeline DataSource

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-35450: -- Fix Version/s: cdc-3.4.0 (was: cdc-3.3.0) > Introduce Tikv pipeline DataSource

[jira] [Updated] (FLINK-35344) Move same code from multiple subclasses to JdbcSourceChunkSplitter

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-35344: -- Fix Version/s: cdc-3.3.0 (was: cdc-3.3.1) > Move same code from multiple subcla

[jira] [Updated] (FLINK-35344) Move same code from multiple subclasses to JdbcSourceChunkSplitter

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-35344: -- Fix Version/s: cdc-3.3.1 (was: cdc-3.3.0) > Move same code from multiple subcla

[jira] [Updated] (FLINK-35296) Flink mysql-cdc connector stops reading data

2025-01-16 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-35296: -- Fix Version/s: cdc-3.3.1 (was: cdc-3.3.0) > Flink mysql-cdc connector stops rea

  1   2   3   4   5   6   >