Re: [PR] [FLINK-36160] Support hive advanced configuration [flink]

2025-01-10 Thread via GitHub
luoyuxia commented on PR #25258: URL: https://github.com/apache/flink/pull/25258#issuecomment-2585115946 FYI, let's wait the response for the question I asked in [FLINK-37097](https://issues.apache.org/jira/browse/FLINK-37097?focusedCommentId=17912172&page=com.atlassian.jira.plugin.system.is

Re: [PR] [MINOR] Deprecated StreamSink and SinkOperator [flink]

2025-01-10 Thread via GitHub
beliefer commented on code in PR #25835: URL: https://github.com/apache/flink/pull/25835#discussion_r1911925092 ## flink-runtime/src/main/java/org/apache/flink/streaming/api/operators/StreamSink.java: ## @@ -25,6 +25,7 @@ import org.apache.flink.streaming.runtime.tasks.Processi

[jira] [Commented] (FLINK-37097) Remove Hive connector from core Flink

2025-01-10 Thread luoyuxia (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17912172#comment-17912172 ] luoyuxia commented on FLINK-37097: -- So the currently pending pr for hive connector shou

Re: [PR] [FLINK-36645] [flink-autoscaler] Gracefully handle null execution pla… [flink-kubernetes-operator]

2025-01-10 Thread via GitHub
sharath1709 commented on code in PR #930: URL: https://github.com/apache/flink-kubernetes-operator/pull/930#discussion_r1911479006 ## flink-autoscaler/src/main/java/org/apache/flink/autoscaler/topology/JobTopology.java: ## @@ -150,6 +151,11 @@ public static JobTopology fromJson

Re: [PR] [FLINK-36696] [flink-autoscaler-plugin-jdbc] Switch sql connection usages to datasource [flink-kubernetes-operator]

2025-01-10 Thread via GitHub
sharath1709 commented on PR #929: URL: https://github.com/apache/flink-kubernetes-operator/pull/929#issuecomment-2584888730 Thanks a lot @1996fanrui for the quick review. Please find my replies below 1. Typically, DataSource connections will be relinquished automatically after a time

Re: [PR] [FLINK-35600] Add timestamp for low and high watermark [flink-cdc]

2025-01-10 Thread via GitHub
github-actions[bot] commented on PR #3415: URL: https://github.com/apache/flink-cdc/pull/3415#issuecomment-2584936582 This pull request has been automatically marked as stale because it has not had recent activity for 60 days. It will be closed in 30 days if no further activity occurs. --

[jira] [Commented] (FLINK-34932) Translate concepts of Flink-Kubernetes-Operator documentation

2025-01-10 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17912165#comment-17912165 ] Rui Fan commented on FLINK-34932: - [~fernandoha] , assigned it to you.  Hi [~caicancai]

[jira] [Assigned] (FLINK-34932) Translate concepts of Flink-Kubernetes-Operator documentation

2025-01-10 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan reassigned FLINK-34932: --- Assignee: yinrhh (was: Caican Cai) > Translate concepts of Flink-Kubernetes-Operator documentation

[jira] [Commented] (FLINK-34932) Translate concepts of Flink-Kubernetes-Operator documentation

2025-01-10 Thread yinrhh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17912164#comment-17912164 ] yinrhh commented on FLINK-34932: Hi. can anybody assign this problem to me,i truly want

Re: [PR] [FLINK-28897] [TABLE-SQL] Fail to use udf in added jar when enabling checkpoint [flink]

2025-01-10 Thread via GitHub
ammu20-dev commented on PR #25656: URL: https://github.com/apache/flink/pull/25656#issuecomment-2585004128 > In that case the primary question should be - why does the `userClassLoader` class field not contain the actual user class loader in the first place. Should not that be the focus of

[jira] [Created] (FLINK-37094) Adapt the external Hive connector to the removal of deprecated APIs in table module in 2.0

2025-01-10 Thread xuyang (Jira)
xuyang created FLINK-37094: -- Summary: Adapt the external Hive connector to the removal of deprecated APIs in table module in 2.0 Key: FLINK-37094 URL: https://issues.apache.org/jira/browse/FLINK-37094 Projec

[jira] [Created] (FLINK-37095) test case that used AI model may met quota not enough exception.

2025-01-10 Thread Yanquan Lv (Jira)
Yanquan Lv created FLINK-37095: -- Summary: test case that used AI model may met quota not enough exception. Key: FLINK-37095 URL: https://issues.apache.org/jira/browse/FLINK-37095 Project: Flink

[jira] [Resolved] (FLINK-37024) Task can be stuck in deploying state forever when canceling job/failover

2025-01-10 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu resolved FLINK-37024. --- Fix Version/s: 2.0.0 Resolution: Fixed merged in master: 37c70c482a09845370cb6e694a26f55950c4

Re: [PR] [FLINK-37025] Fix generating watermarks in SQL on-periodic (#25921) [flink]

2025-01-10 Thread via GitHub
dawidwys merged PR #25935: URL: https://github.com/apache/flink/pull/25935 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apac

Re: [PR] [FLINK-37091][table-common] Remove deprecated interface CatalogLock [flink]

2025-01-10 Thread via GitHub
flinkbot commented on PR #25947: URL: https://github.com/apache/flink/pull/25947#issuecomment-2582054899 ## CI report: * 0557987216d7d26709023fd6cfc2379ec9f92eae UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-37094) Adapt the external Hive connector to the removal of deprecated APIs in table module in 2.0

2025-01-10 Thread xuyang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xuyang updated FLINK-37094: --- Issue Type: Improvement (was: Bug) > Adapt the external Hive connector to the removal of deprecated APIs in

Re: [PR] [FLINK-37093][table] store catalog in catalogStoreHolder should after initCatalog and open when createCatalog [flink]

2025-01-10 Thread via GitHub
flinkbot commented on PR #25946: URL: https://github.com/apache/flink/pull/25946#issuecomment-2582054718 ## CI report: * 59d74f97e7e7905497e8db467527c9961c3a2f86 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-37094) Adapt the external Hive connector to the removal of deprecated APIs in table module in 2.0

2025-01-10 Thread xuyang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xuyang updated FLINK-37094: --- Description: Since the Hive connector is scheduled to be removed from the Flink repo, and the compilation o

Re: [PR] [FLINK-37024][task] Make cancel watchdog cover tasks stuck in DEPLOYING state [flink]

2025-01-10 Thread via GitHub
huwh merged PR #25915: URL: https://github.com/apache/flink/pull/25915 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.o

[jira] [Updated] (FLINK-35325) Paimon connector miss the position of AddColumnEvent

2025-01-10 Thread Yanquan Lv (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanquan Lv updated FLINK-35325: --- Fix Version/s: cdc-3.2.1 (was: cdc-3.1.1) > Paimon connector miss the positio

[jira] [Resolved] (FLINK-37025) Periodic SQL watermarks can travel back in time

2025-01-10 Thread Dawid Wysakowicz (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dawid Wysakowicz resolved FLINK-37025. -- Resolution: Fixed Fixed in: * master ** 7059ee555c5093e3b233876ac3d84ad693023df8 * 1.2

[jira] [Commented] (FLINK-37094) Adapt the external Hive connector to the removal of deprecated APIs in table module in 2.0

2025-01-10 Thread xuyang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17911842#comment-17911842 ] xuyang commented on FLINK-37094: Btw, I tried to enable the compilation directly in the

[PR] [FLINK-35325][transform] Skip insufficient_quota error when running test case using ad model. [flink-cdc]

2025-01-10 Thread via GitHub
lvyanquan opened a new pull request, #3849: URL: https://github.com/apache/flink-cdc/pull/3849 Fix Ci failure. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscrib

Re: [PR] [FLINK-36957][Datastream] Implement asyc state version of stream flatmap [flink]

2025-01-10 Thread via GitHub
fredia commented on PR #25848: URL: https://github.com/apache/flink/pull/25848#issuecomment-2582074659 > @fredia I am unsure what this change it - please could you add the motivation of the fix in the Jira and the impact on the Datastream API. Does this require a docs change? @davidr

[PR] [FLINK-36494][table] Remove deprecated method Catalog#getTableFactory [flink]

2025-01-10 Thread via GitHub
xuyangzhong opened a new pull request, #25948: URL: https://github.com/apache/flink/pull/25948 ## What is the purpose of the change Remove deprecated method Catalog#getTableFactory. Note: no changes are done in hive connector repo because of https://issues.apache.org/jira/browse/F

Re: [PR] [FLINK-37011] Improve get source field value by column name in PreTransformProcessor. [flink-cdc]

2025-01-10 Thread via GitHub
ChaomingZhangCN commented on PR #3836: URL: https://github.com/apache/flink-cdc/pull/3836#issuecomment-2582263733 > @leonardBang @yuxiqian Please take a look. pin -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] [FLINK-36193] Supports applying TRUNCATE / DROP table ddl... [flink-cdc]

2025-01-10 Thread via GitHub
yuxiqian commented on code in PR #3673: URL: https://github.com/apache/flink-cdc/pull/3673#discussion_r1910133465 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-paimon/src/main/java/org/apache/flink/cdc/connectors/paimon/sink/PaimonMetadataApplier.java:

[PR] [FLINK-36506][table] Remove all deprecated methods in ColumnStats [flink]

2025-01-10 Thread via GitHub
xuyangzhong opened a new pull request, #25950: URL: https://github.com/apache/flink/pull/25950 ## What is the purpose of the change Remove all deprecated methods in ColumnStats ## Brief change log - Remove all deprecated methods in ColumnStats ## Verifying th

[PR] [FLINK-37093][table] store catalog in catalogStoreHolder should after initCatalog and open when createCatalog [flink]

2025-01-10 Thread via GitHub
jiefei30 opened a new pull request, #25946: URL: https://github.com/apache/flink/pull/25946 ## What is the purpose of the change This pull request fix a bug which a catalog that failed validation due to no type still exists in catalogStoreHolder. And this catalog you cannot USE, AL

[jira] [Updated] (FLINK-37093) The catalog that failed validation due to no type still exists in catalogStoreHolder

2025-01-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-37093: --- Labels: pull-request-available (was: ) > The catalog that failed validation due to no type

Re: [PR] [FLINK-36899][state/forst] Introduce metrics for forst cache [flink]

2025-01-10 Thread via GitHub
fredia commented on code in PR #25884: URL: https://github.com/apache/flink/pull/25884#discussion_r1909974038 ## flink-state-backends/flink-statebackend-forst/src/main/java/org/apache/flink/state/forst/fs/cache/FileBasedCache.java: ## @@ -97,6 +129,13 @@ public void delete(Path

[jira] [Updated] (FLINK-36494) Remove deprecated methods `Catalog#getTableFactory` and `Catalog#supportsManagedTable`

2025-01-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36494: --- Labels: pull-request-available (was: ) > Remove deprecated methods `Catalog#getTableFactory

[jira] [Comment Edited] (FLINK-37094) Adapt the external Hive connector to the removal of deprecated APIs in table module in 2.0

2025-01-10 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17911849#comment-17911849 ] Sergey Nuyanzin edited comment on FLINK-37094 at 1/10/25 8:51 AM:

Re: [PR] [FLINK-36494][table] Remove deprecated method Catalog#getTableFactory [flink]

2025-01-10 Thread via GitHub
flinkbot commented on PR #25948: URL: https://github.com/apache/flink/pull/25948#issuecomment-2582085953 ## CI report: * 69dbfadecb608f9ccd9702c9a793ea0218a039cb UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Commented] (FLINK-37094) Adapt the external Hive connector to the removal of deprecated APIs in table module in 2.0

2025-01-10 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17911849#comment-17911849 ] Sergey Nuyanzin commented on FLINK-37094: - Hi [~xuyangzhong]  IIRC the idea was

Re: [PR] [FLINK-36698][pipeline-connector][elasticsearch] Elasticsearch pipeline sink support authentication [flink-cdc]

2025-01-10 Thread via GitHub
beryllw commented on PR #3728: URL: https://github.com/apache/flink-cdc/pull/3728#issuecomment-2582088579 https://github.com/apache/flink-cdc/pull/3849 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

Re: [PR] [FLINK-35325][transform] Skip insufficient_quota error when running test case using ad model. [flink-cdc]

2025-01-10 Thread via GitHub
yuxiqian commented on code in PR #3849: URL: https://github.com/apache/flink-cdc/pull/3849#discussion_r1910020556 ## flink-cdc-composer/src/test/java/org/apache/flink/cdc/composer/flink/FlinkPipelineUdfITCase.java: ## @@ -897,7 +899,6 @@ void testTransformWithModel(ValuesDataSin

[jira] [Commented] (FLINK-36506) Remove all deprecated methods in `ColumnStats`

2025-01-10 Thread xuyang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17911850#comment-17911850 ] xuyang commented on FLINK-36506: I'll take charge of this task and add you [~atusharm] 

[PR] [FLINK-37089][Runtime] Advanced scheduling for derived async state processing [flink]

2025-01-10 Thread via GitHub
Zakelly opened a new pull request, #25949: URL: https://github.com/apache/flink/pull/25949 ## What is the purpose of the change Currently, there is a limit for in-flight records in async state processing. However, we allow developers to initialize a new processing in-middle of anothe

[jira] [Updated] (FLINK-37089) Advanced scheduling for derived async state processing

2025-01-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-37089: --- Labels: pull-request-available (was: ) > Advanced scheduling for derived async state proces

Re: [PR] [FLINK-36506][table] Remove all deprecated methods in ColumnStats [flink]

2025-01-10 Thread via GitHub
flinkbot commented on PR #25950: URL: https://github.com/apache/flink/pull/25950#issuecomment-2582291586 ## CI report: * 43820887f2acc648f48dbfc0c8c18fb370f4a55a UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-37078] Fix for jackson-mapper-asl 1.9.13 vulnerability [flink]

2025-01-10 Thread via GitHub
rmetzger commented on code in PR #25890: URL: https://github.com/apache/flink/pull/25890#discussion_r1910162122 ## flink-connectors/flink-sql-connector-hive-3.1.3/src/main/resources/META-INF/NOTICE: ## @@ -45,7 +45,7 @@ the Apache Software License 2.0 (http://www.apache.org/lic

Re: [PR] [FLINK-37078] Fix for jackson-mapper-asl 1.9.13 vulnerability [flink]

2025-01-10 Thread via GitHub
rmetzger commented on code in PR #25890: URL: https://github.com/apache/flink/pull/25890#discussion_r1910165407 ## pom.xml: ## @@ -328,6 +335,13 @@ under the License. --> + + +

Re: [PR] [FLINK-28897] [TABLE-SQL] Fail to use udf in added jar when enabling checkpoint [flink]

2025-01-10 Thread via GitHub
afedulov commented on PR #25656: URL: https://github.com/apache/flink/pull/25656#issuecomment-2582320914 > But while debugging the issue I found that the class loader coming here is the App class loader and not the user class loader. In that case the primary question should be - why d

Re: [PR] [FLINK-36899][state/forst] Introduce metrics for forst cache [flink]

2025-01-10 Thread via GitHub
fredia commented on code in PR #25884: URL: https://github.com/apache/flink/pull/25884#discussion_r1909979879 ## flink-state-backends/flink-statebackend-forst/src/main/java/org/apache/flink/state/forst/fs/ForStFlinkFileSystem.java: ## @@ -119,7 +121,11 @@ public static FileBased

Re: [PR] [FLINK-36193] Supports applying TRUNCATE / DROP table ddl... [flink-cdc]

2025-01-10 Thread via GitHub
lvyanquan commented on code in PR #3673: URL: https://github.com/apache/flink-cdc/pull/3673#discussion_r1910115690 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-paimon/src/main/java/org/apache/flink/cdc/connectors/paimon/sink/PaimonMetadataApplier.java:

[jira] [Assigned] (FLINK-36811) MySQL CDC source set is processing backlog during snapshot phase

2025-01-10 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang reassigned FLINK-36811: - Assignee: Xiao Huang > MySQL CDC source set is processing backlog during snapshot phase > -

[jira] [Assigned] (FLINK-36811) MySQL CDC source set is processing backlog during snapshot phase

2025-01-10 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang reassigned FLINK-36811: - Assignee: (was: Ruan Hang) > MySQL CDC source set is processing backlog during snapshot pha

[jira] [Updated] (FLINK-37093) The catalog that failed validation due to no type still exists in catalogStoreHolder

2025-01-10 Thread Mingcan Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingcan Wang updated FLINK-37093: - Description: here's sql-client (1.20 & 2.0-preview1):   *Flink SQL> create catalog cat1;* {col

Re: [PR] [FLINK-36794] [cdc-composer/cli] pipeline cdc connector support multiple data sources [flink-cdc]

2025-01-10 Thread via GitHub
ChaomingZhangCN commented on code in PR #3844: URL: https://github.com/apache/flink-cdc/pull/3844#discussion_r1910131067 ## docs/content.zh/docs/connectors/pipeline-connectors/mysql.md: ## @@ -77,6 +77,32 @@ pipeline: parallelism: 4 ``` +## 多数据源示例 + +单数据源,从多个 MySQL 读取数据同步

[jira] [Commented] (FLINK-37093) The catalog that failed validation due to no type still exists in catalogStoreHolder

2025-01-10 Thread Mingcan Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17911817#comment-17911817 ] Mingcan Wang commented on FLINK-37093: -- can someone assign this issue to me ? thank

[PR] [FLINK-37091][table-common] Remove deprecated interface CatalogLock [flink]

2025-01-10 Thread via GitHub
lsyldliu opened a new pull request, #25947: URL: https://github.com/apache/flink/pull/25947 ## What is the purpose of the change *Remove deprecated interface CatalogLock* ## Brief change log - *Remove deprecated interface CatalogLock* ## Verifying this change

[jira] [Commented] (FLINK-30064) Move existing Hive connector code from Flink repo to dedicated Hive repo

2025-01-10 Thread xuyang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17911818#comment-17911818 ] xuyang commented on FLINK-30064: Hi, should we sync the new commits from the Hive connec

[jira] [Updated] (FLINK-37091) Remove deprecated CatalogLock interface

2025-01-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-37091: --- Labels: pull-request-available (was: ) > Remove deprecated CatalogLock interface >

Re: [PR] [FLINK-36899][state/forst] Introduce metrics for forst cache [flink]

2025-01-10 Thread via GitHub
fredia commented on code in PR #25884: URL: https://github.com/apache/flink/pull/25884#discussion_r1909979879 ## flink-state-backends/flink-statebackend-forst/src/main/java/org/apache/flink/state/forst/fs/ForStFlinkFileSystem.java: ## @@ -119,7 +121,11 @@ public static FileBased

Re: [PR] [FLINK-36794] [cdc-composer/cli] pipeline cdc connector support multiple data sources [flink-cdc]

2025-01-10 Thread via GitHub
linjianchang commented on code in PR #3844: URL: https://github.com/apache/flink-cdc/pull/3844#discussion_r1910064891 ## flink-cdc-composer/src/main/java/org/apache/flink/cdc/composer/flink/FlinkPipelineComposer.java: ## @@ -126,16 +127,28 @@ private void translate(StreamExecuti

Re: [PR] [FLINK-36794] [cdc-composer/cli] pipeline cdc connector support multiple data sources [flink-cdc]

2025-01-10 Thread via GitHub
linjianchang commented on code in PR #3844: URL: https://github.com/apache/flink-cdc/pull/3844#discussion_r1910065232 ## docs/content.zh/docs/connectors/pipeline-connectors/mysql.md: ## @@ -77,6 +77,32 @@ pipeline: parallelism: 4 ``` +## 多数据源示例 + +单数据源,从多个 MySQL 读取数据同步到 D

[jira] [Comment Edited] (FLINK-37096) If the MongoDB connector is implemented with DebeziumSourceFunction, the curve will appear in the full phase delay curve showing 55year

2025-01-10 Thread sukang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17911874#comment-17911874 ] sukang edited comment on FLINK-37096 at 1/10/25 9:22 AM: - I will

[jira] [Commented] (FLINK-37096) If the MongoDB connector is implemented with DebeziumSourceFunction, the curve will appear in the full phase delay curve showing 55year

2025-01-10 Thread sukang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17911876#comment-17911876 ] sukang commented on FLINK-37096: assign to you > If the MongoDB connector is implemente

[jira] [Closed] (FLINK-37081) The debezium version of sqlserver cdc needs to be upgraded to 2.6 or higher

2025-01-10 Thread zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhang closed FLINK-37081. - Resolution: Later > The debezium version of sqlserver cdc needs to be upgraded to 2.6 or higher > --

Re: [PR] [FLINK-28897] [TABLE-SQL] Fail to use udf in added jar when enabling checkpoint [flink]

2025-01-10 Thread via GitHub
ammu20-dev commented on PR #25656: URL: https://github.com/apache/flink/pull/25656#issuecomment-2582186905 > As per the comments please could you investigate: > > * potential regressions > * the loss of the user class loader > * whether existing option could solve this without a

Re: [PR] [FLINK-36979][rpc] Reverting pekko version bump in Flink 1.20 [flink]

2025-01-10 Thread via GitHub
He-Pin commented on PR #25866: URL: https://github.com/apache/flink/pull/25866#issuecomment-2582436133 @davidradl Is there any investigation result update from your side, thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[PR] [hotfix][docs] Typo fix in RBAC docs [flink-kubernetes-operator]

2025-01-10 Thread via GitHub
gunnarmorling opened a new pull request, #931: URL: https://github.com/apache/flink-kubernetes-operator/pull/931 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [FLINK-37011] Improve get source field value by column name in PreTransformProcessor. [flink-cdc]

2025-01-10 Thread via GitHub
yuxiqian commented on code in PR #3836: URL: https://github.com/apache/flink-cdc/pull/3836#discussion_r1910216599 ## flink-cdc-runtime/src/main/java/org/apache/flink/cdc/runtime/operators/transform/PreTransformProcessor.java: ## @@ -62,30 +62,18 @@ public CreateTableEvent preTr

Re: [PR] [FLINK-36506][table] Remove all deprecated methods in ColumnStats [flink]

2025-01-10 Thread via GitHub
xuyangzhong commented on code in PR #25950: URL: https://github.com/apache/flink/pull/25950#discussion_r1910221269 ## flink-table/flink-table-common/src/main/java/org/apache/flink/table/plan/stats/ColumnStats.java: ## @@ -118,40 +81,10 @@ public Integer getMaxLen() { re

Re: [PR] [FLINK-36964] Fix potential exception when SchemaChange in parallel w… [flink-cdc]

2025-01-10 Thread via GitHub
lvyanquan commented on PR #3818: URL: https://github.com/apache/flink-cdc/pull/3818#issuecomment-2582453742 Rebased to master. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[jira] [Closed] (FLINK-36608) Support dynamic StreamGraph optimization for AdaptiveBroadcastJoinOperator

2025-01-10 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-36608. --- Resolution: Done 5d0cb98fe7843796e6ca0598060839f2b48f0882 627395acf46b8b38ee2c8db2cb6ba31849db9f27 80a79bb5f

Re: [PR] [FLINK-36506][table] Remove all deprecated methods in ColumnStats [flink]

2025-01-10 Thread via GitHub
davidradl commented on code in PR #25950: URL: https://github.com/apache/flink/pull/25950#discussion_r1910216285 ## flink-table/flink-table-common/src/main/java/org/apache/flink/table/plan/stats/ColumnStats.java: ## @@ -118,40 +81,10 @@ public Integer getMaxLen() { retu

Re: [PR] [FLINK-36494][table] Remove deprecated method Catalog#getTableFactory [flink]

2025-01-10 Thread via GitHub
davidradl commented on code in PR #25948: URL: https://github.com/apache/flink/pull/25948#discussion_r1910227028 ## flink-table/flink-table-api-java/src/main/java/org/apache/flink/table/factories/TableFactoryUtil.java: ## @@ -70,28 +66,14 @@ public static TableSource findAndCr

Re: [PR] [FLINK-37091][table-common] Remove deprecated interface CatalogLock [flink]

2025-01-10 Thread via GitHub
davidradl commented on PR #25947: URL: https://github.com/apache/flink/pull/25947#issuecomment-2582466083 I see in HiveDynamicTableFactory that there are references to RequireCatalogLock -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[jira] [Created] (FLINK-37097) Remove

2025-01-10 Thread david radley (Jira)
david radley created FLINK-37097: Summary: Remove Key: FLINK-37097 URL: https://issues.apache.org/jira/browse/FLINK-37097 Project: Flink Issue Type: Technical Debt Components: Conn

[PR] [FLINK-36910][table] Add function call syntax support to time-related dynamic functions [flink]

2025-01-10 Thread via GitHub
gustavodemorais opened a new pull request, #25951: URL: https://github.com/apache/flink/pull/25951 ## What is the purpose of the change Enabled dynamic time-related functions to be called with or without parenthesis ## Brief change log - Add function call syn

Re: [PR] [FLINK-37091][table-common] Remove deprecated interface CatalogLock [flink]

2025-01-10 Thread via GitHub
lsyldliu commented on PR #25947: URL: https://github.com/apache/flink/pull/25947#issuecomment-2582517352 > I just checked the external Hive connector and that refers to the class we are removing. I think we need a plan for the Hive connector before removing it from core Flink We can

[jira] [Assigned] (FLINK-37097) Remove

2025-01-10 Thread dalongliu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dalongliu reassigned FLINK-37097: - Assignee: david radley > Remove > --- > > Key: FLINK-37097 >

Re: [PR] [FLINK-37091][table-common] Remove deprecated interface CatalogLock [flink]

2025-01-10 Thread via GitHub
davidradl commented on PR #25947: URL: https://github.com/apache/flink/pull/25947#issuecomment-2582518192 I have raised https://issues.apache.org/jira/browse/FLINK-37097 to track the removal of the Hive connector from core flink, -- This is an automated message from the Apache Git Servic

Re: [PR] [FLINK-37091][table-common] Remove deprecated interface CatalogLock [flink]

2025-01-10 Thread via GitHub
lsyldliu commented on PR #25947: URL: https://github.com/apache/flink/pull/25947#issuecomment-2582519779 > I have raised https://issues.apache.org/jira/browse/FLINK-37097 to track the removal of the Hive connector from core flink, Good job, assign to you. -- This is an automated me

[jira] [Commented] (FLINK-37094) Adapt the external Hive connector to the removal of deprecated APIs in table module in 2.0

2025-01-10 Thread xuyang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17911929#comment-17911929 ] xuyang commented on FLINK-37094: [~Sergey Nuyanzin] Okay... IIUC we can adapt, test, and

Re: [PR] [FLINK-36698][pipeline-connector][elasticsearch] Elasticsearch pipeline sink support authentication [flink-cdc]

2025-01-10 Thread via GitHub
lvyanquan commented on PR #3728: URL: https://github.com/apache/flink-cdc/pull/3728#issuecomment-2582478475 Hi @beryllw, is it convenient to build a test to verify whether this certification is effective? -- This is an automated message from the Apache Git Service. To respond to the messa

[jira] [Closed] (FLINK-37097) Remove

2025-01-10 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin closed FLINK-37097. --- Resolution: Duplicate > Remove > --- > > Key: FLINK-37097 >

[jira] [Commented] (FLINK-37097) Remove

2025-01-10 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17911932#comment-17911932 ] Sergey Nuyanzin commented on FLINK-37097: - This is a duplicate of https://issues

Re: [PR] [FLINK-3154][API] Upgrade from Kryo 2.x to Kryo 5.x. Removed twitter … [flink]

2025-01-10 Thread via GitHub
davidradl commented on PR #25896: URL: https://github.com/apache/flink/pull/25896#issuecomment-258276 @kurtostfeld on your suggestion - I have raised this with on the dev list. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

Re: [PR] [FLINK-37091][table-common] Remove deprecated interface CatalogLock [flink]

2025-01-10 Thread via GitHub
xuyangzhong commented on PR #25947: URL: https://github.com/apache/flink/pull/25947#issuecomment-2582796136 @davidradl FYI we can ignore all classes in hive connector module in flink repo. You can refer more here https://issues.apache.org/jira/browse/FLINK-37094 -- This is an automated me

[PR] [FLINK-37100][tests] Fix `test_netty_shuffle_memory_control.sh` in CI for JDK11+ [flink]

2025-01-10 Thread via GitHub
ferenc-csaky opened a new pull request, #25955: URL: https://github.com/apache/flink/pull/25955 ## What is the purpose of the change Fixes the test executed by `test_netty_shuffle_memory_control.sh` that can possibly fail the CI in case Netty4 cannot reserve enough memory, hence Pekko

[jira] [Updated] (FLINK-37100) Fix test_netty_shuffle_memory_control.sh in CI for JDK11+

2025-01-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-37100: --- Labels: pull-request-available (was: ) > Fix test_netty_shuffle_memory_control.sh in CI for

Re: [PR] [FLINK-36979][rpc] Reverting pekko version bump in Flink 1.20 [flink]

2025-01-10 Thread via GitHub
ferenc-csaky commented on PR #25866: URL: https://github.com/apache/flink/pull/25866#issuecomment-2582907004 Opened https://github.com/apache/flink/pull/25955 which I believe should supersede this current PR. -- This is an automated message from the Apache Git Service. To respond to the m

[jira] [Commented] (FLINK-36753) Adaptive Scheduler actively triggers a Checkpoint

2025-01-10 Thread Samrat Deb (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17911938#comment-17911938 ] Samrat Deb commented on FLINK-36753: Thank you [~fanrui] for the input.  for 1:  it

Re: [PR] [FLINK-36910][table] Add function call syntax support to time-related dynamic functions [flink]

2025-01-10 Thread via GitHub
gustavodemorais commented on PR #25806: URL: https://github.com/apache/flink/pull/25806#issuecomment-2582505543 The reason for the failures are the planner changes I did to try to extend testing. They are not valid, and I'll discard the planner changes. We'll stick to the testDynamicDatetim

Re: [PR] [FLINK-36910][table] Add function call syntax support to time-related dynamic functions [flink]

2025-01-10 Thread via GitHub
gustavodemorais closed pull request #25806: [FLINK-36910][table] Add function call syntax support to time-related dynamic functions URL: https://github.com/apache/flink/pull/25806 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

Re: [PR] [FLINK-36576][runtime] Improving amount-based data balancing distribution algorithm for DefaultVertexParallelismAndInputInfosDecider [flink]

2025-01-10 Thread via GitHub
zhuzhurk commented on code in PR #25552: URL: https://github.com/apache/flink/pull/25552#discussion_r1910075634 ## flink-runtime/src/test/java/org/apache/flink/runtime/scheduler/adaptivebatch/VertexInputInfoComputerTestUtil.java: ## @@ -86,22 +90,55 @@ public static List create

[jira] [Commented] (FLINK-37097) Remove Hive connector from core Flink

2025-01-10 Thread lincoln lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17911962#comment-17911962 ] lincoln lee commented on FLINK-37097: - [~davidradl] We're hoping to see this happen

[PR] [FLINK-37026] Add Stale PR GitHub Action workflow [flink]

2025-01-10 Thread via GitHub
tomncooper opened a new pull request, #25953: URL: https://github.com/apache/flink/pull/25953 ## What is the purpose of the change This is the implementation of the [Stale PR GitHub Action Proposal](https://cwiki.apache.org/confluence/display/FLINK/Stale+PR+Cleanup). This was [voted

Re: [PR] [FLINK-37026] Add Stale PR GitHub Action workflow [flink]

2025-01-10 Thread via GitHub
tomncooper commented on PR #25953: URL: https://github.com/apache/flink/pull/25953#issuecomment-2582840912 cc @gyfora @1996fanrui -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

[jira] [Updated] (FLINK-37026) Enable Stale PR Github Action

2025-01-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-37026: --- Labels: pull-request-available (was: ) > Enable Stale PR Github Action > --

[PR] [FLINK-37090][e2e] Add adaptive broadcast join to e2e tpc-ds tests. [flink]

2025-01-10 Thread via GitHub
SinBex opened a new pull request, #25954: URL: https://github.com/apache/flink/pull/25954 ## What is the purpose of the change Add adaptive broadcast join to e2e tpc-ds tests. In this case, we will set the AdaptiveBroadcastJoinStrategy to RUNTIME_ONLY, significantly increasing

[jira] [Updated] (FLINK-37090) Introduce a TPC-DS E2E case for adaptive broadcast join

2025-01-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-37090: --- Labels: pull-request-available (was: ) > Introduce a TPC-DS E2E case for adaptive broadcast

Re: [PR] [FLINK-37098] Fix selecting time attribute from a view [flink]

2025-01-10 Thread via GitHub
flinkbot commented on PR #25952: URL: https://github.com/apache/flink/pull/25952#issuecomment-2582853024 ## CI report: * fdf0105d32c8a346d9a890411098715bd297ddee UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-37026] Add Stale PR GitHub Action workflow [flink]

2025-01-10 Thread via GitHub
flinkbot commented on PR #25953: URL: https://github.com/apache/flink/pull/25953#issuecomment-2582853276 ## CI report: * 03ee68c53e6523046cbb64f9a2b6d15823edb659 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-37090][e2e] Add adaptive broadcast join to e2e tpc-ds tests. [flink]

2025-01-10 Thread via GitHub
flinkbot commented on PR #25954: URL: https://github.com/apache/flink/pull/25954#issuecomment-2582853466 ## CI report: * 27e503efb6c2fc7742a513cd166399a51312af67 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Commented] (FLINK-37097) Remove Hive connector from core Flink

2025-01-10 Thread david radley (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17911964#comment-17911964 ] david radley commented on FLINK-37097: -- [~Sergey Nuyanzin] it seems that:  - V1 (1

[jira] [Comment Edited] (FLINK-37097) Remove Hive connector from core Flink

2025-01-10 Thread lincoln lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17911962#comment-17911962 ] lincoln lee edited comment on FLINK-37097 at 1/10/25 1:24 PM:

  1   2   3   >