[jira] [Updated] (FLINK-37265) document of python elasticsearch connector exeample has a mistake

2025-02-05 Thread Zhang Hechuan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhang Hechuan updated FLINK-37265: -- Affects Version/s: 2.0-preview > document of python elasticsearch connector exeample has a mis

Re: [PR] [FLINK-37253] Add state size in application status and deployment metrics [flink-kubernetes-operator]

2025-02-05 Thread via GitHub
gyfora commented on PR #941: URL: https://github.com/apache/flink-kubernetes-operator/pull/941#issuecomment-2637299649 Have you tested this in a (local) kubernetes env with different Flink versions? Does it work as expected? -- This is an automated message from the Apache Git Service. To

Re: [PR] [hotfix][table-planner] Use equals instead of '==' to compare digests in FlinkCalcMergeRule [flink]

2025-02-05 Thread via GitHub
flinkbot commented on PR #26110: URL: https://github.com/apache/flink/pull/26110#issuecomment-2636958644 ## CI report: * 97a5490876835d22ce72b1942fa1c9e748976810 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-37253] Add state size in application status and deployment metrics [flink-kubernetes-operator]

2025-02-05 Thread via GitHub
gyfora commented on code in PR #941: URL: https://github.com/apache/flink-kubernetes-operator/pull/941#discussion_r1943007081 ## flink-kubernetes-operator/src/main/java/org/apache/flink/kubernetes/operator/utils/FlinkUtils.java: ## @@ -403,6 +403,28 @@ public static Long calcu

Re: [PR] [hotfix][table-planner] Use equals instead of '==' to compare digests in FlinkCalcMergeRule [flink]

2025-02-05 Thread via GitHub
lincoln-lil commented on PR #26110: URL: https://github.com/apache/flink/pull/26110#issuecomment-2636954144 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

Re: [PR] [FLINK-37253] Add state size in application status and deployment metrics [flink-kubernetes-operator]

2025-02-05 Thread via GitHub
gyfora commented on code in PR #941: URL: https://github.com/apache/flink-kubernetes-operator/pull/941#discussion_r1943005634 ## flink-kubernetes-operator/src/main/java/org/apache/flink/kubernetes/operator/service/AbstractFlinkService.java: ## @@ -757,16 +778,35 @@ public Map g

Re: [PR] [FLINK-37253] Add state size in application status and deployment metrics [flink-kubernetes-operator]

2025-02-05 Thread via GitHub
gyfora commented on code in PR #941: URL: https://github.com/apache/flink-kubernetes-operator/pull/941#discussion_r1943008300 ## flink-kubernetes-operator/src/main/java/org/apache/flink/kubernetes/operator/utils/FlinkUtils.java: ## @@ -403,6 +403,28 @@ public static Long calcu

[PR] [FLINK-37258][Runtime/Dispatcher] Return Ordered Job list on Disptacher#requestMultipleJobDetails [flink]

2025-02-05 Thread via GitHub
vahmed-hamdy opened a new pull request, #26111: URL: https://github.com/apache/flink/pull/26111 ## What is the purpose of the change *(For example: This pull request makes task deployment go through the blob server, rather than through RPC. That way we avoid re-transfe

[jira] [Updated] (FLINK-37258) Order Flink Job list in Flink UI with start time

2025-02-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-37258: --- Labels: pull-request-available (was: ) > Order Flink Job list in Flink UI with start time >

Re: [PR] [FLINK-37253] Add state size in application status and deployment metrics [flink-kubernetes-operator]

2025-02-05 Thread via GitHub
gyfora commented on code in PR #941: URL: https://github.com/apache/flink-kubernetes-operator/pull/941#discussion_r1943183369 ## flink-kubernetes-operator/src/main/java/org/apache/flink/kubernetes/operator/service/AbstractFlinkService.java: ## @@ -757,16 +778,35 @@ public Map g

Re: [PR] [FLINK-37258][runtime] Return Ordered Job list on Disptacher#requestMultipleJobDetails [flink]

2025-02-05 Thread via GitHub
vahmed-hamdy commented on code in PR #26111: URL: https://github.com/apache/flink/pull/26111#discussion_r1943418379 ## flink-runtime/src/test/java/org/apache/flink/runtime/dispatcher/DispatcherTest.java: ## @@ -1225,7 +1257,16 @@ public void testOverridingJobVertexParallelisms()

Re: [PR] [FLINK-34227][runtime] Ensure that the scheduler close call doesn't leak IO threads into the JobMaster [flink]

2025-02-05 Thread via GitHub
XComp commented on PR #26095: URL: https://github.com/apache/flink/pull/26095#issuecomment-2637379727 Created FLINK-37259 to cover [CI failure](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=65800) -- This is an automated message from the Ap

Re: [PR] [FLINK-34227][runtime] Ensure that the scheduler close call doesn't leak IO threads into the JobMaster [flink]

2025-02-05 Thread via GitHub
XComp commented on PR #26095: URL: https://github.com/apache/flink/pull/26095#issuecomment-2637380110 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [FLINK-37258][runtime] Return Ordered Job list on Disptacher#requestMultipleJobDetails [flink]

2025-02-05 Thread via GitHub
davidradl commented on code in PR #26111: URL: https://github.com/apache/flink/pull/26111#discussion_r1943263854 ## flink-runtime/src/test/java/org/apache/flink/runtime/dispatcher/DispatcherTest.java: ## @@ -1225,7 +1257,16 @@ public void testOverridingJobVertexParallelisms() th

Re: [PR] [FLINK-37253] Add state size in application status and deployment metrics [flink-kubernetes-operator]

2025-02-05 Thread via GitHub
gyfora commented on code in PR #941: URL: https://github.com/apache/flink-kubernetes-operator/pull/941#discussion_r1943177167 ## flink-kubernetes-operator/src/main/java/org/apache/flink/kubernetes/operator/utils/FlinkUtils.java: ## @@ -403,6 +403,28 @@ public static Long calcu

Re: [PR] [FLINK-37005][table] Make StreamExecDeduplicate ouput insert only where possible [flink]

2025-02-05 Thread via GitHub
pnowojski commented on PR #26051: URL: https://github.com/apache/flink/pull/26051#issuecomment-2637506032 @Zakelly / @xuyangzhong I'm struggling with some failures in tests. `DeduplicateITCase#testFirstRowOnRowtime` fails for mini batch in a very weird way. ``` [ERROR] Run 3: Dedup

[jira] [Updated] (FLINK-37258) Order Flink Job list in Flink UI with start time

2025-02-05 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl updated FLINK-37258: -- Affects Version/s: 2.0.0 > Order Flink Job list in Flink UI with start time >

[jira] [Updated] (FLINK-37258) Order Flink Job list in Flink UI with start time

2025-02-05 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl updated FLINK-37258: -- Affects Version/s: 1.20.0 > Order Flink Job list in Flink UI with start time > ---

Re: [PR] [FLINK-36932][metrics] Added resource-level metrics for different states/statuses [flink-kubernetes-operator]

2025-02-05 Thread via GitHub
gyfora commented on PR #926: URL: https://github.com/apache/flink-kubernetes-operator/pull/926#issuecomment-2637293777 I am wondering if this is a good use of the metric system in Flink. We are introducing an explosion of new metrics and we are using a large number of gauges to represent E

Re: [PR] [FLINK-37258][runtime] Return Ordered Job list on Disptacher#requestMultipleJobDetails [flink]

2025-02-05 Thread via GitHub
vahmed-hamdy commented on code in PR #26111: URL: https://github.com/apache/flink/pull/26111#discussion_r1943227152 ## flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/Dispatcher.java: ## @@ -878,8 +879,12 @@ public CompletableFuture requestMultipleJobDetails(Dur

[jira] [Updated] (FLINK-37260) Change MySQL Connector address

2025-02-05 Thread 911432 (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 911432 updated FLINK-37260: --- Description: I think " If “MySQL Connector Java” is 8.0.x, there won’t be any major problems. [https://night

[jira] [Resolved] (FLINK-37251) Add download link for pipeline connector.

2025-02-05 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu resolved FLINK-37251. Resolution: Implemented Implemented via master: 8d54be65c01a07c73b361a744b76cf51e4760027 > Add do

[jira] [Updated] (FLINK-37251) Add download link for pipeline connector.

2025-02-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-37251: --- Labels: pull-request-available (was: ) > Add download link for pipeline connector. > -

[jira] [Assigned] (FLINK-37251) Add download link for pipeline connector.

2025-02-05 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reassigned FLINK-37251: -- Assignee: Yanquan Lv > Add download link for pipeline connector. > -

Re: [PR] [FLINK-37251][docs] add Download Page in overview.md for Pipeline connectors. [flink-cdc]

2025-02-05 Thread via GitHub
leonardBang merged PR #3900: URL: https://github.com/apache/flink-cdc/pull/3900 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink

[jira] [Closed] (FLINK-37192) [pyflink] Replace deprecated avro-python3 with avro

2025-02-05 Thread Dian Fu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dian Fu closed FLINK-37192. --- Fix Version/s: 2.0.0 Release Note: (was: [pyflink] Replace deprecated avro-python3 with avro) R

[jira] [Updated] (FLINK-37192) Replace deprecated avro-python3 with avro

2025-02-05 Thread Dian Fu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dian Fu updated FLINK-37192: Summary: Replace deprecated avro-python3 with avro (was: [pyflink] Replace deprecated avro-python3 with a

[jira] [Assigned] (FLINK-37192) [pyflink] Replace deprecated avro-python3 with avro

2025-02-05 Thread Dian Fu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dian Fu reassigned FLINK-37192: --- Assignee: Mina Asham > [pyflink] Replace deprecated avro-python3 with avro > --

Re: [PR] [FLINK-37087][doc] Add docs for alter materialized table as query [flink]

2025-02-05 Thread via GitHub
lsyldliu commented on code in PR #26064: URL: https://github.com/apache/flink/pull/26064#discussion_r1943961810 ## docs/content/docs/dev/table/materialized-table/statements.md: ## @@ -326,6 +328,69 @@ ALTER MATERIALIZED TABLE my_materialized_table REFRESH PARTITION (ds='2024-06

Re: [PR] [FLINK-37192] [pyflink] Replace deprecated avro-python3 with avro [flink]

2025-02-05 Thread via GitHub
dianfu commented on PR #26008: URL: https://github.com/apache/flink/pull/26008#issuecomment-2638415603 Merged to master via https://github.com/apache/flink/commit/aef8c868545d70b743ee5cf29e17489f8a3bd848 -- This is an automated message from the Apache Git Service. To respond to the messag

Re: [PR] [FLINK-37192] [pyflink] Replace deprecated avro-python3 with avro [flink]

2025-02-05 Thread via GitHub
dianfu closed pull request #26008: [FLINK-37192] [pyflink] Replace deprecated avro-python3 with avro URL: https://github.com/apache/flink/pull/26008 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[jira] [Assigned] (FLINK-37254) Flink CDC OceanBase Connector Throws Exception for Column Default Value ‘DEFAULT ‘0’

2025-02-05 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reassigned FLINK-37254: -- Assignee: He Wang > Flink CDC OceanBase Connector Throws Exception for Column Default Value

Re: [PR] [FLINK-37187][doc] Add doc for Submitting Refresh Job of Materialized Table to Yarn/K8s [flink]

2025-02-05 Thread via GitHub
lsyldliu commented on code in PR #26073: URL: https://github.com/apache/flink/pull/26073#discussion_r1944013609 ## docs/content.zh/docs/dev/table/materialized-table/deployment.md: ## @@ -0,0 +1,220 @@ +--- +title: 部署 +weight: 3 +type: docs +aliases: +- /dev/table/materialized-ta

[jira] [Assigned] (FLINK-37252) Align Chinese document of Postgres CDC Connector with English document

2025-02-05 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reassigned FLINK-37252: -- Assignee: Yanquan Lv > Align Chinese document of Postgres CDC Connector with English document

Re: [PR] [FLINK-34729][docs] Translate "Core Concept" Pages of Flink CDC into Chinese Documentation. [flink-cdc]

2025-02-05 Thread via GitHub
leonardBang merged PR #3901: URL: https://github.com/apache/flink-cdc/pull/3901 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink

[jira] [Updated] (FLINK-34729) "Core Concept" Pages for Flink CDC Chinese Documentation

2025-02-05 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu updated FLINK-34729: --- Fix Version/s: cdc-3.4.0 > "Core Concept" Pages for Flink CDC Chinese Documentation > --

[jira] [Resolved] (FLINK-34729) "Core Concept" Pages for Flink CDC Chinese Documentation

2025-02-05 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu resolved FLINK-34729. Resolution: Resolved Resolved via master: d1d334d13a18a58b6997caaef35c764bc2ca13d6 > "Core Concep

[jira] [Updated] (FLINK-34729) "Core Concept" Pages for Flink CDC Chinese Documentation

2025-02-05 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu updated FLINK-34729: --- Affects Version/s: cdc-3.3.0 > "Core Concept" Pages for Flink CDC Chinese Documentation > --

[jira] [Resolved] (FLINK-37252) Align Chinese document of Postgres CDC Connector with English document

2025-02-05 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu resolved FLINK-37252. Resolution: Fixed Fixed via master: 1fa762dd632dfa8cf52bbe491e2e42ce44860e38 > Align Chinese docu

Re: [PR] [FLINK-36997] Add Log4j JSONTemplateLayout to flink-dist [flink]

2025-02-05 Thread via GitHub
ryanvanhuuksloot commented on PR #25888: URL: https://github.com/apache/flink/pull/25888#issuecomment-2638686440 @davidradl Do you know any committer we could get to merge this? We'd love it to be merged in 2.0 -- This is an automated message from the Apache Git Service. To respond to the

Re: [PR] [FLINK-37252][doc] Align Chinese document of Postgres CDC Connector with English document. [flink-cdc]

2025-02-05 Thread via GitHub
leonardBang merged PR #3903: URL: https://github.com/apache/flink-cdc/pull/3903 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink

[jira] [Updated] (FLINK-37261) Provide JSON series functions in YAML pipeline

2025-02-05 Thread JunboWang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JunboWang updated FLINK-37261: -- Description: It is reasonable to expect some functions like `JSON_VALUE(numeric[, string])`, JSON_EXI

Re: [PR] [FLINK-37224] Add the missing documents and parameters of MongoDB CDC. [flink-cdc]

2025-02-05 Thread via GitHub
leonardBang merged PR #3895: URL: https://github.com/apache/flink-cdc/pull/3895 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink

[jira] [Assigned] (FLINK-37224) Add the missing content of MongoDB CDC to the Chinese document.

2025-02-05 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reassigned FLINK-37224: -- Assignee: Yanquan Lv > Add the missing content of MongoDB CDC to the Chinese document. >

[jira] [Resolved] (FLINK-37224) Add the missing content of MongoDB CDC to the Chinese document.

2025-02-05 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu resolved FLINK-37224. Resolution: Resolved Resolved via master: 6aeb5e8c9fb2a59b46adc3bf2349a59e9deac2f7 > Add the miss

[jira] [Updated] (FLINK-37231) Add doc for newly added source metric statistics

2025-02-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-37231: --- Labels: pull-request-available (was: ) > Add doc for newly added source metric statistics >

Re: [PR] [FLINK-37231] Add doc for Source metrics. [flink-cdc]

2025-02-05 Thread via GitHub
leonardBang commented on code in PR #3897: URL: https://github.com/apache/flink-cdc/pull/3897#discussion_r1944020399 ## docs/content.zh/docs/connectors/pipeline-connectors/mysql.md: ## @@ -343,6 +343,25 @@ source: # ... ``` +### 可用的指标 + +指标系统能够帮助了解分片分发的进展, 下面列举出了支持的 Flink

Re: [PR] [FLINK-37231] Add doc for Source metrics. [flink-cdc]

2025-02-05 Thread via GitHub
leonardBang commented on code in PR #3897: URL: https://github.com/apache/flink-cdc/pull/3897#discussion_r1944021017 ## docs/content.zh/docs/connectors/pipeline-connectors/mysql.md: ## @@ -343,6 +343,25 @@ source: # ... ``` +### 可用的指标 + +指标系统能够帮助了解分片分发的进展, 下面列举出了支持的 Flink

Re: [PR] [hotfix][table-planner] Use equals instead of '==' to compare digests in FlinkCalcMergeRule [flink]

2025-02-05 Thread via GitHub
lincoln-lil merged PR #26110: URL: https://github.com/apache/flink/pull/26110 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.a

[jira] [Created] (FLINK-37262) MySQL CDC connector could not configure the `scan.parse.online.schema.changes.enabled` option

2025-02-05 Thread yux (Jira)
yux created FLINK-37262: --- Summary: MySQL CDC connector could not configure the `scan.parse.online.schema.changes.enabled` option Key: FLINK-37262 URL: https://issues.apache.org/jira/browse/FLINK-37262 Project:

[jira] [Commented] (FLINK-37262) MySQL CDC connector could not configure the `scan.parse.online.schema.changes.enabled` option

2025-02-05 Thread yux (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17924366#comment-17924366 ] yux commented on FLINK-37262: - I'll prepare a fix for this ticket. > MySQL CDC connector co

Re: [PR] [FLINK-37163] Add documents for recently merged PRs in FlinkCDC 3.3. [flink-cdc]

2025-02-05 Thread via GitHub
lvyanquan closed pull request #3872: [FLINK-37163] Add documents for recently merged PRs in FlinkCDC 3.3. URL: https://github.com/apache/flink-cdc/pull/3872 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] [FLINK-37163] Add documents for recently merged PRs in FlinkCDC 3.3. [flink-cdc]

2025-02-05 Thread via GitHub
lvyanquan commented on PR #3872: URL: https://github.com/apache/flink-cdc/pull/3872#issuecomment-2638714059 closed by https://github.com/apache/flink-cdc/pull/3899. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

[jira] [Closed] (FLINK-35495) The native metrics for column family are not reported

2025-02-05 Thread Yanfei Lei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanfei Lei closed FLINK-35495. -- Resolution: Not A Problem > The native metrics for column family are not reported > --

[jira] [Commented] (FLINK-35687) JSON_QUERY should return a well formatted nested objects/arrays for ARRAY

2025-02-05 Thread macdoor615 (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17924353#comment-17924353 ] macdoor615 commented on FLINK-35687: [~dwysakowicz] I applied this PR to branch rele

[jira] [Closed] (FLINK-37163) Add documents for recently merged PRs in FlinkCDC 3.3

2025-02-05 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu closed FLINK-37163. -- Resolution: Fixed > Add documents for recently merged PRs in FlinkCDC 3.3 > --

Re: [PR] [FLINK-37191][mysql] Avoid back filling if the lowWatermark of BinlogSplit is equal to highWatermark. [flink-cdc]

2025-02-05 Thread via GitHub
yuxiqian commented on code in PR #3902: URL: https://github.com/apache/flink-cdc/pull/3902#discussion_r1944038007 ## flink-cdc-connect/flink-cdc-source-connectors/flink-connector-mysql-cdc/src/main/java/org/apache/flink/cdc/connectors/mysql/source/offset/BinlogOffset.java: ##

Re: [PR] [FLINK-37231] Add doc for Source metrics. [flink-cdc]

2025-02-05 Thread via GitHub
lvyanquan commented on code in PR #3897: URL: https://github.com/apache/flink-cdc/pull/3897#discussion_r1944036837 ## docs/content.zh/docs/connectors/pipeline-connectors/mysql.md: ## @@ -343,6 +343,25 @@ source: # ... ``` +### 可用的指标 + +指标系统能够帮助了解分片分发的进展, 下面列举出了支持的 Flink 指标

Re: [PR] [FLINK-37191][mysql] Avoid back filling if the lowWatermark of BinlogSplit is equal to highWatermark. [flink-cdc]

2025-02-05 Thread via GitHub
yuxiqian commented on PR #3902: URL: https://github.com/apache/flink-cdc/pull/3902#issuecomment-2638736051 Seems `testBinlogOffsetCompareWithSnapshotAndBinlogPhase` is failing due to this change. DataStream migration test is irrelevant, and should be fixed in #3884. -- This is an automat

Re: [PR] [FLINK-37191][mysql] Avoid back filling if the lowWatermark of BinlogSplit is equal to highWatermark. [flink-cdc]

2025-02-05 Thread via GitHub
yuxiqian commented on code in PR #3902: URL: https://github.com/apache/flink-cdc/pull/3902#discussion_r1944038007 ## flink-cdc-connect/flink-cdc-source-connectors/flink-connector-mysql-cdc/src/main/java/org/apache/flink/cdc/connectors/mysql/source/offset/BinlogOffset.java: ##

Re: [PR] [BP-2.0][FLINK-37218][network] Avoid repeatedly reading the broadcast buffer from the sort-merge shuffle data file while accumulating small buffers from multiple sub-partitions. [flink]

2025-02-05 Thread via GitHub
JunRuiLee merged PR #26078: URL: https://github.com/apache/flink/pull/26078 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apa

[jira] [Commented] (FLINK-37218) Avoid repeatedly reading the broadcast buffer from the sort-merge shuffle data file while accumulating small buffers from multiple sub-partitions.

2025-02-05 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17924356#comment-17924356 ] Junrui Lee commented on FLINK-37218: release-2.0:4e2bc4d05ffc2911c0347cc0c7ec306

Re: [PR] [hotfix][table-planner] Use equals instead of '==' to compare digests in FlinkCalcMergeRule [flink]

2025-02-05 Thread via GitHub
lincoln-lil commented on PR #26110: URL: https://github.com/apache/flink/pull/26110#issuecomment-2638374908 > Please could we have a test case for this change. @davidradl I did try to add a case(see #26108), but it doesn't actually affect the optimization results(this is also the reas

Re: [PR] [FLINK-37163] Add documents for recently merged PRs in FlinkCDC 3.3. [flink-cdc]

2025-02-05 Thread via GitHub
leonardBang commented on PR #3872: URL: https://github.com/apache/flink-cdc/pull/3872#issuecomment-2638658606 A rebase action is required @lvyanquan -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Created] (FLINK-37260) Change MySQL Connector address

2025-02-05 Thread 911432 (Jira)
911432 created FLINK-37260: -- Summary: Change MySQL Connector address Key: FLINK-37260 URL: https://issues.apache.org/jira/browse/FLINK-37260 Project: Flink Issue Type: Improvement Componen

[PR] [hotfix][license] Update legacy license [flink-cdc]

2025-02-05 Thread via GitHub
Shawn-Hx opened a new pull request, #3908: URL: https://github.com/apache/flink-cdc/pull/3908 License of some files need to be updated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[jira] [Created] (FLINK-37261) Provide JSON series functions in YAML pipeline

2025-02-05 Thread JunboWang (Jira)
JunboWang created FLINK-37261: - Summary: Provide JSON series functions in YAML pipeline Key: FLINK-37261 URL: https://issues.apache.org/jira/browse/FLINK-37261 Project: Flink Issue Type: Improvem

[PR] [hotfix][ci] Use raise to fix uncaught throw [flink-cdc]

2025-02-05 Thread via GitHub
whhe opened a new pull request, #3909: URL: https://github.com/apache/flink-cdc/pull/3909 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mai

Re: [PR] [hotfix][table-planner] Use equals instead of '==' to compare digests in FlinkCalcMergeRule [flink]

2025-02-05 Thread via GitHub
lincoln-lil commented on PR #26110: URL: https://github.com/apache/flink/pull/26110#issuecomment-2638376868 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

Re: [PR] [hotfix][Connector/JDBC] Remove unnecessary update fields of PostgreSQL upsert statement [flink-connector-jdbc]

2025-02-05 Thread via GitHub
leonardBang commented on code in PR #155: URL: https://github.com/apache/flink-connector-jdbc/pull/155#discussion_r1944150943 ## flink-connector-jdbc-postgres/src/main/java/org/apache/flink/connector/jdbc/postgres/database/dialect/PostgresDialect.java: ## @@ -73,8 +74,10 @@ pub

[jira] [Resolved] (FLINK-37231) Add doc for newly added source metric statistics

2025-02-05 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu resolved FLINK-37231. Resolution: Fixed via master: 7717779ebff3d5900c3adcd06bc860949d543f97 > Add doc for newly added

[jira] [Assigned] (FLINK-37231) Add doc for newly added source metric statistics

2025-02-05 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reassigned FLINK-37231: -- Assignee: Yanquan Lv > Add doc for newly added source metric statistics > ---

Re: [PR] [FLINK-37231] Add doc for Source metrics. [flink-cdc]

2025-02-05 Thread via GitHub
leonardBang merged PR #3897: URL: https://github.com/apache/flink-cdc/pull/3897 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink

[PR] [FLINK-37262][connect/mysql] Fix missing `PARSE_ONLINE_SCHEMA_CHANGES` option in the config manifest [flink-cdc]

2025-02-05 Thread via GitHub
yuxiqian opened a new pull request, #3910: URL: https://github.com/apache/flink-cdc/pull/3910 This closes FLINK-37262 by adding `PARSE_ONLINE_SCHEMA_CHANGES` into optional configs list. -- This is an automated message from the Apache Git Service. To respond to the message, please log on t

[jira] [Updated] (FLINK-37262) MySQL CDC connector could not configure the `scan.parse.online.schema.changes.enabled` option

2025-02-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-37262: --- Labels: pull-request-available (was: ) > MySQL CDC connector could not configure the > `sc

[jira] [Commented] (FLINK-35687) JSON_QUERY should return a well formatted nested objects/arrays for ARRAY

2025-02-05 Thread Dawid Wysakowicz (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17924038#comment-17924038 ] Dawid Wysakowicz commented on FLINK-35687: -- True, it's been fixed in 2.0. I thi

[jira] [Updated] (FLINK-37257) Add an API on keyedStream to allow users to customize the hash method from key to parallelism.

2025-02-05 Thread Jinkun Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinkun Liu updated FLINK-37257: --- Description: When the number of keys is small, the existing hashing method can cause severe state s

[jira] [Created] (FLINK-37257) Add an API on keyedStream to allow users to customize the hash method from key to parallelism.

2025-02-05 Thread Jinkun Liu (Jira)
Jinkun Liu created FLINK-37257: -- Summary: Add an API on keyedStream to allow users to customize the hash method from key to parallelism. Key: FLINK-37257 URL: https://issues.apache.org/jira/browse/FLINK-37257

[jira] [Created] (FLINK-37258) Order Flink Job list in Flink UI with start time

2025-02-05 Thread Ahmed Hamdy (Jira)
Ahmed Hamdy created FLINK-37258: --- Summary: Order Flink Job list in Flink UI with start time Key: FLINK-37258 URL: https://issues.apache.org/jira/browse/FLINK-37258 Project: Flink Issue Type: Im

[PR] [FLINK-35687] JSON_QUERY should return a well formatted nested objects/arrays for ARRAY (#24976) [flink]

2025-02-05 Thread via GitHub
dawidwys opened a new pull request, #26109: URL: https://github.com/apache/flink/pull/26109 backport of https://github.com/apache/flink/commit/90508a00bb310d26f9be245098cda9192647ab14 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] [hotfix][table-planner] Use equals instead of '==' to compare digests in FlinkCalcMergeRule [flink]

2025-02-05 Thread via GitHub
lincoln-lil commented on PR #26108: URL: https://github.com/apache/flink/pull/26108#issuecomment-2636785898 @snuyanzin Could you help look at this minor fix? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

Re: [PR] [hotfix][table-planner] Use equals instead of '==' to compare digests in FlinkCalcMergeRule [flink]

2025-02-05 Thread via GitHub
snuyanzin commented on PR #26108: URL: https://github.com/apache/flink/pull/26108#issuecomment-2636851063 should we have a backport to 2.0? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

Re: [PR] [FLINK-32097][Connectors/Kinesis] Implement support for Kinesis deaggregation [flink-connector-aws]

2025-02-05 Thread via GitHub
Lzgpom commented on PR #188: URL: https://github.com/apache/flink-connector-aws/pull/188#issuecomment-2636857333 @hlteoh37 could you take a look? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] [FLINK-35687] JSON_QUERY should return a well formatted nested objects/arrays for ARRAY (#24976) [flink]

2025-02-05 Thread via GitHub
flinkbot commented on PR #26109: URL: https://github.com/apache/flink/pull/26109#issuecomment-2636715909 ## CI report: * 67999fc38cba18c4573e6e5b4687beb7be0204de UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Resolved] (FLINK-37222) Table planner exception when sql client submit job

2025-02-05 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan resolved FLINK-37222. - Fix Version/s: 2.0.0 Assignee: Dawid Wysakowicz Resolution: Fixed > Table planne

[jira] [Updated] (FLINK-37257) Add an API on keyedStream to allow users to customize the hash method from key to parallelism.

2025-02-05 Thread Jinkun Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinkun Liu updated FLINK-37257: --- Description: When the number of keys is small, the existing hashing method can cause severe state s

Re: [PR] [hotfix][table-planner] Use equals instead of '==' to compare digests in FlinkCalcMergeRule [flink]

2025-02-05 Thread via GitHub
lincoln-lil commented on PR #26108: URL: https://github.com/apache/flink/pull/26108#issuecomment-263688 > should we have a backport to 2.0? I think so, will create a backport pr soon. -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [PR] [hotfix][table-planner] Use equals instead of '==' to compare digests in FlinkCalcMergeRule [flink]

2025-02-05 Thread via GitHub
lincoln-lil merged PR #26108: URL: https://github.com/apache/flink/pull/26108 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.a

[PR] [hotfix][table-planner] Use equals instead of '==' to compare digests in FlinkCalcMergeRule [flink]

2025-02-05 Thread via GitHub
lincoln-lil opened a new pull request, #26110: URL: https://github.com/apache/flink/pull/26110 This is a backport pr of #26108 to 2.0 branch -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

Re: [PR] [hotfix][table-planner] Use equals instead of '==' to compare digests in FlinkCalcMergeRule [flink]

2025-02-05 Thread via GitHub
lincoln-lil commented on PR #26108: URL: https://github.com/apache/flink/pull/26108#issuecomment-2636914745 @snuyanzin Thanks for reviewing this! Backport pr #26110 to 2.0 branch has been created. -- This is an automated message from the Apache Git Service. To respond to the message, ple

Re: [PR] [FLINK-37236] Flink 2.0 preview support [flink-kubernetes-operator]

2025-02-05 Thread via GitHub
gyfora merged PR #938: URL: https://github.com/apache/flink-kubernetes-operator/pull/938 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr

[jira] [Closed] (FLINK-37221) Apply FLIP-406 to Kubernetes Operator

2025-02-05 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora closed FLINK-37221. -- Resolution: Fixed > Apply FLIP-406 to Kubernetes Operator > - > >

[jira] [Commented] (FLINK-37236) Make Flink operator compatible with 2.0 preview

2025-02-05 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17924081#comment-17924081 ] Gyula Fora commented on FLINK-37236: merged to main d6e20e22ff832abe644eee91d520238b

[jira] [Updated] (FLINK-37221) Apply FLIP-406 to Kubernetes Operator

2025-02-05 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora updated FLINK-37221: --- Affects Version/s: kubernetes-operator-1.11.0 (was: 1.20.0)

[jira] [Closed] (FLINK-37236) Make Flink operator compatible with 2.0 preview

2025-02-05 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora closed FLINK-37236. -- Fix Version/s: kubernetes-operator-1.11.0 Resolution: Fixed > Make Flink operator compatible wi

<    1   2