[PR] [FLINK-37332] Support any column as chunk key column (postgres, orcale, db2, sqlserver) #3922 [flink-cdc]

2025-02-20 Thread via GitHub
SML0127 opened a new pull request, #3928: URL: https://github.com/apache/flink-cdc/pull/3928 MySQL CDC connector supports this feature from flink cdc v3.2 Now, other connectors that support incremental snapshot allow any columns as chunk key column apache jira: https://issues.apach

Re: [PR] [FLINK-37236] Bump the flink version from 1.20.0 to 1.20.1 [flink-kubernetes-operator]

2025-02-20 Thread via GitHub
gyfora commented on PR #943: URL: https://github.com/apache/flink-kubernetes-operator/pull/943#issuecomment-2673514124 No changes to the NOTICE file necessary? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Commented] (FLINK-37161) Cross-team verification for "Adaptive skewed join optimization for batch jobs"

2025-02-20 Thread xingbe (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17929029#comment-17929029 ] xingbe commented on FLINK-37161: The above test cases have been sequentially verified.

[jira] [Updated] (FLINK-37322) surport eval groovy scripts udf for flink sql

2025-02-20 Thread tianyuan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tianyuan updated FLINK-37322: - Component/s: Table SQL / API > surport eval groovy scripts udf for flink sql > -

[jira] [Updated] (FLINK-37322) surport eval groovy scripts udf for flink sql

2025-02-20 Thread tianyuan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tianyuan updated FLINK-37322: - Affects Version/s: 2.1.0 > surport eval groovy scripts udf for flink sql > -

Re: [PR] [FLINK-37320] [Observer] FINISHED finite streaming jobs incorrectly being set to RECONCILING [flink-kubernetes-operator]

2025-02-20 Thread via GitHub
gyfora merged PR #944: URL: https://github.com/apache/flink-kubernetes-operator/pull/944 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr

[jira] [Commented] (FLINK-3154) Update Kryo version from 2.24.0 to latest Kryo LTS version

2025-02-20 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-3154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17929032#comment-17929032 ] Gyula Fora commented on FLINK-3154: --- I feel that there is not a very strong consensus h

[jira] [Closed] (FLINK-37320) [Observer] FINISHED finite streaming jobs incorrectly being set to RECONCILING

2025-02-20 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora closed FLINK-37320. -- Fix Version/s: kubernetes-operator-1.11.0 Assignee: Luca Castelli Resolution: Fixed me

[PR] [FLINK-37350][table-planner] Fix memory leak caused by skewed join optimization strategy [flink]

2025-02-20 Thread via GitHub
noorall opened a new pull request, #26180: URL: https://github.com/apache/flink/pull/26180 ## What is the purpose of the change When the AdaptiveBroadcastJoinOptimizationStrategy is in effect, it leads to the statistics in the AdaptiveSkewedJoinOptimizationStrategy to not be r

[jira] [Updated] (FLINK-37350) Memory leak caused by skewed join optimization strategy

2025-02-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-37350: --- Labels: pull-request-available (was: ) > Memory leak caused by skewed join optimization str

Re: [PR] [BP-2.0][FLINK-28047][docs] Remove deprecated StreamExecutionEnvironment#readTextFile method in documentation [flink]

2025-02-20 Thread via GitHub
reswqa merged PR #26164: URL: https://github.com/apache/flink/pull/26164 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache

[jira] [Commented] (FLINK-37356) Recycle use of kafka producer(which commit error) maybe send data without AddPartitionsToTxnRequest

2025-02-20 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928691#comment-17928691 ] Arvid Heise commented on FLINK-37356: - Thank you very much for the detailed analysis

Re: [PR] [FLINK-37350][table-planner] Fix memory leak caused by skewed join optimization strategy [flink]

2025-02-20 Thread via GitHub
JunRuiLee commented on code in PR #26180: URL: https://github.com/apache/flink/pull/26180#discussion_r1963051617 ## flink-runtime/src/main/java/org/apache/flink/runtime/scheduler/adaptivebatch/util/VertexParallelismAndInputInfosDeciderUtils.java: ## @@ -658,4 +660,148 @@ public

Re: [PR] [FLINK-37149][doc] Add documents for adaptive batch execution. [flink]

2025-02-20 Thread via GitHub
JunRuiLee merged PR #26168: URL: https://github.com/apache/flink/pull/26168 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apa

[jira] [Commented] (FLINK-37069) Cross-team verification for "Disaggregated State Management"

2025-02-20 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928718#comment-17928718 ] Zakelly Lan commented on FLINK-37069: - Thanks Weijie! > Cross-team verification for

[jira] [Commented] (FLINK-36549) Using the ignore-parse-errors parameter in Debezium/Canal/Maxwell/Ogg JSON results in unexpected data loss.

2025-02-20 Thread xiaoyu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928717#comment-17928717 ] xiaoyu commented on FLINK-36549: The PRs for versions 1.19 and 1.20 have been created. H

Re: [PR] [FLINK-37327] [Formats (JSON, Avro, Parquet, ORC, SequenceFile)] Debezium Avro Format: Add FormatOption to Optionally Skip emitting UPDATE_BEFORE Rows [flink]

2025-02-20 Thread via GitHub
davidradl commented on code in PR #26159: URL: https://github.com/apache/flink/pull/26159#discussion_r1963417984 ## docs/content.zh/docs/connectors/table/formats/debezium.md: ## @@ -320,6 +320,13 @@ Flink 提供了 `debezium-avro-confluent` 和 `debezium-json` 两种 format 来

Re: [PR] [FLINK-37329][table-planner] Skip Source Stats Collection When table.optimizer.source.report-statistics-enabled is False [flink]

2025-02-20 Thread via GitHub
davidradl commented on code in PR #26162: URL: https://github.com/apache/flink/pull/26162#discussion_r1963420772 ## flink-table/flink-table-planner/src/main/java/org/apache/flink/table/planner/plan/optimize/program/FlinkRecomputeStatisticsProgram.java: ## @@ -115,25 +115,26 @@ p

Re: [PR] [FLINK-36409] Publish some autoscaler metrics during stabilisation period [flink-kubernetes-operator]

2025-02-20 Thread via GitHub
mxm commented on PR #945: URL: https://github.com/apache/flink-kubernetes-operator/pull/945#issuecomment-2671259434 I'm ok with not having flag / config option. I do see that adding the changes under a feature flag is of little use. Plus, we have too many config options already. You will l

Re: [PR] [hotfix] Fix post-release japicmp update script for macOS [flink]

2025-02-20 Thread via GitHub
flinkbot commented on PR #26182: URL: https://github.com/apache/flink/pull/26182#issuecomment-2671276189 ## CI report: * 90fcdf11fa4a9d9933965f4430d7a6c2d3fb182c UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-37336][python] Introduce TablePipeline descriptor to Python Table API [flink]

2025-02-20 Thread via GitHub
davidradl commented on code in PR #26167: URL: https://github.com/apache/flink/pull/26167#discussion_r1963430852 ## flink-python/docs/reference/pyflink.table/catalog.rst: ## @@ -250,3 +250,31 @@ A CatalogDescriptor is a template for creating a catalog instance. It closely re

Re: [PR] [FLINK-37336][python] Introduce TablePipeline descriptor to Python Table API [flink]

2025-02-20 Thread via GitHub
davidradl commented on code in PR #26167: URL: https://github.com/apache/flink/pull/26167#discussion_r1963431910 ## flink-python/docs/reference/pyflink.table/catalog.rst: ## @@ -250,3 +250,31 @@ A CatalogDescriptor is a template for creating a catalog instance. It closely re

Re: [PR] [FLINK-37336][python] Introduce TablePipeline descriptor to Python Table API [flink]

2025-02-20 Thread via GitHub
davidradl commented on code in PR #26167: URL: https://github.com/apache/flink/pull/26167#discussion_r1963432849 ## flink-python/docs/reference/pyflink.table/catalog.rst: ## @@ -250,3 +250,31 @@ A CatalogDescriptor is a template for creating a catalog instance. It closely re

[PR] [FLINK-37359] Use pinned qemu image [flink-kubernetes-operator]

2025-02-20 Thread via GitHub
gyfora opened a new pull request, #946: URL: https://github.com/apache/flink-kubernetes-operator/pull/946 ## Brief change log Use fixed qemu image as new latest seems to be broken ## Verifying this change CI ## Does this pull request potentially affect one of the follo

Re: [PR] [FLINK-37336][python] Introduce TablePipeline descriptor to Python Table API [flink]

2025-02-20 Thread via GitHub
davidradl commented on code in PR #26167: URL: https://github.com/apache/flink/pull/26167#discussion_r1963431910 ## flink-python/docs/reference/pyflink.table/catalog.rst: ## @@ -250,3 +250,31 @@ A CatalogDescriptor is a template for creating a catalog instance. It closely re

Re: [PR] [BP-2.0][FLINK-37149][doc] Add documents for adaptive batch execution. [flink]

2025-02-20 Thread via GitHub
JunRuiLee merged PR #26181: URL: https://github.com/apache/flink/pull/26181 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apa

[PR] [BP-2.0][FLINK-37149][doc] Add documents for adaptive batch execution. [flink]

2025-02-20 Thread via GitHub
JunRuiLee opened a new pull request, #26181: URL: https://github.com/apache/flink/pull/26181 ## What is the purpose of the change [BP-2.0][FLINK-37149][doc] Add documents for adaptive batch execution. ## Brief change log [BP-2.0][FLINK-37149][doc] Add docu

Re: [PR] [FLINK-37350][table-planner] Fix memory leak caused by skewed join optimization strategy [flink]

2025-02-20 Thread via GitHub
JunRuiLee commented on code in PR #26180: URL: https://github.com/apache/flink/pull/26180#discussion_r1963051617 ## flink-runtime/src/main/java/org/apache/flink/runtime/scheduler/adaptivebatch/util/VertexParallelismAndInputInfosDeciderUtils.java: ## @@ -658,4 +660,148 @@ public

[jira] [Created] (FLINK-37359) Docker build fails for Kubernetes operator

2025-02-20 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-37359: -- Summary: Docker build fails for Kubernetes operator Key: FLINK-37359 URL: https://issues.apache.org/jira/browse/FLINK-37359 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-37356) Recycle use of kafka producer(which commit error) maybe send data without AddPartitionsToTxnRequest

2025-02-20 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928706#comment-17928706 ] Hongshun Wang commented on FLINK-37356: --- [~arvid] . The flink log is lost, thus I

Re: [PR] [FLINK-36409] Publish some autoscaler metrics during stabilisation period [flink-kubernetes-operator]

2025-02-20 Thread via GitHub
mxm commented on PR #945: URL: https://github.com/apache/flink-kubernetes-operator/pull/945#issuecomment-2671149679 > I guess Max is under the assumption that the current logic does not collect metrics during the stabilization period. We do collect samples, and once the stabilization is ov

Re: [PR] [FLINK-36409] Publish some autoscaler metrics during stabilisation period [flink-kubernetes-operator]

2025-02-20 Thread via GitHub
mxm commented on code in PR #945: URL: https://github.com/apache/flink-kubernetes-operator/pull/945#discussion_r1963310240 ## flink-autoscaler/src/main/java/org/apache/flink/autoscaler/ScalingMetricCollector.java: ## @@ -149,19 +149,31 @@ public CollectedMetricHistory updateMet

Re: [PR] [FLINK-37350][table-planner] Fix memory leak caused by skewed join optimization strategy [flink]

2025-02-20 Thread via GitHub
JunRuiLee commented on code in PR #26180: URL: https://github.com/apache/flink/pull/26180#discussion_r1963052390 ## flink-runtime/src/main/java/org/apache/flink/runtime/scheduler/adaptivebatch/util/VertexParallelismAndInputInfosDeciderUtils.java: ## @@ -658,4 +660,148 @@ public

Re: [PR] [FLINK-37348][pipeline-paimon] fix paimon ArrayIndexOutOfBoundsException when add column first [flink-cdc]

2025-02-20 Thread via GitHub
MOBIN-F commented on code in PR #3925: URL: https://github.com/apache/flink-cdc/pull/3925#discussion_r1961136374 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-paimon/src/test/java/org/apache/flink/cdc/connectors/paimon/sink/PaimonMetadataApplierTest.jav

Re: [PR] [FLINK-36659] Bump to 2.0-preview1. [flink-connector-jdbc]

2025-02-20 Thread via GitHub
leonardBang commented on code in PR #153: URL: https://github.com/apache/flink-connector-jdbc/pull/153#discussion_r1944348435 ## flink-connector-jdbc-core/src/test/java/org/apache/flink/connector/jdbc/internal/JdbcFullTest.java: ## @@ -106,66 +92,66 @@ void testEnrichedClassCas

Re: [PR] [BP-2.0][FLINK-37149][doc] Add documents for adaptive batch execution. [flink]

2025-02-20 Thread via GitHub
flinkbot commented on PR #26181: URL: https://github.com/apache/flink/pull/26181#issuecomment-2670908708 ## CI report: * f5ea5d1375ce527720ee8be6fd8081f5805535a5 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-35014] SqlNode to operation conversion for models [flink]

2025-02-20 Thread via GitHub
lihaosky commented on code in PR #25834: URL: https://github.com/apache/flink/pull/25834#discussion_r1964599071 ## flink-table/flink-sql-parser/src/main/java/org/apache/flink/sql/parser/ddl/SqlAlterModelReset.java: ## @@ -0,0 +1,76 @@ +/* + * Licensed to the Apache Software Foun

Re: [PR] [FLINK-34467] add lineage integration for jdbc connector [flink-connector-jdbc]

2025-02-20 Thread via GitHub
HuangZhenQiu commented on code in PR #149: URL: https://github.com/apache/flink-connector-jdbc/pull/149#discussion_r1964608069 ## flink-connector-jdbc-db2/src/main/java/org/apache/flink/connector/jdbc/db2/database/lineage/Db2LocationExtractor.java: ## @@ -0,0 +1,50 @@ +/* + * L

Re: [PR] [FLINK-35724][oss] Bump OSS SDK to 3.17.4 [flink]

2025-02-20 Thread via GitHub
JunRuiLee merged PR #26177: URL: https://github.com/apache/flink/pull/26177 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apa

[jira] [Commented] (FLINK-37333) Use ForwardForUnspecifiedPartitioner when adaptive broadcast join takes effect

2025-02-20 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928971#comment-17928971 ] Junrui Lee commented on FLINK-37333: release-2.0 83dc6f4013854ccc5089daf7d9bc0472504

[PR] [BP-2.0][FLINK-35724][oss] Bump OSS SDK to 3.17.4 [flink]

2025-02-20 Thread via GitHub
JunRuiLee opened a new pull request, #26189: URL: https://github.com/apache/flink/pull/26189 (cherry picked from commit 225ef6a2a060bff13530d699d20fb8d5f1f8b7e4) ## What is the purpose of the change [BP-2.0][FLINK-35724][oss] Bump OSS SDK to 3.17.4 -- This is an a

Re: [PR] [FLINK-35936][cdc-connector][paimon] Fix paimon cdc schema evolution failure when restart job [flink-cdc]

2025-02-20 Thread via GitHub
github-actions[bot] closed pull request #3502: [FLINK-35936][cdc-connector][paimon] Fix paimon cdc schema evolution failure when restart job URL: https://github.com/apache/flink-cdc/pull/3502 -- This is an automated message from the Apache Git Service. To respond to the message, please log o

Re: [PR] [FLINK-35936][cdc-connector][paimon] Fix paimon cdc schema evolution failure when restart job [flink-cdc]

2025-02-20 Thread via GitHub
github-actions[bot] commented on PR #3502: URL: https://github.com/apache/flink-cdc/pull/3502#issuecomment-2672990347 This pull request has been closed because it has not had recent activity. You could reopen it if you try to continue your work, and anyone who are interested in it are encou

Re: [PR] [FLINK-35622][runtime] Filter out noisy 'Coordinator of operator xxx does not exist' exceptions in CollectResultFetcher [flink]

2025-02-20 Thread via GitHub
JunRuiLee merged PR #26171: URL: https://github.com/apache/flink/pull/26171 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apa

[jira] [Closed] (FLINK-35622) Filter out noisy "Coordinator of operator xxxx does not exist" exceptions in batch mode

2025-02-20 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee closed FLINK-35622. -- Fix Version/s: 2.0.1 Resolution: Fixed master c92f208f4a074812b5314f2b4858f244b5ecd9fe > Filte

[jira] [Assigned] (FLINK-35622) Filter out noisy "Coordinator of operator xxxx does not exist" exceptions in batch mode

2025-02-20 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee reassigned FLINK-35622: -- Assignee: Biao Geng > Filter out noisy "Coordinator of operator does not exist" exceptio

[jira] [Assigned] (FLINK-37366) Allow configurable retry for Kafka topic metadata fetch

2025-02-20 Thread Shuyi Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyi Chen reassigned FLINK-37366: -- Assignee: Shuyi Chen > Allow configurable retry for Kafka topic metadata fetch >

[jira] [Updated] (FLINK-37357) Migrating SqlNode conversion logic from to SqlNodeConverters

2025-02-20 Thread Hirson Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hirson Zhang updated FLINK-37357: - Summary: Migrating SqlNode conversion logic from to SqlNodeConverters (was: Migrating conversi

[jira] [Updated] (FLINK-37357) Migrating SqlNode conversion logic from SqlNodeToOperationConversion to SqlNodeConverters

2025-02-20 Thread Hirson Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hirson Zhang updated FLINK-37357: - Summary: Migrating SqlNode conversion logic from SqlNodeToOperationConversion to SqlNodeConvert

[jira] [Created] (FLINK-37366) Allow configurable retry for Kafka topic metadata fetch

2025-02-20 Thread Shuyi Chen (Jira)
Shuyi Chen created FLINK-37366: -- Summary: Allow configurable retry for Kafka topic metadata fetch Key: FLINK-37366 URL: https://issues.apache.org/jira/browse/FLINK-37366 Project: Flink Issue Typ

Re: [PR] [BP-2.0][FLINK-35724][oss] Bump OSS SDK to 3.17.4 [flink]

2025-02-20 Thread via GitHub
flinkbot commented on PR #26189: URL: https://github.com/apache/flink/pull/26189#issuecomment-2673252457 ## CI report: * 3f24b40dd73221a2ac8790e2ce9fdf93d7e316e9 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-37120][cdc-connector] Add ending split chunk first to avoid TaskManager oom [flink-cdc]

2025-02-20 Thread via GitHub
beryllw commented on code in PR #3856: URL: https://github.com/apache/flink-cdc/pull/3856#discussion_r1964738198 ## flink-cdc-connect/flink-cdc-source-connectors/flink-cdc-base/src/main/java/org/apache/flink/cdc/connectors/base/source/assigner/splitter/JdbcSourceChunkSplitter.java:

Re: [PR] [FLINK-37120][cdc-connector] Add ending split chunk first to avoid TaskManager oom [flink-cdc]

2025-02-20 Thread via GitHub
beryllw commented on code in PR #3856: URL: https://github.com/apache/flink-cdc/pull/3856#discussion_r1964738198 ## flink-cdc-connect/flink-cdc-source-connectors/flink-cdc-base/src/main/java/org/apache/flink/cdc/connectors/base/source/assigner/splitter/JdbcSourceChunkSplitter.java:

Re: [PR] [FLINK-37329][table-planner] Skip Source Stats Collection When table.optimizer.source.report-statistics-enabled is False [flink]

2025-02-20 Thread via GitHub
shameersss1 commented on PR #26162: URL: https://github.com/apache/flink/pull/26162#issuecomment-2673427565 @davidradl - I have addressed your comments. Could you please review the same ? -- This is an automated message from the Apache Git Service. To respond to the message, please log o

Re: [PR] [FLINK-37332] Support any column as chunk key column (postgres, orcale, db2, sqlserver) [flink-cdc]

2025-02-20 Thread via GitHub
SML0127 commented on PR #3922: URL: https://github.com/apache/flink-cdc/pull/3922#issuecomment-2673458269 > cc @lvyanquan I recently changed my laptop and some environment seems to have become a bit messed up..🥲 I'll make a new PR. -- This is an automated message from the Apache

Re: [PR] [FLINK-37332] Support any column as chunk key column (postgres, orcale, db2, sqlserver) [flink-cdc]

2025-02-20 Thread via GitHub
SML0127 closed pull request #3922: [FLINK-37332] Support any column as chunk key column (postgres, orcale, db2, sqlserver) URL: https://github.com/apache/flink-cdc/pull/3922 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] [FLINK-36409] Publish some autoscaler metrics during stabilisation period [flink-kubernetes-operator]

2025-02-20 Thread via GitHub
morhidi merged PR #945: URL: https://github.com/apache/flink-kubernetes-operator/pull/945 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubsc

Re: [PR] [FLINK-37120][cdc-connector] Add ending split chunk first to avoid TaskManager oom [flink-cdc]

2025-02-20 Thread via GitHub
beryllw commented on code in PR #3856: URL: https://github.com/apache/flink-cdc/pull/3856#discussion_r1964751251 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-mysql/src/main/java/org/apache/flink/cdc/connectors/mysql/source/MySqlDataSourceOptions.java:

Re: [PR] [FLINK-37120][cdc-connector] Add ending split chunk first to avoid TaskManager oom [flink-cdc]

2025-02-20 Thread via GitHub
leonardBang commented on code in PR #3856: URL: https://github.com/apache/flink-cdc/pull/3856#discussion_r1964761727 ## flink-cdc-connect/flink-cdc-source-connectors/flink-cdc-base/src/main/java/org/apache/flink/cdc/connectors/base/source/assigner/splitter/JdbcSourceChunkSplitter.java:

Re: [PR] [FLINK-37120][cdc-connector] Add ending split chunk first to avoid TaskManager oom [flink-cdc]

2025-02-20 Thread via GitHub
leonardBang commented on code in PR #3856: URL: https://github.com/apache/flink-cdc/pull/3856#discussion_r1964756149 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-mysql/src/main/java/org/apache/flink/cdc/connectors/mysql/source/MySqlDataSourceOptions.ja

Re: [PR] [FLINK-37120][cdc-connector] Add ending split chunk first to avoid TaskManager oom [flink-cdc]

2025-02-20 Thread via GitHub
beryllw commented on code in PR #3856: URL: https://github.com/apache/flink-cdc/pull/3856#discussion_r1964738198 ## flink-cdc-connect/flink-cdc-source-connectors/flink-cdc-base/src/main/java/org/apache/flink/cdc/connectors/base/source/assigner/splitter/JdbcSourceChunkSplitter.java:

Re: [PR] [FLINK-37313] Fix the problem of reading binlog before the high and low watermarks during the snapshot process [flink-cdc]

2025-02-20 Thread via GitHub
gongzexin closed pull request #3920: [FLINK-37313] Fix the problem of reading binlog before the high and low watermarks during the snapshot process URL: https://github.com/apache/flink-cdc/pull/3920 -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [PR] [FLINK-37313] Fix the problem of reading binlog before the high and low watermarks during the snapshot process [flink-cdc]

2025-02-20 Thread via GitHub
gongzexin commented on PR #3920: URL: https://github.com/apache/flink-cdc/pull/3920#issuecomment-2673182080 > Hi, @gongzexin. > > I think that the problem that you met was resolved in #3902 as [#3902 (comment)](https://github.com/apache/flink-cdc/pull/3902#issuecomment-2639121416) de

Re: [PR] [FLINK-35360] support Flink cdc pipeline Yarn application mode [flink-cdc]

2025-02-20 Thread via GitHub
joyCurry30 commented on PR #3643: URL: https://github.com/apache/flink-cdc/pull/3643#issuecomment-2673185291 Could you please add a document, like this: https://github.com/apache/flink-cdc/blob/master/docs/content.zh/docs/deployment/yarn.md ? -- This is an automated message from the Apac

Re: [PR] [FLINK-37120][cdc-connector] Add ending split chunk first to avoid TaskManager oom [flink-cdc]

2025-02-20 Thread via GitHub
leonardBang commented on code in PR #3856: URL: https://github.com/apache/flink-cdc/pull/3856#discussion_r1964634199 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-mysql/src/main/java/org/apache/flink/cdc/connectors/mysql/source/MySqlDataSourceOptions.ja

Re: [PR] [FLINK-37332] Support any column as chunk key column (postgres, orcale, db2, sqlserver) [flink-cdc]

2025-02-20 Thread via GitHub
gtk96 commented on PR #3922: URL: https://github.com/apache/flink-cdc/pull/3922#issuecomment-2673187886 cc @lvyanquan -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

Re: [PR] [FLINK-37333][runtime] Use ForwardForUnspecifiedPartitioner when adaptive broadcast join takes effect [flink]

2025-02-20 Thread via GitHub
JunRuiLee merged PR #26178: URL: https://github.com/apache/flink/pull/26178 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apa

[jira] [Closed] (FLINK-37149) Add Adaptive Batch Execution Documentation

2025-02-20 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee closed FLINK-37149. -- Resolution: Done master 1c759337fd9eef2bcf482ae173d0d45355213565 release-2.0 63e1bfbbae1ff43b150fbc0ec

Re: [PR] [FLINK-37336][python] Introduce TablePipeline descriptor to Python Table API [flink]

2025-02-20 Thread via GitHub
davidradl commented on code in PR #26167: URL: https://github.com/apache/flink/pull/26167#discussion_r1963468045 ## flink-python/pyflink/table/table.py: ## @@ -1077,6 +1078,91 @@ def explain(self, *extra_details: ExplainDetail) -> str: j_extra_details = to_j_explain_det

Re: [PR] [hotfix] Fix post-release japicmp update script for macOS [flink]

2025-02-20 Thread via GitHub
flinkbot commented on PR #26183: URL: https://github.com/apache/flink/pull/26183#issuecomment-2671340643 ## CI report: * 00795756ff864f9783d6ce8e38c3d99213845493 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-37361) Update japicmp configuration post 1.19.2

2025-02-20 Thread Alexander Fedulov (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Fedulov updated FLINK-37361: -- Fix Version/s: 1.19.3 > Update japicmp configuration post 1.19.2 > ---

[jira] [Updated] (FLINK-37360) Update japicmp configuration post 1.20.1

2025-02-20 Thread Alexander Fedulov (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Fedulov updated FLINK-37360: -- Fix Version/s: 1.20.2 > Update japicmp configuration post 1.20.1 > ---

[jira] [Updated] (FLINK-37361) Update japicmp configuration post 1.19.2

2025-02-20 Thread Alexander Fedulov (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Fedulov updated FLINK-37361: -- Affects Version/s: 1.19.1 (was: 1.20.2) > Update japicmp co

[jira] [Created] (FLINK-37361) Update japicmp configuration post 1.19.2

2025-02-20 Thread Alexander Fedulov (Jira)
Alexander Fedulov created FLINK-37361: - Summary: Update japicmp configuration post 1.19.2 Key: FLINK-37361 URL: https://issues.apache.org/jira/browse/FLINK-37361 Project: Flink Issue Type

[jira] [Updated] (FLINK-37360) Update japicmp configuration post 1.20.1

2025-02-20 Thread Alexander Fedulov (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Fedulov updated FLINK-37360: -- Affects Version/s: 1.20.1 (was: 1.20.2) > Update japicmp co

[jira] [Updated] (FLINK-37361) Update japicmp configuration post 1.19.2

2025-02-20 Thread Alexander Fedulov (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Fedulov updated FLINK-37361: -- Affects Version/s: 1.19.2 (was: 1.19.1) > Update japicmp co

[jira] [Created] (FLINK-37360) Update japicmp configuration post 1.20.1

2025-02-20 Thread Alexander Fedulov (Jira)
Alexander Fedulov created FLINK-37360: - Summary: Update japicmp configuration post 1.20.1 Key: FLINK-37360 URL: https://issues.apache.org/jira/browse/FLINK-37360 Project: Flink Issue Type

Re: [PR] [FLINK-37336][python] Introduce TablePipeline descriptor to Python Table API [flink]

2025-02-20 Thread via GitHub
davidradl commented on code in PR #26167: URL: https://github.com/apache/flink/pull/26167#discussion_r1963481246 ## flink-python/pyflink/table/table_pipeline.py: ## @@ -0,0 +1,78 @@ + +# Licensed to

[jira] [Comment Edited] (FLINK-37356) Recycle use of kafka producer(which commit error) maybe send data without AddPartitionsToTxnRequest

2025-02-20 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928771#comment-17928771 ] Hongshun Wang edited comment on FLINK-37356 at 2/20/25 12:28 PM: -

Re: [PR] [FLINK-37336][python] Introduce TablePipeline descriptor to Python Table API [flink]

2025-02-20 Thread via GitHub
davidradl commented on code in PR #26167: URL: https://github.com/apache/flink/pull/26167#discussion_r1963476837 ## flink-python/pyflink/table/table_pipeline.py: ## @@ -0,0 +1,78 @@ + +# Licensed to

[jira] [Updated] (FLINK-37361) Update japicmp configuration post 1.19.2

2025-02-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-37361: --- Labels: pull-request-available (was: ) > Update japicmp configuration post 1.19.2 > ---

[PR] [FLINK-37361][release] Update japicmp configuration post 1.19.2 [flink]

2025-02-20 Thread via GitHub
afedulov opened a new pull request, #26185: URL: https://github.com/apache/flink/pull/26185 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-m

[jira] [Commented] (FLINK-37356) Recycle use of kafka producer(which commit error) maybe send data without AddPartitionsToTxnRequest

2025-02-20 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928771#comment-17928771 ] Hongshun Wang commented on FLINK-37356: --- [~arvid] just do it. I'd like to see your

[jira] [Updated] (FLINK-37360) Update japicmp configuration post 1.20.1

2025-02-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-37360: --- Labels: pull-request-available (was: ) > Update japicmp configuration post 1.20.1 > ---

Re: [PR] [FLINK-37359] Pin qemu image to 7.0.0 [flink-kubernetes-operator]

2025-02-20 Thread via GitHub
gyfora merged PR #946: URL: https://github.com/apache/flink-kubernetes-operator/pull/946 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr

[jira] [Created] (FLINK-37362) PolardbxCharsetITCase test has timed out after 60 minutes

2025-02-20 Thread Leonard Xu (Jira)
Leonard Xu created FLINK-37362: -- Summary: PolardbxCharsetITCase test has timed out after 60 minutes Key: FLINK-37362 URL: https://issues.apache.org/jira/browse/FLINK-37362 Project: Flink Issue T

[jira] [Closed] (FLINK-37359) Docker build fails for Kubernetes operator

2025-02-20 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora closed FLINK-37359. -- Fix Version/s: kubernetes-operator-1.11.0 Resolution: Fixed merged to main 3a2cfdd916c475ee1ccb

[jira] [Created] (FLINK-37363) Remove confusing and duplicated state.backend.type config from state SQL connector

2025-02-20 Thread Gabor Somogyi (Jira)
Gabor Somogyi created FLINK-37363: - Summary: Remove confusing and duplicated state.backend.type config from state SQL connector Key: FLINK-37363 URL: https://issues.apache.org/jira/browse/FLINK-37363

Re: [PR] [FLINK-37152][build] Update Flink version to 1.20 [flink-cdc]

2025-02-20 Thread via GitHub
leonardBang commented on PR #3868: URL: https://github.com/apache/flink-cdc/pull/3868#issuecomment-2671490111 Failed case tracked via https://issues.apache.org/jira/browse/FLINK-37362 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G

Re: [PR] [FLINK-37120][cdc-connector] Add ending split chunk first to avoid TaskManager oom [flink-cdc]

2025-02-20 Thread via GitHub
beryllw commented on code in PR #3856: URL: https://github.com/apache/flink-cdc/pull/3856#discussion_r1963566316 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-mysql/src/main/java/org/apache/flink/cdc/connectors/mysql/source/MySqlDataSourceOptions.java:

Re: [PR] [FLINK-37336][python] Introduce TablePipeline descriptor to Python Table API [flink]

2025-02-20 Thread via GitHub
davidradl commented on code in PR #26167: URL: https://github.com/apache/flink/pull/26167#discussion_r1963448829 ## flink-python/pyflink/table/catalog.py: ## @@ -1391,3 +1391,87 @@ def of(catalog_name: str, configuration: Configuration, comment: str = None): j_catalog_

[jira] [Comment Edited] (FLINK-37356) Recycle use of kafka producer(which commit error) maybe send data without AddPartitionsToTxnRequest

2025-02-20 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928771#comment-17928771 ] Hongshun Wang edited comment on FLINK-37356 at 2/20/25 12:27 PM: -

Re: [PR] [FLINK-37120][cdc-connector] Add ending split chunk first to avoid TaskManager oom [flink-cdc]

2025-02-20 Thread via GitHub
leonardBang commented on code in PR #3856: URL: https://github.com/apache/flink-cdc/pull/3856#discussion_r1963519196 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-mysql/src/main/java/org/apache/flink/cdc/connectors/mysql/source/MySqlDataSourceOptions.ja

Re: [PR] [FLINK-36900] Migrate from conda to uv for managing Python environments [flink-connector-shared-utils]

2025-02-20 Thread via GitHub
autophagy commented on code in PR #43: URL: https://github.com/apache/flink-connector-shared-utils/pull/43#discussion_r1963579142 ## python/lint-python.sh: ## @@ -377,73 +375,62 @@ function install_environment() { print_function "STAGE" "installing environment" loca

Re: [PR] [FLINK-36594][hive]HiveCatalog should set HiveConf.hiveSiteLocation back [flink]

2025-02-20 Thread via GitHub
slankka commented on PR #25568: URL: https://github.com/apache/flink/pull/25568#issuecomment-2671535475 closed in favor of https://github.com/apache/flink-connector-hive/pull/32 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [PR] [FLINK-36594][hive]HiveCatalog should set HiveConf.hiveSiteLocation back [flink]

2025-02-20 Thread via GitHub
slankka closed pull request #25568: [FLINK-36594][hive]HiveCatalog should set HiveConf.hiveSiteLocation back URL: https://github.com/apache/flink/pull/25568 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] [FLINK-37336][python] Introduce TablePipeline descriptor to Python Table API [flink]

2025-02-20 Thread via GitHub
davidradl commented on code in PR #26167: URL: https://github.com/apache/flink/pull/26167#discussion_r1963472704 ## flink-python/pyflink/table/table.py: ## @@ -1077,6 +1078,91 @@ def explain(self, *extra_details: ExplainDetail) -> str: j_extra_details = to_j_explain_det

Re: [PR] [FLINK-37336][python] Introduce TablePipeline descriptor to Python Table API [flink]

2025-02-20 Thread via GitHub
davidradl commented on code in PR #26167: URL: https://github.com/apache/flink/pull/26167#discussion_r1963465316 ## flink-python/pyflink/table/table.py: ## @@ -1077,6 +1078,91 @@ def explain(self, *extra_details: ExplainDetail) -> str: j_extra_details = to_j_explain_det

Re: [PR] [FLINK-37336][python] Introduce TablePipeline descriptor to Python Table API [flink]

2025-02-20 Thread via GitHub
davidradl commented on code in PR #26167: URL: https://github.com/apache/flink/pull/26167#discussion_r1963472704 ## flink-python/pyflink/table/table.py: ## @@ -1077,6 +1078,91 @@ def explain(self, *extra_details: ExplainDetail) -> str: j_extra_details = to_j_explain_det

Re: [PR] [FLINK-37336][python] Introduce TablePipeline descriptor to Python Table API [flink]

2025-02-20 Thread via GitHub
davidradl commented on code in PR #26167: URL: https://github.com/apache/flink/pull/26167#discussion_r1963443638 ## flink-python/pyflink/table/catalog.py: ## @@ -1391,3 +1391,87 @@ def of(catalog_name: str, configuration: Configuration, comment: str = None): j_catalog_

  1   2   >