Re: [PR] [FLINK-37348][pipeline-paimon] fix paimon ArrayIndexOutOfBoundsException when add column first [flink-cdc]

2025-02-18 Thread via GitHub
MOBIN-F commented on code in PR #3925: URL: https://github.com/apache/flink-cdc/pull/3925#discussion_r1961136374 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-paimon/src/test/java/org/apache/flink/cdc/connectors/paimon/sink/PaimonMetadataApplierTest.jav

Re: [PR] [FLINK-35599] Introduce JDBC pipeline sink connector [flink-cdc]

2025-02-18 Thread via GitHub
Mrart commented on PR #3916: URL: https://github.com/apache/flink-cdc/pull/3916#issuecomment-2667786041 Why not integrate with flink-cdc-connector?It has implemented pgsql/orcale/mysql. -- This is an automated message from the Apache Git Service. To respond to the message, please log on t

Re: [PR] [FLINK-37348][pipeline-paimon] fix paimon ArrayIndexOutOfBoundsException when add column first [flink-cdc]

2025-02-18 Thread via GitHub
lvyanquan commented on code in PR #3925: URL: https://github.com/apache/flink-cdc/pull/3925#discussion_r1961126616 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-paimon/src/test/java/org/apache/flink/cdc/connectors/paimon/sink/PaimonMetadataApplierTest.j

Re: [PR] [FLINK-37348][pipeline-paimon] fix paimon ArrayIndexOutOfBoundsException when add column first [flink-cdc]

2025-02-18 Thread via GitHub
MOBIN-F commented on code in PR #3925: URL: https://github.com/apache/flink-cdc/pull/3925#discussion_r1961119229 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-paimon/src/test/java/org/apache/flink/cdc/connectors/paimon/sink/PaimonMetadataApplierTest.jav

Re: [PR] [FLINK-37348][pipeline-paimon] fix paimon ArrayIndexOutOfBoundsException when add column first [flink-cdc]

2025-02-18 Thread via GitHub
lvyanquan commented on code in PR #3925: URL: https://github.com/apache/flink-cdc/pull/3925#discussion_r1961112111 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-paimon/src/test/java/org/apache/flink/cdc/connectors/paimon/sink/PaimonMetadataApplierTest.j

Re: [PR] [FLINK-35360] support Flink cdc pipeline Yarn application mode [flink-cdc]

2025-02-18 Thread via GitHub
Mrart commented on code in PR #3643: URL: https://github.com/apache/flink-cdc/pull/3643#discussion_r1961103490 ## flink-cdc-composer/pom.xml: ## @@ -61,6 +61,12 @@ limitations under the License. flink-kubernetes ${flink.version} + +

Re: [PR] [BP-2.0][FLINK-37335][state/forst] Handle the first full checkpoint for ForSt IncrementalSnapshotStrategy. [flink]

2025-02-18 Thread via GitHub
flinkbot commented on PR #26176: URL: https://github.com/apache/flink/pull/26176#issuecomment-2667721635 ## CI report: * b0f3d9134edd14af7052d852c4717386146ebb5f UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Created] (FLINK-37350) Memory leak caused by skewed join optimization strategy

2025-02-18 Thread Lei Yang (Jira)
Lei Yang created FLINK-37350: Summary: Memory leak caused by skewed join optimization strategy Key: FLINK-37350 URL: https://issues.apache.org/jira/browse/FLINK-37350 Project: Flink Issue Type: B

[PR] [BP-2.0][FLINK-37335][state/forst] Handle the first full checkpoint for ForSt IncrementalSnapshotStrategy. [flink]

2025-02-18 Thread via GitHub
AlexYinHan opened a new pull request, #26176: URL: https://github.com/apache/flink/pull/26176 ## What is the purpose of the change Fix the case when ForSt encounters the first full checkpoint with IncrementalCheckpoint is enabled. ## Brief change log - `

Re: [PR] [FLINK-37204] Add missing StarRocks connector options for 1.2.10. [flink-cdc]

2025-02-18 Thread via GitHub
lvyanquan commented on code in PR #3883: URL: https://github.com/apache/flink-cdc/pull/3883#discussion_r1961069924 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-starrocks/src/main/java/org/apache/flink/cdc/connectors/starrocks/sink/StarRocksDataSinkOpti

Re: [PR] [FLINK-37204] Add missing StarRocks connector options for 1.2.10. [flink-cdc]

2025-02-18 Thread via GitHub
lvyanquan commented on code in PR #3883: URL: https://github.com/apache/flink-cdc/pull/3883#discussion_r1961067067 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-starrocks/src/main/java/org/apache/flink/cdc/connectors/starrocks/sink/StarRocksDataSinkFact

Re: [PR] [FLINK-36549][formats] Fix using the ignore-parse-errors parameter in Debezium/Canal/Maxwell/Ogg JSON results in unexpected data loss [flink]

2025-02-18 Thread via GitHub
xiaoyu19950911 commented on PR #26172: URL: https://github.com/apache/flink/pull/26172#issuecomment-2667674623 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Comment Edited] (FLINK-37073) Cross-team verification for "Adaptive optimization for batch jobs"

2025-02-18 Thread Yi Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17927892#comment-17927892 ] Yi Zhang edited comment on FLINK-37073 at 2/19/25 6:59 AM: --- Ve

[jira] [Closed] (FLINK-36253) Wordcount on Docker test failed due to mismatch output hash

2025-02-18 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo closed FLINK-36253. -- Resolution: Invalid > Wordcount on Docker test failed due to mismatch output hash > --

[jira] [Created] (FLINK-37349) Add timeout for test case that call waitForSinkSize method to avoid Infinite waiting

2025-02-18 Thread Yanquan Lv (Jira)
Yanquan Lv created FLINK-37349: -- Summary: Add timeout for test case that call waitForSinkSize method to avoid Infinite waiting Key: FLINK-37349 URL: https://issues.apache.org/jira/browse/FLINK-37349 Pro

[jira] [Updated] (FLINK-37348) [pipeline-paimon]fix paimon ArrayIndexOutOfBoundsException when add column before first_column

2025-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-37348: --- Labels: pull-request-available (was: ) > [pipeline-paimon]fix paimon ArrayIndexOutOfBoundsE

[PR] [FLINK-37348][pipeline-paimon] fix paimon ArrayIndexOutOfBoundsException when add column first [flink-cdc]

2025-02-18 Thread via GitHub
MOBIN-F opened a new pull request, #3925: URL: https://github.com/apache/flink-cdc/pull/3925 Repeat step: 1. ALTER TABLE table_name add COLUMN new_first_column bigint first 2. throw ArrayIndexOutOfBoundsException(Because the [add column first] event will be converted into an [add colu

[jira] [Created] (FLINK-37348) [pipeline-paimon]fix paimon ArrayIndexOutOfBoundsException when add column before first_column

2025-02-18 Thread MOBIN (Jira)
MOBIN created FLINK-37348: - Summary: [pipeline-paimon]fix paimon ArrayIndexOutOfBoundsException when add column before first_column Key: FLINK-37348 URL: https://issues.apache.org/jira/browse/FLINK-37348 Proj

[jira] [Commented] (FLINK-37254) Flink CDC OceanBase Connector Throws Exception for Column Default Value ‘DEFAULT ‘0’

2025-02-18 Thread caixiaowei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928280#comment-17928280 ] caixiaowei commented on FLINK-37254: Hello, may I ask when this bug will be fixed?

[jira] [Updated] (FLINK-35900) PyFlink: update version of Apache Beam dependency

2025-02-18 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song updated FLINK-35900: - Issue Type: Improvement (was: Bug) > PyFlink: update version of Apache Beam dependency > --

[jira] [Updated] (FLINK-35900) PyFlink: update version of Apache Beam dependency

2025-02-18 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song updated FLINK-35900: - Priority: Major (was: Blocker) > PyFlink: update version of Apache Beam dependency > --

[jira] [Closed] (FLINK-36867) flink on k8s operator could not create TM

2025-02-18 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-36867. Resolution: Invalid > flink on k8s operator could not create TM >

[jira] [Updated] (FLINK-35810) OOM in AsyncWaitOperatorTest.testProcessingTimeRepeatedCompleteUnorderedWithRetry

2025-02-18 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song updated FLINK-35810: - Fix Version/s: 2.0.0 > OOM in > AsyncWaitOperatorTest.testProcessingTimeRepeatedCompleteUnorder

[jira] [Assigned] (FLINK-37335) ForSt fails to generate the first checkpoint in IncrementalCP and NO_CLAIM mode.

2025-02-18 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song reassigned FLINK-37335: Assignee: Han Yin > ForSt fails to generate the first checkpoint in IncrementalCP and NO_

[jira] [Updated] (FLINK-35810) OOM in AsyncWaitOperatorTest.testProcessingTimeRepeatedCompleteUnorderedWithRetry

2025-02-18 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song updated FLINK-35810: - Affects Version/s: (was: 2.0.0) (was: 2.1.0) > OOM in > AsyncWai

[jira] [Commented] (FLINK-37073) Cross-team verification for "Adaptive optimization for batch jobs"

2025-02-18 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928271#comment-17928271 ] Junrui Lee commented on FLINK-37073: Thanks [~yizh] for verification~ > Cross-team

[jira] [Closed] (FLINK-37073) Cross-team verification for "Adaptive optimization for batch jobs"

2025-02-18 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee closed FLINK-37073. -- Resolution: Done > Cross-team verification for "Adaptive optimization for batch jobs" > --

Re: [PR] [FLINK-37320] [Observer] FINISHED finite streaming jobs incorrectly being set to RECONCILING [flink-kubernetes-operator]

2025-02-18 Thread via GitHub
gyfora commented on code in PR #944: URL: https://github.com/apache/flink-kubernetes-operator/pull/944#discussion_r1960993002 ## flink-kubernetes-operator/src/main/java/org/apache/flink/kubernetes/operator/observer/deployment/AbstractFlinkDeploymentObserver.java: ## @@ -152,7 +

[jira] [Commented] (FLINK-37044) Support connectors and formats as plugins

2025-02-18 Thread Karan Makhija (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928266#comment-17928266 ] Karan Makhija commented on FLINK-37044: --- Thank you. I will check it out. > Suppor

[PR] [FLINK-36203][Connectors/DynamoDB] Added polling delay between empty polls in getRecords calls [flink-connector-aws]

2025-02-18 Thread via GitHub
gguptp opened a new pull request, #190: URL: https://github.com/apache/flink-connector-aws/pull/190 ## Purpose of the change DDB Streams customers are charged on number of getrecords calls and given the connector maintains a queue of shards and if a task manager has only a

[jira] [Updated] (FLINK-36203) Have some way to control the polling frequency of GetRecords from SplitFetcher

2025-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36203: --- Labels: pull-request-available (was: ) > Have some way to control the polling frequency of

Re: [PR] [hotfix][runtime] Remove the unused SchedulerBase#transitionToScheduled method [flink]

2025-02-18 Thread via GitHub
flinkbot commented on PR #26175: URL: https://github.com/apache/flink/pull/26175#issuecomment-2667467529 ## CI report: * f1ea6361313af6844927811cb7f18be3cc1e9e0f UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-37332] Support any column as chunk key column (postgres, orcale, db2, sqlserver) [flink-cdc]

2025-02-18 Thread via GitHub
SML0127 commented on PR #3922: URL: https://github.com/apache/flink-cdc/pull/3922#issuecomment-2667460016 > I suggest separating the pull requests for code and documentation to avoid the term 'snapshot' appearing in the documents. The pull request for the documentation can be merged after t

[PR] [FLINK-37347][DOCS] Support any column as chunk key column (postgres, orcale, db2, sqlserver) [flink-cdc]

2025-02-18 Thread via GitHub
SML0127 opened a new pull request, #3924: URL: https://github.com/apache/flink-cdc/pull/3924 updates documentation for https://github.com/apache/flink-cdc/pull/3922 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

[jira] [Updated] (FLINK-37347) [docs ]Support any columns as chunk key column (postgres, orcale, db2, sqlserver)

2025-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-37347: --- Labels: pull-request-available (was: ) > [docs ]Support any columns as chunk key column (po

Re: [PR] [FLINK-35810][test] increase unittest Xmx to debug FLINK-35810 [flink]

2025-02-18 Thread via GitHub
flinkbot commented on PR #26174: URL: https://github.com/apache/flink/pull/26174#issuecomment-2667454792 ## CI report: * daaed1ed67dd8afea067c3dca689dca13a3ef611 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[PR] [hotfix][runtime] Remove the unused SchedulerBase#transitionToScheduled method [flink]

2025-02-18 Thread via GitHub
RocMarshal opened a new pull request, #26175: URL: https://github.com/apache/flink/pull/26175 ## What is the purpose of the change [hotfix][runtime] Remove the unused SchedulerBase#transitionToScheduled method ## Brief change log [hotfix][runtime] Rem

[jira] [Created] (FLINK-37347) [docs ]Support any columns as chunk key column (postgres, orcale, db2, sqlserver)

2025-02-18 Thread Lee SeungMin (Jira)
Lee SeungMin created FLINK-37347: Summary: [docs ]Support any columns as chunk key column (postgres, orcale, db2, sqlserver) Key: FLINK-37347 URL: https://issues.apache.org/jira/browse/FLINK-37347 Pro

[jira] [Updated] (FLINK-35810) AsyncWaitOperatorTest.testProcessingTimeRepeatedCompleteUnorderedWithRetry fails

2025-02-18 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-35810: --- Priority: Blocker (was: Critical) > AsyncWaitOperatorTest.testProcessingTimeRepeatedCompleteUnorder

[jira] [Updated] (FLINK-36290) OutOfMemoryError in connect test run

2025-02-18 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-36290: --- Priority: Critical (was: Blocker) > OutOfMemoryError in connect test run >

[jira] [Updated] (FLINK-35810) OOM in AsyncWaitOperatorTest.testProcessingTimeRepeatedCompleteUnorderedWithRetry

2025-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35810: --- Labels: pull-request-available test-stability (was: test-stability) > OOM in > AsyncWaitOp

[PR] [FLINK-35810][test] increase unittest Xmx to debug FLINK-35810 [flink]

2025-02-18 Thread via GitHub
reswqa opened a new pull request, #26174: URL: https://github.com/apache/flink/pull/26174 I download the heap dump file in failed build. But don't find any suspicious leak objects. Slightly increase the memory limit to help troubleshoot this problem. -- This is an automated message

[jira] [Updated] (FLINK-35810) OOM in AsyncWaitOperatorTest.testProcessingTimeRepeatedCompleteUnorderedWithRetry

2025-02-18 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-35810: --- Summary: OOM in AsyncWaitOperatorTest.testProcessingTimeRepeatedCompleteUnorderedWithRetry (was:

[jira] [Assigned] (FLINK-35810) OOM in AsyncWaitOperatorTest.testProcessingTimeRepeatedCompleteUnorderedWithRetry

2025-02-18 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo reassigned FLINK-35810: -- Assignee: Weijie Guo > OOM in > AsyncWaitOperatorTest.testProcessingTimeRepeatedCompleteUnor

[jira] [Updated] (FLINK-35810) AsyncWaitOperatorTest.testProcessingTimeRepeatedCompleteUnorderedWithRetry fails

2025-02-18 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-35810: --- Description: AsyncWaitOperatorTest.testProcessingTimeRepeatedCompleteUnorderedWithRetry fails   [h

[jira] [Commented] (FLINK-36290) OutOfMemoryError in connect test run

2025-02-18 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928252#comment-17928252 ] Weijie Guo commented on FLINK-36290: Downgrade to critical due to lack of recurrence

[jira] [Updated] (FLINK-35810) AsyncWaitOperatorTest.testProcessingTimeRepeatedCompleteUnorderedWithRetry fails

2025-02-18 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-35810: --- Affects Version/s: 2.0.0 2.1.0 > AsyncWaitOperatorTest.testProcessingTimeRepe

[jira] [Commented] (FLINK-33463) Support the implementation of dynamic source tables based on the new source

2025-02-18 Thread RocMarshal (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928251#comment-17928251 ] RocMarshal commented on FLINK-33463: Hi, [~kunni] Thanks for your attention on it.

[jira] [Commented] (FLINK-37334) Fix mysql's add column after event becomes add column last

2025-02-18 Thread MOBIN (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928248#comment-17928248 ] MOBIN commented on FLINK-37334: --- sorry,because I used old version, closed > Fix mysql's a

[jira] [Closed] (FLINK-37334) Fix mysql's add column after event becomes add column last

2025-02-18 Thread MOBIN (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MOBIN closed FLINK-37334. - Resolution: Not A Bug > Fix mysql's add column after event becomes add column last > ---

[jira] [Created] (FLINK-37346) [CI] Unit Tests (mysql) / compile_and_test (8, generic) (pull_request)Failing after 60m

2025-02-18 Thread Yanquan Lv (Jira)
Yanquan Lv created FLINK-37346: -- Summary: [CI] Unit Tests (mysql) / compile_and_test (8, generic) (pull_request)Failing after 60m Key: FLINK-37346 URL: https://issues.apache.org/jira/browse/FLINK-37346 P

[jira] [Commented] (FLINK-37346) [CI] Unit Tests (mysql) / compile_and_test (8, generic) (pull_request)Failing after 60m

2025-02-18 Thread Yanquan Lv (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928246#comment-17928246 ] Yanquan Lv commented on FLINK-37346: I'm trying to find out the cause. > [CI] Unit

[jira] [Commented] (FLINK-37313) [BUG] MySQL snapshot read phase is unresponsive for a long time (even up to several hours)

2025-02-18 Thread Yanquan Lv (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928241#comment-17928241 ] Yanquan Lv commented on FLINK-37313: Hi, [~zexin]. could you check that whether [ht

Re: [PR] [FLINK-37313] Fix the problem of reading binlog before the high and low watermarks during the snapshot process [flink-cdc]

2025-02-18 Thread via GitHub
lvyanquan commented on PR #3920: URL: https://github.com/apache/flink-cdc/pull/3920#issuecomment-2667375370 Hi, @gongzexin. I think that the problem that you met was resolved in https://github.com/apache/flink-cdc/pull/3902 as https://github.com/apache/flink-cdc/pull/3902#issuecommen

Re: [PR] [FLINK-37333][runtime] Use ForwardForUnspecifiedPartitioner when adaptive broadcast join takes effect. [flink]

2025-02-18 Thread via GitHub
zhuzhurk commented on code in PR #26163: URL: https://github.com/apache/flink/pull/26163#discussion_r1960865281 ## flink-table/flink-table-runtime/src/main/java/org/apache/flink/table/runtime/strategy/AdaptiveBroadcastJoinOptimizationStrategy.java: ## @@ -162,7 +162,22 @@ protec

Re: [PR] [FLINK-37152][build] Update Flink version to 1.20 [flink-cdc]

2025-02-18 Thread via GitHub
lvyanquan commented on PR #3868: URL: https://github.com/apache/flink-cdc/pull/3868#issuecomment-2667370988 > Well, exchanged the `mongodb7` failure to a `mysql` one.. :) Will check on it tomorrow I think that the failure of mysql is unrelated to the change here, because this error a

[jira] [Resolved] (FLINK-37201) FlinkCDC Pipeline transform arithmetic functions support parameters of null and more numerical types.

2025-02-18 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu resolved FLINK-37201. Resolution: Implemented Implemented via master: 83ae36a854ffe37b5ea16a9cb0494b8651123f02 > FlinkC

[jira] [Updated] (FLINK-37201) FlinkCDC Pipeline transform arithmetic functions support parameters of null and more numerical types.

2025-02-18 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu updated FLINK-37201: --- Fix Version/s: cdc-3.4.0 > FlinkCDC Pipeline transform arithmetic functions support parameters of nu

Re: [PR] [FLINK-37201] [cdc] [transform] FlinkCDC Pipeline transform arithmetic functions support parameters of null and more numerical types [flink-cdc]

2025-02-18 Thread via GitHub
leonardBang merged PR #3881: URL: https://github.com/apache/flink-cdc/pull/3881 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink

[jira] [Commented] (FLINK-36998) The RowKind of data about globalUpsertResult is different in KeyedUpsertingSinkFunction while being inserted or being restored

2025-02-18 Thread lincoln lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928230#comment-17928230 ] lincoln lee commented on FLINK-36998: - Fixed in 2.0: bbfbe33f6bc265af3264774bc4600b8

Re: [PR] [FLINK-36998][table-planner] Keep same behavior about the RowKind of data in globalUpsertResult for KeyedUpsertingSinkFunction while being inserted or being restore [flink]

2025-02-18 Thread via GitHub
lincoln-lil merged PR #26169: URL: https://github.com/apache/flink/pull/26169 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.a

[jira] [Updated] (FLINK-36409) Publish some autoscaler metrics during stabilisation period

2025-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36409: --- Labels: pull-request-available (was: ) > Publish some autoscaler metrics during stabilisati

[PR] [FLINK-36409] Publish some autoscaler metrics during stabilisation period [flink-kubernetes-operator]

2025-02-18 Thread via GitHub
morhidi opened a new pull request, #945: URL: https://github.com/apache/flink-kubernetes-operator/pull/945 ## What is the purpose of the change Currently autoscaler metrics although collected are not published during stabilization period. We report metrics after the stabilization peri

Re: [PR] [FLINK-36009] Architecture tests fixes [flink-connector-jdbc]

2025-02-18 Thread via GitHub
eskabetxe closed pull request #140: [FLINK-36009] Architecture tests fixes URL: https://github.com/apache/flink-connector-jdbc/pull/140 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Re: [PR] [FLINK-36086] [Sqlserver] Fix Sqlserver restart during one transaction [flink-cdc]

2025-02-18 Thread via GitHub
morozov commented on PR #3873: URL: https://github.com/apache/flink-cdc/pull/3873#issuecomment-2666875989 I read more about the semantics of `InputStatus`, and I think the current logic is good. Please validate my understanding below. There are three possible value of the status: 1

Re: [PR] [FLINK-36585][connector / common] SplitFetcherManager.close() should not chain runnables to the element queue future in a tight loop. [flink]

2025-02-18 Thread via GitHub
becketqin commented on PR #25569: URL: https://github.com/apache/flink/pull/25569#issuecomment-2666553880 @PatrickRen @tomncooper Thanks for the review and sorry for the late reply. I just returned to work from vacation. I updated the patch to fix the checkstyle failure. Will merge the patc

Re: [PR] [FLINK-37152][build] Update Flink version to 1.20 [flink-cdc]

2025-02-18 Thread via GitHub
ferenc-csaky commented on PR #3868: URL: https://github.com/apache/flink-cdc/pull/3868#issuecomment-2666506471 Well, exchanged the `mongodb7` failure to a `mysql` one.. :) Will check on it tomorrow -- This is an automated message from the Apache Git Service. To respond to the message, ple

Re: [PR] [FLINK-30371] Fix the problem of JdbcOutputFormat database connection leak [flink-connector-jdbc]

2025-02-18 Thread via GitHub
KevDi commented on PR #75: URL: https://github.com/apache/flink-connector-jdbc/pull/75#issuecomment-2666504445 @fapaul i can try to take a look at it tomorrow. Question would be if it is still enough to do the fix like i provided it here or if the solution from @tamirsagi here https://git

[PR] Release flink-shaded 20.0 [flink-web]

2025-02-18 Thread via GitHub
snuyanzin opened a new pull request, #774: URL: https://github.com/apache/flink-web/pull/774 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-

[jira] [Commented] (FLINK-37344) setup_hugo.sh should install the hugo binary only

2025-02-18 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928169#comment-17928169 ] Gabor Somogyi commented on FLINK-37344: --- [{{9a1e986}}|https://github.com/apache/fl

[jira] [Updated] (FLINK-37320) [Observer] FINISHED finite streaming jobs incorrectly being set to RECONCILING

2025-02-18 Thread Luca Castelli (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luca Castelli updated FLINK-37320: -- Summary: [Observer] FINISHED finite streaming jobs incorrectly being set to RECONCILING (was:

[PR] [FLINK-37320] [Observer] FINISHED finite streaming jobs incorrectly being set to RECONCILING [flink-kubernetes-operator]

2025-02-18 Thread via GitHub
luca-p-castelli opened a new pull request, #944: URL: https://github.com/apache/flink-kubernetes-operator/pull/944 ## What is the purpose of the change This pull request fixes a bug where the observer tries changing the JOB STATUS of a FINISHED finite/bounded streaming job back to REC

[jira] [Updated] (FLINK-37320) FINISHED finite streaming jobs incorrectly being set to RECONCILING

2025-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-37320: --- Labels: pull-request-available (was: ) > FINISHED finite streaming jobs incorrectly being s

Re: [PR] [FLINK-37344][doc] setup_hugo.sh now installs the binary only [flink]

2025-02-18 Thread via GitHub
mxm merged PR #26170: URL: https://github.com/apache/flink/pull/26170 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.or

[jira] [Resolved] (FLINK-37344) setup_hugo.sh should install the hugo binary only

2025-02-18 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved FLINK-37344. Resolution: Fixed > setup_hugo.sh should install the hugo binary only > --

Re: [PR] [FLINK-33703] Use maven 3.8.6 for release profile [flink-shaded]

2025-02-18 Thread via GitHub
snuyanzin merged PR #131: URL: https://github.com/apache/flink-shaded/pull/131 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.

[jira] [Updated] (FLINK-33703) Use maven 3.8.6 for releasing of flink-shaded

2025-02-18 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin updated FLINK-33703: Fix Version/s: shaded-20.0 > Use maven 3.8.6 for releasing of flink-shaded > -

[jira] [Commented] (FLINK-33703) Use maven 3.8.6 for releasing of flink-shaded

2025-02-18 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928150#comment-17928150 ] Sergey Nuyanzin commented on FLINK-33703: - Merged as [8b3972eb102c42fd247b9e2d6

[jira] [Resolved] (FLINK-33703) Use maven 3.8.6 for releasing of flink-shaded

2025-02-18 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin resolved FLINK-33703. - Resolution: Fixed > Use maven 3.8.6 for releasing of flink-shaded >

Re: [PR] [FLINK-33703] Use maven 3.8.6 for release profile [flink-shaded]

2025-02-18 Thread via GitHub
snuyanzin commented on PR #131: URL: https://github.com/apache/flink-shaded/pull/131#issuecomment-2666253912 Addressed feedback also noticed that latest jackson 2.18.2 requires maven-shade-plugin 3.6.0 since it has a version folder for java 22. And maven-shade-plugin 3.6.0 requires at

[jira] [Updated] (FLINK-37320) FINISHED jobs incorrectly being set to RECONCILING

2025-02-18 Thread Luca Castelli (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luca Castelli updated FLINK-37320: -- Attachment: (was: test-batch-job.yaml) > FINISHED jobs incorrectly being set to RECONCILIN

[jira] [Updated] (FLINK-37320) FINISHED jobs incorrectly being set to RECONCILING

2025-02-18 Thread Luca Castelli (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luca Castelli updated FLINK-37320: -- Description: Hello, I believe I've found bugs within the observation logic for both finite s

[jira] [Updated] (FLINK-37320) FINISHED finite streaming jobs incorrectly being set to RECONCILING

2025-02-18 Thread Luca Castelli (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luca Castelli updated FLINK-37320: -- Description: Hello, I believe I've found a bug within the observation logic for finite stream

[jira] [Updated] (FLINK-37320) FINISHED finite streaming jobs incorrectly being set to RECONCILING

2025-02-18 Thread Luca Castelli (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luca Castelli updated FLINK-37320: -- Summary: FINISHED finite streaming jobs incorrectly being set to RECONCILING (was: FINISHED j

[jira] [Updated] (FLINK-37320) FINISHED jobs incorrectly being set to RECONCILING

2025-02-18 Thread Luca Castelli (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luca Castelli updated FLINK-37320: -- Attachment: (was: operator-log-batch-job.log) > FINISHED jobs incorrectly being set to REC

Re: [PR] [BP-1.19][FLINK-36739] Update the NodeJS to v22.11.0 (LTS) [flink]

2025-02-18 Thread via GitHub
mehdid93 closed pull request #25912: [BP-1.19][FLINK-36739] Update the NodeJS to v22.11.0 (LTS) URL: https://github.com/apache/flink/pull/25912 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

Re: [PR] [BP-1.19][FLINK-34194] Update CI to Ubuntu 22.04 (Jammy) [flink]

2025-02-18 Thread via GitHub
mehdid93 closed pull request #25911: [BP-1.19][FLINK-34194] Update CI to Ubuntu 22.04 (Jammy) URL: https://github.com/apache/flink/pull/25911 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

Re: [PR] [BP-1.19][FLINK-36689][Runtime/Web Frontend] Update ng-zorro-antd to v18 [flink]

2025-02-18 Thread via GitHub
mehdid93 closed pull request #25913: [BP-1.19][FLINK-36689][Runtime/Web Frontend] Update ng-zorro-antd to v18 URL: https://github.com/apache/flink/pull/25913 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

Re: [PR] [BP-1.19][FLINK-36740] [WebFrontend] Update frontend dependencies to address vulnerabilities [flink]

2025-02-18 Thread via GitHub
mehdid93 closed pull request #25914: [BP-1.19][FLINK-36740] [WebFrontend] Update frontend dependencies to address vulnerabilities URL: https://github.com/apache/flink/pull/25914 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[jira] [Commented] (FLINK-23886) An exception is thrown out when recover job timers from checkpoint file

2025-02-18 Thread Tommy Schnabel (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928137#comment-17928137 ] Tommy Schnabel commented on FLINK-23886: Value overflow makes sense! We were no

[jira] [Commented] (FLINK-36354) Enable FORSTDB_BACKEND in async releated tests

2025-02-18 Thread Stepan Stepanishchev (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928106#comment-17928106 ] Stepan Stepanishchev commented on FLINK-36354: -- [~xuyangzhong], can I help

Re: [PR] [FLINK-21912][pyflink] Introduce ResolvedSchema in Python Table API [flink]

2025-02-18 Thread via GitHub
autophagy commented on code in PR #26121: URL: https://github.com/apache/flink/pull/26121#discussion_r1959749951 ## flink-python/pyflink/table/catalog.py: ## @@ -1391,3 +1398,418 @@ def of(catalog_name: str, configuration: Configuration, comment: str = None): j_catalog

Re: [PR] [FLINK-30371] Fix the problem of JdbcOutputFormat database connection leak [flink-connector-jdbc]

2025-02-18 Thread via GitHub
lvyanquan commented on PR #75: URL: https://github.com/apache/flink-connector-jdbc/pull/75#issuecomment-2665652224 Hi, @KevDi. Would you like to rebase and fix the conflict? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [PR] [FLINK-30371] Fix the problem of JdbcOutputFormat database connection leak [flink-connector-jdbc]

2025-02-18 Thread via GitHub
lvyanquan commented on PR #75: URL: https://github.com/apache/flink-connector-jdbc/pull/75#issuecomment-2665651533 Hi, @KevDi. Would you like to rebase and fix the conflict? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[jira] [Commented] (FLINK-34979) Implement State Future and related utilities

2025-02-18 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928073#comment-17928073 ] Zakelly Lan commented on FLINK-34979: - We could have the similar API like `Completab

Re: [PR] [FLINK-36549][formats] Fix using the ignore-parse-errors parameter in Debezium/Canal/Maxwell/Ogg JSON results in unexpected data loss [flink]

2025-02-18 Thread via GitHub
flinkbot commented on PR #26173: URL: https://github.com/apache/flink/pull/26173#issuecomment-2665622934 ## CI report: * c3eb74229712131a084bcfb224d32232cba92ba7 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-36549][formats] Fix using the ignore-parse-errors parameter in Debezium/Canal/Maxwell/Ogg JSON results in unexpected data loss [flink]

2025-02-18 Thread via GitHub
xiaoyu19950911 commented on PR #26172: URL: https://github.com/apache/flink/pull/26172#issuecomment-2665590960 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

Re: [PR] [FLINK-36549][formats] Fix using the ignore-parse-errors parameter in Debezium/Canal/Maxwell/Ogg JSON results in unexpected data loss [flink]

2025-02-18 Thread via GitHub
flinkbot commented on PR #26172: URL: https://github.com/apache/flink/pull/26172#issuecomment-2665584874 ## CI report: * 0fa67d2efde59dacc301bd5688f7b570f0bfefea UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Commented] (FLINK-34979) Implement State Future and related utilities

2025-02-18 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928063#comment-17928063 ] Zakelly Lan commented on FLINK-34979: - Yes, if a callback may produce exception that

[PR] [FLINK-36549][formats] Fix using the ignore-parse-errors parameter in Debezium/Canal/Maxwell/Ogg JSON results in unexpected data loss [flink]

2025-02-18 Thread via GitHub
xiaoyu19950911 opened a new pull request, #26173: URL: https://github.com/apache/flink/pull/26173 ## What is the purpose of the change Enabling the ignore-parse-errors parameter does not skip exceptions caused by the format of the emitted data. ## Brief change l

  1   2   >