Re: [PR] [hotfix][runtime] Remove the redundant JobVertex#hasNoConnectedInputs and use JobVertex#isInputVertex instead. [flink]

2025-02-19 Thread via GitHub
JunRuiLee merged PR #26083: URL: https://github.com/apache/flink/pull/26083 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apa

[jira] [Comment Edited] (FLINK-37160) Cross-team verification for "Adaptive broadcast join for batch jobs"

2025-02-19 Thread Lei Yang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928645#comment-17928645 ] Lei Yang edited comment on FLINK-37160 at 2/20/25 5:21 AM: --- Ve

[jira] [Commented] (FLINK-37160) Cross-team verification for "Adaptive broadcast join for batch jobs"

2025-02-19 Thread Lei Yang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928645#comment-17928645 ] Lei Yang commented on FLINK-37160: -- Verification results: The results match the descri

[jira] [Closed] (FLINK-37160) Cross-team verification for "Adaptive broadcast join for batch jobs"

2025-02-19 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee closed FLINK-37160. -- Resolution: Done > Cross-team verification for "Adaptive broadcast join for batch jobs" >

[jira] [Commented] (FLINK-37160) Cross-team verification for "Adaptive broadcast join for batch jobs"

2025-02-19 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928646#comment-17928646 ] Junrui Lee commented on FLINK-37160: Thanks [~noorall] for verification! > Cross-te

[jira] [Closed] (FLINK-37048) Cross-team verification for "Remove Deprecated methods/fields/classes in DataStream API"

2025-02-19 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee closed FLINK-37048. -- Resolution: Done > Cross-team verification for "Remove Deprecated methods/fields/classes in > DataStr

[jira] [Commented] (FLINK-37048) Cross-team verification for "Remove Deprecated methods/fields/classes in DataStream API"

2025-02-19 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928647#comment-17928647 ] Junrui Lee commented on FLINK-37048: I searched the current flink-streaming-java and

[jira] [Updated] (FLINK-37334) Fix mysql's add column after event becomes add column last

2025-02-19 Thread MOBIN (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MOBIN updated FLINK-37334: -- Description: Repeat step: {code:java} 1. set schema.change.behavior:lenient 2. ALTER TABLE cdc_sink19 add COL

[PR] [FLINK-37333][runtime] Use ForwardForUnspecifiedPartitioner when adaptive broadcast join takes effect [flink]

2025-02-19 Thread via GitHub
SinBex opened a new pull request, #26178: URL: https://github.com/apache/flink/pull/26178 ## What is the purpose of the change According to the design, we need to change the original forward partitioner to a rescale partitioner after the adaptive broadcast join takes effect. Accordin

[jira] [Resolved] (FLINK-37335) ForSt fails to generate the first checkpoint in IncrementalCP and NO_CLAIM mode.

2025-02-19 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan resolved FLINK-37335. - Resolution: Fixed > ForSt fails to generate the first checkpoint in IncrementalCP and NO_CLAIM

[jira] [Assigned] (FLINK-35724) javax.xml.bind.JAXBException not found with jdk11 while writing to oss

2025-02-19 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee reassigned FLINK-35724: -- Assignee: Junrui Lee > javax.xml.bind.JAXBException not found with jdk11 while writing to oss

[jira] [Commented] (FLINK-35724) javax.xml.bind.JAXBException not found with jdk11 while writing to oss

2025-02-19 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928628#comment-17928628 ] Junrui Lee commented on FLINK-35724: I also encountered this bug when using Flink 1.

[PR] [FLINK-35724][oss] Bump OSS SDK to 3.17.4 [flink]

2025-02-19 Thread via GitHub
JunRuiLee opened a new pull request, #26177: URL: https://github.com/apache/flink/pull/26177 ## What is the purpose of the change [FLINK-35724][oss] Bump OSS SDK to 3.17.4 ## Brief change log [FLINK-35724][oss] Bump OSS SDK to 3.17.4 ## Verifying th

[jira] [Updated] (FLINK-35724) javax.xml.bind.JAXBException not found with jdk11 while writing to oss

2025-02-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35724: --- Labels: pull-request-available (was: ) > javax.xml.bind.JAXBException not found with jdk11

Re: [PR] [FLINK-37149][doc] Add documents for adaptive batch execution. [flink]

2025-02-19 Thread via GitHub
zhuzhurk commented on code in PR #26168: URL: https://github.com/apache/flink/pull/26168#discussion_r1962796362 ## docs/content.zh/docs/deployment/adaptive_batch.md: ## @@ -0,0 +1,172 @@ +--- +title: 自适应批处理 +weight: 5 +type: docs + +--- + + +# 自适应批处理 +本文档描述了自适应批处理的背景,使用方法,以及限制条件

Re: [PR] [FLINK-36409] Publish some autoscaler metrics during stabilisation period [flink-kubernetes-operator]

2025-02-19 Thread via GitHub
morhidi commented on PR #945: URL: https://github.com/apache/flink-kubernetes-operator/pull/945#issuecomment-2669277034 > +1 for @mxm 's suggestion to enable this by a config flag but it should probably be disabled by default (to keep the current behaviour as the default) > I'm not 1

[jira] [Updated] (FLINK-37356) Recycle use of kafka producer(which commit error) may send data without AddPartitionsToTxnRequest

2025-02-19 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-37356: -- Summary: Recycle use of kafka producer(which commit error) may send data without AddPartitions

[jira] [Updated] (FLINK-37356) Recycle use of kafka producer(which commit error) maybe send data without AddPartitionsToTxnRequest

2025-02-19 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-37356: -- Summary: Recycle use of kafka producer(which commit error) maybe send data without AddPartitio

[jira] [Commented] (FLINK-37356) Recycle use of kafka producer(which commit error) will send data without AddPartitionsToTxnRequest

2025-02-19 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928614#comment-17928614 ] Hongshun Wang commented on FLINK-37356: --- Hi, [~arvid] , I just know you are also w

[jira] [Updated] (FLINK-37356) Recycle use of kafka producer(which commit error) maybe send data without AddPartitionsToTxnRequest

2025-02-19 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-37356: -- Description: In my production environment,  READ_COMMITTED consumer can no longer consume any

[jira] [Updated] (FLINK-37356) Recycle use of kafka producer(which commit error) maybe send data without AddPartitionsToTxnRequest

2025-02-19 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-37356: -- Description: In my production environment,  READ_COMMITTED consumer can no longer consume any

[jira] [Reopened] (FLINK-37334) Fix mysql's add column after event becomes add column last

2025-02-19 Thread MOBIN (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MOBIN reopened FLINK-37334: --- reopen > Fix mysql's add column after event becomes add column last > -

[jira] (FLINK-37334) Fix mysql's add column after event becomes add column last

2025-02-19 Thread MOBIN (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37334 ] MOBIN deleted comment on FLINK-37334: --- was (Author: mobin): sorry,because I used old version, closed > Fix mysql's add column after event becomes add column last >

[jira] [Updated] (FLINK-37334) Fix mysql's add column after event becomes add column last

2025-02-19 Thread MOBIN (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MOBIN updated FLINK-37334: -- Description: Repeat step: {code:java} 1. set schema.change.behavior:lenient (EVOLVE) 2. ALTER TABLE cdc_sink19

[jira] [Updated] (FLINK-37355) When using the DataStream API of Flink CDC 3.3.0 and setting the tableList to database_name.*, it fails to restore from the checkpoint.

2025-02-19 Thread longwang0616 (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] longwang0616 updated FLINK-37355: - Priority: Blocker (was: Major) > When using the DataStream API of Flink CDC 3.3.0 and setting t

Re: [PR] [FLINK-35810][test] increase unittest Xmx to debug FLINK-35810 [flink]

2025-02-19 Thread via GitHub
reswqa merged PR #26174: URL: https://github.com/apache/flink/pull/26174 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache

[jira] [Created] (FLINK-37356) Recycle use of kafka producer(which commit error) will send data without AddPartitionsToTxnRequest

2025-02-19 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-37356: - Summary: Recycle use of kafka producer(which commit error) will send data without AddPartitionsToTxnRequest Key: FLINK-37356 URL: https://issues.apache.org/jira/browse/FLINK-373

[jira] [Commented] (FLINK-31880) Bad Test in OrcColumnarRowSplitReaderTest

2025-02-19 Thread Sai Sharath Dandi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928603#comment-17928603 ] Sai Sharath Dandi commented on FLINK-31880: --- +1 to this. [~kurto] May I know w

Re: [PR] [FLINK-37333][runtime] Use ForwardForUnspecifiedPartitioner when adaptive broadcast join takes effect. [flink]

2025-02-19 Thread via GitHub
zhuzhurk merged PR #26163: URL: https://github.com/apache/flink/pull/26163 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apac

[jira] [Updated] (FLINK-37334) Fix mysql's add column after event becomes add column last

2025-02-19 Thread MOBIN (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MOBIN updated FLINK-37334: -- Description: Repeat step: {code:java} 1. set schema.change.behavior:lenient (EVOLVE) 2. ALTER TABLE cdc_sink19

[jira] [Updated] (FLINK-37334) Fix mysql's add column after event becomes add column last

2025-02-19 Thread MOBIN (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MOBIN updated FLINK-37334: -- Attachment: image-2025-02-20-11-01-02-254.png > Fix mysql's add column after event becomes add column last > -

Re: [PR] [FLINK-36611][pipeline-connector][kafka] Add schema info to output of Kafka sink [flink-cdc]

2025-02-19 Thread via GitHub
lvyanquan commented on PR #3791: URL: https://github.com/apache/flink-cdc/pull/3791#issuecomment-2670348352 Hi, @MOBIN-F. Is there any blocker for this being ready? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[jira] [Created] (FLINK-37355) When using the DataStream API of Flink CDC 3.3.0 and setting the tableList to database_name.*, it fails to restore from the checkpoint.

2025-02-19 Thread longwang0616 (Jira)
longwang0616 created FLINK-37355: Summary: When using the DataStream API of Flink CDC 3.3.0 and setting the tableList to database_name.*, it fails to restore from the checkpoint. Key: FLINK-37355 URL: https://iss

Re: [PR] [FLINK-36585][connector / common] SplitFetcherManager.close() should not chain runnables to the element queue future in a tight loop. [flink]

2025-02-19 Thread via GitHub
becketqin commented on PR #25569: URL: https://github.com/apache/flink/pull/25569#issuecomment-2669853890 I see the unit test to be flaky. Will fix it with a follow up hotfix patch. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

Re: [PR] [FLINK-36579][cdc] Fix mysql cdc charset collation sort not equals ja… [flink-cdc]

2025-02-19 Thread via GitHub
github-actions[bot] commented on PR #3659: URL: https://github.com/apache/flink-cdc/pull/3659#issuecomment-2670051365 This pull request has been closed because it has not had recent activity. You could reopen it if you try to continue your work, and anyone who are interested in it are encou

Re: [PR] [FLINK-36579][cdc] Fix mysql cdc charset collation sort not equals ja… [flink-cdc]

2025-02-19 Thread via GitHub
github-actions[bot] closed pull request #3659: [FLINK-36579][cdc] Fix mysql cdc charset collation sort not equals ja… URL: https://github.com/apache/flink-cdc/pull/3659 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] [FLINK-36409] Publish some autoscaler metrics during stabilisation period [flink-kubernetes-operator]

2025-02-19 Thread via GitHub
gyfora commented on PR #945: URL: https://github.com/apache/flink-kubernetes-operator/pull/945#issuecomment-2669500389 I am not sure that’s what Max meant, because you can already reduce the stabilization period to 0 if you want. So we wouldn’t need a new option . I thought he meant

Re: [PR] [FLINK-36611][pipeline-connector][kafka] Add schema info to output of Kafka sink [flink-cdc]

2025-02-19 Thread via GitHub
lvyanquan commented on code in PR #3791: URL: https://github.com/apache/flink-cdc/pull/3791#discussion_r1962921992 ## flink-cdc-common/src/main/java/org/apache/flink/cdc/common/event/DataChangeEvent.java: ## @@ -40,11 +40,22 @@ private DataChangeEvent( RecordData af

Re: [PR] [FLINK-37333][runtime] Use ForwardForUnspecifiedPartitioner when adaptive broadcast join takes effect [flink]

2025-02-19 Thread via GitHub
flinkbot commented on PR #26178: URL: https://github.com/apache/flink/pull/26178#issuecomment-2670572673 ## CI report: * 13ba05de3267c4fce74b0408fa3bdc7814bb1696 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [BP-2.0][FLINK-37274] Add examples for DataStream V2 [flink]

2025-02-19 Thread via GitHub
flinkbot commented on PR #26179: URL: https://github.com/apache/flink/pull/26179#issuecomment-2670572821 ## CI report: * 7b88fa3ab4413f0bea7ea8b62badb0a8dd52d07f UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-36611][pipeline-connector][kafka] Add schema info to output of Kafka sink [flink-cdc]

2025-02-19 Thread via GitHub
lvyanquan commented on code in PR #3791: URL: https://github.com/apache/flink-cdc/pull/3791#discussion_r1962930554 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-mysql/src/main/java/org/apache/flink/cdc/connectors/mysql/source/MySqlDataSourceOptions.java

Re: [PR] [FLINK-36086] [Sqlserver] Fix Sqlserver restart during one transaction [flink-cdc]

2025-02-19 Thread via GitHub
GOODBOY008 commented on PR #3873: URL: https://github.com/apache/flink-cdc/pull/3873#issuecomment-2670628730 > I read more about the semantics of `InputStatus`, and I think the current logic is good. Please validate my understanding below. > > There are three possible value of the sta

[PR] [FLINK-37358][kafka] Support to pass format options [flink-cdc]

2025-02-19 Thread via GitHub
Shawn-Hx opened a new pull request, #3926: URL: https://github.com/apache/flink-cdc/pull/3926 This closes [FLINK-37358](https://issues.apache.org/jira/browse/FLINK-37358). Currently, we cannot pass format options (e.g. `csv.write-null-properties`) to kafka pipeline sink because format

[jira] [Created] (FLINK-37358) Support pass format options to kafka pipeline sink

2025-02-19 Thread Xiao Huang (Jira)
Xiao Huang created FLINK-37358: -- Summary: Support pass format options to kafka pipeline sink Key: FLINK-37358 URL: https://issues.apache.org/jira/browse/FLINK-37358 Project: Flink Issue Type: Im

[jira] [Updated] (FLINK-37358) Support pass format options to kafka pipeline sink

2025-02-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-37358: --- Labels: pull-request-available (was: ) > Support pass format options to kafka pipeline sink

[jira] [Closed] (FLINK-37333) Use ForwardForUnspecifiedPartitioner when adaptive broadcast join takes effect

2025-02-19 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-37333. --- Resolution: Fixed ee0c187b35df9a20ee3249f984274f012a7b5309 > Use ForwardForUnspecifiedPartitioner when adap

[jira] [Updated] (FLINK-37356) Recycle use of kafka producer(which commit error) maybe send data without AddPartitionsToTxnRequest

2025-02-19 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-37356: -- Description: In my production environment,  READ_COMMITTED consumer can no longer consume any

[jira] [Created] (FLINK-37357) Migrating conversion logic to SqlNodeConverters

2025-02-19 Thread Hirson Zhang (Jira)
Hirson Zhang created FLINK-37357: Summary: Migrating conversion logic to SqlNodeConverters Key: FLINK-37357 URL: https://issues.apache.org/jira/browse/FLINK-37357 Project: Flink Issue Type: I

[jira] [Updated] (FLINK-37357) Migrating conversion logic to SqlNodeConverters

2025-02-19 Thread Hirson Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hirson Zhang updated FLINK-37357: - Fix Version/s: (was: 2.1.0) > Migrating conversion logic to SqlNodeConverters >

[jira] [Updated] (FLINK-37357) Migrating conversion logic to SqlNodeConverters

2025-02-19 Thread Hirson Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hirson Zhang updated FLINK-37357: - Description: There is a "TODO" at class "SqlNodeToOperationConversion", method "convertValidate

[jira] [Updated] (FLINK-37357) Migrating conversion logic to SqlNodeConverters

2025-02-19 Thread Hirson Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hirson Zhang updated FLINK-37357: - Description: There is a "TODO" at class "SqlNodeToOperationConversion", method "convertValidate

[jira] [Updated] (FLINK-37357) Migrating conversion logic to SqlNodeConverters

2025-02-19 Thread Hirson Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hirson Zhang updated FLINK-37357: - Description: There is a "TODO" at class "SqlNodeToOperationConversion", method "convertValidate

[jira] [Commented] (FLINK-37357) Migrating conversion logic to SqlNodeConverters

2025-02-19 Thread Hirson Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928630#comment-17928630 ] Hirson Zhang commented on FLINK-37357: -- I will try to deal with this. > Migrating

Re: [PR] [hotfix][runtime] Remove the unused SchedulerBase#transitionToScheduled method [flink]

2025-02-19 Thread via GitHub
JunRuiLee merged PR #26175: URL: https://github.com/apache/flink/pull/26175 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apa

Re: [PR] [hotfix][runtime] Remove the redundant JobVertex#hasNoConnectedInputs and use JobVertex#isInputVertex instead. [flink]

2025-02-19 Thread via GitHub
RocMarshal commented on PR #26083: URL: https://github.com/apache/flink/pull/26083#issuecomment-2670411841 Hi, master @JunRuiLee Could you help take a look for the pr if you had the free time ? many thanks! -- This is an automated message from the Apache Git Service. To respond to the

Re: [PR] [FLINK-35724][oss] Bump OSS SDK to 3.17.4 [flink]

2025-02-19 Thread via GitHub
flinkbot commented on PR #26177: URL: https://github.com/apache/flink/pull/26177#issuecomment-2670410311 ## CI report: * 2906cfb1093a83bfb95e81fb20728665eb13f4a2 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Closed] (FLINK-37334) Fix mysql's add column after event becomes add column last

2025-02-19 Thread MOBIN (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MOBIN closed FLINK-37334. - Resolution: Not A Bug > Fix mysql's add column after event becomes add column last > ---

[jira] [Comment Edited] (FLINK-37334) Fix mysql's add column after event becomes add column last

2025-02-19 Thread MOBIN (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928621#comment-17928621 ] MOBIN edited comment on FLINK-37334 at 2/20/25 7:34 AM: normal p

Re: [PR] [FLINK-37267][table] Add support for UNNEST WITH ORDINALITY [flink]

2025-02-19 Thread via GitHub
gustavodemorais commented on code in PR #26113: URL: https://github.com/apache/flink/pull/26113#discussion_r1961268518 ## flink-table/flink-table-runtime/src/main/java/org/apache/flink/table/runtime/functions/table/UnnestRowsWithOrdinalityFunction.java: ## @@ -0,0 +1,149 @@ +/*

Re: [PR] [FLINK-37267][table] Add support for UNNEST WITH ORDINALITY [flink]

2025-02-19 Thread via GitHub
gustavodemorais commented on code in PR #26113: URL: https://github.com/apache/flink/pull/26113#discussion_r1961296377 ## flink-table/flink-table-planner/src/test/scala/org/apache/flink/table/planner/runtime/stream/sql/UnnestITCase.scala: ## @@ -312,71 +306,509 @@ class UnnestIT

[jira] [Created] (FLINK-37351) Ensure writer and committer are colocated

2025-02-19 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-37351: --- Summary: Ensure writer and committer are colocated Key: FLINK-37351 URL: https://issues.apache.org/jira/browse/FLINK-37351 Project: Flink Issue Type: Bug

Re: [PR] [BP-1.20][FLINK-37093][table] Fix catalog that failed validation due to no type still exists in catalogStoreHolder [flink]

2025-02-19 Thread via GitHub
jiefei30 commented on PR #26138: URL: https://github.com/apache/flink/pull/26138#issuecomment-2667886719 cc @hackergin -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u

Re: [PR] [BP-2.0][FLINK-37093][table] Fix catalog that failed validation due to no type still exists in catalogStoreHolder [flink]

2025-02-19 Thread via GitHub
jiefei30 commented on PR #26139: URL: https://github.com/apache/flink/pull/26139#issuecomment-2667887725 cc @hackergin -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u

[jira] [Commented] (FLINK-36172) Web UI Freezes When There Are Many Finished Tasks in Batch Jobs

2025-02-19 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928370#comment-17928370 ] Junrui Lee commented on FLINK-36172: Gentle ping [~Zhanghao Chen] on this issue. >

[jira] [Commented] (FLINK-37321) Make window functions with wrong input fail during planning rather than runtime

2025-02-19 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928380#comment-17928380 ] Sergey Nuyanzin commented on FLINK-37321: - Merged as [18c6cafe7f41765850f793d0f

[jira] [Resolved] (FLINK-37321) Make window functions with wrong input fail during planning rather than runtime

2025-02-19 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin resolved FLINK-37321. - Fix Version/s: 2.1.0 Resolution: Fixed > Make window functions with wrong input f

Re: [PR] [FLINK-37267][table] Add support for UNNEST WITH ORDINALITY [flink]

2025-02-19 Thread via GitHub
gustavodemorais commented on code in PR #26113: URL: https://github.com/apache/flink/pull/26113#discussion_r1961296377 ## flink-table/flink-table-planner/src/test/scala/org/apache/flink/table/planner/runtime/stream/sql/UnnestITCase.scala: ## @@ -312,71 +306,509 @@ class UnnestIT

Re: [PR] [FLINK-37321][table] Make window functions with wrong descriptors fail during planning rather than runtime [flink]

2025-02-19 Thread via GitHub
snuyanzin merged PR #26157: URL: https://github.com/apache/flink/pull/26157 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apa

Re: [PR] [FLINK-36409] Publish some autoscaler metrics during stabilisation period [flink-kubernetes-operator]

2025-02-19 Thread via GitHub
mxm commented on code in PR #945: URL: https://github.com/apache/flink-kubernetes-operator/pull/945#discussion_r1961334586 ## flink-autoscaler/src/main/java/org/apache/flink/autoscaler/ScalingMetricCollector.java: ## @@ -149,19 +149,31 @@ public CollectedMetricHistory updateMet

Re: [PR] [FLINK-37336][python] Introduce TablePipeline descriptor to Python Table API [flink]

2025-02-19 Thread via GitHub
autophagy commented on code in PR #26167: URL: https://github.com/apache/flink/pull/26167#discussion_r1961499980 ## flink-python/pyflink/table/catalog.py: ## @@ -1391,3 +1391,87 @@ def of(catalog_name: str, configuration: Configuration, comment: str = None): j_catalog_

Re: [PR] [BP-2.0][FLINK-37093][table] Fix catalog that failed validation due to no type still exists in catalogStoreHolder [flink]

2025-02-19 Thread via GitHub
hackergin commented on PR #26139: URL: https://github.com/apache/flink/pull/26139#issuecomment-2668374642 cc @fsk119 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

[jira] [Created] (FLINK-37353) [Doc] Add doc for scan.incremental.snapshot.chunk.key-column Mysql Data Sink

2025-02-19 Thread Yanquan Lv (Jira)
Yanquan Lv created FLINK-37353: -- Summary: [Doc] Add doc for scan.incremental.snapshot.chunk.key-column Mysql Data Sink Key: FLINK-37353 URL: https://issues.apache.org/jira/browse/FLINK-37353 Project: Fl

[jira] [Resolved] (FLINK-37282) Add backchannel for producer recycling

2025-02-19 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise resolved FLINK-37282. - Fix Version/s: kafka-4.0.0 Resolution: Fixed Merged into main as 5947f3c..f4015d1. > Add

Re: [PR] [FLINK-37320] [Observer] FINISHED finite streaming jobs incorrectly being set to RECONCILING [flink-kubernetes-operator]

2025-02-19 Thread via GitHub
luca-p-castelli commented on code in PR #944: URL: https://github.com/apache/flink-kubernetes-operator/pull/944#discussion_r1961786978 ## flink-kubernetes-operator/src/main/java/org/apache/flink/kubernetes/operator/observer/deployment/AbstractFlinkDeploymentObserver.java: ## @@

Re: [PR] Add Flink 1.19.2 release [flink-web]

2025-02-19 Thread via GitHub
afedulov merged PR #771: URL: https://github.com/apache/flink-web/pull/771 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apac

Re: [PR] [BP-2.0][FLINK-37335][state/forst] Handle the first full checkpoint for ForSt IncrementalSnapshotStrategy. [flink]

2025-02-19 Thread via GitHub
Zakelly merged PR #26176: URL: https://github.com/apache/flink/pull/26176 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apach

[jira] [Updated] (FLINK-37353) [Doc] Add doc for scan.incremental.snapshot.chunk.key-column Mysql Data Sink

2025-02-19 Thread Yanquan Lv (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanquan Lv updated FLINK-37353: --- Description: Add doc for [scan.incremental.snapshot.chunk.key-column|https://github.com/apache/flink

[jira] [Updated] (FLINK-37353) [Doc] Add doc for scan.incremental.snapshot.chunk.key-column Mysql Data Sink

2025-02-19 Thread Yanquan Lv (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanquan Lv updated FLINK-37353: --- Description: Add doc for [scan.incremental.snapshot.chunk.key-column|https://github.com/apache/flink

[jira] [Commented] (FLINK-37335) ForSt fails to generate the first checkpoint in IncrementalCP and NO_CLAIM mode.

2025-02-19 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928407#comment-17928407 ] Zakelly Lan commented on FLINK-37335: - Master: 9de7d1ff13dc7d096bc793c11f2747692b281

[jira] [Created] (FLINK-37352) Write full changelog to Paimon Sink.

2025-02-19 Thread Yanquan Lv (Jira)
Yanquan Lv created FLINK-37352: -- Summary: Write full changelog to Paimon Sink. Key: FLINK-37352 URL: https://issues.apache.org/jira/browse/FLINK-37352 Project: Flink Issue Type: Improvement

Re: [PR] [FLINK-36409] Publish some autoscaler metrics during stabilisation period [flink-kubernetes-operator]

2025-02-19 Thread via GitHub
gyfora commented on PR #945: URL: https://github.com/apache/flink-kubernetes-operator/pull/945#issuecomment-2668549767 +1 for @mxm 's suggestion to enable this by a config flag but it should probably be disabled by default (to keep the current behaviour as the default) -- This is an auto

Re: [PR] [FLINK-36648] Bump Flink version to Flink 2.0-preview1 [flink-connector-kafka]

2025-02-19 Thread via GitHub
lvyanquan commented on code in PR #140: URL: https://github.com/apache/flink-connector-kafka/pull/140#discussion_r1961644045 ## .github/workflows/push_pr.yml: ## @@ -28,16 +28,9 @@ jobs: compile_and_test: strategy: matrix: -flink: [ 1.20.0 ] -jdk:

[jira] [Comment Edited] (FLINK-37327) Debezium Avro Format: Add FormatOption to Optionally Skip emitting UPDATE_BEFORE Rows

2025-02-19 Thread David Radley (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928441#comment-17928441 ] David Radley edited comment on FLINK-37327 at 2/19/25 2:35 PM: ---

[jira] [Commented] (FLINK-37327) Debezium Avro Format: Add FormatOption to Optionally Skip emitting UPDATE_BEFORE Rows

2025-02-19 Thread David Radley (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928441#comment-17928441 ] David Radley commented on FLINK-37327: -- Please could you give more detail as to how

[jira] [Commented] (FLINK-37327) Debezium Avro Format: Add FormatOption to Optionally Skip emitting UPDATE_BEFORE Rows

2025-02-19 Thread Kevin Lam (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928447#comment-17928447 ] Kevin Lam commented on FLINK-37327: --- This Jira ticket is about a change to the Deseria

Re: [PR] [FLINK-37267][table] Add support for UNNEST WITH ORDINALITY [flink]

2025-02-19 Thread via GitHub
gustavodemorais commented on code in PR #26113: URL: https://github.com/apache/flink/pull/26113#discussion_r1961296377 ## flink-table/flink-table-planner/src/test/scala/org/apache/flink/table/planner/runtime/stream/sql/UnnestITCase.scala: ## @@ -312,71 +306,509 @@ class UnnestIT

[jira] [Updated] (FLINK-37354) Kubernetes Operator HealthCheck compatibility

2025-02-19 Thread Anton Solovev (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Solovev updated FLINK-37354: -- Description: Kubernetes Operator HealthCheck is not aligned with checkpoint interval when it

[jira] [Updated] (FLINK-37160) Cross-team verification for "Adaptive broadcast join for batch jobs"

2025-02-19 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-37160: Description: In Flink 2.0, we support the capability of adaptive broadcast join for batch jobs, which can

[jira] [Updated] (FLINK-37160) Cross-team verification for "Adaptive broadcast join for batch jobs"

2025-02-19 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-37160: Description: In Flink 2.0, we support the capability of adaptive broadcast join for batch jobs, which can

Re: [PR] Add Flink 1.20.1 release [flink-web]

2025-02-19 Thread via GitHub
afedulov merged PR #772: URL: https://github.com/apache/flink-web/pull/772 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apac

Re: [PR] [FLINK-37282] Add Backchannel and ProducerPool [flink-connector-kafka]

2025-02-19 Thread via GitHub
AHeise merged PR #152: URL: https://github.com/apache/flink-connector-kafka/pull/152 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@

Re: [PR] [FLINK-37335][state/forst] Handle the first full checkpoint for ForSt IncrementalSnapshotStrategy. [flink]

2025-02-19 Thread via GitHub
Zakelly merged PR #26165: URL: https://github.com/apache/flink/pull/26165 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apach

[jira] [Updated] (FLINK-37353) [Doc] Add doc for scan.incremental.snapshot.chunk.key-column Mysql Data Sink

2025-02-19 Thread Yanquan Lv (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanquan Lv updated FLINK-37353: --- Description: Add doc for [scan.incremental.snapshot.chunk.key-column|https://github.com/apache/flink

Re: [PR] [FLINK-37267][table] Add support for UNNEST WITH ORDINALITY [flink]

2025-02-19 Thread via GitHub
gustavodemorais commented on PR #26113: URL: https://github.com/apache/flink/pull/26113#issuecomment-2668637902 Thanks for the review, @twalthr! Please take a look at the updated code -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G

[jira] [Created] (FLINK-37354) Kubernetes Operator HealthCheck compatibility

2025-02-19 Thread Anton Solovev (Jira)
Anton Solovev created FLINK-37354: - Summary: Kubernetes Operator HealthCheck compatibility Key: FLINK-37354 URL: https://issues.apache.org/jira/browse/FLINK-37354 Project: Flink Issue Type: B

[jira] [Comment Edited] (FLINK-37327) Debezium Avro Format: Add FormatOption to Optionally Skip emitting UPDATE_BEFORE Rows

2025-02-19 Thread David Radley (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928441#comment-17928441 ] David Radley edited comment on FLINK-37327 at 2/19/25 2:35 PM: ---

[jira] [Commented] (FLINK-37327) Debezium Avro Format: Add FormatOption to Optionally Skip emitting UPDATE_BEFORE Rows

2025-02-19 Thread David Radley (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928458#comment-17928458 ] David Radley commented on FLINK-37327: -- Thanks for the explanation [~klam-shop] tha

[jira] [Resolved] (FLINK-36585) The SplitFetcherManager.close() can chain the futures in a tight loop.

2025-02-19 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved FLINK-36585. -- Resolution: Fixed Patch merged. master: fdf9b292b0db87b8639da1337d04c4ef570e5ca1 release-2.0

[jira] [Commented] (FLINK-37353) [Doc] Add doc for scan.incremental.snapshot.chunk.key-column Mysql Data Sink

2025-02-19 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928496#comment-17928496 ] Leonard Xu commented on FLINK-37353: +1 from my side > [Doc] Add doc for scan.incre

[jira] [Assigned] (FLINK-37353) [Doc] Add doc for scan.incremental.snapshot.chunk.key-column Mysql Data Sink

2025-02-19 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reassigned FLINK-37353: -- Assignee: Yanquan Lv > [Doc] Add doc for scan.incremental.snapshot.chunk.key-column Mysql Dat

  1   2   >