Re: [PR] [FLINK-36565] Route module allows merging Decimals with various precisions [flink-cdc]

2024-11-11 Thread via GitHub
lvyanquan commented on code in PR #3651: URL: https://github.com/apache/flink-cdc/pull/3651#discussion_r1837605829 ## flink-cdc-runtime/src/main/java/org/apache/flink/cdc/runtime/operators/schema/SchemaOperator.java: ## @@ -611,14 +614,42 @@ public Object getFieldOrNull(RecordDa

[jira] [Created] (FLINK-36693) Implement checkpoint for ForStSyncKeyedStateBackend

2024-11-11 Thread Yanfei Lei (Jira)
Yanfei Lei created FLINK-36693: -- Summary: Implement checkpoint for ForStSyncKeyedStateBackend Key: FLINK-36693 URL: https://issues.apache.org/jira/browse/FLINK-36693 Project: Flink Issue Type: S

Re: [PR] [FLINK-34466] Lineage interfaces for kafka connector [flink-connector-kafka]

2024-11-11 Thread via GitHub
pawel-big-lebowski commented on code in PR #130: URL: https://github.com/apache/flink-connector-kafka/pull/130#discussion_r1837597500 ## flink-connector-kafka/src/main/java/org/apache/flink/connector/kafka/lineage/LineageUtil.java: ## @@ -0,0 +1,118 @@ +/* + * Licensed to the A

[jira] [Comment Edited] (FLINK-36375) Missing default value in AddColumnEvent/RenameColumnEvent

2024-11-11 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17897137#comment-17897137 ] Leonard Xu edited comment on FLINK-36375 at 11/12/24 7:21 AM:

Re: [PR] [FLINK-36375][cdc-runtime] Fix missed default value in AddColumnEvent/RenameColumnEvent [flink-cdc]

2024-11-11 Thread via GitHub
leonardBang merged PR #3714: URL: https://github.com/apache/flink-cdc/pull/3714 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink

[jira] [Assigned] (FLINK-36693) Implement checkpoint for ForStSyncKeyedStateBackend

2024-11-11 Thread Yanfei Lei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanfei Lei reassigned FLINK-36693: -- Assignee: Yanfei Lei > Implement checkpoint for ForStSyncKeyedStateBackend >

Re: [PR] [FLINK-36565] Route module allows merging Decimals with various precisions [flink-cdc]

2024-11-11 Thread via GitHub
yuxiqian commented on code in PR #3651: URL: https://github.com/apache/flink-cdc/pull/3651#discussion_r1837584244 ## flink-cdc-runtime/src/main/java/org/apache/flink/cdc/runtime/operators/schema/SchemaOperator.java: ## @@ -611,14 +614,42 @@ public Object getFieldOrNull(RecordDat

Re: [PR] [FLINK-36565] Route module allows merging Decimals with various precisions [flink-cdc]

2024-11-11 Thread via GitHub
yuxiqian commented on code in PR #3651: URL: https://github.com/apache/flink-cdc/pull/3651#discussion_r1837584244 ## flink-cdc-runtime/src/main/java/org/apache/flink/cdc/runtime/operators/schema/SchemaOperator.java: ## @@ -611,14 +614,42 @@ public Object getFieldOrNull(RecordDat

Re: [PR] [FLINK-36678][docs][deploy] Fixed the documentation error of Flink CDC YARN deployment mode [flink-cdc]

2024-11-11 Thread via GitHub
Timi988 commented on PR #3706: URL: https://github.com/apache/flink-cdc/pull/3706#issuecomment-2469756372 > @Timi988 Would you like to open a PR for release-3.2 branch? Okay -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

Re: [PR] [FLINK-36565] Route module allows merging Decimals with various precisions [flink-cdc]

2024-11-11 Thread via GitHub
yuxiqian commented on code in PR #3651: URL: https://github.com/apache/flink-cdc/pull/3651#discussion_r1837584244 ## flink-cdc-runtime/src/main/java/org/apache/flink/cdc/runtime/operators/schema/SchemaOperator.java: ## @@ -611,14 +614,42 @@ public Object getFieldOrNull(RecordDat

[jira] [Commented] (FLINK-36685) Enable update/create operation on flinkdeployment resource in mutation webhook

2024-11-11 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17897383#comment-17897383 ] Gyula Fora commented on FLINK-36685: Makes sense to have it the same for deployments

[jira] [Updated] (FLINK-27014) Fix exception when select null literal in subquery for Hive dialect

2024-11-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-27014: --- Labels: pull-request-available (was: ) > Fix exception when select null literal in subquery

[jira] [Updated] (FLINK-36678) The Flink CDC Yarn deployment mode document description is incorrect

2024-11-11 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu updated FLINK-36678: --- Fix Version/s: cdc-3.3.0 cdc-3.2.1 > The Flink CDC Yarn deployment mode document

[jira] [Commented] (FLINK-36678) The Flink CDC Yarn deployment mode document description is incorrect

2024-11-11 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17897380#comment-17897380 ] Leonard Xu commented on FLINK-36678: master: 8b8330e2456e4429c82d5f67bf8aec634399f68

Re: [PR] [FLINK-36678][docs][deploy] Fixed the documentation error of Flink CDC YARN deployment mode [flink-cdc]

2024-11-11 Thread via GitHub
leonardBang commented on PR #3706: URL: https://github.com/apache/flink-cdc/pull/3706#issuecomment-2469735176 @Timi988 Would you like to open a PR for release-3.2 branch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[jira] [Assigned] (FLINK-36678) The Flink CDC Yarn deployment mode document description is incorrect

2024-11-11 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reassigned FLINK-36678: -- Assignee: xuweiwei > The Flink CDC Yarn deployment mode document description is incorrect > -

Re: [PR] [FLINK-36678][docs][deploy] Fixed the documentation error of Flink CDC YARN deployment mode [flink-cdc]

2024-11-11 Thread via GitHub
leonardBang merged PR #3706: URL: https://github.com/apache/flink-cdc/pull/3706 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink

Re: [PR] [FLINK-36565] Route module allows merging Decimals with various precisions [flink-cdc]

2024-11-11 Thread via GitHub
yuxiqian commented on code in PR #3651: URL: https://github.com/apache/flink-cdc/pull/3651#discussion_r1837561967 ## flink-cdc-runtime/src/main/java/org/apache/flink/cdc/runtime/operators/schema/SchemaOperator.java: ## @@ -611,14 +614,42 @@ public Object getFieldOrNull(RecordDat

Re: [PR] [FLINK-36690][runtime] Fix schema operator hanging under extreme parallelized pressure [flink-cdc]

2024-11-11 Thread via GitHub
yuxiqian commented on PR #3680: URL: https://github.com/apache/flink-cdc/pull/3680#issuecomment-2469724193 Based on previous discussions, I've made the following changes: * Adjusted flush event nonce generating algorithm. Now the higher 32 bits are timestamp and lower 32 bits are Java

[jira] [Updated] (FLINK-36690) Pipeline occasionally blocks when handling schema change events in parallel

2024-11-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36690: --- Labels: pull-request-available (was: ) > Pipeline occasionally blocks when handling schema

[jira] [Comment Edited] (FLINK-36486) Remove deprecated method `StreamTableEnvironment#registerDataStream`

2024-11-11 Thread Shalini M (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17897377#comment-17897377 ] Shalini M edited comment on FLINK-36486 at 11/12/24 6:34 AM: -

Re: [PR] [FLINK-36565] Route module allows merging Decimals with various precisions [flink-cdc]

2024-11-11 Thread via GitHub
lvyanquan commented on code in PR #3651: URL: https://github.com/apache/flink-cdc/pull/3651#discussion_r1837547706 ## flink-cdc-runtime/src/main/java/org/apache/flink/cdc/runtime/operators/schema/SchemaOperator.java: ## @@ -611,14 +614,42 @@ public Object getFieldOrNull(RecordDa

[jira] [Commented] (FLINK-36486) Remove deprecated method `StreamTableEnvironment#registerDataStream`

2024-11-11 Thread Shalini M (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17897377#comment-17897377 ] Shalini M commented on FLINK-36486: --- https://github.com/apache/flink/pull/25527 > Rem

[jira] [Created] (FLINK-36692) Flink Table HBase connector

2024-11-11 Thread cris niu (Jira)
cris niu created FLINK-36692: Summary: Flink Table HBase connector Key: FLINK-36692 URL: https://issues.apache.org/jira/browse/FLINK-36692 Project: Flink Issue Type: New Feature Compone

Re: [PR] [FLINK-36678][docs][deploy] Fixed the documentation error of Flink CDC YARN deployment mode [flink-cdc]

2024-11-11 Thread via GitHub
Timi988 commented on PR #3706: URL: https://github.com/apache/flink-cdc/pull/3706#issuecomment-2469681660 > +1, thanks @Timi988 for the fix Thank you for your affirmation , is there anything else needed to get this merged @leonardBang -- This is an automated message from the Apach

Re: [PR] [FLINK-22897][Connectors/Hive] fix the issue that sink to hive with different parallelism will due to produce many small files [flink]

2024-11-11 Thread via GitHub
luoyuxia closed pull request #16311: [FLINK-22897][Connectors/Hive] fix the issue that sink to hive with different parallelism will due to produce many small files URL: https://github.com/apache/flink/pull/16311 -- This is an automated message from the Apache Git Service. To respond to the m

Re: [PR] [FLINK-19004][hive] Fix the issue that fail to call Hive percentile f… [flink]

2024-11-11 Thread via GitHub
luoyuxia closed pull request #18997: [FLINK-19004][hive] Fix the issue that fail to call Hive percentile f… URL: https://github.com/apache/flink/pull/18997 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] [FLINK-26426][hive] Hive dialect supports "create table like" [flink]

2024-11-11 Thread via GitHub
luoyuxia closed pull request #19650: [FLINK-26426][hive] Hive dialect supports "create table like" URL: https://github.com/apache/flink/pull/19650 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] [FLINK-21871][hive] Hive streaming source use FIFO FileSplitAssigner instead of LIFO [flink]

2024-11-11 Thread via GitHub
luoyuxia closed pull request #16043: [FLINK-21871][hive] Hive streaming source use FIFO FileSplitAssigner instead of LIFO URL: https://github.com/apache/flink/pull/16043 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] [FLINK-36613] Fix unstable RescaleCheckpointManuallyITCase in parallel run [flink]

2024-11-11 Thread via GitHub
flinkbot commented on PR #25642: URL: https://github.com/apache/flink/pull/25642#issuecomment-2469670066 ## CI report: * d902b3cc313c620199124340c83df8a6a07413b9 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[PR] [FLINK-36613] Fix unstable RescaleCheckpointManuallyITCase in parallel run [flink]

2024-11-11 Thread via GitHub
Zakelly opened a new pull request, #25642: URL: https://github.com/apache/flink/pull/25642 ## What is the purpose of the change The `RescaleCheckpointManuallyITCase#CollectionSink` collects elements into a single static collection, which might be a problem when multiple tests run in

Re: [PR] [FLINK-27375][hive] Fix exception when no order keys exists in over() in Hive Dialect [flink]

2024-11-11 Thread via GitHub
luoyuxia closed pull request #19246: [FLINK-27375][hive] Fix exception when no order keys exists in over() in Hive Dialect URL: https://github.com/apache/flink/pull/19246 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

[jira] [Updated] (FLINK-27375) Fix exception when no order keys exists in over() in Hive Dialect

2024-11-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-27375: --- Labels: pull-request-available (was: ) > Fix exception when no order keys exists in over()

Re: [PR] [FLINK-27603][hive] Hive dialect supports 'reload function' as a NoOperaton [flink]

2024-11-11 Thread via GitHub
luoyuxia closed pull request #19714: [FLINK-27603][hive] Hive dialect supports 'reload function' as a NoOperaton URL: https://github.com/apache/flink/pull/19714 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

Re: [PR] [FLINK-27014][hive] Fix exception when select null literal in subquery for Hive dialect [flink]

2024-11-11 Thread via GitHub
luoyuxia closed pull request #19336: [FLINK-27014][hive] Fix exception when select null literal in subquery for Hive dialect URL: https://github.com/apache/flink/pull/19336 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] [FLINK-25529][hive] add orc-core dependency specification in hive con… [flink]

2024-11-11 Thread via GitHub
luoyuxia closed pull request #18455: [FLINK-25529][hive] add orc-core dependency specification in hive con… URL: https://github.com/apache/flink/pull/18455 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] [FLINK-16952][Connectors/Parquet] Parquet file format support filter push down. [flink]

2024-11-11 Thread via GitHub
luoyuxia closed pull request #16211: [FLINK-16952][Connectors/Parquet] Parquet file format support filter push down. URL: https://github.com/apache/flink/pull/16211 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Commented] (FLINK-36613) RescaleCheckpointManuallyITCase.testCheckpointRescalingInKeyedState fails on AZP

2024-11-11 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17897369#comment-17897369 ] Zakelly Lan commented on FLINK-36613: - I found that when I run {{RescaleCheckpointM

Re: [PR] [FLINK-36565] Route module allows merging Decimals with various precisions [flink-cdc]

2024-11-11 Thread via GitHub
yuxiqian commented on PR #3651: URL: https://github.com/apache/flink-cdc/pull/3651#issuecomment-2469627340 Done, rebased with `master`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[jira] [Created] (FLINK-36691) Support configuration to enable tasks balancing at slot level for Default Scheduler

2024-11-11 Thread RocMarshal (Jira)
RocMarshal created FLINK-36691: -- Summary: Support configuration to enable tasks balancing at slot level for Default Scheduler Key: FLINK-36691 URL: https://issues.apache.org/jira/browse/FLINK-36691 Proje

Re: [PR] [FLINK-36598][state/ForSt] Provide FileSystem instance in initialization [flink]

2024-11-11 Thread via GitHub
fredia commented on code in PR #25638: URL: https://github.com/apache/flink/pull/25638#discussion_r1837462875 ## flink-state-backends/flink-statebackend-forst/src/main/java/org/apache/flink/state/forst/ForStResourceContainer.java: ## @@ -331,25 +331,21 @@ public void prepareDire

Re: [PR] [FLINK-35825][hive] HiveTableSource supports report statistics for text file [flink]

2024-11-11 Thread via GitHub
xuyangzhong commented on code in PR #25078: URL: https://github.com/apache/flink/pull/25078#discussion_r1837425108 ## flink-connectors/flink-connector-hive/src/test/java/org/apache/flink/connectors/hive/util/TextFormatStatisticsReportUtilTest.java: ## @@ -0,0 +1,96 @@ +/* + * Li

Re: [PR] [FLINK-36565] Route module allows merging Decimals with various precisions [flink-cdc]

2024-11-11 Thread via GitHub
lvyanquan commented on PR #3651: URL: https://github.com/apache/flink-cdc/pull/3651#issuecomment-2469543093 @yuxiqian could you rebase to master as https://github.com/apache/flink-cdc/pull/3636 merged? -- This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Resolved] (FLINK-34125) Flink 2.0: Remove deprecated serialization config methods and options

2024-11-11 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo resolved FLINK-34125. Fix Version/s: 2.0.0 Resolution: Done 195efff51eb5971633d7fab0ccb0669a6ebba324 > Flink 2.0

[jira] [Created] (FLINK-36690) Pipeline occasionally blocks when handling schema change events in parallel

2024-11-11 Thread yux (Jira)
yux created FLINK-36690: --- Summary: Pipeline occasionally blocks when handling schema change events in parallel Key: FLINK-36690 URL: https://issues.apache.org/jira/browse/FLINK-36690 Project: Flink Is

Re: [PR] [FLINK-36093][transform] fix preTransformoperator wrongly filters columns when multiple transform [flink-cdc]

2024-11-11 Thread via GitHub
aiwenmo commented on PR #3572: URL: https://github.com/apache/flink-cdc/pull/3572#issuecomment-2469497337 > Thanks for cleaning up `PreTransformOperator`! Looks much neater now, just left some trivial comments. > > Also +@aiwenmo who is familiar with transform modules. Hi. @MOB

[jira] [Commented] (FLINK-36356) HadoopRecoverableWriterTest.testRecoverWithState due to IOException

2024-11-11 Thread Jim Hughes (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17897338#comment-17897338 ] Jim Hughes commented on FLINK-36356: Failed in a CI build here: https://dev.azure.c

Re: [PR] [FLINK-36047] Add CompiledPlan annotations to BatchExecOverAggregate [flink]

2024-11-11 Thread via GitHub
jnh5y commented on PR #25635: URL: https://github.com/apache/flink/pull/25635#issuecomment-2469487521 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [FLINK-36093][transform] fix preTransformoperator wrongly filters columns when multiple transform [flink-cdc]

2024-11-11 Thread via GitHub
MOBIN-F commented on code in PR #3572: URL: https://github.com/apache/flink-cdc/pull/3572#discussion_r1837413936 ## flink-cdc-runtime/src/test/java/org/apache/flink/cdc/runtime/operators/transform/PreTransformOperatorTest.java: ## @@ -526,4 +526,39 @@ void testMetadataTransform(

[jira] [Updated] (FLINK-36689) [UI] Upgrade runtime web Angular framework and associated deps to latest version

2024-11-11 Thread Jason TANG (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason TANG updated FLINK-36689: --- Fix Version/s: 2.0.0 (was: 1.20.1) > [UI] Upgrade runtime web Angular framewo

[jira] [Commented] (FLINK-36298) NullPointerException in Calcite causes a PyFlink test failure

2024-11-11 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17897324#comment-17897324 ] Weijie Guo commented on FLINK-36298: It seems that this problem has not appeared rec

[jira] [Assigned] (FLINK-36689) [UI] Upgrade runtime web Angular framework and associated deps to latest version

2024-11-11 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo reassigned FLINK-36689: -- Assignee: Jason TANG > [UI] Upgrade runtime web Angular framework and associated deps to late

Re: [PR] [FLINK-36682][mysql][mongodb] Add scan.chunk.assign.strategy to avoid OOM exception. [flink-cdc]

2024-11-11 Thread via GitHub
lvyanquan commented on code in PR #3704: URL: https://github.com/apache/flink-cdc/pull/3704#discussion_r1837379995 ## flink-cdc-connect/flink-cdc-source-connectors/flink-connector-mongodb-cdc/src/main/java/org/apache/flink/cdc/connectors/mongodb/source/config/MongoDBSourceOptions.java:

[jira] [Commented] (FLINK-36613) RescaleCheckpointManuallyITCase.testCheckpointRescalingInKeyedState fails on AZP

2024-11-11 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17897323#comment-17897323 ] Weijie Guo commented on FLINK-36613: https://dev.azure.com/apache-flink/apache-flink

[jira] [Comment Edited] (FLINK-36686) allow customizing env variables for flink-webhook container

2024-11-11 Thread Shuyi Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17897288#comment-17897288 ] Shuyi Chen edited comment on FLINK-36686 at 11/11/24 10:38 PM: ---

[jira] [Comment Edited] (FLINK-36686) allow customizing env variables for flink-webhook container

2024-11-11 Thread Shuyi Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17897288#comment-17897288 ] Shuyi Chen edited comment on FLINK-36686 at 11/11/24 10:37 PM: ---

[jira] [Commented] (FLINK-36686) allow customizing env variables for flink-webhook container

2024-11-11 Thread Shuyi Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17897288#comment-17897288 ] Shuyi Chen commented on FLINK-36686: Created PR [https://github.com/apache/flink-kub

Re: [PR] [FLINK-36047] Add CompiledPlan annotations to BatchExecOverAggregate [flink]

2024-11-11 Thread via GitHub
jnh5y commented on code in PR #25635: URL: https://github.com/apache/flink/pull/25635#discussion_r1837260891 ## flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/plan/nodes/exec/batch/OverAggregateBatchRestoreTest.java: ## @@ -0,0 +1,45 @@ +/* + * Lice

[PR] add operatorPod.webhook.container.env to allow customizating of flink-webhook container envs [flink-kubernetes-operator]

2024-11-11 Thread via GitHub
suez1224 opened a new pull request, #914: URL: https://github.com/apache/flink-kubernetes-operator/pull/914 ## What is the purpose of the change *(For example: This pull request adds a new feature to periodically create and maintain savepoints through the `FlinkDeployment` cus

Re: [PR] [FLINK-36493][TABLE API] Remove all deprecated methods in MapView [flink]

2024-11-11 Thread via GitHub
SamBarker commented on code in PR #25566: URL: https://github.com/apache/flink/pull/25566#discussion_r1837241184 ## flink-table/flink-table-common/src/main/java/org/apache/flink/table/api/dataview/MapView.java: ## @@ -88,11 +85,7 @@ * } * * } - * - * @param key type - * @

Re: [PR] [FLINK-36492][TABLE API] Remove all deprecated methods in ListView [flink]

2024-11-11 Thread via GitHub
SamBarker commented on code in PR #25565: URL: https://github.com/apache/flink/pull/25565#discussion_r1837239642 ## flink-table/flink-table-common/src/main/java/org/apache/flink/table/api/dataview/ListView.java: ## @@ -186,22 +182,4 @@ public static DataType newListViewDataType(

Re: [PR] [FLINK-36047] Add CompiledPlan annotations to BatchExecOverAggregate [flink]

2024-11-11 Thread via GitHub
snuyanzin commented on code in PR #25635: URL: https://github.com/apache/flink/pull/25635#discussion_r1837235503 ## flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/plan/nodes/exec/batch/OverAggregateBatchRestoreTest.java: ## @@ -0,0 +1,45 @@ +/* + *

[jira] [Updated] (FLINK-36685) Enable update/create operation on flinkdeployment resource in mutation webhook

2024-11-11 Thread Shuyi Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyi Chen updated FLINK-36685: --- Priority: Blocker (was: Minor) > Enable update/create operation on flinkdeployment resource in muta

[jira] [Commented] (FLINK-36685) Enable update/create operation on flinkdeployment resource in mutation webhook

2024-11-11 Thread Shuyi Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17897251#comment-17897251 ] Shuyi Chen commented on FLINK-36685: Thanks [~gyfora]. We used mutation webhook to i

Re: [PR] [FLINK-15867][table-planner-blink] Support time-related types for FIRST_VALUE and LAST_VALUE aggregate functions [flink]

2024-11-11 Thread via GitHub
shmyer closed pull request #14084: [FLINK-15867][table-planner-blink] Support time-related types for FIRST_VALUE and LAST_VALUE aggregate functions URL: https://github.com/apache/flink/pull/14084 -- This is an automated message from the Apache Git Service. To respond to the message, please lo

Re: [PR] [FLINK-36679][runtime] Add a metric to track checkpoint _metadata size [flink]

2024-11-11 Thread via GitHub
liuml07 commented on PR #25634: URL: https://github.com/apache/flink/pull/25634#issuecomment-2468823024 The failing test `RescaleCheckpointManuallyITCase.testCheckpointRescalingInKeyedState` seems to be unreliable. I see it's failing in multiple recent builds of other PRs. -- This is an

[jira] [Updated] (FLINK-36679) Add a metric to track checkpoint _metadata size

2024-11-11 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated FLINK-36679: -- Description: Currently we expose multiple metrics for the checkpoint size. One specific inter

[jira] [Comment Edited] (FLINK-36495) Remove deprecated method `CatalogBaseTable#getSchema`

2024-11-11 Thread Gantigmaa Selenge (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17897204#comment-17897204 ] Gantigmaa Selenge edited comment on FLINK-36495 at 11/11/24 4:45 PM: -

[jira] [Updated] (FLINK-35067) Support metadata 'op_type' virtual column for Postgres CDC Connector.

2024-11-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35067: --- Labels: pull-request-available (was: ) > Support metadata 'op_type' virtual column for Pos

[jira] [Commented] (FLINK-36495) Remove deprecated method `CatalogBaseTable#getSchema`

2024-11-11 Thread Gantigmaa Selenge (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17897204#comment-17897204 ] Gantigmaa Selenge commented on FLINK-36495: --- Removing getSchema() results in s

[jira] [Assigned] (FLINK-36668) Release flink-connector-aws v5.0.0

2024-11-11 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Liang Teoh reassigned FLINK-36668: --- Assignee: Hong Liang Teoh > Release flink-connector-aws v5.0.0 > --

[jira] [Resolved] (FLINK-36668) Release flink-connector-aws v5.0.0

2024-11-11 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Liang Teoh resolved FLINK-36668. - Resolution: Fixed  merged commit [{{6cad12a}}|https://github.com/apache/flink/commit/6c

[jira] [Commented] (FLINK-36668) Release flink-connector-aws v5.0.0

2024-11-11 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17897190#comment-17897190 ] Hong Liang Teoh commented on FLINK-36668: -  merged commit [{{9d1e744}}|https://

[jira] [Commented] (FLINK-36668) Release flink-connector-aws v5.0.0

2024-11-11 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17897191#comment-17897191 ] Hong Liang Teoh commented on FLINK-36668: -  merged commit [{{54994fc}}|https://

Re: [PR] [FLINK-36668][docs] Update AWS docs for v5.0 [flink]

2024-11-11 Thread via GitHub
hlteoh37 merged PR #25641: URL: https://github.com/apache/flink/pull/25641 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apac

Re: [PR] Update AWS docs for v5.0 [flink]

2024-11-11 Thread via GitHub
hlteoh37 merged PR #25640: URL: https://github.com/apache/flink/pull/25640 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apac

Re: [PR] [FLINK-36668][build] Update AWS build for v5.0 [flink-connector-aws]

2024-11-11 Thread via GitHub
hlteoh37 merged PR #181: URL: https://github.com/apache/flink-connector-aws/pull/181 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@

Re: [PR] [FLINK-36668][docs] Update AWS docs for v5.0 [flink]

2024-11-11 Thread via GitHub
hlteoh37 merged PR #25615: URL: https://github.com/apache/flink/pull/25615 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apac

[jira] [Commented] (FLINK-36668) Release flink-connector-aws v5.0.0

2024-11-11 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17897189#comment-17897189 ] Hong Liang Teoh commented on FLINK-36668: -  merged commit [{{b55dec1}}|https://

Re: [PR] [FLINK-36578][mysql][BUG] Add table information of binlog offsets when checkpointing added modified JsonStringFormatter [flink-cdc]

2024-11-11 Thread via GitHub
yuxiqian commented on code in PR #3658: URL: https://github.com/apache/flink-cdc/pull/3658#discussion_r1836571642 ## flink-cdc-connect/flink-cdc-source-connectors/flink-connector-mysql-cdc/src/main/java/com/github/shyiko/mysql/binlog/event/deserialization/json/JsonStringFormatter.java:

[PR] [FLINK-36668][build] Update AWS build for v5.0 [flink-connector-aws]

2024-11-11 Thread via GitHub
hlteoh37 opened a new pull request, #181: URL: https://github.com/apache/flink-connector-aws/pull/181 ## Purpose of the change Bump version to `5.1-SNAPSHOT` ## Verifying this change This change is a trivial rework / code cleanup without any test coverage. ## Signi

Re: [PR] [FLINK-36517][cdc-connect][paimon] use filterAndCommit API for Avoid commit the same datafile duplicate [flink-cdc]

2024-11-11 Thread via GitHub
beryllw commented on PR #3639: URL: https://github.com/apache/flink-cdc/pull/3639#issuecomment-2468035197 OK. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe

[jira] [Commented] (FLINK-36517) Duplicate commit the same datafile in Paimon Sink

2024-11-11 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17897170#comment-17897170 ] Leonard Xu commented on FLINK-36517: master: ff77a490bd88d86952d47607f44a07163f5d8ce

Re: [PR] [FLINK-36668][docs] Update AWS docs for v5.0 [flink]

2024-11-11 Thread via GitHub
flinkbot commented on PR #25641: URL: https://github.com/apache/flink/pull/25641#issuecomment-2468003927 ## CI report: * 3fbb73b9949c82cd8d228fb7ad9021a0ec9d UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] Update AWS docs for v5.0 [flink]

2024-11-11 Thread via GitHub
flinkbot commented on PR #25640: URL: https://github.com/apache/flink/pull/25640#issuecomment-2468003517 ## CI report: * 1065f7eed7613996db99b0bd1e0d5a6e28030c10 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-36517][cdc-connect][paimon] use filterAndCommit API for Avoid commit the same datafile duplicate [flink-cdc]

2024-11-11 Thread via GitHub
leonardBang commented on PR #3639: URL: https://github.com/apache/flink-cdc/pull/3639#issuecomment-2468003278 @beryllw Would you like to backport this fix to release-3.2 branch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[jira] [Assigned] (FLINK-36517) Duplicate commit the same datafile in Paimon Sink

2024-11-11 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reassigned FLINK-36517: -- Assignee: JunboWang > Duplicate commit the same datafile in Paimon Sink > ---

[jira] [Updated] (FLINK-36517) Duplicate commit the same datafile in Paimon Sink

2024-11-11 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu updated FLINK-36517: --- Fix Version/s: cdc-3.2.1 > Duplicate commit the same datafile in Paimon Sink > -

[jira] [Updated] (FLINK-36517) Duplicate commit the same datafile in Paimon Sink

2024-11-11 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu updated FLINK-36517: --- Fix Version/s: cdc-3.3.0 > Duplicate commit the same datafile in Paimon Sink > -

Re: [PR] [FLINK-36517][cdc-connect][paimon] use filterAndCommit API for Avoid commit the same datafile duplicate [flink-cdc]

2024-11-11 Thread via GitHub
leonardBang merged PR #3639: URL: https://github.com/apache/flink-cdc/pull/3639 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink

[PR] [FLINK-36668][docs] Update AWS docs for v5.0 [flink]

2024-11-11 Thread via GitHub
hlteoh37 opened a new pull request, #25641: URL: https://github.com/apache/flink/pull/25641 ## What is the purpose of the change Update AWS docs for v5.0 ## Brief change log Update AWS docs for v5.0 ## Verifying this change This change is a trivial rework / code cle

[PR] Update AWS docs for v5.0 [flink]

2024-11-11 Thread via GitHub
hlteoh37 opened a new pull request, #25640: URL: https://github.com/apache/flink/pull/25640 ## What is the purpose of the change Update AWS docs for v5.0 ## Brief change log Update AWS docs for v5.0 ## Verifying this change This change is a trivial rework / code

Re: [PR] [BP-3.2][FLINK-36474] Support merging timestamp columns when routing [flink-cdc]

2024-11-11 Thread via GitHub
leonardBang merged PR #3693: URL: https://github.com/apache/flink-cdc/pull/3693 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink

[jira] [Comment Edited] (FLINK-36214) Error log when building flink-cdc-pipeline-udf-examples from source code

2024-11-11 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17892072#comment-17892072 ] Leonard Xu edited comment on FLINK-36214 at 11/11/24 11:31 AM: ---

Re: [PR] [BP-3.2][FLINK-36214] Downgrade scala-maven-plugin version to 4.8.0 to keep compatibility with Java 8 [flink-cdc]

2024-11-11 Thread via GitHub
leonardBang merged PR #3662: URL: https://github.com/apache/flink-cdc/pull/3662 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink

Re: [PR] [FLINK-36598][state/ForSt] Provide FileSystem instance in initialization [flink]

2024-11-11 Thread via GitHub
Zakelly commented on PR #25638: URL: https://github.com/apache/flink/pull/25638#issuecomment-2467948590 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Updated] (FLINK-36545) generate-olm-bundle.sh switches uid/gid when running the OLM tool image

2024-11-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36545: --- Labels: pull-request-available (was: ) > generate-olm-bundle.sh switches uid/gid when runni

[PR] FLINK-36545: [OLM] fix uid/gid mixup when generating the OLM bundle. [flink-kubernetes-operator]

2024-11-11 Thread via GitHub
k-wall opened a new pull request, #913: URL: https://github.com/apache/flink-kubernetes-operator/pull/913 The docker container was being run with the uid/gid arguments switched about. ## What is the purpose of the change As pointed out by https://issues.apache.org/jira/b

[jira] [Comment Edited] (FLINK-36474) YAML Table-merging route should accept more type widening cases

2024-11-11 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17895937#comment-17895937 ] Leonard Xu edited comment on FLINK-36474 at 11/11/24 11:18 AM: ---

[jira] [Closed] (FLINK-36474) YAML Table-merging route should accept more type widening cases

2024-11-11 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu closed FLINK-36474. -- Resolution: Fixed > YAML Table-merging route should accept more type widening cases >

  1   2   >