[jira] [Created] (FLINK-35875) Flink cdc frequently encounters LabelAlreadyExists errors

2024-07-22 Thread Jira
牛一凡 created FLINK-35875: --- Summary: Flink cdc frequently encounters LabelAlreadyExists errors Key: FLINK-35875 URL: https://issues.apache.org/jira/browse/FLINK-35875 Project: Flink Issue Type: Bug

[jira] [Closed] (FLINK-35844) Build Release Candidate: 1.20.0-rc1

2024-07-22 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo closed FLINK-35844. -- Resolution: Abandoned > Build Release Candidate: 1.20.0-rc1 > >

[jira] [Commented] (FLINK-35844) Build Release Candidate: 1.20.0-rc1

2024-07-22 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17867958#comment-17867958 ] Weijie Guo commented on FLINK-35844: 1.20-rc1 was officially cancelled because of th

[jira] [Closed] (FLINK-35848) [Release-1.20] Vote on the release candidate

2024-07-22 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo closed FLINK-35848. -- Resolution: Invalid Canceled. > [Release-1.20] Vote on the release candidate > --

Re: [PR] [FLINK-27355][runtime] Unregister JobManagerRunner after it's closed [flink]

2024-07-22 Thread via GitHub
XComp commented on code in PR #25027: URL: https://github.com/apache/flink/pull/25027#discussion_r1687470490 ## flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/DefaultJobManagerRunnerRegistry.java: ## @@ -83,9 +83,15 @@ public Collection getJobManagerRunners() {

[jira] [Commented] (FLINK-35835) SnapshotFileMergingCompatibilityITCase.testSwitchFromDisablingToEnablingFileMerging failed on AZP

2024-07-22 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17867954#comment-17867954 ] Zakelly Lan commented on FLINK-35835: - [~Weijie Guo] Seems 1.20 does not contain FLI

Re: [PR] [BP-1.20][FLINK-35095][test] Fix unstable tests in `ExecutionEnvironmentImplTest` [flink]

2024-07-22 Thread via GitHub
flinkbot commented on PR #25111: URL: https://github.com/apache/flink/pull/25111#issuecomment-2244299273 ## CI report: * 599839b334cb52e6159912ccb2162e314ce38198 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Commented] (FLINK-23598) DataOutputSerializer.writeBytes updates position twice

2024-07-22 Thread Shalini M (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17867951#comment-17867951 ] Shalini M commented on FLINK-23598: --- Hi , Is there any update on this issue as there i

[jira] [Commented] (FLINK-35810) AsyncWaitOperatorTest.testProcessingTimeRepeatedCompleteUnorderedWithRetry fails

2024-07-22 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17867950#comment-17867950 ] Weijie Guo commented on FLINK-35810: https://dev.azure.com/apache-flink/apache-flink

[jira] [Commented] (FLINK-33555) LocalRecoveryITCase.testRecoverLocallyFromProcessCrashWithWorkingDirectory:

2024-07-22 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17867949#comment-17867949 ] Weijie Guo commented on FLINK-33555: https://dev.azure.com/apache-flink/apache-flink

[jira] [Commented] (FLINK-35835) SnapshotFileMergingCompatibilityITCase.testSwitchFromDisablingToEnablingFileMerging failed on AZP

2024-07-22 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17867948#comment-17867948 ] Weijie Guo commented on FLINK-35835: https://dev.azure.com/apache-flink/apache-flink

[PR] [BP-1.20]][FLINK-35095][test] Fix unstable tests in `ExecutionEnvironmentImplTest` [flink]

2024-07-22 Thread via GitHub
reswqa opened a new pull request, #25111: URL: https://github.com/apache/flink/pull/25111 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mai

Re: [PR] [FLINK-23598] [core] Fix a bug that caused position to be updated twice when writing a string to a byte array [flink]

2024-07-22 Thread via GitHub
sn-12-3 commented on PR #23563: URL: https://github.com/apache/flink/pull/23563#issuecomment-2244234183 Hello, could someone please clarify if this PR requires any further modifications as the PR is open from quite some time now. -- This is an automated message from the Apache Git Service

Re: [PR] [cdc-common] add field of defaultValue to Column. [flink-cdc]

2024-07-22 Thread via GitHub
leonardBang commented on PR #2944: URL: https://github.com/apache/flink-cdc/pull/2944#issuecomment-2244218226 @lvyanquan Could you check the failed tests? and it's recommended to rebase master. -- This is an automated message from the Apache Git Service. To respond to the message, pleas

Re: [PR] [FLINK-35713][cdc-compose] Add sink PARALLELISM for flink-cdc. [flink-cdc]

2024-07-22 Thread via GitHub
ruanhang1993 commented on code in PR #3438: URL: https://github.com/apache/flink-cdc/pull/3438#discussion_r1687392535 ## flink-cdc-composer/src/main/java/org/apache/flink/cdc/composer/flink/FlinkPipelineComposer.java: ## @@ -93,6 +93,7 @@ private FlinkPipelineComposer(StreamExec

Re: [PR] [FLINK-31931][runtime] Prevent exception history page from linking to non-existent TM page. [flink]

2024-07-22 Thread via GitHub
JunRuiLee closed pull request #22542: [FLINK-31931][runtime] Prevent exception history page from linking to non-existent TM page. URL: https://github.com/apache/flink/pull/22542 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[jira] [Assigned] (FLINK-34730) Translate pages of Flink CDC docs to Chinese

2024-07-22 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reassigned FLINK-34730: -- Assignee: LvYanquan > Translate pages of Flink CDC docs to Chinese >

[jira] [Commented] (FLINK-35740) [mysql] Allow column as chunk key even if not in Primary Keys

2024-07-22 Thread ouyangwulin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17867938#comment-17867938 ] ouyangwulin commented on FLINK-35740: - [~seung-min]  As this ticket describe,I have

Re: [PR] [minor][cdc-connector][oracle] OracleSchema getTableSchema Description Modified [flink-cdc]

2024-07-22 Thread via GitHub
leonardBang merged PR #3443: URL: https://github.com/apache/flink-cdc/pull/3443 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink

Re: [PR] [FLINK-35766][streaming] Fix hang issue in JobGraph generation when StreamGraph contains many YieldingOperatorFactory. [flink]

2024-07-22 Thread via GitHub
flinkbot commented on PR #25110: URL: https://github.com/apache/flink/pull/25110#issuecomment-2244169719 ## CI report: * e83bc90e32841a76be85d96d25e1098e9276c50a UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[PR] [FLINK-35766][streaming] Fix hang issue in JobGraph generation when StreamGraph contains many YieldingOperatorFactory. [flink]

2024-07-22 Thread via GitHub
JunRuiLee opened a new pull request, #25110: URL: https://github.com/apache/flink/pull/25110 ## What is the purpose of the change Fix hang issue in JobGraph generation when StreamGraph contains many YieldingOperatorFactory. ## Brief change log Add a c

[jira] [Updated] (FLINK-35766) When the job contains many YieldingOperatorFactory instances, compiling the JobGraph hangs

2024-07-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35766: --- Labels: pull-request-available (was: ) > When the job contains many YieldingOperatorFactory

Re: [PR] [FLINK-35674][cdc-connector][mysql]Fix blocking caused by searching for timestamp in binlog file [flink-cdc]

2024-07-22 Thread via GitHub
shiyiky commented on code in PR #3432: URL: https://github.com/apache/flink-cdc/pull/3432#discussion_r1687363640 ## flink-cdc-connect/flink-cdc-source-connectors/flink-connector-mysql-cdc/src/main/java/org/apache/flink/cdc/connectors/mysql/debezium/DebeziumUtils.java: ## @@ -240

Re: [PR] [FLINK-35674][cdc-connector][mysql]Fix blocking caused by searching for timestamp in binlog file [flink-cdc]

2024-07-22 Thread via GitHub
whhe commented on code in PR #3432: URL: https://github.com/apache/flink-cdc/pull/3432#discussion_r1687359553 ## flink-cdc-connect/flink-cdc-source-connectors/flink-connector-mysql-cdc/src/main/java/org/apache/flink/cdc/connectors/mysql/debezium/DebeziumUtils.java: ## @@ -240,12

[jira] [Commented] (FLINK-35874) Check pureBinlogPhaseTables set before call getBinlogPosition method in BinlogSplitReader

2024-07-22 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17867932#comment-17867932 ] Leonard Xu commented on FLINK-35874: [~qiaozhongmin] Assigned to you > Check pureBi

[jira] [Assigned] (FLINK-35873) Add HashFunctionProvider for Paimon DataSink.

2024-07-22 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reassigned FLINK-35873: -- Assignee: LvYanquan > Add HashFunctionProvider for Paimon DataSink. > ---

[jira] [Assigned] (FLINK-35874) Check pureBinlogPhaseTables set before call getBinlogPosition method in BinlogSplitReader

2024-07-22 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reassigned FLINK-35874: -- Assignee: Zhongmin Qiao > Check pureBinlogPhaseTables set before call getBinlogPosition metho

[jira] [Resolved] (FLINK-35865) Support Byte and Short in ObjectUtils

2024-07-22 Thread Zhongqiang Gong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongqiang Gong resolved FLINK-35865. - Resolution: Fixed Merged Into Master via :c5f391cf6a032333f398038cf96b11a0354bf3c3 > S

[jira] [Assigned] (FLINK-35865) Support Byte and Short in ObjectUtils

2024-07-22 Thread Zhongqiang Gong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongqiang Gong reassigned FLINK-35865: --- Assignee: Zhongqiang Gong > Support Byte and Short in ObjectUtils > -

Re: [PR] [FLINK-35865][base] Support Byte and Short in ObjectUtils [flink-cdc]

2024-07-22 Thread via GitHub
GOODBOY008 merged PR #3481: URL: https://github.com/apache/flink-cdc/pull/3481 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.

Re: [PR] [cdc-runtime]SchemaRegistry Log output is repeated [flink-cdc]

2024-07-22 Thread via GitHub
ChengJie1053 commented on PR #3487: URL: https://github.com/apache/flink-cdc/pull/3487#issuecomment-2244140620 @PatrickRen Hi, can you take a look at this code for me -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and us

[jira] [Commented] (FLINK-35095) ExecutionEnvironmentImplTest.testFromSource failure on GitHub CI

2024-07-22 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17867926#comment-17867926 ] Weijie Guo commented on FLINK-35095: https://dev.azure.com/apache-flink/apache-flink

Re: [PR] [FLINK-35674][cdc-connector][mysql]Fix blocking caused by searching for timestamp in binlog file [flink-cdc]

2024-07-22 Thread via GitHub
whhe commented on PR #3432: URL: https://github.com/apache/flink-cdc/pull/3432#issuecomment-2244137919 > May be we should consider fix the BinaryLogClient with LifecycleListener in a new pr ,because another pr also should be fixed https://github.com/apache/flink-cdc/pull/1915/ +1, c

[jira] [Commented] (FLINK-35874) Check pureBinlogPhaseTables set before call getBinlogPosition method in BinlogSplitReader

2024-07-22 Thread Zhongmin Qiao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17867924#comment-17867924 ] Zhongmin Qiao commented on FLINK-35874: --- Assign this pr to me please.   https://gi

Re: [PR] [FLINK-35363] FLIP-449: Reorganization of flink-connector-jdbc [flink-connector-jdbc]

2024-07-22 Thread via GitHub
RocMarshal commented on PR #123: URL: https://github.com/apache/flink-connector-jdbc/pull/123#issuecomment-2244122538 > Note: Before the merge, we can consider removing the backward-compatibility module (and workflow) to avoid generating the jar, as it was only meant to be a helper.

Re: [PR] [hotfix][docs] Add missing "Submitting a Flink job" section in Chinese version doc and other fixes [flink]

2024-07-22 Thread via GitHub
showuon commented on PR #24952: URL: https://github.com/apache/flink/pull/24952#issuecomment-2244119347 The CI test passed. Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Re: [PR] [hotfix] [docs] Fix java doc api [flink]

2024-07-22 Thread via GitHub
reswqa merged PR #25101: URL: https://github.com/apache/flink/pull/25101 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache

Re: [PR] [hotfix] [base] Fix the serialization error occurring with table names containing dot [flink-cdc]

2024-07-22 Thread via GitHub
leonardBang commented on code in PR #2705: URL: https://github.com/apache/flink-cdc/pull/2705#discussion_r1687318951 ## flink-cdc-connect/flink-cdc-source-connectors/flink-cdc-base/src/main/java/org/apache/flink/cdc/connectors/base/source/meta/split/SourceSplitSerializer.java: #

[PR] [cdc-runtime]SchemaRegistry Log output is repeated [flink-cdc]

2024-07-22 Thread via GitHub
ChengJie1053 opened a new pull request, #3487: URL: https://github.com/apache/flink-cdc/pull/3487 ![image](https://github.com/user-attachments/assets/0d8bbbf7-98d1-4ca2-896b-f0f27bc074ff) ![image](https://github.com/user-attachments/assets/60ba14d1-09e2-4cb8-b648-a857c76600c3)

Re: [PR] [FLINK-35674][cdc-connector][mysql]Fix blocking caused by searching for timestamp in binlog file [flink-cdc]

2024-07-22 Thread via GitHub
shiyiky commented on PR #3432: URL: https://github.com/apache/flink-cdc/pull/3432#issuecomment-2244093727 May be we should consider fix the BinaryLogClient with LifecycleListener in a new pr ,because another pr also should be fixed https://github.com/apache/flink-cdc/pull/1915/ -- This

Re: [PR] [FLINK-35674][cdc-connector][mysql]Fix blocking caused by searching for timestamp in binlog file [flink-cdc]

2024-07-22 Thread via GitHub
shiyiky commented on PR #3432: URL: https://github.com/apache/flink-cdc/pull/3432#issuecomment-2244085865 > I think adding a server id can indeed solve the issue, and a LifecycleListener is also needed for other exceptions. Can you add a basic implementation like `ReaderThreadLifecycleListe

[jira] [Assigned] (FLINK-33100) Implement YarnJobFetcher for Standalone Autoscaler

2024-07-22 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan reassigned FLINK-33100: --- Assignee: Samrat Deb (was: Rui Fan) > Implement YarnJobFetcher for Standalone Autoscaler > ---

Re: [PR] [hotfix] [base] Fix the serialization error occurring with table names containing dot [flink-cdc]

2024-07-22 Thread via GitHub
github-actions[bot] commented on PR #2705: URL: https://github.com/apache/flink-cdc/pull/2705#issuecomment-2244013184 This pull request has been automatically marked as stale because it has not had recent activity for 60 days. It will be closed in 30 days if no further activity occurs. --

Re: [PR] [FLINK-31362][table] Upgrade Calcite version to 1.33.0 [flink]

2024-07-22 Thread via GitHub
snuyanzin commented on PR #24255: URL: https://github.com/apache/flink/pull/24255#issuecomment-2243935706 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [FLINK-35265] Implement FlinkStateSnapshot custom resource [flink-kubernetes-operator]

2024-07-22 Thread via GitHub
ferenc-csaky commented on code in PR #821: URL: https://github.com/apache/flink-kubernetes-operator/pull/821#discussion_r1686812531 ## flink-kubernetes-operator-api/src/main/java/org/apache/flink/kubernetes/operator/api/spec/CheckpointSpec.java: ## @@ -0,0 +1,39 @@ +/* + * Lice

Re: [PR] [FLINK-35265] Implement FlinkStateSnapshot custom resource [flink-kubernetes-operator]

2024-07-22 Thread via GitHub
ferenc-csaky commented on code in PR #821: URL: https://github.com/apache/flink-kubernetes-operator/pull/821#discussion_r1684358470 ## flink-kubernetes-operator-api/src/main/java/org/apache/flink/kubernetes/operator/api/spec/JobSpec.java: ## @@ -90,8 +100,8 @@ public class JobS

Re: [PR] [FLINK-35267][snapshot] FlinkStateSnapshot documentation and examples [flink-kubernetes-operator]

2024-07-22 Thread via GitHub
ferenc-csaky commented on code in PR #854: URL: https://github.com/apache/flink-kubernetes-operator/pull/854#discussion_r1686476104 ## docs/content/docs/custom-resource/snapshots.md: ## @@ -0,0 +1,117 @@ +--- +title: "Snapshots" +weight: 3 +type: docs +aliases: + - /custom-res

Re: [PR] [FLINK-27355][runtime] Unregister JobManagerRunner after it's closed [flink]

2024-07-22 Thread via GitHub
kumar-mallikarjuna commented on code in PR #25027: URL: https://github.com/apache/flink/pull/25027#discussion_r1686805757 ## flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/DefaultJobManagerRunnerRegistry.java: ## @@ -97,6 +106,14 @@ public JobManagerRunner unreg

Re: [PR] [FLINK-27355][runtime] Unregister JobManagerRunner after it's closed [flink]

2024-07-22 Thread via GitHub
kumar-mallikarjuna commented on code in PR #25027: URL: https://github.com/apache/flink/pull/25027#discussion_r1686804638 ## flink-runtime/src/test/java/org/apache/flink/runtime/dispatcher/DefaultJobManagerRunnerRegistryTest.java: ## @@ -164,7 +164,8 @@ void testFailingLocalClea

Re: [PR] [FLINK-21373] Add RabbitMQ SinkV2 Implementation, Port Flink version to Flink 1.19 [flink-connector-rabbitmq]

2024-07-22 Thread via GitHub
rjbaucells commented on PR #29: URL: https://github.com/apache/flink-connector-rabbitmq/pull/29#issuecomment-2243290547 Hello, What is the status of this PR? Thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

[jira] [Commented] (FLINK-35726) Data Stream to Table API converts Map to RAW 'java.util.Map'

2024-07-22 Thread David Perkins (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17867790#comment-17867790 ] David Perkins commented on FLINK-35726: --- [~sverma] , Seems odd that this is inten

Re: [PR] [FLINK-31215] [autoscaler] Backpropagate processing rate limits from non-scalable bottlenecks to upstream operators [flink-kubernetes-operator]

2024-07-22 Thread via GitHub
mxm commented on PR #847: URL: https://github.com/apache/flink-kubernetes-operator/pull/847#issuecomment-2243227124 > The `actual_target_data_rate_join` still can be greater than `target_data_rate_upstream_1` or `target_data_rate_upstream_2`. It means that the upstreams' target_data_rate r

Re: [PR] [FLINK-27355][runtime] Unregister JobManagerRunner after it's closed [flink]

2024-07-22 Thread via GitHub
kumar-mallikarjuna commented on code in PR #25027: URL: https://github.com/apache/flink/pull/25027#discussion_r1686721979 ## flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/DefaultJobManagerRunnerRegistry.java: ## @@ -97,6 +106,14 @@ public JobManagerRunner unreg

[jira] [Created] (FLINK-35874) Check pureBinlogPhaseTables set before call getBinlogPosition method in BinlogSplitReader

2024-07-22 Thread Zhongmin Qiao (Jira)
Zhongmin Qiao created FLINK-35874: - Summary: Check pureBinlogPhaseTables set before call getBinlogPosition method in BinlogSplitReader Key: FLINK-35874 URL: https://issues.apache.org/jira/browse/FLINK-35874

Re: [PR] [FLINK-35674][cdc-connector][mysql]Fix blocking caused by searching for timestamp in binlog file [flink-cdc]

2024-07-22 Thread via GitHub
whhe commented on PR #3432: URL: https://github.com/apache/flink-cdc/pull/3432#issuecomment-2242931869 I think adding a server id can indeed solve the issue, and a LifecycleListener is also needed for other exceptions. Can you add a basic implementation like `ReaderThreadLifecycleListener`

[jira] [Updated] (FLINK-35872) Fix the incorrect partition generation during period refresh in Full Mode

2024-07-22 Thread dalongliu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dalongliu updated FLINK-35872: -- Fix Version/s: 2.0.0 1.20.0 > Fix the incorrect partition generation during period

[jira] [Resolved] (FLINK-35872) Fix the incorrect partition generation during period refresh in Full Mode

2024-07-22 Thread dalongliu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dalongliu resolved FLINK-35872. --- Resolution: Fixed > Fix the incorrect partition generation during period refresh in Full Mode >

[jira] [Commented] (FLINK-35872) Fix the incorrect partition generation during period refresh in Full Mode

2024-07-22 Thread dalongliu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17867749#comment-17867749 ] dalongliu commented on FLINK-35872: --- Merged in master: af7d2b3ab0e0ecc4157005704bebac9

[jira] [Updated] (FLINK-35873) Add HashFunctionProvider for Paimon DataSink.

2024-07-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35873: --- Labels: pull-request-available (was: ) > Add HashFunctionProvider for Paimon DataSink. > --

[PR] [FLINK-35873][cdc-connector][paimon] Add HashFunctionProvider implementation for PaimonDataSink. [flink-cdc]

2024-07-22 Thread via GitHub
lvyanquan opened a new pull request, #3486: URL: https://github.com/apache/flink-cdc/pull/3486 A followup of https://github.com/apache/flink-cdc/pull/3414. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Commented] (FLINK-35634) Add a CDC quickstart utility

2024-07-22 Thread yux (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17867744#comment-17867744 ] yux commented on FLINK-35634: - Paimon / kafka sink options have been added. > Add a CDC qui

[jira] [Created] (FLINK-35873) Add HashFunctionProvider for Paimon DataSink.

2024-07-22 Thread LvYanquan (Jira)
LvYanquan created FLINK-35873: - Summary: Add HashFunctionProvider for Paimon DataSink. Key: FLINK-35873 URL: https://issues.apache.org/jira/browse/FLINK-35873 Project: Flink Issue Type: New Featu

Re: [PR] [FLINK-35872][table] Fix the incorrect partition generation during period refresh in Full Mode [flink]

2024-07-22 Thread via GitHub
lsyldliu closed pull request #25108: [FLINK-35872][table] Fix the incorrect partition generation during period refresh in Full Mode URL: https://github.com/apache/flink/pull/25108 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

Re: [PR] [FLINK-34877][cdc] Flink CDC pipeline transform supports type conversion [flink-cdc]

2024-07-22 Thread via GitHub
leonardBang commented on PR #3357: URL: https://github.com/apache/flink-cdc/pull/3357#issuecomment-2242770101 > Is it possible to add actual values conversion checks besides existing syntax parsing tests? And it should cover cases where `NULL` value is passed as conversion argument.

Re: [PR] [FLINK-27355][runtime] Unregister JobManagerRunner after it's closed [flink]

2024-07-22 Thread via GitHub
XComp commented on code in PR #25027: URL: https://github.com/apache/flink/pull/25027#discussion_r1686411653 ## flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/DefaultJobManagerRunnerRegistry.java: ## @@ -97,6 +106,14 @@ public JobManagerRunner unregister(JobID j

[jira] [Commented] (FLINK-35853) Regression in checkpoint size when performing full checkpointing in RocksDB

2024-07-22 Thread Keith Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17867735#comment-17867735 ] Keith Lee commented on FLINK-35853: --- Thanks for your response Jinzhong. I understand

Re: [PR] [FLINK-35864][Table SQL / API] Add CONV function [flink]

2024-07-22 Thread via GitHub
flinkbot commented on PR #25109: URL: https://github.com/apache/flink/pull/25109#issuecomment-2242532958 ## CI report: * fc3fe3cbe67d160f08dec878039f66d42a91b29d UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Commented] (FLINK-35864) Add CONV function

2024-07-22 Thread Dylan He (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17867725#comment-17867725 ] Dylan He commented on FLINK-35864: -- The original Hive implementation of CONV is kind of

[jira] [Updated] (FLINK-35864) Add CONV function

2024-07-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35864: --- Labels: pull-request-available (was: ) > Add CONV function > - > >

[PR] [FLINK-35864][Table SQL / API] Add CONV function [flink]

2024-07-22 Thread via GitHub
dylanhz opened a new pull request, #25109: URL: https://github.com/apache/flink/pull/25109 ## What is the purpose of the change Add CONV function. Examples: ```SQL > SELECT CONV(7, 10, 2); 111 ``` ## Brief change log [FLINK-35864](https://issues.apa

Re: [PR] [FLINK-32501][table-planner] Fix wrong plan of a proctime window aggregation generated due to incorrect cost evaluation [flink]

2024-07-22 Thread via GitHub
Myasuka commented on PR #22964: URL: https://github.com/apache/flink/pull/22964#issuecomment-2242408382 It seems this backport was not merged in release-1.17 branch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[jira] [Comment Edited] (FLINK-35576) FRocksDB cherry pick IngestDB related commits

2024-07-22 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17867681#comment-17867681 ] Yue Ma edited comment on FLINK-35576 at 7/22/24 8:10 AM: - [~roma

[jira] [Commented] (FLINK-35576) FRocksDB cherry pick IngestDB related commits

2024-07-22 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17867681#comment-17867681 ] Yue Ma commented on FLINK-35576: update the pull request [https://github.com/ververica/f

Re: [PR] [FLINK-35318][table-planner] use UTC timezone to handle TIMESTAMP_WITHOUT_TIME_ZONE type in RexNodeToExpressionConverter [flink]

2024-07-22 Thread via GitHub
lshangq commented on PR #24787: URL: https://github.com/apache/flink/pull/24787#issuecomment-2242267464 @leonardBang Could you please take a look when you have time? cherry-pick to release-1.19 https://github.com/apache/flink/pull/25093 cherry-pick to release-1.20 https://github.co

Re: [PR] [FLINK-35674][cdc-connector][mysql]Fix blocking caused by searching for timestamp in binlog file [flink-cdc]

2024-07-22 Thread via GitHub
shiyiky commented on PR #3432: URL: https://github.com/apache/flink-cdc/pull/3432#issuecomment-2242253725 @whhe PTAL -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsu