[jira] [Commented] (FLINK-34510) Flink 2.0: Rename RestoreMode to RecoveryClaimMode

2024-08-08 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17872204#comment-17872204 ] Zakelly Lan commented on FLINK-34510: - [~spoon-lz] Thanks for your volunteering! Alr

[jira] [Assigned] (FLINK-34510) Flink 2.0: Rename RestoreMode to RecoveryClaimMode

2024-08-08 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan reassigned FLINK-34510: --- Assignee: liuzhuo > Flink 2.0: Rename RestoreMode to RecoveryClaimMode > --

[jira] [Updated] (FLINK-36020) An exception occurred when enabling the buffer debloating mechanism: Time should be non negative

2024-08-08 Thread siyuan zheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] siyuan zheng updated FLINK-36020: - Description: Running a Flink job on YARN, setting 'taskmanager.network.memory.buffer-debloat.pe

[jira] [Commented] (FLINK-34510) Flink 2.0: Rename RestoreMode to RecoveryClaimMode

2024-08-08 Thread liuzhuo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17872199#comment-17872199 ] liuzhuo commented on FLINK-34510: - [~zakelly] Could you please assign this issue to me?

[jira] [Updated] (FLINK-36020) An exception occurred when enabling the buffer debloating mechanism: Time should be non negative

2024-08-08 Thread siyuan zheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] siyuan zheng updated FLINK-36020: - Summary: An exception occurred when enabling the buffer debloating mechanism: Time should be no

[jira] [Updated] (FLINK-36020) when enable buffer debloating mechanism got a exception: Time should be non negative

2024-08-08 Thread siyuan zheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] siyuan zheng updated FLINK-36020: - Summary: when enable buffer debloating mechanism got a exception: Time should be non negative

[jira] [Updated] (FLINK-36020) exception: Time should be non negative when enable buffer debloating mechanism

2024-08-08 Thread siyuan zheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] siyuan zheng updated FLINK-36020: - Summary: exception: Time should be non negative when enable buffer debloating mechanism (was: e

[jira] [Commented] (FLINK-35615) CDC3.0, the pipeline of mysql-doris , do not support the MySQL field type timestamp(6)

2024-08-08 Thread yux (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17872198#comment-17872198 ] yux commented on FLINK-35615: - This has been resolved in https://github.com/apache/flink-cdc

[jira] [Resolved] (FLINK-35715) Mysql Source support schema cache to deserialize record

2024-08-08 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang resolved FLINK-35715. --- Resolution: Fixed fix via(3.2-SNAPSHOT):07446d1f9de23b6d5e7b50de1b00ba901ffd31db > Mysql Source sup

[jira] [Updated] (FLINK-36020) exception: Time should be non negative

2024-08-08 Thread siyuan zheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] siyuan zheng updated FLINK-36020: - Description: Running a Flink job on YARN, setting 'taskmanager.network.memory.buffer-debloat.pe

Re: [PR] [FLINK-35715][common] Ignore the compact optimize for mysql timestamp type in BinaryRecordData [flink-cdc]

2024-08-08 Thread via GitHub
ruanhang1993 merged PR #3511: URL: https://github.com/apache/flink-cdc/pull/3511 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flin

[jira] [Updated] (FLINK-36020) exception: Time should be non negative

2024-08-08 Thread siyuan zheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] siyuan zheng updated FLINK-36020: - Description: Running a Flink job on YARN, setting 'taskmanager.network.memory.buffer-debloat.pe

[jira] [Created] (FLINK-36020) exception: Time should be non negative

2024-08-08 Thread siyuan zheng (Jira)
siyuan zheng created FLINK-36020: Summary: exception: Time should be non negative Key: FLINK-36020 URL: https://issues.apache.org/jira/browse/FLINK-36020 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-36019) flink_ha目录下的文件,可以通过配置自定义权限

2024-08-08 Thread yanggang (Jira)
yanggang created FLINK-36019: Summary: flink_ha目录下的文件,可以通过配置自定义权限 Key: FLINK-36019 URL: https://issues.apache.org/jira/browse/FLINK-36019 Project: Flink Issue Type: New Feature Affects Versio

[jira] [Commented] (FLINK-35774) The cache of transform is not updated after process schema change event

2024-08-08 Thread yux (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17872193#comment-17872193 ] yux commented on FLINK-35774: - Resolved by https://github.com/apache/flink-cdc/pull/3285. >

[jira] [Commented] (FLINK-35852) When used through the transform function, the decimal(10,2) type field value in the MySQL source table becomes 100 times the original value after being transferred to

2024-08-08 Thread yux (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17872192#comment-17872192 ] yux commented on FLINK-35852: - Resolved in https://github.com/apache/flink-cdc/pull/3285. >

[jira] [Commented] (FLINK-35012) ChangelogNormalizeRestoreTest.testRestore failure

2024-08-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17872188#comment-17872188 ] Weijie Guo commented on FLINK-35012: https://dev.azure.com/apache-flink/apache-flink

Re: [PR] [FLINK-34865][pipeline-connector]support sync table and column comments [flink-cdc]

2024-08-08 Thread via GitHub
qg-lin commented on PR #3482: URL: https://github.com/apache/flink-cdc/pull/3482#issuecomment-2277193856 > fix paimon ![image](https://private-user-images.githubusercontent.com/1145830/356470073-c2e9ceef-80f3-433e-bddf-165d7390a44b.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXR

[jira] [Assigned] (FLINK-35143) Expose newly added tables capture in mysql pipeline connector

2024-08-08 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang reassigned FLINK-35143: - Assignee: linqigeng > Expose newly added tables capture in mysql pipeline connector > -

[jira] [Resolved] (FLINK-35143) Expose newly added tables capture in mysql pipeline connector

2024-08-08 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang resolved FLINK-35143. --- Resolution: Fixed > Expose newly added tables capture in mysql pipeline connector >

[jira] [Assigned] (FLINK-35143) Expose newly added tables capture in mysql pipeline connector

2024-08-08 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang reassigned FLINK-35143: - Assignee: (was: Hongshun Wang) > Expose newly added tables capture in mysql pipeline connec

[jira] [Commented] (FLINK-35143) Expose newly added tables capture in mysql pipeline connector

2024-08-08 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17872185#comment-17872185 ] Ruan Hang commented on FLINK-35143: --- fix via master(3.2-SNAPSHOT): 09f36a4a05797b7e319

Re: [PR] [FLINK-35143][pipeline-connector][mysql] Expose newly added tables capture in mysql pipeline connector. [flink-cdc]

2024-08-08 Thread via GitHub
ruanhang1993 merged PR #3411: URL: https://github.com/apache/flink-cdc/pull/3411 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flin

Re: [PR] [FLINK-34865][pipeline-connector]support sync table and column comments [flink-cdc]

2024-08-08 Thread via GitHub
melin commented on PR #3482: URL: https://github.com/apache/flink-cdc/pull/3482#issuecomment-2277162861 fix ![image](https://github.com/user-attachments/assets/9287a0f6-8563-4690-830d-56e75f1d7a7a) -- This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Commented] (FLINK-36018) Support lazy scale down to avoid frequent rescaling

2024-08-08 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17872182#comment-17872182 ] Rui Fan commented on FLINK-36018: - Hey [~gyfora] [~mxm] , would you mind checking whethe

Re: [PR] [FLINK-35992][runtime] Close the TieredStorageMasterClient when NettyShuffleMaster close [flink]

2024-08-08 Thread via GitHub
reswqa commented on PR #25164: URL: https://github.com/apache/flink/pull/25164#issuecomment-2277104649 Can you rebase? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

[jira] [Created] (FLINK-36018) Support lazy scale down to avoid frequent rescaling

2024-08-08 Thread Rui Fan (Jira)
Rui Fan created FLINK-36018: --- Summary: Support lazy scale down to avoid frequent rescaling Key: FLINK-36018 URL: https://issues.apache.org/jira/browse/FLINK-36018 Project: Flink Issue Type: Improve

Re: [PR] [FLINK-34876][transform] Support UDF functions in transform [flink-cdc]

2024-08-08 Thread via GitHub
yuxiqian commented on PR #3465: URL: https://github.com/apache/flink-cdc/pull/3465#issuecomment-2277077343 Rebased with `master` and resolved conflicts. cc @leonardBang @ruanhang1993 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G

Re: [PR] [FLINK-36007][[cdc-composer] cdc load factory and add jar in once search [flink-cdc]

2024-08-08 Thread via GitHub
loserwang1024 commented on code in PR #3520: URL: https://github.com/apache/flink-cdc/pull/3520#discussion_r1710612188 ## flink-cdc-composer/src/main/java/org/apache/flink/cdc/composer/utils/FactoryDiscoveryUtils.java: ## @@ -20,6 +20,7 @@ import org.apache.flink.cdc.common.ann

Re: [PR] [FLINK-35997][table] Complete the Table API and Python API for LTRIM and RTRIM [flink]

2024-08-08 Thread via GitHub
flinkbot commented on PR #25182: URL: https://github.com/apache/flink/pull/25182#issuecomment-2277045070 ## CI report: * f5c2a6c7c1de6be79b54bb037b9f996be5843575 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-35997) Incomplete Table API & Python API of built-in function LTRIM & RTRIM

2024-08-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35997: --- Labels: pull-request-available (was: ) > Incomplete Table API & Python API of built-in func

[PR] [FLINK-35997] Complete the Table API and Python API for LTRIM and RTRIM [flink]

2024-08-08 Thread via GitHub
dylanhz opened a new pull request, #25182: URL: https://github.com/apache/flink/pull/25182 ## What is the purpose of the change Complete the Table API and Python API for LTRIM and RTRIM. Examples: ```Java str.ltrim(trimStr); str.rtrim(trimStr); ``` ## Brief ch

[jira] [Commented] (FLINK-33555) LocalRecoveryITCase.testRecoverLocallyFromProcessCrashWithWorkingDirectory:

2024-08-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17872171#comment-17872171 ] Weijie Guo commented on FLINK-33555: https://dev.azure.com/apache-flink/apache-flink

Re: [PR] [FLINK-35885][table] Prohibit advancing the progress of processing time window through watermark [flink]

2024-08-08 Thread via GitHub
lincoln-lil commented on PR #25180: URL: https://github.com/apache/flink/pull/25180#issuecomment-2277018182 @xuyangzhong you can rebase the latest branch to get e2e pass -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] [FLINK-35885][table] Prohibit advancing the progress of processing time window through watermark [flink]

2024-08-08 Thread via GitHub
lincoln-lil commented on PR #25179: URL: https://github.com/apache/flink/pull/25179#issuecomment-2277018449 @xuyangzhong rebase the latest branch to get e2e pass -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Assigned] (FLINK-36007) cdc load and register factory in once search

2024-08-08 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang reassigned FLINK-36007: - Assignee: Hongshun Wang > cdc load and register factory in once search > --

Re: [PR] [hotfix][cdc-connector][mongodb] Fix unstable test cases for snapshot back-filling [flink-cdc]

2024-08-08 Thread via GitHub
Jiabao-Sun merged PR #3506: URL: https://github.com/apache/flink-cdc/pull/3506 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.

[jira] [Commented] (FLINK-35974) PyFlink YARN per-job on Docker test failed because docker-compose command not found

2024-08-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17872169#comment-17872169 ] Weijie Guo commented on FLINK-35974: 1.20: 94c6903f44c0ab73c1316ccb8861a19b53a71651

[jira] [Updated] (FLINK-35974) PyFlink YARN per-job on Docker test failed because docker-compose command not found

2024-08-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-35974: --- Fix Version/s: 1.19.2 1.20.1 > PyFlink YARN per-job on Docker test failed because

Re: [PR] [FLINK-34688][cdc-connector] Fix: The assigner is not ready to offer finished split information, this should not be called [flink-cdc]

2024-08-08 Thread via GitHub
loserwang1024 commented on code in PR #3519: URL: https://github.com/apache/flink-cdc/pull/3519#discussion_r1710552773 ## flink-cdc-connect/flink-cdc-source-connectors/flink-connector-mysql-cdc/src/test/java/org/apache/flink/cdc/connectors/mysql/source/assigners/MySqlSnapshotSplitAssign

Re: [PR] [BP-1.20][FLINK-35974][e2e] Use docker compose v2 for E2E tests [flink]

2024-08-08 Thread via GitHub
reswqa merged PR #25177: URL: https://github.com/apache/flink/pull/25177 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache

Re: [PR] [BP-1.19][FLINK-35974][e2e] Use docker compose v2 for E2E tests [flink]

2024-08-08 Thread via GitHub
reswqa merged PR #25178: URL: https://github.com/apache/flink/pull/25178 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache

[jira] [Updated] (FLINK-35442) Kafka Pipeline Sink may distribute the same key to different partitions after modify parallelism

2024-08-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35442: --- Labels: pull-request-available (was: ) > Kafka Pipeline Sink may distribute the same key to

[PR] [FLINK-35442][cdc-connect][kafka] add key.format and partition.strategy option [flink-cdc]

2024-08-08 Thread via GitHub
lvyanquan opened a new pull request, #3522: URL: https://github.com/apache/flink-cdc/pull/3522 To make sure the same record sending to the same partition after job restarted. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

Re: [PR] [FLINK-35885][table] Prohibit advancing the progress of processing time window through watermark [flink]

2024-08-08 Thread via GitHub
xuyangzhong commented on PR #25179: URL: https://github.com/apache/flink/pull/25179#issuecomment-2276988449 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

Re: [PR] [FLINK-35885][table] Prohibit advancing the progress of processing time window through watermark [flink]

2024-08-08 Thread via GitHub
xuyangzhong commented on PR #25180: URL: https://github.com/apache/flink/pull/25180#issuecomment-2276987842 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

Re: [PR] [WIP] [FLINK-XXXX] Generalized watermark wip [flink]

2024-08-08 Thread via GitHub
jeyhunkarimov commented on PR #24997: URL: https://github.com/apache/flink/pull/24997#issuecomment-2276687135 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

Re: [PR] [WIP] [FLINK-XXXX] Generalized watermark wip [flink]

2024-08-08 Thread via GitHub
jeyhunkarimov commented on PR #24997: URL: https://github.com/apache/flink/pull/24997#issuecomment-2276581946 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

[jira] [Created] (FLINK-36017) Support Passing Metadata to Formats in KafkaDynamicSink

2024-08-08 Thread Kevin Lam (Jira)
Kevin Lam created FLINK-36017: - Summary: Support Passing Metadata to Formats in KafkaDynamicSink Key: FLINK-36017 URL: https://issues.apache.org/jira/browse/FLINK-36017 Project: Flink Issue Type:

[jira] [Closed] (FLINK-35944) Add CompiledPlan annotations to BatchExecUnion

2024-08-08 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler closed FLINK-35944. Fix Version/s: 2.0.0 Resolution: Fixed master: f1eb644024df497738a4a40fba7c0ae29cf8

Re: [PR] [FLINK-35944] Add CompiledPlan annotations to BatchExecUnion [flink]

2024-08-08 Thread via GitHub
zentol merged PR #25170: URL: https://github.com/apache/flink/pull/25170 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache

Re: [PR] [FLINK-33803] Remove deprecated `lastReconciledSpec` meta generation in favour of `observedGeneration` [flink-kubernetes-operator]

2024-08-08 Thread via GitHub
angelachenn commented on PR #834: URL: https://github.com/apache/flink-kubernetes-operator/pull/834#issuecomment-2276410434 hey @gyfora, thanks for checking in, and apologies for the lack of updates. I had to shift my focus to some higher-priority tasks and have also been on vacation. I do

[jira] [Commented] (FLINK-36004) Flink SQL returns wrong results for Paimon tables with complex schemas

2024-08-08 Thread Xingcan Cui (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17872084#comment-17872084 ] Xingcan Cui commented on FLINK-36004: - Please see the screenshot for an explanation.

[jira] [Updated] (FLINK-36004) Flink SQL returns wrong results for Paimon tables with complex schemas

2024-08-08 Thread Xingcan Cui (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingcan Cui updated FLINK-36004: Attachment: screenshot-1.png > Flink SQL returns wrong results for Paimon tables with complex sche

Re: [PR] [FLINK-35305]Amazon SQS Sink Connector [flink-connector-aws]

2024-08-08 Thread via GitHub
VittoriDavide commented on PR #141: URL: https://github.com/apache/flink-connector-aws/pull/141#issuecomment-2276295085 yes this PR will be super helpful for us as well 👀 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and us

Re: [PR] [FLINK-25907][runtime][security] Add pluggable delegation token manager [flink]

2024-08-08 Thread via GitHub
gaborgsomogyi commented on PR #18664: URL: https://github.com/apache/flink/pull/18664#issuecomment-2276215030 The token framework stores everything in-memory and it's not compatible with `HADOOP_TOKEN_FILE_LOCATION`. Such case the new container will load the file content with old tokens (YA

Re: [PR] [FLINK-25907][runtime][security] Add pluggable delegation token manager [flink]

2024-08-08 Thread via GitHub
dpengpeng commented on PR #18664: URL: https://github.com/apache/flink/pull/18664#issuecomment-2276162116 @gaborgsomogyi Hello, I am currently using Flink version 1.15.2 and have encountered an issue with the HDFS delegation token expiring after 7 days in a Kerberos scenario. I have seen

[jira] [Closed] (FLINK-35265) Implement FlinkStateSnapshot custom resource

2024-08-08 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora closed FLINK-35265. -- Resolution: Fixed > Implement FlinkStateSnapshot custom resource > ---

[jira] [Updated] (FLINK-35265) Implement FlinkStateSnapshot custom resource

2024-08-08 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora updated FLINK-35265: --- Fix Version/s: kubernetes-operator-1.10.0 > Implement FlinkStateSnapshot custom resource > -

[jira] [Commented] (FLINK-35265) Implement FlinkStateSnapshot custom resource

2024-08-08 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17872060#comment-17872060 ] Gyula Fora commented on FLINK-35265: merged to main: 0f390144cb8516d31aac61e46b9ce06

[jira] [Assigned] (FLINK-35265) Implement FlinkStateSnapshot custom resource

2024-08-08 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora reassigned FLINK-35265: -- Assignee: Mate Czagany > Implement FlinkStateSnapshot custom resource > -

[jira] [Commented] (FLINK-36004) Flink SQL returns wrong results for Paimon tables with complex schemas

2024-08-08 Thread Xingcan Cui (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17872058#comment-17872058 ] Xingcan Cui commented on FLINK-36004: - I narrowed down the scope a bit. In the table

Re: [PR] [FLINK-35774][cdc-runtime] Fix the cache of transform is not updated after process schema change event [flink-cdc]

2024-08-08 Thread via GitHub
aiwenmo closed pull request #3455: [FLINK-35774][cdc-runtime] Fix the cache of transform is not updated after process schema change event URL: https://github.com/apache/flink-cdc/pull/3455 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Assigned] (FLINK-36012) Integrate StateTransitionManager into WaitingForResources state

2024-08-08 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl reassigned FLINK-36012: - Assignee: Zdenek Tison > Integrate StateTransitionManager into WaitingForResources stat

[jira] [Assigned] (FLINK-36011) Generalize RescaleManager to become StateTransitionManager

2024-08-08 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl reassigned FLINK-36011: - Assignee: Zdenek Tison > Generalize RescaleManager to become StateTransitionManager > -

Re: [PR] [FLINK-35265] Implement FlinkStateSnapshot custom resource [flink-kubernetes-operator]

2024-08-08 Thread via GitHub
gyfora merged PR #821: URL: https://github.com/apache/flink-kubernetes-operator/pull/821 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr

Re: [PR] [FLINK-35774][cdc-runtime] Fix the cache of transform is not updated after process schema change event [flink-cdc]

2024-08-08 Thread via GitHub
aiwenmo commented on PR #3455: URL: https://github.com/apache/flink-cdc/pull/3455#issuecomment-2276030958 The issue has been fixed by https://github.com/apache/flink-cdc/pull/3285. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

[jira] [Closed] (FLINK-31534) CREATE TABLE AS SELECT should support to define primary key

2024-08-08 Thread Timo Walther (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timo Walther closed FLINK-31534. Fix Version/s: 2.0.0 Assignee: Sergio Peña Resolution: Fixed Fixed as part of FLIN

[jira] [Updated] (FLINK-31534) CREATE TABLE AS SELECT should support to define primary key

2024-08-08 Thread Timo Walther (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timo Walther updated FLINK-31534: - Component/s: Table SQL / Planner > CREATE TABLE AS SELECT should support to define primary key >

[jira] [Closed] (FLINK-31533) CREATE TABLE AS SELECT should support to define partition

2024-08-08 Thread Timo Walther (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timo Walther closed FLINK-31533. Fix Version/s: 2.0.0 Assignee: Sergio Peña Resolution: Fixed Fixed as part of FLIN

Re: [PR] [FLINK-34853] Draft: Submit CDC Job To Flink K8S Native Application Mode [flink-cdc]

2024-08-08 Thread via GitHub
PatrickRen merged PR #3093: URL: https://github.com/apache/flink-cdc/pull/3093 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.

[jira] [Created] (FLINK-36016) Synchronize initialization time and clock usage

2024-08-08 Thread Zdenek Tison (Jira)
Zdenek Tison created FLINK-36016: Summary: Synchronize initialization time and clock usage Key: FLINK-36016 URL: https://issues.apache.org/jira/browse/FLINK-36016 Project: Flink Issue Type:

[jira] [Created] (FLINK-36015) Align rescale parameters

2024-08-08 Thread Zdenek Tison (Jira)
Zdenek Tison created FLINK-36015: Summary: Align rescale parameters Key: FLINK-36015 URL: https://issues.apache.org/jira/browse/FLINK-36015 Project: Flink Issue Type: Sub-task Compo

[jira] [Created] (FLINK-36014) Align the desired and sufficient resources definiton in Executing and WaitForResources states

2024-08-08 Thread Zdenek Tison (Jira)
Zdenek Tison created FLINK-36014: Summary: Align the desired and sufficient resources definiton in Executing and WaitForResources states Key: FLINK-36014 URL: https://issues.apache.org/jira/browse/FLINK-36014

[jira] [Created] (FLINK-36013) Introduce the transition from Restarting to CreatingExecutionGraph state

2024-08-08 Thread Zdenek Tison (Jira)
Zdenek Tison created FLINK-36013: Summary: Introduce the transition from Restarting to CreatingExecutionGraph state Key: FLINK-36013 URL: https://issues.apache.org/jira/browse/FLINK-36013 Project: Fli

Re: [PR] [FLINK-35243] Extends schema change event types support [flink-cdc]

2024-08-08 Thread via GitHub
yuxiqian commented on PR #3521: URL: https://github.com/apache/flink-cdc/pull/3521#issuecomment-2275944544 Marked it as draft for now, need to add more tests to verify if table-level schema change event works as expected. -- This is an automated message from the Apache Git Service. To res

Re: [PR] [FLINK-35944] Add CompiledPlan annotations to BatchExecUnion [flink]

2024-08-08 Thread via GitHub
twalthr commented on PR #25170: URL: https://github.com/apache/flink/pull/25170#issuecomment-2275945382 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Updated] (FLINK-36010) Duplicate Job Submission returns Succeeded on single execution even if Global state is FAILED

2024-08-08 Thread Ahmed Hamdy (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hamdy updated FLINK-36010: Description: h2. Description Running a job on single execution mode with HA enabled typically [sh

[jira] [Created] (FLINK-36012) Integrate StateTransitionManager into WaitingForResources state

2024-08-08 Thread Zdenek Tison (Jira)
Zdenek Tison created FLINK-36012: Summary: Integrate StateTransitionManager into WaitingForResources state Key: FLINK-36012 URL: https://issues.apache.org/jira/browse/FLINK-36012 Project: Flink

[jira] [Created] (FLINK-36011) Generalize RescaleManager to become StateTransitionManager

2024-08-08 Thread Zdenek Tison (Jira)
Zdenek Tison created FLINK-36011: Summary: Generalize RescaleManager to become StateTransitionManager Key: FLINK-36011 URL: https://issues.apache.org/jira/browse/FLINK-36011 Project: Flink Is

[jira] [Updated] (FLINK-35941) Add CompiledPlan annotations to BatchExecLimit

2024-08-08 Thread Timo Walther (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timo Walther updated FLINK-35941: - Component/s: Table SQL / Planner > Add CompiledPlan annotations to BatchExecLimit >

[jira] [Closed] (FLINK-35941) Add CompiledPlan annotations to BatchExecLimit

2024-08-08 Thread Timo Walther (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timo Walther closed FLINK-35941. Fix Version/s: 2.0.0 Resolution: Fixed Fixed in master: 8a45cd6cffb7ff55e0af6c1167b255d7da6

Re: [PR] [FLINK-35941] Add CompiledPlan annotations to BatchExecLimit [flink]

2024-08-08 Thread via GitHub
twalthr merged PR #25168: URL: https://github.com/apache/flink/pull/25168 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apach

[jira] [Commented] (FLINK-35035) Reduce job pause time when cluster resources are expanded in adaptive mode

2024-08-08 Thread Zdenek Tison (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17872011#comment-17872011 ] Zdenek Tison commented on FLINK-35035: -- This task will be used as a parent task for

[jira] [Updated] (FLINK-36010) Duplicate Job Submission returns Succeeded on single execution even if Global state is FAILED

2024-08-08 Thread Ahmed Hamdy (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hamdy updated FLINK-36010: Fix Version/s: 1.20.1 > Duplicate Job Submission returns Succeeded on single execution even if Glo

Re: [PR] [FLINK-32562][connectors/filesystem] Handle compressed streams correctly in ConcatFileCompactor [flink]

2024-08-08 Thread via GitHub
gaborgsomogyi commented on code in PR #24914: URL: https://github.com/apache/flink/pull/24914#discussion_r1709562167 ## flink-connectors/flink-connector-files/src/main/java/org/apache/flink/connector/file/sink/compactor/operator/CompactService.java: ## @@ -173,4 +203,36 @@ priva

Re: [PR] [FLINK-36002] Add CompiledPlan annotations to BatchExecMatch [flink]

2024-08-08 Thread via GitHub
jnh5y commented on code in PR #25171: URL: https://github.com/apache/flink/pull/25171#discussion_r1709560780 ## flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/plan/nodes/exec/batch/MatchRecognizeBatchRestoreTest.java: ## @@ -0,0 +1,46 @@ +/* + * Lic

[jira] [Assigned] (FLINK-35035) Reduce job pause time when cluster resources are expanded in adaptive mode

2024-08-08 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl reassigned FLINK-35035: - Assignee: Zdenek Tison > Reduce job pause time when cluster resources are expanded in a

[jira] [Created] (FLINK-36010) Duplicate Job Submission returns Succeeded on single execution even if Global state is FAILED

2024-08-08 Thread Ahmed Hamdy (Jira)
Ahmed Hamdy created FLINK-36010: --- Summary: Duplicate Job Submission returns Succeeded on single execution even if Global state is FAILED Key: FLINK-36010 URL: https://issues.apache.org/jira/browse/FLINK-36010

[jira] [Created] (FLINK-36009) Change configs to use CondigOptions

2024-08-08 Thread Jira
João Boto created FLINK-36009: - Summary: Change configs to use CondigOptions Key: FLINK-36009 URL: https://issues.apache.org/jira/browse/FLINK-36009 Project: Flink Issue Type: Sub-task

Re: [PR] [FLINK-36008][Documentation] Script and guidance to preview connector docs contributions [flink]

2024-08-08 Thread via GitHub
flinkbot commented on PR #25181: URL: https://github.com/apache/flink/pull/25181#issuecomment-2275829536 ## CI report: * 34dc44d8843fc879e21ff3e3f8dc48f4927b676b UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-34688][cdc-connector] Fix: The assigner is not ready to offer finished split information, this should not be called [flink-cdc]

2024-08-08 Thread via GitHub
leonardBang commented on code in PR #3519: URL: https://github.com/apache/flink-cdc/pull/3519#discussion_r1709493160 ## flink-cdc-connect/flink-cdc-source-connectors/flink-connector-mysql-cdc/src/test/java/org/apache/flink/cdc/connectors/mysql/source/assigners/MySqlSnapshotSplitAssigner

Re: [PR] [FLINK-36007][[cdc-composer] cdc load factory and add jar in once search [flink-cdc]

2024-08-08 Thread via GitHub
leonardBang commented on code in PR #3520: URL: https://github.com/apache/flink-cdc/pull/3520#discussion_r1709483268 ## flink-cdc-composer/src/main/java/org/apache/flink/cdc/composer/utils/FactoryDiscoveryUtils.java: ## @@ -20,6 +20,7 @@ import org.apache.flink.cdc.common.annot

[jira] [Assigned] (FLINK-35859) [flink-cdc] Fix: The assigner is not ready to offer finished split information, this should not be called

2024-08-08 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reassigned FLINK-35859: -- Assignee: Hongshun Wang > [flink-cdc] Fix: The assigner is not ready to offer finished split

[jira] [Commented] (FLINK-35859) [flink-cdc] Fix: The assigner is not ready to offer finished split information, this should not be called

2024-08-08 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17871996#comment-17871996 ] Leonard Xu commented on FLINK-35859: Assigned to you [~loserwang1024] , thanks for t

[jira] [Commented] (FLINK-36008) Guidance for previewing connector docs contributions

2024-08-08 Thread Lorenzo Nicora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17871994#comment-17871994 ] Lorenzo Nicora commented on FLINK-36008: I created a PR with the small change re

[jira] [Updated] (FLINK-36008) Guidance for previewing connector docs contributions

2024-08-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36008: --- Labels: pull-request-available (was: ) > Guidance for previewing connector docs contributio

[PR] [FLINK-36008][Documentation] Script and guidance to preview connector docs contributions [flink]

2024-08-08 Thread via GitHub
nicusX opened a new pull request, #25181: URL: https://github.com/apache/flink/pull/25181 ## What is the purpose of the change * Improving the contributors' experience when modifying docs of an existing connector or developing docs of a new connector. ## Brief change log

Re: [PR] pipeline add param scan.newly-added-table.enabled [flink-cdc]

2024-08-08 Thread via GitHub
leonardBang closed pull request #3470: pipeline add param scan.newly-added-table.enabled URL: https://github.com/apache/flink-cdc/pull/3470 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

Re: [PR] pipeline add param scan.newly-added-table.enabled [flink-cdc]

2024-08-08 Thread via GitHub
leonardBang commented on PR #3470: URL: https://github.com/apache/flink-cdc/pull/3470#issuecomment-2275774886 closed as duplicate with an earlier https://github.com/apache/flink-cdc/pull/3411 -- This is an automated message from the Apache Git Service. To respond to the message, please lo

  1   2   >