Re: [PR] [FLINK-30196][tests] Replace usage of deprecated Mockito methods and update Mockito to 4.11.0 [flink]

2024-10-28 Thread via GitHub
Zakelly commented on PR #21389: URL: https://github.com/apache/flink/pull/21389#issuecomment-2443052225 :D Sure, will take a look -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

[jira] [Updated] (FLINK-36619) Downstream lost the CreateTableEvent when tables were removed and then re-added

2024-10-28 Thread linqigeng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] linqigeng updated FLINK-36619: -- Description: If some tables are removed from the `tables` parameter and then re-added, the `CreateTab

Re: [PR] [FLINK-34944] Use Incremental Source Framework in Flink CDC OceanBase Source Connector [flink-cdc]

2024-10-28 Thread via GitHub
Mrart commented on PR #3211: URL: https://github.com/apache/flink-cdc/pull/3211#issuecomment-2443322635 @whhe RichSourceFunction is Deprecated interface,We can implements use Source interface? -- This is an automated message from the Apache Git Service. To respond to the message, please

[jira] [Commented] (FLINK-36614) mysql cdc will be stuck when the ChangeEventQueue is full at snapshot consume phase

2024-10-28 Thread LvYanquan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17893698#comment-17893698 ] LvYanquan commented on FLINK-36614: --- looks like this issue is the same with  https://i

[jira] [Updated] (FLINK-36619) Downstream lost the CreateTableEvent when tables were removed and then re-added

2024-10-28 Thread linqigeng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] linqigeng updated FLINK-36619: -- Description: If some tables are removed from the `tables` parameter and then re-added, the `CreateTab

[jira] [Updated] (FLINK-36618) Improve PostgresDialect.discoverDataCollections to reduce the start time of Postgres CDC

2024-10-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36618: --- Labels: pull-request-available (was: ) > Improve PostgresDialect.discoverDataCollections to

Re: [PR] [FLINK-36618][cdc-connector][postgres] Improve PostgresDialect.discoverDataCollections to reduce the start time of Postgres CDC. [flink-cdc]

2024-10-28 Thread via GitHub
loserwang1024 commented on PR #3672: URL: https://github.com/apache/flink-cdc/pull/3672#issuecomment-2443271198 @ruanhang1993 @leonardBang @GOODBOY008 , CC -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Commented] (FLINK-36502) Remove all deprecated methods in `FactoryUtil`

2024-10-28 Thread Shengbo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17893693#comment-17893693 ] Shengbo commented on FLINK-36502: - Hi [~xuyangzhong] , I've fixed the failed test cases.

Re: [PR] [FLINK-35268][state] Add ttl interface for Async State API && implement TtlListStateV2/TtlValueStateV2 [flink]

2024-10-28 Thread via GitHub
Zakelly commented on code in PR #25515: URL: https://github.com/apache/flink/pull/25515#discussion_r1820059326 ## flink-runtime/src/main/java/org/apache/flink/runtime/state/v2/ttl/TtlListState.java: ## @@ -0,0 +1,207 @@ +/* + * Licensed to the Apache Software Foundation (ASF) un

[jira] [Created] (FLINK-36619) Downstream lost the CreateTableEvent when tables were removed and then re-added

2024-10-28 Thread linqigeng (Jira)
linqigeng created FLINK-36619: - Summary: Downstream lost the CreateTableEvent when tables were removed and then re-added Key: FLINK-36619 URL: https://issues.apache.org/jira/browse/FLINK-36619 Project: Fl

[jira] [Updated] (FLINK-36619) Downstream lost the CreateTableEvent when tables were removed and then re-added

2024-10-28 Thread linqigeng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] linqigeng updated FLINK-36619: -- Description: If some tables are removed from the `tables` parameter and then re-added, the `CreateTab

[jira] [Updated] (FLINK-36619) Downstream lost the CreateTableEvent when tables were removed and then re-added

2024-10-28 Thread linqigeng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] linqigeng updated FLINK-36619: -- Description: If some tables are removed from the `tables` parameter and then re-added, the `CreateTab

[jira] [Updated] (FLINK-36619) Downstream lost the CreateTableEvent when tables were removed and then re-added

2024-10-28 Thread linqigeng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] linqigeng updated FLINK-36619: -- Description: If some tables are removed from the `tables` parameter and then re-added, the `CreateTab

[jira] [Updated] (FLINK-36619) Downstream lost the CreateTableEvent when tables were removed and then re-added

2024-10-28 Thread linqigeng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] linqigeng updated FLINK-36619: -- Attachment: image-2024-10-29-12-04-26-718.png > Downstream lost the CreateTableEvent when tables were

[jira] [Updated] (FLINK-36619) Downstream lost the CreateTableEvent when tables were removed and then re-added

2024-10-28 Thread linqigeng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] linqigeng updated FLINK-36619: -- Description: If some tables are removed from the `tables` parameter and then re-added, the `CreateTab

[jira] [Updated] (FLINK-36619) Downstream lost the CreateTableEvent when tables were removed and then re-added

2024-10-28 Thread linqigeng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] linqigeng updated FLINK-36619: -- Description: If some tables are removed from the `tables` parameter and then re-added, the `CreateTab

Re: [PR] [FLINK-36504][table]Remove all deprecated methods `ModuleFactory` [flink]

2024-10-28 Thread via GitHub
flinkbot commented on PR #25584: URL: https://github.com/apache/flink/pull/25584#issuecomment-2443126627 ## CI report: * 6705cf684ad6a8693d6af4dbab36b39b9a9f5d00 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Commented] (FLINK-36497) Remove all deprecated methods in `CatalogTable`

2024-10-28 Thread jarrod (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17893687#comment-17893687 ] jarrod commented on FLINK-36497: I will do it. > Remove all deprecated methods in `Cata

[jira] [Commented] (FLINK-36161) Integration Test Example uses deprecated SinkFunction

2024-10-28 Thread Jinhao Ran (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17893686#comment-17893686 ] Jinhao Ran commented on FLINK-36161: Hi, can this issue be assigned to me as my firs

[jira] [Updated] (FLINK-32315) Support local file upload in K8s mode

2024-10-28 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated FLINK-32315: -- Attachment: image-2024-10-29-11-32-25-979.png > Support local file upload in K8s mode > --

[jira] [Comment Edited] (FLINK-32315) Support local file upload in K8s mode

2024-10-28 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17893685#comment-17893685 ] melin edited comment on FLINK-32315 at 10/29/24 3:34 AM: - Can't

[jira] [Commented] (FLINK-32315) Support local file upload in K8s mode

2024-10-28 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17893685#comment-17893685 ] melin commented on FLINK-32315: --- ./bin/flink run-application \     --target kubernetes-app

[jira] [Commented] (FLINK-36584) PostgresIncrementalSource is not exiting the flink execution when StartupOptions is snapshot and create multiple replication slots

2024-10-28 Thread Anil Dasari (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17893684#comment-17893684 ] Anil Dasari commented on FLINK-36584: - [~loserwang1024] Thank you for your assistanc

[jira] [Closed] (FLINK-36584) PostgresIncrementalSource is not exiting the flink execution when StartupOptions is snapshot and create multiple replication slots

2024-10-28 Thread Anil Dasari (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anil Dasari closed FLINK-36584. --- Resolution: Not A Bug > PostgresIncrementalSource is not exiting the flink execution when > Startup

[jira] [Resolved] (FLINK-36174) CDC yaml without pipeline will throw NullPointException

2024-10-28 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang resolved FLINK-36174. --- Resolution: Fixed master(3.3-SNAPSHOT):aa4f15a6364227d39fa2c586b4fdac507f627fc7 > CDC yaml without

[jira] [Commented] (FLINK-36584) PostgresIncrementalSource is not exiting the flink execution when StartupOptions is snapshot and create multiple replication slots

2024-10-28 Thread Anil Dasari (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17893681#comment-17893681 ] Anil Dasari commented on FLINK-36584: - [~loserwang1024] Thank you for the details.

[jira] [Updated] (FLINK-36504) Remove all deprecated methods `ModuleFactory`

2024-10-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36504: --- Labels: pull-request-available (was: ) > Remove all deprecated methods `ModuleFactory` > --

[PR] [FLINK-36504][table]Remove all deprecated methods `ModuleFactory` [flink]

2024-10-28 Thread via GitHub
Edward-Gavin opened a new pull request, #25584: URL: https://github.com/apache/flink/pull/25584 ## What is the purpose of the change Remove all deprecated methods `ModuleFactory` ## Brief change log Remove all deprecated methods `ModuleFactory` ## Verifying

[jira] [Commented] (FLINK-36584) PostgresIncrementalSource is not exiting the flink execution when StartupOptions is snapshot and create multiple replication slots

2024-10-28 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17893683#comment-17893683 ] Hongshun Wang commented on FLINK-36584: --- [~dasarianil] , Maybe slack of flink cdc

[jira] [Commented] (FLINK-36609) Protobuf Format not support proto3

2024-10-28 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17893680#comment-17893680 ] Hongshun Wang commented on FLINK-36609: --- I'd like to do it. > Protobuf Format not

[jira] [Created] (FLINK-36618) Improve PostgresDialect.discoverDataCollections to reduce the start time of Postgres CDC

2024-10-28 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-36618: - Summary: Improve PostgresDialect.discoverDataCollections to reduce the start time of Postgres CDC Key: FLINK-36618 URL: https://issues.apache.org/jira/browse/FLINK-36618

[jira] [Updated] (FLINK-36584) PostgresIncrementalSource is not exiting the flink execution when StartupOptions is snapshot and create multiple replication slots

2024-10-28 Thread Anil Dasari (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anil Dasari updated FLINK-36584: Attachment: image-2024-10-28-20-14-27-255.png > PostgresIncrementalSource is not exiting the flink

Re: [PR] [FLINK-36174][hotfix] CDC yaml without pipeline should not throw exception. [flink-cdc]

2024-10-28 Thread via GitHub
ruanhang1993 merged PR #3588: URL: https://github.com/apache/flink-cdc/pull/3588 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flin

[jira] [Commented] (FLINK-4602) Move RocksDB backend to proper package

2024-10-28 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-4602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17893675#comment-17893675 ] Zakelly Lan commented on FLINK-4602: Merge 316daca into master > Move RocksDB backen

[jira] [Commented] (FLINK-36584) PostgresIncrementalSource is not exiting the flink execution when StartupOptions is snapshot and create multiple replication slots

2024-10-28 Thread Anil Dasari (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17893673#comment-17893673 ] Anil Dasari commented on FLINK-36584: - > Yes, when skip backfill, the snapshot spot

[jira] [Commented] (FLINK-36584) PostgresIncrementalSource is not exiting the flink execution when StartupOptions is snapshot and create multiple replication slots

2024-10-28 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17893670#comment-17893670 ] Hongshun Wang commented on FLINK-36584: --- Yes, when skip backfill, the snapshot spo

Re: [PR] [FLINK-36560][pipeline-connector][paimon] fix the issue that timestamp_ltz field is not correctly converted. [flink-cdc]

2024-10-28 Thread via GitHub
lvyanquan commented on code in PR #3648: URL: https://github.com/apache/flink-cdc/pull/3648#discussion_r1820005853 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-paimon/src/main/java/org/apache/flink/cdc/connectors/paimon/sink/v2/PaimonWriterHelper.java:

[jira] [Commented] (FLINK-36584) PostgresIncrementalSource is not exiting the flink execution when StartupOptions is snapshot and create multiple replication slots

2024-10-28 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17893676#comment-17893676 ] Hongshun Wang commented on FLINK-36584: --- [~dasarianil] ,  > Is there a reason for

[jira] [Updated] (FLINK-36584) PostgresIncrementalSource is not exiting the flink execution when StartupOptions is snapshot and create multiple replication slots

2024-10-28 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-36584: -- Attachment: image-2024-10-29-10-44-23-005.png > PostgresIncrementalSource is not exiting the f

[jira] [Resolved] (FLINK-4602) Move RocksDB backend to proper package

2024-10-28 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-4602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan resolved FLINK-4602. Resolution: Fixed > Move RocksDB backend to proper package > --

Re: [PR] [FLINK-4602][State] Move RocksDB statebackend classes to o.a.f.state.rocksdb package. [flink]

2024-10-28 Thread via GitHub
Zakelly merged PR #25543: URL: https://github.com/apache/flink/pull/25543 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apach

[PR] add updateBinlogStartPoint function [flink-cdc]

2024-10-28 Thread via GitHub
tudou-sunge opened a new pull request, #3671: URL: https://github.com/apache/flink-cdc/pull/3671 we need record the binlog_name first, besease when start with timestamp option the binlog_name will be '', until the binglog changed -- This is an automated message from the Apache Git Service

Re: [PR] [FLINK-36501][table] Remove all deprecated methods in `CatalogFactory` [flink]

2024-10-28 Thread via GitHub
hackergin commented on PR #25579: URL: https://github.com/apache/flink/pull/25579#issuecomment-2443033568 Test failed because of https://issues.apache.org/jira/browse/FLINK-36613 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

Re: [PR] [FLINK-36501][table] Remove all deprecated methods in `CatalogFactory` [flink]

2024-10-28 Thread via GitHub
hackergin commented on PR #25579: URL: https://github.com/apache/flink/pull/25579#issuecomment-2443033303 @xuyangzhong Please help review the pr if you are free. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Updated] (FLINK-36584) PostgresIncrementalSource is not exiting the flink execution when StartupOptions is snapshot and create multiple replication slots

2024-10-28 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-36584: -- Attachment: image-2024-10-29-10-00-44-321.png > PostgresIncrementalSource is not exiting the f

[jira] [Commented] (FLINK-36613) RescaleCheckpointManuallyITCase.testCheckpointRescalingInKeyedState fails on AZP

2024-10-28 Thread Feng Jin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17893669#comment-17893669 ] Feng Jin commented on FLINK-36613: -- Another failed tests. https://dev.azure.com/apache

[jira] [Assigned] (FLINK-36159) FLIP-470: Support Adaptive Broadcast Join

2024-10-28 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-36159: --- Assignee: xingbe > FLIP-470: Support Adaptive Broadcast Join >

[jira] [Assigned] (FLINK-36607) Introduce AdaptiveBroadcastJoinProcessor to inject adaptive broadcast join

2024-10-28 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-36607: --- Assignee: xingbe > Introduce AdaptiveBroadcastJoinProcessor to inject adaptive broadcast join > ---

[jira] [Assigned] (FLINK-36608) Support dynamic StreamGraph optimization for AdaptiveBroadcastJoinOperator

2024-10-28 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-36608: --- Assignee: xingbe > Support dynamic StreamGraph optimization for AdaptiveBroadcastJoinOperator > ---

Re: [PR] [FLINK-36086] Set isSnapshotCompleted only immediately after snapshot [flink-cdc]

2024-10-28 Thread via GitHub
github-actions[bot] commented on PR #3552: URL: https://github.com/apache/flink-cdc/pull/3552#issuecomment-2442898656 This pull request has been automatically marked as stale because it has not had recent activity for 60 days. It will be closed in 30 days if no further activity occurs. --

Re: [PR] Flink Kubernetes Operator 1.10.0 [flink-web]

2024-10-28 Thread via GitHub
mbalassi merged PR #758: URL: https://github.com/apache/flink-web/pull/758 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apac

Re: [PR] [FLINK-36616] fix npe [flink-connector-gcp-pubsub]

2024-10-28 Thread via GitHub
stankiewicz commented on PR #33: URL: https://github.com/apache/flink-connector-gcp-pubsub/pull/33#issuecomment-2442504832 @vahmed-hamdy done, thanks for the suggestions. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [PR] [FLINK-36617] migrate kyro package [flink]

2024-10-28 Thread via GitHub
flinkbot commented on PR #25583: URL: https://github.com/apache/flink/pull/25583#issuecomment-2442469719 ## CI report: * dd09f113b30403cb8b1407d716f75cc52feba208 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-36527][autoscaler] Introduce a parameter to support autoscaler adopt a more radical strategy when source vertex or upstream shuffle is keyBy [flink-kubernetes-operator]

2024-10-28 Thread via GitHub
mxm commented on code in PR #904: URL: https://github.com/apache/flink-kubernetes-operator/pull/904#discussion_r1819378159 ## flink-autoscaler/src/main/java/org/apache/flink/autoscaler/ParallelismAdjuster.java: ## @@ -0,0 +1,148 @@ +/* + * Licensed to the Apache Software Founda

[jira] [Updated] (FLINK-36617) Migrate kryo package

2024-10-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36617: --- Labels: pull-request-available (was: ) > Migrate kryo package > > >

[PR] [FLINK-36617] migrate kyro package [flink]

2024-10-28 Thread via GitHub
r-sidd opened a new pull request, #25583: URL: https://github.com/apache/flink/pull/25583 ## What is the purpose of the change Migrate kryo package ## Brief change log Kryo has been moved to the com.esotericsoftware package. Updating to this version will enhance capabili

[jira] [Created] (FLINK-36617) Migrate kryo package

2024-10-28 Thread Siddharth R (Jira)
Siddharth R created FLINK-36617: --- Summary: Migrate kryo package Key: FLINK-36617 URL: https://issues.apache.org/jira/browse/FLINK-36617 Project: Flink Issue Type: Improvement Report

Re: [PR] [FLINK-36455] Sinks retry synchronously [flink]

2024-10-28 Thread via GitHub
AHeise commented on code in PR #25547: URL: https://github.com/apache/flink/pull/25547#discussion_r1819084931 ## flink-runtime/src/main/java/org/apache/flink/streaming/api/connector/sink2/CommittableSummary.java: ## @@ -39,11 +39,21 @@ public class CommittableSummary implements

Re: [PR] [FLINK-33722] Fix events ordering in MATCH_RECOGNIZE in batch mode [flink]

2024-10-28 Thread via GitHub
jnh5y commented on code in PR #24699: URL: https://github.com/apache/flink/pull/24699#discussion_r1819468595 ## flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/runtime/batch/sql/MatchRecognizeITCase.java: ## @@ -567,7 +912,7 @@ void testUserDefinedFu

[jira] [Updated] (FLINK-36616) Null pointer in PubSub's GcpPublisherConfig

2024-10-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36616: --- Labels: pull-request-available (was: ) > Null pointer in PubSub's GcpPublisherConfig > ---

Re: [PR] [FLINK-36616] fix npe [flink-connector-gcp-pubsub]

2024-10-28 Thread via GitHub
stankiewicz commented on PR #33: URL: https://github.com/apache/flink-connector-gcp-pubsub/pull/33#issuecomment-2442159071 @vahmed-hamdy would you be able to take a look at this and merge it? Also, do you happen to know what is the release cycle for this connector? -- This is an autom

[jira] [Commented] (FLINK-36616) Null pointer in PubSub's GcpPublisherConfig

2024-10-28 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-36616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17893543#comment-17893543 ] Radosław Stankiewicz commented on FLINK-36616: -- https://github.com/apache/f

[jira] [Created] (FLINK-36616) Null pointer in PubSub's GcpPublisherConfig

2024-10-28 Thread Jira
Radosław Stankiewicz created FLINK-36616: Summary: Null pointer in PubSub's GcpPublisherConfig Key: FLINK-36616 URL: https://issues.apache.org/jira/browse/FLINK-36616 Project: Flink

Re: [PR] fix npe [flink-connector-gcp-pubsub]

2024-10-28 Thread via GitHub
boring-cyborg[bot] commented on PR #33: URL: https://github.com/apache/flink-connector-gcp-pubsub/pull/33#issuecomment-2442135742 Thanks for opening this pull request! Please check out our contributing guidelines. (https://flink.apache.org/contributing/how-to-contribute.html) -- This

Re: [PR] [FLINK-33722] Fix events ordering in MATCH_RECOGNIZE in batch mode [flink]

2024-10-28 Thread via GitHub
grzegorz8 commented on code in PR #24699: URL: https://github.com/apache/flink/pull/24699#discussion_r1819361358 ## flink-table/flink-table-planner/src/main/java/org/apache/flink/table/planner/plan/nodes/exec/batch/BatchExecMatch.java: ## @@ -51,7 +71,95 @@ public BatchExecMatch

Re: [PR] [FLIP-278][connector] Add hybrid source connector for table & sql [flink]

2024-10-28 Thread via GitHub
grzegorz8 commented on PR #21841: URL: https://github.com/apache/flink/pull/21841#issuecomment-2441855866 Hey @chucheng92 ! What is the current status of this FLIP? Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

Re: [PR] [FLINK-36615] Support LEAD/LAG functions in Table API [flink]

2024-10-28 Thread via GitHub
flinkbot commented on PR #25582: URL: https://github.com/apache/flink/pull/25582#issuecomment-2441838852 ## CI report: * 56b898b6740e62590ca6c69bd9d0877b1422ed4a UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[PR] [FLINK-36615] Support LEAD/LAG functions in Table API [flink]

2024-10-28 Thread via GitHub
dawidwys opened a new pull request, #25582: URL: https://github.com/apache/flink/pull/25582 ## What is the purpose of the change Support `LEAD/LAG` functions natively in Table API. ## Verifying this change To be done ## Does this pull request potentially af

[jira] [Updated] (FLINK-36615) Support LEAD/LAG functions in Table API

2024-10-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36615: --- Labels: pull-request-available (was: ) > Support LEAD/LAG functions in Table API >

[jira] [Assigned] (FLINK-33525) Migrate LoadSimulationPipeline in Flink K8S Operator to the new Source API

2024-10-28 Thread Alexander Fedulov (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Fedulov reassigned FLINK-33525: - Assignee: Poorvank Bhatia > Migrate LoadSimulationPipeline in Flink K8S Operato

Re: [PR] [FLINK-36146][connector] Fix SingleThreadFetcherManager race condition [flink]

2024-10-28 Thread via GitHub
kimgr commented on PR #25340: URL: https://github.com/apache/flink/pull/25340#issuecomment-2441682715 Added a multi-threaded testcase. It fails on average 50% of the time before the bugfix, succeeds consistently after. Runtime on my system is ~5 seconds. Let me know what you think. -- Th

[jira] [Created] (FLINK-36615) Support LEAD/LAG functions in Table API

2024-10-28 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-36615: Summary: Support LEAD/LAG functions in Table API Key: FLINK-36615 URL: https://issues.apache.org/jira/browse/FLINK-36615 Project: Flink Issue Type: I

Re: [PR] [FLINK-36027][cdc-connector][mysql] numRecordsOut/numRecordsOutRate metrics for each OperationType [flink-cdc]

2024-10-28 Thread via GitHub
SML0127 commented on PR #3529: URL: https://github.com/apache/flink-cdc/pull/3529#issuecomment-2441714262 @ruanhang1993 Could you please take a look? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Commented] (FLINK-36611) Add schema info to output of Kafka sink

2024-10-28 Thread Andrew Otto (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17893468#comment-17893468 ] Andrew Otto commented on FLINK-36611: - This will be very useful!   Having Kafka in

Re: [PR] [FLINK-36571][web] Fix issue to allow Busy and Backpressure numbers o… [flink]

2024-10-28 Thread via GitHub
hlteoh37 commented on code in PR #25548: URL: https://github.com/apache/flink/pull/25548#discussion_r1819083958 ## flink-runtime-web/web-dashboard/src/app/components/dagre/components/node/node.component.ts: ## @@ -82,7 +84,7 @@ export class NodeComponent { } isValid = (v

Re: [PR] [FLINK-36502] [TABLE-SQL] Remove deprecated methods in FactoryUtil. [flink]

2024-10-28 Thread via GitHub
Sud0x67 commented on PR #25559: URL: https://github.com/apache/flink/pull/25559#issuecomment-2441529771 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [FLINK-36613][tests] Ensure RescaleCheckpointManuallyITCase.testCheckpointRescalingInKeyedState runs with large enough value for STARTING_MEMORY_SEGMENT_SIZE [flink]

2024-10-28 Thread via GitHub
flinkbot commented on PR #25581: URL: https://github.com/apache/flink/pull/25581#issuecomment-2441474387 ## CI report: * 15a2d24c65bb7cd59242cc107a428728ca5aa3d3 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-36066][runtime] Introducing the AdaptiveGraphManager component [flink]

2024-10-28 Thread via GitHub
noorall commented on code in PR #25414: URL: https://github.com/apache/flink/pull/25414#discussion_r1816403718 ## flink-runtime/src/main/java/org/apache/flink/streaming/api/graph/util/StreamEdgeUpdateRequestInfo.java: ## @@ -0,0 +1,62 @@ +/* + * Licensed to the Apache Software F

Re: [PR] [FLINK-36011] [runtime] Generalize RescaleManager to become StateTransitionManager [flink]

2024-10-28 Thread via GitHub
rkhachatryan commented on code in PR #25280: URL: https://github.com/apache/flink/pull/25280#discussion_r1818949028 ## flink-runtime/src/main/java/org/apache/flink/runtime/scheduler/adaptive/DefaultStateTransitionManager.java: ## @@ -0,0 +1,434 @@ +/* + * Licensed to the Apache

[jira] [Commented] (FLINK-36613) RescaleCheckpointManuallyITCase.testCheckpointRescalingInKeyedState fails on AZP

2024-10-28 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17893434#comment-17893434 ] Sergey Nuyanzin commented on FLINK-36613: - [~roman], [~pnowojski] since you were

[jira] [Commented] (FLINK-32483) RescaleCheckpointManuallyITCase.testCheckpointRescalingOutKeyedState fails on AZP

2024-10-28 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17893435#comment-17893435 ] Sergey Nuyanzin commented on FLINK-32483: - [~dmvk] I wonder whether it could be

[PR] [FLINK-36613][tests] Ensure RescaleCheckpointManuallyITCase.testCheckpointRescalingInKeyedState runs with large enough value for STARTING_MEMORY_SEGMENT_SIZE [flink]

2024-10-28 Thread via GitHub
snuyanzin opened a new pull request, #25581: URL: https://github.com/apache/flink/pull/25581 ## What is the purpose of the change There is a floating issue while execution of `RescaleCheckpointManuallyITCase.testCheckpointRescalingInKeyedState` also could be reproduced loca

[jira] [Updated] (FLINK-36613) RescaleCheckpointManuallyITCase.testCheckpointRescalingInKeyedState fails on AZP

2024-10-28 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin updated FLINK-36613: Labels: pull-request-available test-stability (was: pull-request-available) > RescaleChec

Re: [PR] [FLINK-36011] [runtime] Generalize RescaleManager to become StateTransitionManager [flink]

2024-10-28 Thread via GitHub
rkhachatryan commented on code in PR #25280: URL: https://github.com/apache/flink/pull/25280#discussion_r1818949028 ## flink-runtime/src/main/java/org/apache/flink/runtime/scheduler/adaptive/DefaultStateTransitionManager.java: ## @@ -0,0 +1,434 @@ +/* + * Licensed to the Apache

Re: [PR] [FLINK-36066][runtime] Introducing the AdaptiveGraphManager component [flink]

2024-10-28 Thread via GitHub
noorall commented on code in PR #25414: URL: https://github.com/apache/flink/pull/25414#discussion_r1816403718 ## flink-runtime/src/main/java/org/apache/flink/streaming/api/graph/util/StreamEdgeUpdateRequestInfo.java: ## @@ -0,0 +1,62 @@ +/* + * Licensed to the Apache Software F

[jira] [Updated] (FLINK-36613) RescaleCheckpointManuallyITCase.testCheckpointRescalingInKeyedState fails on AZP

2024-10-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36613: --- Labels: pull-request-available (was: ) > RescaleCheckpointManuallyITCase.testCheckpointResc

[jira] [Updated] (FLINK-36612) Flink TypeSerializer doesn't recognize valid POJO getters/setters generated by Lombok

2024-10-28 Thread Dawid Wysakowicz (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dawid Wysakowicz updated FLINK-36612: - Issue Type: New Feature (was: Bug) > Flink TypeSerializer doesn't recognize valid POJO

[jira] [Created] (FLINK-36614) mysql cdc will be stuck when the ChangeEventQueue is full at snapshot consume phase

2024-10-28 Thread Youle (Jira)
Youle created FLINK-36614: - Summary: mysql cdc will be stuck when the ChangeEventQueue is full at snapshot consume phase Key: FLINK-36614 URL: https://issues.apache.org/jira/browse/FLINK-36614 Project: Flink

Re: [PR] [FLINK-36011] [runtime] Generalize RescaleManager to become StateTransitionManager [flink]

2024-10-28 Thread via GitHub
rkhachatryan commented on code in PR #25280: URL: https://github.com/apache/flink/pull/25280#discussion_r1818949028 ## flink-runtime/src/main/java/org/apache/flink/runtime/scheduler/adaptive/DefaultStateTransitionManager.java: ## @@ -0,0 +1,434 @@ +/* + * Licensed to the Apache

[jira] [Comment Edited] (FLINK-36613) RescaleCheckpointManuallyITCase.testCheckpointRescalingInKeyedState fails on AZP

2024-10-28 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17893415#comment-17893415 ] Sergey Nuyanzin edited comment on FLINK-36613 at 10/28/24 12:03 PM: --

Re: [PR] [hotfix] Add connector release tools [flink-connector-prometheus]

2024-10-28 Thread via GitHub
hlteoh37 merged PR #11: URL: https://github.com/apache/flink-connector-prometheus/pull/11 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubsc

[jira] [Commented] (FLINK-36613) RescaleCheckpointManuallyITCase.testCheckpointRescalingInKeyedState fails on AZP

2024-10-28 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17893415#comment-17893415 ] Sergey Nuyanzin commented on FLINK-36613: - It is very likely that the reason is

[jira] [Created] (FLINK-36613) RescaleCheckpointManuallyITCase.testCheckpointRescalingInKeyedState fails on AZP

2024-10-28 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-36613: --- Summary: RescaleCheckpointManuallyITCase.testCheckpointRescalingInKeyedState fails on AZP Key: FLINK-36613 URL: https://issues.apache.org/jira/browse/FLINK-36613

[jira] [Updated] (FLINK-36288) Set up architectural test

2024-10-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36288: --- Labels: pull-request-available (was: ) > Set up architectural test > --

[PR] [FLINK-36288][Connectors/Prometheus]Set up archunit tests [flink-connector-prometheus]

2024-10-28 Thread via GitHub
nicusX opened a new pull request, #12: URL: https://github.com/apache/flink-connector-prometheus/pull/12 ## Purpose of the change * Add archunit tests and initialize archunit-violations ## Verifying this change This change is a trivial rework / code cleanup without any te

[jira] [Updated] (FLINK-36612) Flink TypeSerializer doesn't recognize valid POJO getters/setters generated by Lombok

2024-10-28 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Liang Teoh updated FLINK-36612: Description: When creating a POJO using Lombok, the getters and setters are automatically

[jira] [Updated] (FLINK-36612) Flink TypeSerializer doesn't recognize valid POJO getters/setters generated by Lombok

2024-10-28 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Liang Teoh updated FLINK-36612: Description: When creating a POJO using Lombok, the getters and setters are automatically

[jira] [Created] (FLINK-36612) Flink TypeSerializer doesn't recognize valid POJO getters/setters generated by Lombok

2024-10-28 Thread Hong Liang Teoh (Jira)
Hong Liang Teoh created FLINK-36612: --- Summary: Flink TypeSerializer doesn't recognize valid POJO getters/setters generated by Lombok Key: FLINK-36612 URL: https://issues.apache.org/jira/browse/FLINK-36612

Re: [PR] [FLINK-30196][tests] Replace usage of deprecated Mockito methods and update Mockito to 4.11.0 [flink]

2024-10-28 Thread via GitHub
snuyanzin commented on PR #21389: URL: https://github.com/apache/flink/pull/21389#issuecomment-2441365848 @Zakelly sorry for the ping do you mind if I ask you to have a look here (GitHub says you are the most matching person) -- This is an automated message from the Apache Git Service.

Re: [PR] [FLINK-34466] Lineage interfaces for kafka connector [flink-connector-kafka]

2024-10-28 Thread via GitHub
pawel-big-lebowski commented on code in PR #130: URL: https://github.com/apache/flink-connector-kafka/pull/130#discussion_r1818800029 ## flink-connector-kafka/src/main/java/org/apache/flink/connector/kafka/lineage/KafkaDatasetIdentifierProvider.java: ## @@ -0,0 +1,16 @@ +packag

  1   2   >