Re: [PR] [FLINK-36690][runtime] Fix schema operator hanging under extreme parallelized pressure [flink-cdc]

2024-11-20 Thread via GitHub
leonardBang commented on PR #3680: URL: https://github.com/apache/flink-cdc/pull/3680#issuecomment-2490230409 > @leonardBang Will this PR be reviewed soon? I'm planning to implement [FLINK-36763](https://issues.apache.org/jira/browse/FLINK-36763) based on this. Added to my todo list

[jira] [Updated] (FLINK-36763) Support schema inference and evolution with single-table-mutliple-partition sources

2024-11-20 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu updated FLINK-36763: --- Fix Version/s: cdc-3.3.0 > Support schema inference and evolution with single-table-mutliple-partiti

Re: [PR] [FLINK-36066][runtime] Introducing the AdaptiveGraphManager component [flink]

2024-11-20 Thread via GitHub
noorall commented on code in PR #25414: URL: https://github.com/apache/flink/pull/25414#discussion_r1851480334 ## flink-runtime/src/test/java/org/apache/flink/runtime/jobgraph/forwardgroup/ForwardGroupComputeUtilTest.java: ## @@ -182,7 +319,56 @@ private static Set computeForwa

Re: [PR] [FLINK-36066][runtime] Introducing the AdaptiveGraphManager component [flink]

2024-11-20 Thread via GitHub
noorall commented on code in PR #25414: URL: https://github.com/apache/flink/pull/25414#discussion_r1851480334 ## flink-runtime/src/test/java/org/apache/flink/runtime/jobgraph/forwardgroup/ForwardGroupComputeUtilTest.java: ## @@ -182,7 +319,56 @@ private static Set computeForwa

[jira] [Created] (FLINK-36755) Relax the limit about the pipeline.jar must have one in application mode

2024-11-20 Thread Shengkai Fang (Jira)
Shengkai Fang created FLINK-36755: - Summary: Relax the limit about the pipeline.jar must have one in application mode Key: FLINK-36755 URL: https://issues.apache.org/jira/browse/FLINK-36755 Project: F

[jira] [Updated] (FLINK-36754) When projection is empty or null, it is treated as an asterisk

2024-11-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36754: --- Labels: pull-request-available (was: ) > When projection is empty or null, it is treated as

[jira] [Created] (FLINK-36763) Support schema inference and evolution with single-table-mutliple-partition sources

2024-11-20 Thread yux (Jira)
yux created FLINK-36763: --- Summary: Support schema inference and evolution with single-table-mutliple-partition sources Key: FLINK-36763 URL: https://issues.apache.org/jira/browse/FLINK-36763 Project: Flink

[jira] [Updated] (FLINK-36762) Add E2ECase to run script in application mode

2024-11-20 Thread Shengkai Fang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shengkai Fang updated FLINK-36762: -- Summary: Add E2ECase to run script in application mode (was: Add E2ECase to run sql client in

[jira] [Created] (FLINK-36761) Add document about how to deploy script with SQL Client and SQL Gateway

2024-11-20 Thread Shengkai Fang (Jira)
Shengkai Fang created FLINK-36761: - Summary: Add document about how to deploy script with SQL Client and SQL Gateway Key: FLINK-36761 URL: https://issues.apache.org/jira/browse/FLINK-36761 Project: Fl

[jira] [Created] (FLINK-36759) Intrdouce REST API to deploy script

2024-11-20 Thread Shengkai Fang (Jira)
Shengkai Fang created FLINK-36759: - Summary: Intrdouce REST API to deploy script Key: FLINK-36759 URL: https://issues.apache.org/jira/browse/FLINK-36759 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-36758) Introduce driver to load the application in application mode

2024-11-20 Thread Shengkai Fang (Jira)
Shengkai Fang created FLINK-36758: - Summary: Introduce driver to load the application in application mode Key: FLINK-36758 URL: https://issues.apache.org/jira/browse/FLINK-36758 Project: Flink

[jira] [Created] (FLINK-36756) Bump up the sql-gateway rest api version

2024-11-20 Thread Shengkai Fang (Jira)
Shengkai Fang created FLINK-36756: - Summary: Bump up the sql-gateway rest api version Key: FLINK-36756 URL: https://issues.apache.org/jira/browse/FLINK-36756 Project: Flink Issue Type: Sub-ta

[jira] [Created] (FLINK-36757) Introduce splitter to split scripts

2024-11-20 Thread Shengkai Fang (Jira)
Shengkai Fang created FLINK-36757: - Summary: Introduce splitter to split scripts Key: FLINK-36757 URL: https://issues.apache.org/jira/browse/FLINK-36757 Project: Flink Issue Type: Sub-task

[jira] [Updated] (FLINK-36754) When projection is empty or null, it is treated as an asterisk

2024-11-20 Thread MOBIN (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MOBIN updated FLINK-36754: -- Description: When projection is empty or NULL, the projection should be treated as an asterisk. The following

[jira] [Updated] (FLINK-36754) When projection is empty or null, it is treated as an asterisk

2024-11-20 Thread MOBIN (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MOBIN updated FLINK-36754: -- Description: When projection is empty or NULL, the projection should be treated as an asterisk. The following

[jira] [Created] (FLINK-36754) When projection is empty or null, it is treated as an asterisk

2024-11-20 Thread MOBIN (Jira)
MOBIN created FLINK-36754: - Summary: When projection is empty or null, it is treated as an asterisk Key: FLINK-36754 URL: https://issues.apache.org/jira/browse/FLINK-36754 Project: Flink Issue Type:

Re: [PR] [FLINK-35282][FLINK-35520] PyFlink Support for Apache Beam > 2.49 [flink]

2024-11-20 Thread via GitHub
snuyanzin closed pull request #24908: [FLINK-35282][FLINK-35520] PyFlink Support for Apache Beam > 2.49 URL: https://github.com/apache/flink/pull/24908 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [PR] [FLINK-35282][FLINK-35520] PyFlink Support for Apache Beam > 2.49 [flink]

2024-11-20 Thread via GitHub
snuyanzin commented on PR #24908: URL: https://github.com/apache/flink/pull/24908#issuecomment-2490143091 closed in favor of https://github.com/apache/flink/pull/25541, -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

[jira] [Created] (FLINK-36753) Adaptive Scheduler actively triggers a Checkpoint

2024-11-20 Thread Rui Fan (Jira)
Rui Fan created FLINK-36753: --- Summary: Adaptive Scheduler actively triggers a Checkpoint Key: FLINK-36753 URL: https://issues.apache.org/jira/browse/FLINK-36753 Project: Flink Issue Type: Improveme

[jira] [Commented] (FLINK-23409) CrossITCase fails with "NoResourceAvailableException: Slot request bulk is not fulfillable! Could not allocate the required slot within slot request timeout"

2024-11-20 Thread Fangwei Duan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17899927#comment-17899927 ] Fangwei Duan commented on FLINK-23409: -- same as @felixzh, No more queue resouces.

Re: [PR] Fix typo from MARCO to MACRO [flink]

2024-11-20 Thread via GitHub
sim-pez commented on PR #25614: URL: https://github.com/apache/flink/pull/25614#issuecomment-2489628212 Hi @davidradl, thank you for your feedback. I’ve pushed again to fix all the typos I found. -- This is an automated message from the Apache Git Service. To respond to the message, pleas

[jira] [Assigned] (FLINK-35093) Postgres source connector support SPECIFIC_OFFSETS start up mode from an existed replication slot.

2024-11-20 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reassigned FLINK-35093: -- Assignee: Vinh Pham (was: Hongshun Wang) > Postgres source connector support SPECIFIC_OFFSET

[jira] [Commented] (FLINK-35093) Postgres source connector support SPECIFIC_OFFSETS start up mode from an existed replication slot.

2024-11-20 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17899924#comment-17899924 ] Leonard Xu commented on FLINK-35093: [~phamvinh1712]Assigned to you > Postgres sour

[jira] [Updated] (FLINK-36753) Adaptive Scheduler actively triggers a Checkpoint

2024-11-20 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan updated FLINK-36753: Description: FLIP-461[1] and FLINK-35549[2] support that rescale could be executed after the next complet

[jira] [Updated] (FLINK-36753) Adaptive Scheduler actively triggers a Checkpoint

2024-11-20 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan updated FLINK-36753: Description: FLIP-461[1] and FLINK-35549[2] support that rescale could be executed after the next complet

[jira] [Comment Edited] (FLINK-36572) The local time zone is wrongly set in StarRocks pipeline sink

2024-11-20 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17897081#comment-17897081 ] Leonard Xu edited comment on FLINK-36572 at 11/21/24 2:04 AM:

[jira] [Resolved] (FLINK-36572) The local time zone is wrongly set in StarRocks pipeline sink

2024-11-20 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu resolved FLINK-36572. Resolution: Fixed > The local time zone is wrongly set in StarRocks pipeline sink > --

[jira] [Updated] (FLINK-36572) The local time zone is wrongly set in StarRocks pipeline sink

2024-11-20 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu updated FLINK-36572: --- Fix Version/s: cdc-3.2.1 > The local time zone is wrongly set in StarRocks pipeline sink > -

Re: [PR] [BP release-3.2][FLINK-36572][pipeline-connector][starrocks] Fix the issue that the local time zone is wrongly set [flink-cdc]

2024-11-20 Thread via GitHub
leonardBang merged PR #3733: URL: https://github.com/apache/flink-cdc/pull/3733 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink

Re: [PR] [FLINK-36066][runtime] Introducing the AdaptiveGraphManager component [flink]

2024-11-20 Thread via GitHub
zhuzhurk commented on code in PR #25414: URL: https://github.com/apache/flink/pull/25414#discussion_r1847688952 ## flink-runtime/src/main/java/org/apache/flink/runtime/jobgraph/IntermediateDataSet.java: ## @@ -43,6 +44,8 @@ public class IntermediateDataSet implements java.io.Se

Re: [PR] [FLINK-36693][state/forst] Implement checkpoint for ForStSyncKeyedStateBackend [flink]

2024-11-20 Thread via GitHub
fredia merged PR #25643: URL: https://github.com/apache/flink/pull/25643 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache

[jira] [Resolved] (FLINK-36527) Introduce a parameter to support the autoscaler to adopt a more aggressive strategy when Source or upstream shuffle is keyBy

2024-11-20 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan resolved FLINK-36527. - Fix Version/s: kubernetes-operator-1.11.0 Resolution: Fixed Merged to main(1.11.0) via: acc04da2b

Re: [PR] [FLINK-36527][autoscaler] Introduce a parameter to support autoscaler adopt a more radical strategy when source vertex or upstream shuffle is keyBy [flink-kubernetes-operator]

2024-11-20 Thread via GitHub
huyuanfeng2018 commented on PR #904: URL: https://github.com/apache/flink-kubernetes-operator/pull/904#issuecomment-2489903494 Thanks for the review @mxm @1996fanrui @SamBarker -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[PR] Bump org.apache.kafka:kafka-clients from 3.3.1 to 3.7.1 in /docker/data-generator [flink-playgrounds]

2024-11-20 Thread via GitHub
dependabot[bot] opened a new pull request, #46: URL: https://github.com/apache/flink-playgrounds/pull/46 Bumps org.apache.kafka:kafka-clients from 3.3.1 to 3.7.1. [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=

Re: [PR] [FLINK-33390][runtime] Support slot balancing at TM level for Adaptive Scheduler [flink]

2024-11-20 Thread via GitHub
RocMarshal commented on PR #25510: URL: https://github.com/apache/flink/pull/25510#issuecomment-2489832062 Hi, @XComp Could you help take a look if you had the free time ? Thank you very much~ :) -- This is an automated message from the Apache Git Service. To respond to the message, ple

Re: [PR] Optimize log level [flink-cdc]

2024-11-20 Thread via GitHub
github-actions[bot] commented on PR #3538: URL: https://github.com/apache/flink-cdc/pull/3538#issuecomment-2489789390 This pull request has been closed because it has not had recent activity. You could reopen it if you try to continue your work, and anyone who are interested in it are encou

Re: [PR] Optimize log level [flink-cdc]

2024-11-20 Thread via GitHub
github-actions[bot] closed pull request #3538: Optimize log level URL: https://github.com/apache/flink-cdc/pull/3538 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscr

Re: [PR] [FLINK-36345][feature][cdc-connector][oracle] Oracle cdc support partition table [flink-cdc]

2024-11-20 Thread via GitHub
github-actions[bot] commented on PR #3593: URL: https://github.com/apache/flink-cdc/pull/3593#issuecomment-2489789317 This pull request has been automatically marked as stale because it has not had recent activity for 60 days. It will be closed in 30 days if no further activity occurs. --

[jira] [Resolved] (FLINK-36711) Add tips when System out and err are redirected to LOG or discarded

2024-11-20 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan resolved FLINK-36711. - Fix Version/s: 2.0.0 Assignee: Vincent Woo Resolution: Fixed Thanks [~vincentwoo] for th

[jira] [Created] (FLINK-36752) Emit state related metrics when checkpoints are disabled

2024-11-20 Thread Sai Sharath Dandi (Jira)
Sai Sharath Dandi created FLINK-36752: - Summary: Emit state related metrics when checkpoints are disabled Key: FLINK-36752 URL: https://issues.apache.org/jira/browse/FLINK-36752 Project: Flink

[jira] [Updated] (FLINK-32097) Implement support for Kinesis deaggregation

2024-11-20 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Liang Teoh updated FLINK-32097: Component/s: Connectors / Kinesis > Implement support for Kinesis deaggregation >

[jira] [Updated] (FLINK-32097) Implement support for Kinesis deaggregation

2024-11-20 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Liang Teoh updated FLINK-32097: Affects Version/s: aws-connector-5.0.0 > Implement support for Kinesis deaggregation > ---

Re: [PR] [FLINK-36745][docs] Make FixedSizeSplitFetcherManager and FixedFetcherSizeSourceReader examples match Flink 2.0-preview API [flink]

2024-11-20 Thread via GitHub
davidradl commented on code in PR #25667: URL: https://github.com/apache/flink/pull/25667#discussion_r1850415111 ## docs/content.zh/docs/dev/datastream/sources.md: ## @@ -294,9 +294,9 @@ public class FixedSizeSplitFetcherManager public FixedSizeSplitFetcherManager(

Re: [PR] [FLINK-36527][autoscaler] Introduce a parameter to support autoscaler adopt a more radical strategy when source vertex or upstream shuffle is keyBy [flink-kubernetes-operator]

2024-11-20 Thread via GitHub
mxm commented on PR #904: URL: https://github.com/apache/flink-kubernetes-operator/pull/904#issuecomment-2489095198 Thanks @huyuanfeng2018! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

Re: [PR] [FLINK-36527][autoscaler] Introduce a parameter to support autoscaler adopt a more radical strategy when source vertex or upstream shuffle is keyBy [flink-kubernetes-operator]

2024-11-20 Thread via GitHub
mxm merged PR #904: URL: https://github.com/apache/flink-kubernetes-operator/pull/904 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...

[jira] [Commented] (FLINK-36739) Update NodeJS to v18.20.5 (LTS)

2024-11-20 Thread Mehdi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17899814#comment-17899814 ] Mehdi commented on FLINK-36739: --- It seems to be a problem with GLIBC which is 2.23 but fro

Re: [PR] [FLINK-36745][docs] Make FixedSizeSplitFetcherManager and FixedFetcherSizeSourceReader examples match Flink 2.0-preview API [flink]

2024-11-20 Thread via GitHub
lvyanquan commented on code in PR #25667: URL: https://github.com/apache/flink/pull/25667#discussion_r1849637494 ## docs/content/docs/dev/datastream/sources.md: ## @@ -325,16 +325,13 @@ public class FixedFetcherSizeSourceReader { public FixedFetcherSizeSourceReader( -

Re: [PR] [FLINK-33761][Connector/JDBC] Add Snowflake JDBC Dialect [flink-connector-jdbc]

2024-11-20 Thread via GitHub
borislitvak commented on PR #118: URL: https://github.com/apache/flink-connector-jdbc/pull/118#issuecomment-2488981196 I actively use it, yes. You can built from branch. On Wed, Nov 20, 2024, 17:24 Ecaterina Lazarescu ***@***.***> wrote: > Thank you for your prompt answer!,

Re: [PR] [FLINK-33761][Connector/JDBC] Add Snowflake JDBC Dialect [flink-connector-jdbc]

2024-11-20 Thread via GitHub
EcaterinaL commented on PR #118: URL: https://github.com/apache/flink-connector-jdbc/pull/118#issuecomment-2488874691 Thank you for your prompt answer!, Do you actively use it? Have you merge it with your master? -- This is an automated message from the Apache Git Service. To r

Re: [PR] fix:Event latency does not equal window triggering [flink]

2024-11-20 Thread via GitHub
davidradl commented on PR #25663: URL: https://github.com/apache/flink/pull/25663#issuecomment-241174 is this the same as https://github.com/apache/flink/pull/25664 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

Re: [PR] [hotfix] [docs] Update table environment variable name in common.md [flink]

2024-11-20 Thread via GitHub
davidradl commented on code in PR #25669: URL: https://github.com/apache/flink/pull/25669#discussion_r1850410306 ## docs/content.zh/docs/dev/table/common.md: ## @@ -387,19 +387,19 @@ Table table = ...; // register the view named 'exampleView' in the catalog named 'custom_cata

Re: [PR] [FLINK-36745][docs] Make FixedSizeSplitFetcherManager and FixedFetcherSizeSourceReader examples match Flink 2.0-preview API [flink]

2024-11-20 Thread via GitHub
davidradl commented on code in PR #25667: URL: https://github.com/apache/flink/pull/25667#discussion_r1850415111 ## docs/content.zh/docs/dev/datastream/sources.md: ## @@ -294,9 +294,9 @@ public class FixedSizeSplitFetcherManager public FixedSizeSplitFetcherManager(

Re: [PR] [FLINK-36739] [WebFrontend] Update the NodeJS to v22.11.0 (LTS) [flink]

2024-11-20 Thread via GitHub
davidradl commented on PR #25670: URL: https://github.com/apache/flink/pull/25670#issuecomment-2488701144 @mehdid93 when you say "There will be another PR to fix vulnerabilities once this is merged.". Can you confirm that this PR does not introduce any vulnerabilities compared to the older

Re: [PR] Fix typo from MARCO to MACRO [flink]

2024-11-20 Thread via GitHub
davidradl commented on code in PR #25614: URL: https://github.com/apache/flink/pull/25614#discussion_r1850386490 ## docs/content/docs/dev/table/hive-compatibility/hive-dialect/create.md: ## @@ -27,7 +27,7 @@ With Hive dialect, the following CREATE statements are supported for n

[jira] [Commented] (FLINK-36743) Rescale from unaligend checkpoint failed

2024-11-20 Thread Feifan Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17899490#comment-17899490 ] Feifan Wang commented on FLINK-36743: - Sorry I missed a important change from my col

Re: [PR] [FLINK-34688][cdc-connector] CDC framework split snapshot chunks asynchronously [flink-cdc]

2024-11-20 Thread via GitHub
leonardBang commented on PR #3510: URL: https://github.com/apache/flink-cdc/pull/3510#issuecomment-2488389062 @loserwang1024 Could you kindly rebase your PR to latest master branch to resolve potential conflicts? -- This is an automated message from the Apache Git Service. To respond to t

Re: [PR] [FLINK-36066][runtime] Introducing the AdaptiveGraphManager component [flink]

2024-11-20 Thread via GitHub
zhuzhurk commented on code in PR #25414: URL: https://github.com/apache/flink/pull/25414#discussion_r1849791836 ## flink-runtime/src/main/java/org/apache/flink/streaming/api/graph/AdaptiveGraphManager.java: ## @@ -0,0 +1,697 @@ +/* + * Licensed to the Apache Software Foundation

Re: [PR] [FLINK-36527][autoscaler] Introduce a parameter to support autoscaler adopt a more radical strategy when source vertex or upstream shuffle is keyBy [flink-kubernetes-operator]

2024-11-20 Thread via GitHub
huyuanfeng2018 commented on code in PR #904: URL: https://github.com/apache/flink-kubernetes-operator/pull/904#discussion_r1848520651 ## flink-autoscaler/src/main/java/org/apache/flink/autoscaler/JobVertexScaler.java: ## @@ -411,26 +416,30 @@ protected static > int scale(

Re: [PR] [BP-3.2][FLINK-36565][transform] Route allows merging Decimals with various precisions [flink-cdc]

2024-11-20 Thread via GitHub
ruanhang1993 merged PR #3743: URL: https://github.com/apache/flink-cdc/pull/3743 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flin

Re: [PR] [FLINK-36745][docs] Make FixedSizeSplitFetcherManager and FixedFetcherSizeSourceReader examples match Flink 2.0-preview API [flink]

2024-11-20 Thread via GitHub
kaygorodov commented on code in PR #25667: URL: https://github.com/apache/flink/pull/25667#discussion_r1850149045 ## docs/content/docs/dev/datastream/sources.md: ## @@ -325,16 +325,13 @@ public class FixedFetcherSizeSourceReader { public FixedFetcherSizeSourceReader( -

[jira] [Updated] (FLINK-36509) Fix 'Unsupported bucket mode: GLOBAL_DYNAMIC' error in Paimon Pipeline Sink.

2024-11-20 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-36509: -- Issue Type: Bug (was: Improvement) > Fix 'Unsupported bucket mode: GLOBAL_DYNAMIC' error in Paimon Pi

[jira] [Resolved] (FLINK-36750) Paimon connector would reuse sequence number when schema evolution happened

2024-11-20 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang resolved FLINK-36750. --- Resolution: Fixed > Paimon connector would reuse sequence number when schema evolution happened > --

Re: [PR] [hotfix][tests] Fix CI failure after upgrading to Flink 1.19 [flink-cdc]

2024-11-20 Thread via GitHub
yuxiqian closed pull request #3747: [hotfix][tests] Fix CI failure after upgrading to Flink 1.19 URL: https://github.com/apache/flink-cdc/pull/3747 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

Re: [PR] [FLINK-36745][docs] Make FixedSizeSplitFetcherManager and FixedFetcherSizeSourceReader examples match Flink 2.0-preview API [flink]

2024-11-20 Thread via GitHub
lvyanquan commented on code in PR #25667: URL: https://github.com/apache/flink/pull/25667#discussion_r1850103994 ## docs/content/docs/dev/datastream/sources.md: ## @@ -325,16 +325,13 @@ public class FixedFetcherSizeSourceReader { public FixedFetcherSizeSourceReader( -

Re: [PR] [FLINK-36745][docs] Make FixedSizeSplitFetcherManager and FixedFetcherSizeSourceReader examples match Flink 2.0-preview API [flink]

2024-11-20 Thread via GitHub
lvyanquan commented on code in PR #25667: URL: https://github.com/apache/flink/pull/25667#discussion_r1850103994 ## docs/content/docs/dev/datastream/sources.md: ## @@ -325,16 +325,13 @@ public class FixedFetcherSizeSourceReader { public FixedFetcherSizeSourceReader( -

Re: [PR] [hotfix][source-connector/mysql] Fix conflicts after flink version bumped to 1.19 [flink-cdc]

2024-11-20 Thread via GitHub
ruanhang1993 merged PR #3748: URL: https://github.com/apache/flink-cdc/pull/3748 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flin

Re: [PR] [FLINK-36739] [WebFrontend] Update the NodeJS to v22.11.0 (LTS) [flink]

2024-11-20 Thread via GitHub
flinkbot commented on PR #25670: URL: https://github.com/apache/flink/pull/25670#issuecomment-2488136503 ## CI report: * c7c73f9f60c35c64700e47eaa21b1a6e4f041aff UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [hotfix] [docs] Update table environment variable name in common.md [flink]

2024-11-20 Thread via GitHub
flinkbot commented on PR #25669: URL: https://github.com/apache/flink/pull/25669#issuecomment-2488114295 ## CI report: * 995d861b3b62efed770c69b4853d840b4003dae4 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-36739) Update NodeJS to v18.20.5 (LTS)

2024-11-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36739: --- Labels: pull-request-available (was: ) > Update NodeJS to v18.20.5 (LTS) >

Re: [PR] [FLINK-34545][cdc-pipeline-connector]Add OceanBase pipeline connector to Flink CDC [flink-cdc]

2024-11-20 Thread via GitHub
yuanoOo commented on code in PR #3360: URL: https://github.com/apache/flink-cdc/pull/3360#discussion_r1849995102 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-oceanbase/src/test/java/org/apache/flink/cdc/connectors/oceanbase/sink/OceanBaseEventSerializa

[PR] [FLINK-36739] [WebFrontend] Update the NodeJS to v22.11.0 (LTS) [flink]

2024-11-20 Thread via GitHub
mehdid93 opened a new pull request, #25670: URL: https://github.com/apache/flink/pull/25670 Contribute-to: https://issues.apache.org/jira/browse/FLINK-36739 ## What is the purpose of the change This pull request raises the version of the NodeJS module which is a pre-req

[PR] [hotfix] [docs] Update table environment variable name in common.md [flink]

2024-11-20 Thread via GitHub
Huachao opened a new pull request, #25669: URL: https://github.com/apache/flink/pull/25669 ## What is the purpose of the change Fix enviroment variable name inconsistence in code snippet. ## Brief change log - Change `tableEnv` to `tEnv` for both `Java` and

Re: [PR] [FLINK-34545][cdc-pipeline-connector]Add OceanBase pipeline connector to Flink CDC [flink-cdc]

2024-11-20 Thread via GitHub
yuanoOo commented on code in PR #3360: URL: https://github.com/apache/flink-cdc/pull/3360#discussion_r1849991842 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-oceanbase/src/main/java/org/apache/flink/cdc/connectors/oceanbase/sink/OceanBaseEventSerializa

Re: [PR] [FLINK-34545][cdc-pipeline-connector]Add OceanBase pipeline connector to Flink CDC [flink-cdc]

2024-11-20 Thread via GitHub
yuanoOo commented on code in PR #3360: URL: https://github.com/apache/flink-cdc/pull/3360#discussion_r1849992101 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-oceanbase/src/test/java/org/apache/flink/cdc/connectors/oceanbase/sink/OceanBaseMetadataApplie

[PR] [hotfix][source-connector/mysql] Fix conflicts after flink version bumped to 1.19 [flink-cdc]

2024-11-20 Thread via GitHub
leonardBang opened a new pull request, #3748: URL: https://github.com/apache/flink-cdc/pull/3748 Fix conflicts after flink version bumped to 1.19 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] [FLINK-36745][docs] Make FixedSizeSplitFetcherManager and FixedFetcherSizeSourceReader examples match Flink 2.0-preview API [flink]

2024-11-20 Thread via GitHub
kaygorodov commented on code in PR #25667: URL: https://github.com/apache/flink/pull/25667#discussion_r1849982828 ## docs/content/docs/dev/datastream/sources.md: ## @@ -325,16 +325,13 @@ public class FixedFetcherSizeSourceReader { public FixedFetcherSizeSourceReader( -

[jira] [Commented] (FLINK-36751) PausableRelativeClock does not pause when the source only has one split

2024-11-20 Thread haishui (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17899708#comment-17899708 ] haishui commented on FLINK-36751: - Hi [~pnowojski] , could you help investigate this? >

[jira] [Created] (FLINK-36751) PausableRelativeClock does not pause when the source only has one split

2024-11-20 Thread haishui (Jira)
haishui created FLINK-36751: --- Summary: PausableRelativeClock does not pause when the source only has one split Key: FLINK-36751 URL: https://issues.apache.org/jira/browse/FLINK-36751 Project: Flink

[jira] [Updated] (FLINK-36750) Paimon connector would reuse sequence number when schema evolution happened

2024-11-20 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu updated FLINK-36750: --- Fix Version/s: cdc-3.3.0 > Paimon connector would reuse sequence number when schema evolution happen

[jira] [Commented] (FLINK-36750) Paimon connector would reuse sequence number when schema evolution happened

2024-11-20 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17899699#comment-17899699 ] Leonard Xu commented on FLINK-36750: master:3a2d799fd8eceea76b0abfb066e70b2ca4d58648

Re: [PR] [FLINK-36750][paimon] Restore SinkWrite from state to keep the information of previous SinkWrite when schema evolution happen. [flink-cdc]

2024-11-20 Thread via GitHub
leonardBang merged PR #3745: URL: https://github.com/apache/flink-cdc/pull/3745 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink

Re: [PR] [FLINK-36750][paimon] Restore SinkWrite from state to keep the information of previous SinkWrite when schema evolution happen. [flink-cdc]

2024-11-20 Thread via GitHub
leonardBang merged PR #3744: URL: https://github.com/apache/flink-cdc/pull/3744 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink

Re: [PR] [FLINK-36750][paimon] Restore SinkWrite from state to keep the information of previous SinkWrite when schema evolution happen. [flink-cdc]

2024-11-20 Thread via GitHub
leonardBang commented on PR #3744: URL: https://github.com/apache/flink-cdc/pull/3744#issuecomment-2487990882 CI passed, merging... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[jira] [Assigned] (FLINK-36750) Paimon connector would reuse sequence number when schema evolution happened

2024-11-20 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reassigned FLINK-36750: -- Assignee: Yanquan Lv > Paimon connector would reuse sequence number when schema evolution hap

[jira] [Commented] (FLINK-36743) Rescale from unaligend checkpoint failed

2024-11-20 Thread Feifan Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17899418#comment-17899418 ] Feifan Wang commented on FLINK-36743: - [~arvid]  We do use a internal version forked

[jira] [Comment Edited] (FLINK-36743) Rescale from unaligend checkpoint failed

2024-11-20 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17899693#comment-17899693 ] Arvid Heise edited comment on FLINK-36743 at 11/20/24 9:06 AM: ---

[jira] [Resolved] (FLINK-36743) Rescale from unaligend checkpoint failed

2024-11-20 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise resolved FLINK-36743. - Resolution: Duplicate > Rescale from unaligend checkpoint failed > -

Re: [PR] 同步release3.2 [flink-cdc]

2024-11-20 Thread via GitHub
tcmtang closed pull request #3746: 同步release3.2 URL: https://github.com/apache/flink-cdc/pull/3746 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issue

[jira] [Commented] (FLINK-36743) Rescale from unaligend checkpoint failed

2024-11-20 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17899693#comment-17899693 ] Arvid Heise commented on FLINK-36743: - It looks like https://issues.apache.org/jira/

[PR] 同步release3.2 [flink-cdc]

2024-11-20 Thread via GitHub
tcmtang opened a new pull request, #3746: URL: https://github.com/apache/flink-cdc/pull/3746 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-

[jira] [Updated] (FLINK-36750) Paimon connector would reuse sequence number when schema evolution happened

2024-11-20 Thread Yanquan Lv (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanquan Lv updated FLINK-36750: --- Description: When schema evolution happened, we will prepare commit and recreate a new FileStoreWri

[jira] [Commented] (FLINK-36509) Fix 'Unsupported bucket mode: GLOBAL_DYNAMIC' error in Paimon Pipeline Sink.

2024-11-20 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17899629#comment-17899629 ] Ruan Hang commented on FLINK-36509: --- 3.2 : 40db6d5eb7661696797acba30384e37e56cdac5a >

[jira] [Commented] (FLINK-36743) Rescale from unaligend checkpoint failed

2024-11-20 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17899674#comment-17899674 ] Arvid Heise commented on FLINK-36743: - I try to dig a bit deeper because there may s

Re: [PR] [FLINK-35490] Migrate tests to JUnit 5 and AssertJ [flink-cdc]

2024-11-20 Thread via GitHub
yuxiqian commented on PR #3742: URL: https://github.com/apache/flink-cdc/pull/3742#issuecomment-2487833115 Most changes are just repetitive while some needs more attention: * Created wrapper classes `AbstractTestBaseProxy` because Flink's original version was targeted to JUnit 4 *