Re: [PR] [FLINK-36656][mysql] Fix type conversion failure for newly-added sharding table with mysql boolean type [flink-cdc]

2024-11-19 Thread via GitHub
ruanhang1993 merged PR #3683: URL: https://github.com/apache/flink-cdc/pull/3683 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flin

Re: [PR] [FLINK-36656][mysql] Fix type conversion failure for newly-added sharding table with mysql boolean type [flink-cdc]

2024-11-19 Thread via GitHub
yuxiqian commented on code in PR #3683: URL: https://github.com/apache/flink-cdc/pull/3683#discussion_r1849772522 ## flink-cdc-connect/flink-cdc-source-connectors/flink-connector-mysql-cdc/src/test/java/org/apache/flink/cdc/connectors/mysql/table/MySqlConnectorShardingTableITCase.java:

[jira] [Comment Edited] (FLINK-35291) Improve the ROW data deserialization performance of DebeziumEventDeserializationScheme

2024-11-19 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17893365#comment-17893365 ] Ruan Hang edited comment on FLINK-35291 at 11/20/24 7:38 AM: -

Re: [PR] [FLINK-36656][mysql] Fix type conversion failure for newly-added sharding table with mysql boolean type [flink-cdc]

2024-11-19 Thread via GitHub
ruanhang1993 merged PR #3684: URL: https://github.com/apache/flink-cdc/pull/3684 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flin

Re: [PR] [FLINK-35291][runtime] Improve the ROW data deserialization performance of DebeziumEventDeserializationScheme (#3289) [flink-cdc]

2024-11-19 Thread via GitHub
ruanhang1993 merged PR #3670: URL: https://github.com/apache/flink-cdc/pull/3670 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flin

[jira] [Comment Edited] (FLINK-36656) Flink CDC treats MySQL Sharding table with boolean type conversion error

2024-11-19 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17899667#comment-17899667 ] Ruan Hang edited comment on FLINK-36656 at 11/20/24 7:36 AM: -

[jira] [Resolved] (FLINK-36656) Flink CDC treats MySQL Sharding table with boolean type conversion error

2024-11-19 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang resolved FLINK-36656. --- Resolution: Fixed > Flink CDC treats MySQL Sharding table with boolean type conversion error > -

[jira] [Commented] (FLINK-36656) Flink CDC treats MySQL Sharding table with boolean type conversion error

2024-11-19 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17899667#comment-17899667 ] Ruan Hang commented on FLINK-36656: --- 3.2: 12c36f1ccdd80bdcf068f795e6c8943862a674d5 >

Re: [PR] [FLINK-36714][state] Ignore interrupted in sstmerge.CompactionScheduler#stop [flink]

2024-11-19 Thread via GitHub
pnowojski merged PR #25655: URL: https://github.com/apache/flink/pull/25655 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apa

Re: [PR] [FLINK-36710] Log job ID in RecreateOnResetOperatorCoordinator [flink]

2024-11-19 Thread via GitHub
pnowojski merged PR #25652: URL: https://github.com/apache/flink/pull/25652 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apa

Re: [PR] [FLINK-33761][Connector/JDBC] Add Snowflake JDBC Dialect [flink-connector-jdbc]

2024-11-19 Thread via GitHub
borislitvak commented on PR #118: URL: https://github.com/apache/flink-connector-jdbc/pull/118#issuecomment-2487685106 > Hello all, > > Is there any progress on this? will it be merged, if yes, when do you think this would be? > > Thank you! Ecaterina, I am still waitin

[jira] [Updated] (FLINK-36750) Paimon connector would reuse sequence number when schema evolution happened

2024-11-19 Thread Yanquan Lv (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanquan Lv updated FLINK-36750: --- Description: When schema evolution happened, we will prepare commit and recreate a new FileStoreWri

Re: [PR] [FLINK-36750][paimon] Restore SinkWrite from state to keep the information of previous SinkWrite when schema evolution happen. [flink-cdc]

2024-11-19 Thread via GitHub
lvyanquan commented on PR #3744: URL: https://github.com/apache/flink-cdc/pull/3744#issuecomment-2487580700 @yuxiqian @leonardBang Could you please help to review this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[jira] [Resolved] (FLINK-36052) add elasticsearch.md for elasticsearch pipeline connector

2024-11-19 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang resolved FLINK-36052. --- Resolution: Fixed 3.2: 2c4aa3c0a2fd752b684991cdb562a99231fb31e8 > add elasticsearch.md for elastics

Re: [PR] [FLINK-36052][docs][cdc-pipeline-connector/es] Add flink cdc pipeline elasticsearch connector docs [flink-cdc]

2024-11-19 Thread via GitHub
ruanhang1993 merged PR #3686: URL: https://github.com/apache/flink-cdc/pull/3686 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flin

[jira] [Resolved] (FLINK-36565) Pipeline YAML should allow merging decimal with different precisions

2024-11-19 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang resolved FLINK-36565. --- Resolution: Fixed 3.2 : 4d0174c79c55f9236edfdef760edc28cc1729d90 > Pipeline YAML should allow mergi

[jira] [Updated] (FLINK-36750) Paimon connector would reuse sequence number when schema evolution happened

2024-11-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36750: --- Labels: pull-request-available (was: ) > Paimon connector would reuse sequence number when

[PR] [FLINK-36750][paimon] Restore SinkWrite from state to keep the information of previous SinkWrite when schema evolution happen. [flink-cdc]

2024-11-19 Thread via GitHub
lvyanquan opened a new pull request, #3744: URL: https://github.com/apache/flink-cdc/pull/3744 Use replace API instead of removing and recreating StoreSinkWrite to keep the write state consistent with previous StoreSinkWrite. -- This is an automated message from the Apache Git Service. T

[jira] [Created] (FLINK-36750) Paimon connector would reuse sequence number when schema evolution happened

2024-11-19 Thread Yanquan Lv (Jira)
Yanquan Lv created FLINK-36750: -- Summary: Paimon connector would reuse sequence number when schema evolution happened Key: FLINK-36750 URL: https://issues.apache.org/jira/browse/FLINK-36750 Project: Flin

[jira] [Commented] (FLINK-34868) [Bug] oracle-cdc cannot read oracle multitenant pdb binlog: ORA-00942: table or view does not exist (LOG_MINING_FLUSH)

2024-11-19 Thread Fang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17899636#comment-17899636 ] Fang commented on FLINK-34868: -- yet!  I solved the problem Prerequisites: flinkCDC 2.4 ,

Re: [PR] [FLINK-34865][pipeline-connector]support sync table and column comments [flink-cdc]

2024-11-19 Thread via GitHub
MOBIN-F commented on PR #3482: URL: https://github.com/apache/flink-cdc/pull/3482#issuecomment-2487262098 hi,@qg-lin thank you for PR, which is very useful for us. I did some tests after meger and found a problem. If user defines transform in pipeline, the current TransformParser#generat

[jira] [Commented] (FLINK-36397) Using the offset obtained after a query transaction as a high watermark cannot ensure exactly-once semantics.

2024-11-19 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17899627#comment-17899627 ] Ruan Hang commented on FLINK-36397: --- As [~diwu] said, this problem will not occur beca

Re: [PR] [FLINK-36698][pipeline-connector][elasticsearch] Elasticsearch pipeline sink support authentication [flink-cdc]

2024-11-19 Thread via GitHub
beryllw commented on PR #3728: URL: https://github.com/apache/flink-cdc/pull/3728#issuecomment-2487224644 @proletarians cc -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

[jira] [Updated] (FLINK-36282) Incorrect data type in mysql pipeline connector

2024-11-19 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-36282: -- Fix Version/s: (was: cdc-3.2.1) > Incorrect data type in mysql pipeline connector > --

[jira] [Updated] (FLINK-36285) Modify column type failed when downstream's column with defalut value

2024-11-19 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-36285: -- Fix Version/s: (was: cdc-3.2.1) > Modify column type failed when downstream's column with defalut

Re: [PR] [tests][oceanbase] Fix oceanbase test failure, possibly caused by some interactions among cases [flink-cdc]

2024-11-19 Thread via GitHub
yuxiqian commented on PR #3712: URL: https://github.com/apache/flink-cdc/pull/3712#issuecomment-2487176021 Rebased with master, could @ruanhang1993 please take a look? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

[jira] [Comment Edited] (FLINK-34201) Datadog name resolution fails and do not retry causing metrics to not get exported

2024-11-19 Thread Josh Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17899618#comment-17899618 ] Josh Tan edited comment on FLINK-34201 at 11/20/24 2:36 AM:

Re: [PR] [FLINK-36406] Close MetadataApplier when the job stops [flink-cdc]

2024-11-19 Thread via GitHub
morozov commented on PR #3623: URL: https://github.com/apache/flink-cdc/pull/3623#issuecomment-2486379916 @ruanhang1993, thanks for the review. What are the next steps to get this merged? -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[jira] [Updated] (FLINK-36514) Unable to override include/exclude schema types in lenient mode

2024-11-19 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-36514: -- Fix Version/s: (was: cdc-3.2.1) > Unable to override include/exclude schema types in lenient mode

[jira] [Resolved] (FLINK-36509) Fix 'Unsupported bucket mode: GLOBAL_DYNAMIC' error in Paimon Pipeline Sink.

2024-11-19 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang resolved FLINK-36509. --- Resolution: Fixed > Fix 'Unsupported bucket mode: GLOBAL_DYNAMIC' error in Paimon Pipeline Sink. > -

[jira] [Resolved] (FLINK-35982) Transform metadata config doesn't work if no projection block was provided

2024-11-19 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang resolved FLINK-35982. --- Resolution: Fixed > Transform metadata config doesn't work if no projection block was provided > ---

[jira] [Updated] (FLINK-36713) NoSuchMethodError: PostgresConnection with PostgresIncrementalSource ar runtime

2024-11-19 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-36713: -- Fix Version/s: (was: cdc-3.2.1) > NoSuchMethodError: PostgresConnection with PostgresIncrementalSo

[jira] [Updated] (FLINK-36397) Using the offset obtained after a query transaction as a high watermark cannot ensure exactly-once semantics.

2024-11-19 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-36397: -- Fix Version/s: (was: cdc-3.2.1) > Using the offset obtained after a query transaction as a high wa

[jira] [Updated] (FLINK-36573) Add table information of binlog offsets when checkpointing

2024-11-19 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-36573: -- Fix Version/s: (was: cdc-3.2.1) > Add table information of binlog offsets when checkpointing > ---

[jira] [Updated] (FLINK-36560) Fix the issue of timestamp_ltz increasing by 8 hours in Paimon

2024-11-19 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-36560: -- Issue Type: Bug (was: Improvement) > Fix the issue of timestamp_ltz increasing by 8 hours in Paimon >

[jira] [Updated] (FLINK-36315) The flink-cdc-base module supports source metric statistics

2024-11-19 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-36315: -- Fix Version/s: cdc-3.3.0 (was: cdc-3.2.1) > The flink-cdc-base module supports

[jira] [Updated] (FLINK-36315) The flink-cdc-base module supports source metric statistics

2024-11-19 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-36315: -- Fix Version/s: cdc-3.2.1 > The flink-cdc-base module supports source metric statistics > -

Re: [PR] [FLINK-36527][autoscaler] Introduce a parameter to support autoscaler adopt a more radical strategy when source vertex or upstream shuffle is keyBy [flink-kubernetes-operator]

2024-11-19 Thread via GitHub
1996fanrui commented on code in PR #904: URL: https://github.com/apache/flink-kubernetes-operator/pull/904#discussion_r1849383882 ## flink-autoscaler/src/main/java/org/apache/flink/autoscaler/JobVertexScaler.java: ## @@ -411,26 +416,30 @@ protected static > int scale(

[jira] [Commented] (FLINK-34201) Datadog name resolution fails and do not retry causing metrics to not get exported

2024-11-19 Thread Josh Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17899618#comment-17899618 ] Josh Tan commented on FLINK-34201: -- Facing the same issue. Seems to happen occasionally

Re: [PR] [FLINK-31836][table] Upgrade Calcite version to 1.34.0 [flink]

2024-11-19 Thread via GitHub
snuyanzin commented on PR #24256: URL: https://github.com/apache/flink/pull/24256#issuecomment-2486576559 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [FLINK-36192][log] instruct how to change log level dynamically [flink-kubernetes-operator]

2024-11-19 Thread via GitHub
mxm merged PR #911: URL: https://github.com/apache/flink-kubernetes-operator/pull/911 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...

Re: [PR] [FLINK-36047] Add CompiledPlan annotations to BatchExecOverAggregate [flink]

2024-11-19 Thread via GitHub
jnh5y commented on code in PR #25635: URL: https://github.com/apache/flink/pull/25635#discussion_r1849344761 ## flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/plan/nodes/exec/common/OverAggregateTestPrograms.java: ## @@ -0,0 +1,433 @@ +/* + * Licens

Re: [PR] [FLINK-35490][cdc][JUnit5 Migration] For `flink-cdc-connect/flink-cdc-source-connectors` module [flink-cdc]

2024-11-19 Thread via GitHub
github-actions[bot] closed pull request #3395: [FLINK-35490][cdc][JUnit5 Migration] For `flink-cdc-connect/flink-cdc-source-connectors` module URL: https://github.com/apache/flink-cdc/pull/3395 -- This is an automated message from the Apache Git Service. To respond to the message, please log

Re: [PR] [FLINK-35490][cdc][JUnit5 Migration] For `flink-cdc-connect/flink-cdc-source-connectors` module [flink-cdc]

2024-11-19 Thread via GitHub
github-actions[bot] commented on PR #3395: URL: https://github.com/apache/flink-cdc/pull/3395#issuecomment-2487014309 This pull request has been closed because it has not had recent activity. You could reopen it if you try to continue your work, and anyone who are interested in it are encou

Re: [PR] [FLINK-36276] Fix the description of MySqlDataSourceOptions.`scan.sta… [flink-cdc]

2024-11-19 Thread via GitHub
github-actions[bot] commented on PR #3606: URL: https://github.com/apache/flink-cdc/pull/3606#issuecomment-2487014101 This pull request has been automatically marked as stale because it has not had recent activity for 60 days. It will be closed in 30 days if no further activity occurs. --

Re: [PR] [FLINK-31836][table] Upgrade Calcite version to 1.34.0 [flink]

2024-11-19 Thread via GitHub
snuyanzin commented on code in PR #24256: URL: https://github.com/apache/flink/pull/24256#discussion_r1848638344 ## flink-table/flink-table-planner/src/test/scala/org/apache/flink/table/planner/runtime/batch/sql/OverAggregateITCase.scala: ## @@ -532,6 +532,33 @@ class OverAggreg

[jira] [Commented] (FLINK-36745) Code snippets on the Data Sources page use deprecated (and removed in 2.0) APIs

2024-11-19 Thread Andrei Kaigorodov (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17899574#comment-17899574 ] Andrei Kaigorodov commented on FLINK-36745: --- [~fanrui], [~kunni] could you ple

[jira] [Assigned] (FLINK-36717) Add health check to detect tasks stuck in DEPLOYING state

2024-11-19 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora reassigned FLINK-36717: -- Assignee: Swapna Marru (was: Maximilian Michels) > Add health check to detect tasks stuck in

[PR] Bump org.apache.kafka:kafka-clients from 3.4.0 to 3.7.1 [flink-connector-kafka]

2024-11-19 Thread via GitHub
dependabot[bot] opened a new pull request, #135: URL: https://github.com/apache/flink-connector-kafka/pull/135 Bumps org.apache.kafka:kafka-clients from 3.4.0 to 3.7.1. [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency

[jira] [Updated] (FLINK-36406) MetadataApplier should be closed when the job stop

2024-11-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36406: --- Labels: pull-request-available (was: ) > MetadataApplier should be closed when the job stop

Re: [PR] [hotfix] Log batch size in FlinkS3FileSystem instead of total [flink]

2024-11-19 Thread via GitHub
pnowojski merged PR #25662: URL: https://github.com/apache/flink/pull/25662 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apa

Re: [PR] [FLINK-36527][autoscaler] Introduce a parameter to support autoscaler adopt a more radical strategy when source vertex or upstream shuffle is keyBy [flink-kubernetes-operator]

2024-11-19 Thread via GitHub
mxm commented on code in PR #904: URL: https://github.com/apache/flink-kubernetes-operator/pull/904#discussion_r1848445200 ## flink-autoscaler/src/main/java/org/apache/flink/autoscaler/JobVertexScaler.java: ## @@ -411,26 +416,30 @@ protected static > int scale( var n

Re: [PR] [FLINK-36527][autoscaler] Introduce a parameter to support autoscaler adopt a more radical strategy when source vertex or upstream shuffle is keyBy [flink-kubernetes-operator]

2024-11-19 Thread via GitHub
huyuanfeng2018 commented on code in PR #904: URL: https://github.com/apache/flink-kubernetes-operator/pull/904#discussion_r1848503819 ## flink-autoscaler/src/main/java/org/apache/flink/autoscaler/JobVertexScaler.java: ## @@ -411,26 +416,30 @@ protected static > int scale(

Re: [PR] [FLINK-36527][autoscaler] Introduce a parameter to support autoscaler adopt a more radical strategy when source vertex or upstream shuffle is keyBy [flink-kubernetes-operator]

2024-11-19 Thread via GitHub
huyuanfeng2018 commented on code in PR #904: URL: https://github.com/apache/flink-kubernetes-operator/pull/904#discussion_r1848477399 ## flink-autoscaler/src/main/java/org/apache/flink/autoscaler/JobVertexScaler.java: ## @@ -411,26 +416,30 @@ protected static > int scale(

[jira] [Updated] (FLINK-36743) Rescale from unaligend checkpoint failed

2024-11-19 Thread Feifan Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feifan Wang updated FLINK-36743: Attachment: Allow-user-to-set-whether-restore-forward-rescale-broadcast-from-unaligned-checkpoint-

Re: [PR] [FLINK-36527][autoscaler] Introduce a parameter to support autoscaler adopt a more radical strategy when source vertex or upstream shuffle is keyBy [flink-kubernetes-operator]

2024-11-19 Thread via GitHub
1996fanrui commented on code in PR #904: URL: https://github.com/apache/flink-kubernetes-operator/pull/904#discussion_r1848418936 ## flink-autoscaler/src/main/java/org/apache/flink/autoscaler/JobVertexScaler.java: ## @@ -411,26 +416,30 @@ protected static > int scale(

[PR] [FLINK-35490] Migrate tests to JUnit 5 and AssertJ [flink-cdc]

2024-11-19 Thread via GitHub
yuxiqian opened a new pull request, #3742: URL: https://github.com/apache/flink-cdc/pull/3742 This is a sequel PR based on @morazow's great work in #3395. Currently, there are way too many unit tests and assertion frameworks, including JUnit-4 style `Assert`, JUnit-5 style Assertions,

[jira] [Created] (FLINK-36749) Implement rescaling for ForStKeyedStateBackend

2024-11-19 Thread Yanfei Lei (Jira)
Yanfei Lei created FLINK-36749: -- Summary: Implement rescaling for ForStKeyedStateBackend Key: FLINK-36749 URL: https://issues.apache.org/jira/browse/FLINK-36749 Project: Flink Issue Type: Sub-ta

[jira] [Resolved] (FLINK-36693) Implement checkpoint for ForStSyncKeyedStateBackend

2024-11-19 Thread Yanfei Lei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanfei Lei resolved FLINK-36693. Resolution: Resolved Merged into master via 7341b6ef05090b0c0fb7034bad6033066f78de05 > Implement

Re: [PR] [FLINK-34545][cdc-pipeline-connector]Add OceanBase pipeline connector to Flink CDC [flink-cdc]

2024-11-19 Thread via GitHub
lvyanquan commented on code in PR #3360: URL: https://github.com/apache/flink-cdc/pull/3360#discussion_r1847724959 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-oceanbase/src/test/java/org/apache/flink/cdc/connectors/oceanbase/sink/OceanBaseMetadataAppl

[jira] [Updated] (FLINK-36711) Add tips when System out and err are redirected to LOG or discarded

2024-11-19 Thread Vincent Woo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vincent Woo updated FLINK-36711: Description: When System.out and System.err are redirected to LOG or discarded, there are some sc

Re: [PR] [FLINK-33761][Connector/JDBC] Add Snowflake JDBC Dialect [flink-connector-jdbc]

2024-11-19 Thread via GitHub
EcaterinaL commented on PR #118: URL: https://github.com/apache/flink-connector-jdbc/pull/118#issuecomment-2485369191 Hello all, Is there any progress on this? will it be merged, if yes, when do you think this would be? Thank you! -- This is an automated message from the A

Re: [PR] [hotfix] Use Tag to replace some incorrectly used Category annotation for skipping adaptvie-scheduler test [flink]

2024-11-19 Thread via GitHub
reswqa merged PR #25668: URL: https://github.com/apache/flink/pull/25668 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache

Re: [PR] [FLINK-36711][runtime] Add tips when System out and err are redirected to LOG or discarded [flink]

2024-11-19 Thread via GitHub
1996fanrui merged PR #25653: URL: https://github.com/apache/flink/pull/25653 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.ap

Re: [PR] [FLINK-33389][runtime] Support tasks balancing at slot level for Adaptive Scheduler [flink]

2024-11-19 Thread via GitHub
huyuanfeng2018 commented on code in PR #25504: URL: https://github.com/apache/flink/pull/25504#discussion_r1848081364 ## flink-runtime/src/main/java/org/apache/flink/runtime/scheduler/AbstractSlotSharingStrategy.java: ## @@ -95,15 +96,15 @@ public void notifySchedulingTopologyUp

[jira] [Created] (FLINK-36747) History server can manage archived jobs

2024-11-19 Thread vertern (Jira)
vertern created FLINK-36747: --- Summary: History server can manage archived jobs Key: FLINK-36747 URL: https://issues.apache.org/jira/browse/FLINK-36747 Project: Flink Issue Type: New Feature

[jira] [Updated] (FLINK-36743) Rescale from unaligend checkpoint failed

2024-11-19 Thread Feifan Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feifan Wang updated FLINK-36743: Attachment: image-2024-11-19-17-27-55-387.png > Rescale from unaligend checkpoint failed > ---

Re: [PR] [FLINK-36742][cdc-base][oracle] Filter unacked split for no capture tables when task restore from state [flink-cdc]

2024-11-19 Thread via GitHub
gong commented on PR #3739: URL: https://github.com/apache/flink-cdc/pull/3739#issuecomment-2485174543 @leonardBang Please help retry trigger CI. There are unrelated UT error. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub an

[jira] [Created] (FLINK-36748) Web UI can stop job with savepoint and upload yaml file

2024-11-19 Thread vertern (Jira)
vertern created FLINK-36748: --- Summary: Web UI can stop job with savepoint and upload yaml file Key: FLINK-36748 URL: https://issues.apache.org/jira/browse/FLINK-36748 Project: Flink Issue Type: Imp

[jira] [Updated] (FLINK-36743) Rescale from unaligend checkpoint failed

2024-11-19 Thread Feifan Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feifan Wang updated FLINK-36743: Attachment: image-2024-11-19-17-30-14-816.png > Rescale from unaligend checkpoint failed > ---

[jira] [Commented] (FLINK-36655) using flink state processor api to process big state in rocksdb is very slow

2024-11-19 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17899412#comment-17899412 ] Gabor Somogyi commented on FLINK-36655: --- [~guanghua] can you please elaborate what

[jira] [Updated] (FLINK-36586) Upgrade Flink CDC dependency to Flink 1.19+

2024-11-19 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-36586: -- Affects Version/s: cdc-3.2.0 > Upgrade Flink CDC dependency to Flink 1.19+ > -

[jira] [Commented] (FLINK-36743) Rescale from unaligend checkpoint failed

2024-11-19 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17899386#comment-17899386 ] Piotr Nowojski commented on FLINK-36743: I'm not sure. I would also add that the

[jira] [Resolved] (FLINK-21936) Rescale pointwise connections for unaligned checkpoints

2024-11-19 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise resolved FLINK-21936. - Fix Version/s: 1.13.0 Resolution: Fixed > Rescale pointwise connections for unaligned che

[jira] [Commented] (FLINK-21936) Rescale pointwise connections for unaligned checkpoints

2024-11-19 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17899381#comment-17899381 ] Arvid Heise commented on FLINK-21936: - It's not really solved but we implemented saf