[jira] [Comment Edited] (FLINK-32483) RescaleCheckpointManuallyITCase.testCheckpointRescalingOutKeyedState fails on AZP

2024-09-04 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17879451#comment-17879451 ] Matthias Pohl edited comment on FLINK-32483 at 9/5/24 6:45 AM: ---

[jira] [Created] (FLINK-36224) Add the version mapping between pipeline connectors and flink

2024-09-04 Thread Thorne (Jira)
Thorne created FLINK-36224: -- Summary: Add the version mapping between pipeline connectors and flink Key: FLINK-36224 URL: https://issues.apache.org/jira/browse/FLINK-36224 Project: Flink Issue Typ

[jira] [Updated] (FLINK-36223) SplitFetcher thread 0 received unexpected exception while polling the records

2024-09-04 Thread zjf (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zjf updated FLINK-36223: Attachment: image-2024-09-05-14-39-07-070.png > SplitFetcher thread 0 received unexpected exception while polling

[jira] [Updated] (FLINK-36223) SplitFetcher thread 0 received unexpected exception while polling the records

2024-09-04 Thread zjf (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zjf updated FLINK-36223: Description: 1.SQL Server dynamic table error occurred,The triggering condition is that after I save the checkpoi

Re: [PR] [FLINK-36151] Add schema evolution related docs [flink-cdc]

2024-09-04 Thread via GitHub
gtk96 commented on code in PR #3575: URL: https://github.com/apache/flink-cdc/pull/3575#discussion_r1730587567 ## docs/content.zh/docs/core-concept/schema-evolution.md: ## @@ -0,0 +1,115 @@ +--- +title: "Schema Evolution" +weight: 7 +type: docs +aliases: + - /core-concept/schem

Re: [PR] [FLINK-36151] Add schema evolution related docs [flink-cdc]

2024-09-04 Thread via GitHub
gtk96 commented on PR #3575: URL: https://github.com/apache/flink-cdc/pull/3575#issuecomment-2330716899 LGTM ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscri

[jira] [Updated] (FLINK-36223) SplitFetcher thread 0 received unexpected exception while polling the records

2024-09-04 Thread zjf (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zjf updated FLINK-36223: Attachment: image-2024-09-05-14-36-12-672.png > SplitFetcher thread 0 received unexpected exception while polling

[jira] [Commented] (FLINK-26821) Refactor Cassandra Sink implementation to the ASync Sink

2024-09-04 Thread Robert Metzger (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17879442#comment-17879442 ] Robert Metzger commented on FLINK-26821: I've unassigned Marco, Lorenzo, are you

[jira] [Created] (FLINK-36222) Support the use of LLM models for data processing in the transform module.

2024-09-04 Thread LvYanquan (Jira)
LvYanquan created FLINK-36222: - Summary: Support the use of LLM models for data processing in the transform module. Key: FLINK-36222 URL: https://issues.apache.org/jira/browse/FLINK-36222 Project: Flink

Re: [PR] [FLINK-35827][table-planner] Correcting equality comparisons between rowType fields and constants [flink]

2024-09-04 Thread via GitHub
xuyangzhong commented on PR #25229: URL: https://github.com/apache/flink/pull/25229#issuecomment-2330686539 @lincoln-lil Agree with you. I have updated this pr and removed the first commit. -- This is an automated message from the Apache Git Service. To respond to the message, please log

Re: [PR] [FLINK-35049][state] Implement Map Async State API for ForStStateBackend [flink]

2024-09-04 Thread via GitHub
fredia commented on code in PR #24812: URL: https://github.com/apache/flink/pull/24812#discussion_r1744859290 ## flink-state-backends/flink-statebackend-forst/src/main/java/org/apache/flink/state/forst/ForStDBMapEntryIterRequest.java: ## @@ -0,0 +1,145 @@ +/* + * Licensed to the

[jira] [Commented] (FLINK-36201) StateLocalitySlotAssigner should be only used when local recovery is enabled for Adaptive Scheduler

2024-09-04 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17879439#comment-17879439 ] Xintong Song commented on FLINK-36201: -- Hi [~dmvk], for code changes merged before

[jira] [Updated] (FLINK-36201) StateLocalitySlotAssigner should be only used when local recovery is enabled for Adaptive Scheduler

2024-09-04 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song updated FLINK-36201: - Fix Version/s: 2.0-preview (was: 2.0.0) > StateLocalitySlotAssigner shoul

Re: [PR] [FLINK-33749][core] Remove deprecated getter and setter method in Configuration. [flink]

2024-09-04 Thread via GitHub
JunRuiLee commented on PR #25288: URL: https://github.com/apache/flink/pull/25288#issuecomment-2330639410 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [FLINK-35049][state] Implement Map Async State API for ForStStateBackend [flink]

2024-09-04 Thread via GitHub
Zakelly commented on code in PR #24812: URL: https://github.com/apache/flink/pull/24812#discussion_r1744799308 ## flink-state-backends/flink-statebackend-forst/src/main/java/org/apache/flink/state/forst/ForStDBGetRequest.java: ## @@ -45,6 +47,12 @@ public abstract class ForStDBG

Re: [PR] [FLINK-35049][state] Implement Map Async State API for ForStStateBackend [flink]

2024-09-04 Thread via GitHub
fredia commented on code in PR #24812: URL: https://github.com/apache/flink/pull/24812#discussion_r174481 ## flink-state-backends/flink-statebackend-forst/src/main/java/org/apache/flink/state/forst/ForStDBGetRequest.java: ## @@ -45,6 +47,12 @@ public abstract class ForStDBGe

[jira] [Updated] (FLINK-36221) Add specification about CAST ... AS ... built-in functions

2024-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36221: --- Labels: pull-request-available (was: ) > Add specification about CAST ... AS ... built-in f

[PR] [FLINK-36221] Add `CAST ... AS ...` documentations [flink-cdc]

2024-09-04 Thread via GitHub
yuxiqian opened a new pull request, #3596: URL: https://github.com/apache/flink-cdc/pull/3596 This closes FLINK-36221. [FLINK-34877](https://issues.apache.org/jira/browse/FLINK-34877) adds `CAST ... AS ...` syntax in transform expressions, but there's no corresponding documentations

[jira] [Created] (FLINK-36221) Add specification about CAST ... AS ... built-in functions

2024-09-04 Thread yux (Jira)
yux created FLINK-36221: --- Summary: Add specification about CAST ... AS ... built-in functions Key: FLINK-36221 URL: https://issues.apache.org/jira/browse/FLINK-36221 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-36219) Add Flink compatibility matrix of CDC releases

2024-09-04 Thread yux (Jira)
yux created FLINK-36219: --- Summary: Add Flink compatibility matrix of CDC releases Key: FLINK-36219 URL: https://issues.apache.org/jira/browse/FLINK-36219 Project: Flink Issue Type: Sub-task

Re: [PR] [FLINK-36214] Downgrade scala-maven-plugin version to 4.8.0 to keep compatibility with Java 8 [flink-cdc]

2024-09-04 Thread via GitHub
yuxiqian commented on PR #3594: URL: https://github.com/apache/flink-cdc/pull/3594#issuecomment-2330513582 cc @leonardBang @lincoln-lil -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

Re: [PR] [FLINK-35049][state] Implement Map Async State API for ForStStateBackend [flink]

2024-09-04 Thread via GitHub
Zakelly commented on code in PR #24812: URL: https://github.com/apache/flink/pull/24812#discussion_r1742988791 ## flink-state-backends/flink-statebackend-forst/src/main/java/org/apache/flink/state/forst/ForStDBGetRequest.java: ## @@ -45,6 +47,12 @@ public abstract class ForStDBG

[jira] [Commented] (FLINK-36214) Error log when building flink-cdc-pipeline-udf-examples from source code

2024-09-04 Thread yux (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17879401#comment-17879401 ] yux commented on FLINK-36214: - Seems it was brought in by FLINK-34876, will investigate this

[jira] [Commented] (FLINK-29240) Unify the ClassLoader in StreamExecutionEnvironment and TableEnvironment

2024-09-04 Thread Georgios Kousouris (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17879383#comment-17879383 ] Georgios Kousouris commented on FLINK-29240: Hi [~lsy], do you know if there

[jira] [Comment Edited] (FLINK-36191) FsMergingCheckpointStorageLocationTest generates test data not in tmp folder

2024-09-04 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17878475#comment-17878475 ] Sergey Nuyanzin edited comment on FLINK-36191 at 9/4/24 9:57 PM: -

[jira] [Updated] (FLINK-36191) FsMergingCheckpointStorageLocationTest generates test data not in tmp folder

2024-09-04 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin updated FLINK-36191: Fix Version/s: 1.19.2 > FsMergingCheckpointStorageLocationTest generates test data not in

[jira] [Comment Edited] (FLINK-36191) FsMergingCheckpointStorageLocationTest generates test data not in tmp folder

2024-09-04 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17878475#comment-17878475 ] Sergey Nuyanzin edited comment on FLINK-36191 at 9/4/24 9:17 PM: -

Re: [PR] [BP-1.19][FLINK-36191][tests] FsMergingCheckpointStorageLocationTest generates test data not in tmp folder [flink]

2024-09-04 Thread via GitHub
snuyanzin commented on PR #25278: URL: https://github.com/apache/flink/pull/25278#issuecomment-2330160555 the reason of failure was the improper base commit, after rebase ci passed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

[jira] [Updated] (FLINK-36217) Remove powermock usage

2024-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36217: --- Labels: pull-request-available (was: ) > Remove powermock usage > -- >

[PR] [FLINK-36217][tests] Remove powermock usage [flink]

2024-09-04 Thread via GitHub
snuyanzin opened a new pull request, #25287: URL: https://github.com/apache/flink/pull/25287 ## What is the purpose of the change Remove `powermock` from usages ## Verifying this change This change is a trivial rework / code cleanup without any test coverage.

[jira] [Updated] (FLINK-36217) Remove powermock usage

2024-09-04 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin updated FLINK-36217: Description: Most of the tests are either moved to a different repo like connectors or re

[jira] [Created] (FLINK-36217) Remove powermock usage

2024-09-04 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-36217: --- Summary: Remove powermock usage Key: FLINK-36217 URL: https://issues.apache.org/jira/browse/FLINK-36217 Project: Flink Issue Type: Technical Debt

Re: [PR] [FLINK-14068][streaming] Removes deprecated org.apache.flink.streaming.api.windowing.time.Time [flink]

2024-09-04 Thread via GitHub
XComp commented on code in PR #25261: URL: https://github.com/apache/flink/pull/25261#discussion_r1744113081 ## flink-streaming-scala/src/main/scala/org/apache/flink/streaming/api/scala/AllWindowedStream.scala: ## @@ -70,7 +71,7 @@ class AllWindowedStream[T, W <: Window](javaStr

[jira] [Commented] (FLINK-36169) Support namespace level resource check before scaling up

2024-09-04 Thread Gang Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17879296#comment-17879296 ] Gang Li commented on FLINK-36169: - Thanks for bringing this up. > Support namespace lev

Re: [PR] [FLINK-27355][runtime] Unregister JobManagerRunner after it's closed [flink]

2024-09-04 Thread via GitHub
XComp commented on code in PR #25027: URL: https://github.com/apache/flink/pull/25027#discussion_r1703278478 ## flink-runtime/src/test/java/org/apache/flink/runtime/dispatcher/TestingJobManagerRunnerRegistry.java: ## @@ -188,11 +197,26 @@ public static class Builder { p

[jira] [Comment Edited] (FLINK-36216) RocksDB: Compaction sees out-of-order keys

2024-09-04 Thread Robert Metzger (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17879221#comment-17879221 ] Robert Metzger edited comment on FLINK-36216 at 9/4/24 12:48 PM: -

Re: [PR] [FLINK-36206][Connectors/AWS] Adding support for custom override configuration [flink-connector-aws]

2024-09-04 Thread via GitHub
hlteoh37 merged PR #159: URL: https://github.com/apache/flink-connector-aws/pull/159 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@

Re: [PR] [FLINK-36206][Connectors/AWS] Adding support for custom override configuration [flink-connector-aws]

2024-09-04 Thread via GitHub
gguptp commented on code in PR #159: URL: https://github.com/apache/flink-connector-aws/pull/159#discussion_r1743591005 ## flink-connector-aws-base/src/main/java/org/apache/flink/connector/aws/util/AWSClientUtil.java: ## @@ -194,7 +196,7 @@ S createAwsSyncClient( final

Re: [PR] [FLINK-36206][Connectors/AWS] Adding support for custom override configuration [flink-connector-aws]

2024-09-04 Thread via GitHub
hlteoh37 commented on code in PR #159: URL: https://github.com/apache/flink-connector-aws/pull/159#discussion_r1743584656 ## flink-connector-aws-base/src/main/java/org/apache/flink/connector/aws/util/AWSClientUtil.java: ## @@ -194,7 +196,7 @@ S createAwsSyncClient( fin

Re: [PR] [FLINK-36206][Connectors/AWS] Adding support for custom override configuration [flink-connector-aws]

2024-09-04 Thread via GitHub
gguptp commented on code in PR #159: URL: https://github.com/apache/flink-connector-aws/pull/159#discussion_r1743580734 ## flink-connector-aws-base/src/main/java/org/apache/flink/connector/aws/util/AWSClientUtil.java: ## @@ -207,6 +207,39 @@ S createAwsSyncClient(

Re: [PR] [FLINK-36206][Connectors/AWS] Adding support for custom override configuration [flink-connector-aws]

2024-09-04 Thread via GitHub
hlteoh37 commented on code in PR #159: URL: https://github.com/apache/flink-connector-aws/pull/159#discussion_r1743572674 ## flink-connector-aws-base/src/main/java/org/apache/flink/connector/aws/util/AWSClientUtil.java: ## @@ -207,6 +207,39 @@ S createAwsSyncClient(

[jira] [Updated] (FLINK-36206) Support flink-connector-aws-base to allow custom override configuration

2024-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36206: --- Labels: pull-request-available (was: ) > Support flink-connector-aws-base to allow custom o

[PR] [FLINK-36206][Connectors/AWS] Adding support for custom override configuration [flink-connector-aws]

2024-09-04 Thread via GitHub
gguptp opened a new pull request, #159: URL: https://github.com/apache/flink-connector-aws/pull/159 ## Purpose of the change Adding support for custom override configuration in AWSClientUtil.java ## Verifying this change Please make sure both new and modified test

[jira] [Resolved] (FLINK-36215) Child shards are getting started with LATEST shard iterator even when parents are not expired

2024-09-04 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Liang Teoh resolved FLINK-36215. - Resolution: Fixed  merged commit [{{4d847fe}}|https://github.com/apache/flink-connector

[jira] [Updated] (FLINK-36195) Generalized retry configuration in flink-connector-base

2024-09-04 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Liang Teoh updated FLINK-36195: Summary: Generalized retry configuration in flink-connector-base (was: Migrate DDB Stream

[jira] [Resolved] (FLINK-36196) DDB Streams connector should be able to resolve the stream ARN from given Table name

2024-09-04 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Liang Teoh resolved FLINK-36196. - Resolution: Duplicate https://issues.apache.org/jira/browse/FLINK-36205 > DDB Streams c

[jira] [Updated] (FLINK-36196) DDB Streams connector should be able to resolve the stream ARN from given Table name

2024-09-04 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Liang Teoh updated FLINK-36196: Summary: DDB Streams connector should be able to resolve the stream ARN from given Table n

[jira] [Assigned] (FLINK-36215) Child shards are getting started with LATEST shard iterator even when parents are not expired

2024-09-04 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Liang Teoh reassigned FLINK-36215: --- Assignee: Abhi Gupta > Child shards are getting started with LATEST shard iterator

[jira] [Created] (FLINK-36215) Child shards are getting started with LATEST shard iterator even when parents are not expired

2024-09-04 Thread Abhi Gupta (Jira)
Abhi Gupta created FLINK-36215: -- Summary: Child shards are getting started with LATEST shard iterator even when parents are not expired Key: FLINK-36215 URL: https://issues.apache.org/jira/browse/FLINK-36215

[jira] [Created] (FLINK-36214) Error log when building flink-cdc-pipeline-udf-examples from source code

2024-09-04 Thread lincoln lee (Jira)
lincoln lee created FLINK-36214: --- Summary: Error log when building flink-cdc-pipeline-udf-examples from source code Key: FLINK-36214 URL: https://issues.apache.org/jira/browse/FLINK-36214 Project: Flink

[PR] [FLINK-35660][dynamodb][BugFix] Removing dependency on sorting of splits [flink-connector-aws]

2024-09-04 Thread via GitHub
gguptp opened a new pull request, #158: URL: https://github.com/apache/flink-connector-aws/pull/158 …lits ## Purpose of the change Removing dependency on sorting of splits. This also makes sure that if parent and child come in same describestream call, we get TRIM_HORIZ

[jira] [Comment Edited] (FLINK-36201) StateLocalitySlotAssigner should be only used when local recovery is enabled for Adaptive Scheduler

2024-09-04 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17879116#comment-17879116 ] Rui Fan edited comment on FLINK-36201 at 9/4/24 8:34 AM: - master

[jira] [Commented] (FLINK-36201) StateLocalitySlotAssigner should be only used when local recovery is enabled for Adaptive Scheduler

2024-09-04 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17879136#comment-17879136 ] Rui Fan commented on FLINK-36201: - {quote} This makes me wonder whether we should defaul

[jira] [Commented] (FLINK-36201) StateLocalitySlotAssigner should be only used when local recovery is enabled for Adaptive Scheduler

2024-09-04 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-36201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17879116#comment-17879116 ] David Morávek commented on FLINK-36201: --- master: 57bc16948bef75cf0fb483efb8bb9959d

[jira] [Resolved] (FLINK-36201) StateLocalitySlotAssigner should be only used when local recovery is enabled for Adaptive Scheduler

2024-09-04 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-36201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Morávek resolved FLINK-36201. --- Fix Version/s: 2.0.0 Resolution: Fixed > StateLocalitySlotAssigner should be only use