[jira] [Resolved] (FLINK-36201) StateLocalitySlotAssigner should be only used when local recovery is enabled for Adaptive Scheduler

2024-09-04 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-36201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Morávek resolved FLINK-36201. --- Fix Version/s: 2.0.0 Resolution: Fixed > StateLocalitySlotAssigner should be only use

[jira] [Commented] (FLINK-36201) StateLocalitySlotAssigner should be only used when local recovery is enabled for Adaptive Scheduler

2024-09-04 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-36201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17879116#comment-17879116 ] David Morávek commented on FLINK-36201: --- master: 57bc16948bef75cf0fb483efb8bb9959d

[jira] [Commented] (FLINK-36201) StateLocalitySlotAssigner should be only used when local recovery is enabled for Adaptive Scheduler

2024-09-04 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17879136#comment-17879136 ] Rui Fan commented on FLINK-36201: - {quote} This makes me wonder whether we should defaul

[jira] [Comment Edited] (FLINK-36201) StateLocalitySlotAssigner should be only used when local recovery is enabled for Adaptive Scheduler

2024-09-04 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17879116#comment-17879116 ] Rui Fan edited comment on FLINK-36201 at 9/4/24 8:34 AM: - master

[PR] [FLINK-35660][dynamodb][BugFix] Removing dependency on sorting of splits [flink-connector-aws]

2024-09-04 Thread via GitHub
gguptp opened a new pull request, #158: URL: https://github.com/apache/flink-connector-aws/pull/158 …lits ## Purpose of the change Removing dependency on sorting of splits. This also makes sure that if parent and child come in same describestream call, we get TRIM_HORIZ

[jira] [Created] (FLINK-36214) Error log when building flink-cdc-pipeline-udf-examples from source code

2024-09-04 Thread lincoln lee (Jira)
lincoln lee created FLINK-36214: --- Summary: Error log when building flink-cdc-pipeline-udf-examples from source code Key: FLINK-36214 URL: https://issues.apache.org/jira/browse/FLINK-36214 Project: Flink

[jira] [Created] (FLINK-36215) Child shards are getting started with LATEST shard iterator even when parents are not expired

2024-09-04 Thread Abhi Gupta (Jira)
Abhi Gupta created FLINK-36215: -- Summary: Child shards are getting started with LATEST shard iterator even when parents are not expired Key: FLINK-36215 URL: https://issues.apache.org/jira/browse/FLINK-36215

[jira] [Assigned] (FLINK-36215) Child shards are getting started with LATEST shard iterator even when parents are not expired

2024-09-04 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Liang Teoh reassigned FLINK-36215: --- Assignee: Abhi Gupta > Child shards are getting started with LATEST shard iterator

[jira] [Updated] (FLINK-36196) DDB Streams connector should be able to resolve the stream ARN from given Table name

2024-09-04 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Liang Teoh updated FLINK-36196: Summary: DDB Streams connector should be able to resolve the stream ARN from given Table n

[jira] [Resolved] (FLINK-36196) DDB Streams connector should be able to resolve the stream ARN from given Table name

2024-09-04 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Liang Teoh resolved FLINK-36196. - Resolution: Duplicate https://issues.apache.org/jira/browse/FLINK-36205 > DDB Streams c

[jira] [Updated] (FLINK-36195) Generalized retry configuration in flink-connector-base

2024-09-04 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Liang Teoh updated FLINK-36195: Summary: Generalized retry configuration in flink-connector-base (was: Migrate DDB Stream

[jira] [Resolved] (FLINK-36215) Child shards are getting started with LATEST shard iterator even when parents are not expired

2024-09-04 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Liang Teoh resolved FLINK-36215. - Resolution: Fixed  merged commit [{{4d847fe}}|https://github.com/apache/flink-connector

[PR] [FLINK-36206][Connectors/AWS] Adding support for custom override configuration [flink-connector-aws]

2024-09-04 Thread via GitHub
gguptp opened a new pull request, #159: URL: https://github.com/apache/flink-connector-aws/pull/159 ## Purpose of the change Adding support for custom override configuration in AWSClientUtil.java ## Verifying this change Please make sure both new and modified test

[jira] [Updated] (FLINK-36206) Support flink-connector-aws-base to allow custom override configuration

2024-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36206: --- Labels: pull-request-available (was: ) > Support flink-connector-aws-base to allow custom o

Re: [PR] [FLINK-36206][Connectors/AWS] Adding support for custom override configuration [flink-connector-aws]

2024-09-04 Thread via GitHub
hlteoh37 commented on code in PR #159: URL: https://github.com/apache/flink-connector-aws/pull/159#discussion_r1743572674 ## flink-connector-aws-base/src/main/java/org/apache/flink/connector/aws/util/AWSClientUtil.java: ## @@ -207,6 +207,39 @@ S createAwsSyncClient(

Re: [PR] [FLINK-36206][Connectors/AWS] Adding support for custom override configuration [flink-connector-aws]

2024-09-04 Thread via GitHub
gguptp commented on code in PR #159: URL: https://github.com/apache/flink-connector-aws/pull/159#discussion_r1743580734 ## flink-connector-aws-base/src/main/java/org/apache/flink/connector/aws/util/AWSClientUtil.java: ## @@ -207,6 +207,39 @@ S createAwsSyncClient(

Re: [PR] [FLINK-36206][Connectors/AWS] Adding support for custom override configuration [flink-connector-aws]

2024-09-04 Thread via GitHub
hlteoh37 commented on code in PR #159: URL: https://github.com/apache/flink-connector-aws/pull/159#discussion_r1743584656 ## flink-connector-aws-base/src/main/java/org/apache/flink/connector/aws/util/AWSClientUtil.java: ## @@ -194,7 +196,7 @@ S createAwsSyncClient( fin

Re: [PR] [FLINK-36206][Connectors/AWS] Adding support for custom override configuration [flink-connector-aws]

2024-09-04 Thread via GitHub
gguptp commented on code in PR #159: URL: https://github.com/apache/flink-connector-aws/pull/159#discussion_r1743591005 ## flink-connector-aws-base/src/main/java/org/apache/flink/connector/aws/util/AWSClientUtil.java: ## @@ -194,7 +196,7 @@ S createAwsSyncClient( final

Re: [PR] [FLINK-36206][Connectors/AWS] Adding support for custom override configuration [flink-connector-aws]

2024-09-04 Thread via GitHub
hlteoh37 merged PR #159: URL: https://github.com/apache/flink-connector-aws/pull/159 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@

[jira] [Comment Edited] (FLINK-36216) RocksDB: Compaction sees out-of-order keys

2024-09-04 Thread Robert Metzger (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17879221#comment-17879221 ] Robert Metzger edited comment on FLINK-36216 at 9/4/24 12:48 PM: -

Re: [PR] [FLINK-27355][runtime] Unregister JobManagerRunner after it's closed [flink]

2024-09-04 Thread via GitHub
XComp commented on code in PR #25027: URL: https://github.com/apache/flink/pull/25027#discussion_r1703278478 ## flink-runtime/src/test/java/org/apache/flink/runtime/dispatcher/TestingJobManagerRunnerRegistry.java: ## @@ -188,11 +197,26 @@ public static class Builder { p

[jira] [Commented] (FLINK-36169) Support namespace level resource check before scaling up

2024-09-04 Thread Gang Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17879296#comment-17879296 ] Gang Li commented on FLINK-36169: - Thanks for bringing this up. > Support namespace lev

Re: [PR] [FLINK-14068][streaming] Removes deprecated org.apache.flink.streaming.api.windowing.time.Time [flink]

2024-09-04 Thread via GitHub
XComp commented on code in PR #25261: URL: https://github.com/apache/flink/pull/25261#discussion_r1744113081 ## flink-streaming-scala/src/main/scala/org/apache/flink/streaming/api/scala/AllWindowedStream.scala: ## @@ -70,7 +71,7 @@ class AllWindowedStream[T, W <: Window](javaStr

[jira] [Created] (FLINK-36217) Remove powermock usage

2024-09-04 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-36217: --- Summary: Remove powermock usage Key: FLINK-36217 URL: https://issues.apache.org/jira/browse/FLINK-36217 Project: Flink Issue Type: Technical Debt

[jira] [Updated] (FLINK-36217) Remove powermock usage

2024-09-04 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin updated FLINK-36217: Description: Most of the tests are either moved to a different repo like connectors or re

[PR] [FLINK-36217][tests] Remove powermock usage [flink]

2024-09-04 Thread via GitHub
snuyanzin opened a new pull request, #25287: URL: https://github.com/apache/flink/pull/25287 ## What is the purpose of the change Remove `powermock` from usages ## Verifying this change This change is a trivial rework / code cleanup without any test coverage.

[jira] [Updated] (FLINK-36217) Remove powermock usage

2024-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36217: --- Labels: pull-request-available (was: ) > Remove powermock usage > -- >

Re: [PR] [BP-1.19][FLINK-36191][tests] FsMergingCheckpointStorageLocationTest generates test data not in tmp folder [flink]

2024-09-04 Thread via GitHub
snuyanzin commented on PR #25278: URL: https://github.com/apache/flink/pull/25278#issuecomment-2330160555 the reason of failure was the improper base commit, after rebase ci passed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

[jira] [Comment Edited] (FLINK-36191) FsMergingCheckpointStorageLocationTest generates test data not in tmp folder

2024-09-04 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17878475#comment-17878475 ] Sergey Nuyanzin edited comment on FLINK-36191 at 9/4/24 9:17 PM: -

[jira] [Updated] (FLINK-36191) FsMergingCheckpointStorageLocationTest generates test data not in tmp folder

2024-09-04 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin updated FLINK-36191: Fix Version/s: 1.19.2 > FsMergingCheckpointStorageLocationTest generates test data not in

[jira] [Comment Edited] (FLINK-36191) FsMergingCheckpointStorageLocationTest generates test data not in tmp folder

2024-09-04 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17878475#comment-17878475 ] Sergey Nuyanzin edited comment on FLINK-36191 at 9/4/24 9:57 PM: -

[jira] [Commented] (FLINK-29240) Unify the ClassLoader in StreamExecutionEnvironment and TableEnvironment

2024-09-04 Thread Georgios Kousouris (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17879383#comment-17879383 ] Georgios Kousouris commented on FLINK-29240: Hi [~lsy], do you know if there

[jira] [Commented] (FLINK-36214) Error log when building flink-cdc-pipeline-udf-examples from source code

2024-09-04 Thread yux (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17879401#comment-17879401 ] yux commented on FLINK-36214: - Seems it was brought in by FLINK-34876, will investigate this

Re: [PR] [FLINK-35049][state] Implement Map Async State API for ForStStateBackend [flink]

2024-09-04 Thread via GitHub
Zakelly commented on code in PR #24812: URL: https://github.com/apache/flink/pull/24812#discussion_r1742988791 ## flink-state-backends/flink-statebackend-forst/src/main/java/org/apache/flink/state/forst/ForStDBGetRequest.java: ## @@ -45,6 +47,12 @@ public abstract class ForStDBG

Re: [PR] [FLINK-36214] Downgrade scala-maven-plugin version to 4.8.0 to keep compatibility with Java 8 [flink-cdc]

2024-09-04 Thread via GitHub
yuxiqian commented on PR #3594: URL: https://github.com/apache/flink-cdc/pull/3594#issuecomment-2330513582 cc @leonardBang @lincoln-lil -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

[jira] [Created] (FLINK-36219) Add Flink compatibility matrix of CDC releases

2024-09-04 Thread yux (Jira)
yux created FLINK-36219: --- Summary: Add Flink compatibility matrix of CDC releases Key: FLINK-36219 URL: https://issues.apache.org/jira/browse/FLINK-36219 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-36221) Add specification about CAST ... AS ... built-in functions

2024-09-04 Thread yux (Jira)
yux created FLINK-36221: --- Summary: Add specification about CAST ... AS ... built-in functions Key: FLINK-36221 URL: https://issues.apache.org/jira/browse/FLINK-36221 Project: Flink Issue Type: Sub-task

[PR] [FLINK-36221] Add `CAST ... AS ...` documentations [flink-cdc]

2024-09-04 Thread via GitHub
yuxiqian opened a new pull request, #3596: URL: https://github.com/apache/flink-cdc/pull/3596 This closes FLINK-36221. [FLINK-34877](https://issues.apache.org/jira/browse/FLINK-34877) adds `CAST ... AS ...` syntax in transform expressions, but there's no corresponding documentations

[jira] [Updated] (FLINK-36221) Add specification about CAST ... AS ... built-in functions

2024-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36221: --- Labels: pull-request-available (was: ) > Add specification about CAST ... AS ... built-in f

Re: [PR] [FLINK-35049][state] Implement Map Async State API for ForStStateBackend [flink]

2024-09-04 Thread via GitHub
fredia commented on code in PR #24812: URL: https://github.com/apache/flink/pull/24812#discussion_r174481 ## flink-state-backends/flink-statebackend-forst/src/main/java/org/apache/flink/state/forst/ForStDBGetRequest.java: ## @@ -45,6 +47,12 @@ public abstract class ForStDBGe

Re: [PR] [FLINK-35049][state] Implement Map Async State API for ForStStateBackend [flink]

2024-09-04 Thread via GitHub
Zakelly commented on code in PR #24812: URL: https://github.com/apache/flink/pull/24812#discussion_r1744799308 ## flink-state-backends/flink-statebackend-forst/src/main/java/org/apache/flink/state/forst/ForStDBGetRequest.java: ## @@ -45,6 +47,12 @@ public abstract class ForStDBG

Re: [PR] [FLINK-33749][core] Remove deprecated getter and setter method in Configuration. [flink]

2024-09-04 Thread via GitHub
JunRuiLee commented on PR #25288: URL: https://github.com/apache/flink/pull/25288#issuecomment-2330639410 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Updated] (FLINK-36201) StateLocalitySlotAssigner should be only used when local recovery is enabled for Adaptive Scheduler

2024-09-04 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song updated FLINK-36201: - Fix Version/s: 2.0-preview (was: 2.0.0) > StateLocalitySlotAssigner shoul

[jira] [Commented] (FLINK-36201) StateLocalitySlotAssigner should be only used when local recovery is enabled for Adaptive Scheduler

2024-09-04 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17879439#comment-17879439 ] Xintong Song commented on FLINK-36201: -- Hi [~dmvk], for code changes merged before

Re: [PR] [FLINK-35049][state] Implement Map Async State API for ForStStateBackend [flink]

2024-09-04 Thread via GitHub
fredia commented on code in PR #24812: URL: https://github.com/apache/flink/pull/24812#discussion_r1744859290 ## flink-state-backends/flink-statebackend-forst/src/main/java/org/apache/flink/state/forst/ForStDBMapEntryIterRequest.java: ## @@ -0,0 +1,145 @@ +/* + * Licensed to the

Re: [PR] [FLINK-35827][table-planner] Correcting equality comparisons between rowType fields and constants [flink]

2024-09-04 Thread via GitHub
xuyangzhong commented on PR #25229: URL: https://github.com/apache/flink/pull/25229#issuecomment-2330686539 @lincoln-lil Agree with you. I have updated this pr and removed the first commit. -- This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Created] (FLINK-36222) Support the use of LLM models for data processing in the transform module.

2024-09-04 Thread LvYanquan (Jira)
LvYanquan created FLINK-36222: - Summary: Support the use of LLM models for data processing in the transform module. Key: FLINK-36222 URL: https://issues.apache.org/jira/browse/FLINK-36222 Project: Flink

[jira] [Commented] (FLINK-26821) Refactor Cassandra Sink implementation to the ASync Sink

2024-09-04 Thread Robert Metzger (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17879442#comment-17879442 ] Robert Metzger commented on FLINK-26821: I've unassigned Marco, Lorenzo, are you

[jira] [Updated] (FLINK-36223) SplitFetcher thread 0 received unexpected exception while polling the records

2024-09-04 Thread zjf (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zjf updated FLINK-36223: Attachment: image-2024-09-05-14-36-12-672.png > SplitFetcher thread 0 received unexpected exception while polling

Re: [PR] [FLINK-36151] Add schema evolution related docs [flink-cdc]

2024-09-04 Thread via GitHub
gtk96 commented on PR #3575: URL: https://github.com/apache/flink-cdc/pull/3575#issuecomment-2330716899 LGTM ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscri

Re: [PR] [FLINK-36151] Add schema evolution related docs [flink-cdc]

2024-09-04 Thread via GitHub
gtk96 commented on code in PR #3575: URL: https://github.com/apache/flink-cdc/pull/3575#discussion_r1730587567 ## docs/content.zh/docs/core-concept/schema-evolution.md: ## @@ -0,0 +1,115 @@ +--- +title: "Schema Evolution" +weight: 7 +type: docs +aliases: + - /core-concept/schem

[jira] [Updated] (FLINK-36223) SplitFetcher thread 0 received unexpected exception while polling the records

2024-09-04 Thread zjf (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zjf updated FLINK-36223: Description: 1.SQL Server dynamic table error occurred,The triggering condition is that after I save the checkpoi

[jira] [Updated] (FLINK-36223) SplitFetcher thread 0 received unexpected exception while polling the records

2024-09-04 Thread zjf (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zjf updated FLINK-36223: Attachment: image-2024-09-05-14-39-07-070.png > SplitFetcher thread 0 received unexpected exception while polling

[jira] [Created] (FLINK-36224) Add the version mapping between pipeline connectors and flink

2024-09-04 Thread Thorne (Jira)
Thorne created FLINK-36224: -- Summary: Add the version mapping between pipeline connectors and flink Key: FLINK-36224 URL: https://issues.apache.org/jira/browse/FLINK-36224 Project: Flink Issue Typ

[jira] [Comment Edited] (FLINK-32483) RescaleCheckpointManuallyITCase.testCheckpointRescalingOutKeyedState fails on AZP

2024-09-04 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17879451#comment-17879451 ] Matthias Pohl edited comment on FLINK-32483 at 9/5/24 6:45 AM: ---