Re: [PR] [FLINK-36117] Internal adaptor from State v1 interfaces to v2 [flink]

2024-09-18 Thread via GitHub
Zakelly commented on PR #25345: URL: https://github.com/apache/flink/pull/25345#issuecomment-2360146206 Force pushed to resolve conflicts -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

Re: [PR] [FLINK-35510][statebackend] Implement basic incremental checkpoint fo… [flink]

2024-09-18 Thread via GitHub
Zakelly commented on PR #24879: URL: https://github.com/apache/flink/pull/24879#issuecomment-2360110379 CI green, merging... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Comment Edited] (FLINK-36290) OutOfMemoryError in connect test run

2024-09-18 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17882910#comment-17882910 ] Matthias Pohl edited comment on FLINK-36290 at 9/19/24 6:35 AM: --

[jira] [Resolved] (FLINK-36015) Align rescale parameters

2024-09-18 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl resolved FLINK-36015. --- Assignee: Zdenek Tison Resolution: Fixed master: [6ab3c3d9881b833278e29d205c0bca1acf5

[jira] [Updated] (FLINK-36015) Align rescale parameters

2024-09-18 Thread Zdenek Tison (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zdenek Tison updated FLINK-36015: - Release Note: FLIP-472 aligns timeout logic in AdaptiveScheduler states. To make alignment more

[jira] [Created] (FLINK-36324) MiscAggFunctionITCase expected to raise Throwable

2024-09-18 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-36324: - Summary: MiscAggFunctionITCase expected to raise Throwable Key: FLINK-36324 URL: https://issues.apache.org/jira/browse/FLINK-36324 Project: Flink Issue Typ

[jira] [Commented] (FLINK-35510) Implement basic incremental checkpoint for ForStStateBackend

2024-09-18 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17882912#comment-17882912 ] Zakelly Lan commented on FLINK-35510: - Merged ffd05220ffe829337ac12a49f1bbc822fa11f8

[jira] [Resolved] (FLINK-35510) Implement basic incremental checkpoint for ForStStateBackend

2024-09-18 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan resolved FLINK-35510. - Assignee: Feifan Wang Resolution: Fixed > Implement basic incremental checkpoint for ForSt

Re: [PR] [FLINK-35510][statebackend] Implement basic incremental checkpoint fo… [flink]

2024-09-18 Thread via GitHub
Zakelly merged PR #24879: URL: https://github.com/apache/flink/pull/24879 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apach

[jira] [Commented] (FLINK-31762) Subscribe to multiple Kafka topics may cause partition assignment skew

2024-09-18 Thread Lorenzo Affetti (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17882911#comment-17882911 ] Lorenzo Affetti commented on FLINK-31762: - Hello [~arvid]  Sorry for the late r

[jira] [Comment Edited] (FLINK-36290) OutOfMemoryError in connect test run

2024-09-18 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17882910#comment-17882910 ] Matthias Pohl edited comment on FLINK-36290 at 9/19/24 6:34 AM: --

[jira] [Comment Edited] (FLINK-36290) OutOfMemoryError in connect test run

2024-09-18 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17882910#comment-17882910 ] Matthias Pohl edited comment on FLINK-36290 at 9/19/24 6:34 AM: --

[jira] [Commented] (FLINK-36290) OutOfMemoryError in connect test run

2024-09-18 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17882910#comment-17882910 ] Matthias Pohl commented on FLINK-36290: --- https://dev.azure.com/apache-flink/apache

[jira] [Created] (FLINK-36323) Remove deprecated MemoryStateBackend and RocksDBStateBackend

2024-09-18 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-36323: --- Summary: Remove deprecated MemoryStateBackend and RocksDBStateBackend Key: FLINK-36323 URL: https://issues.apache.org/jira/browse/FLINK-36323 Project: Flink I

[jira] [Commented] (FLINK-30739) SqlGatewayRestEndpointStatementITCase failed with NullPointer

2024-09-18 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17882909#comment-17882909 ] Matthias Pohl commented on FLINK-30739: --- https://dev.azure.com/apache-flink/apache

[jira] [Updated] (FLINK-30739) SqlGatewayRestEndpointStatementITCase failed with NullPointer

2024-09-18 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl updated FLINK-30739: -- Affects Version/s: 2.0-preview > SqlGatewayRestEndpointStatementITCase failed with NullPointer

[jira] [Updated] (FLINK-30739) SqlGatewayRestEndpointStatementITCase failed with NullPointer

2024-09-18 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl updated FLINK-30739: -- Priority: Critical (was: Major) > SqlGatewayRestEndpointStatementITCase failed with NullPoint

[jira] [Updated] (FLINK-30739) SqlGatewayRestEndpointStatementITCase failed with NullPointer

2024-09-18 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl updated FLINK-30739: -- Labels: test-stability (was: ) > SqlGatewayRestEndpointStatementITCase failed with NullPointe

[jira] [Commented] (FLINK-36290) OutOfMemoryError in connect test run

2024-09-18 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17882907#comment-17882907 ] Matthias Pohl commented on FLINK-36290: --- https://dev.azure.com/apache-flink/apache

[jira] [Commented] (FLINK-36291) java.lang.IllegalMonitorStateException causing a fatal error on the TaskManager side

2024-09-18 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17882908#comment-17882908 ] Matthias Pohl commented on FLINK-36291: --- https://dev.azure.com/apache-flink/apache

[jira] [Commented] (FLINK-36167) testSinkDisorderChangeLog failed on AZP

2024-09-18 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17882904#comment-17882904 ] Matthias Pohl commented on FLINK-36167: --- https://dev.azure.com/apache-flink/apache

[jira] [Resolved] (FLINK-36209) Remove redundant operations in the initialization of KafkaSourceEnumState

2024-09-18 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise resolved FLINK-36209. - Fix Version/s: kafka-3.3.0 Assignee: xiaochen.zhou Resolution: Fixed Merged into

[jira] [Commented] (FLINK-34273) git fetch fails

2024-09-18 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17882903#comment-17882903 ] Matthias Pohl commented on FLINK-34273: --- https://dev.azure.com/apache-flink/apache

Re: [PR] [FLINK-36209] Remove redundant operations in the initialization of KafkaSourceEnumState [flink-connector-kafka]

2024-09-18 Thread via GitHub
AHeise merged PR #116: URL: https://github.com/apache/flink-connector-kafka/pull/116 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@

[jira] [Updated] (FLINK-36015) Align rescale parameters

2024-09-18 Thread Zdenek Tison (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zdenek Tison updated FLINK-36015: - Release Note: AdpativeScheduler configuration has been aligned for different AdpativeScheduler

[jira] [Updated] (FLINK-36015) Align rescale parameters

2024-09-18 Thread Zdenek Tison (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zdenek Tison updated FLINK-36015: - Fix Version/s: 2.0-preview Release Note: Parameter `jobmanager.adaptive-scheduler.resource-

[jira] [Updated] (FLINK-36015) Align rescale parameters

2024-09-18 Thread Zdenek Tison (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zdenek Tison updated FLINK-36015: - Release Note: - Parameter `jobmanager.adaptive-scheduler.resource-wait-timeout` was renamed to

[jira] [Updated] (FLINK-36015) Align rescale parameters

2024-09-18 Thread Zdenek Tison (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zdenek Tison updated FLINK-36015: - Release Note: - Parameter `jobmanager.adaptive-scheduler.resource-wait-timeout` was renamed to

[jira] [Commented] (FLINK-35652) FLIP-462: Support Custom Data Distribution for Input Stream of Lookup Join

2024-09-18 Thread Benchao Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17882864#comment-17882864 ] Benchao Li commented on FLINK-35652: Thank you for the update, Weijie, that sounds g

[jira] [Created] (FLINK-36322) Fix compile error of flink benchmark caused by breaking changes

2024-09-18 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-36322: --- Summary: Fix compile error of flink benchmark caused by breaking changes Key: FLINK-36322 URL: https://issues.apache.org/jira/browse/FLINK-36322 Project: Flink

[jira] [Commented] (FLINK-35652) FLIP-462: Support Custom Data Distribution for Input Stream of Lookup Join

2024-09-18 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17882861#comment-17882861 ] Weijie Guo commented on FLINK-35652: Hi Benchao, this feature shall be released in f

Re: [PR] [FLINK-34975][state/forst] Execute read/write state request in different executors [flink]

2024-09-18 Thread via GitHub
flinkbot commented on PR #25360: URL: https://github.com/apache/flink/pull/25360#issuecomment-2359962380 ## CI report: * 1f27c44dab35ed8568fcdc9f43b097884067a191 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[PR] [FLINK-34975][state/forst] Execute read/write state request in different executors [flink]

2024-09-18 Thread via GitHub
fredia opened a new pull request, #25360: URL: https://github.com/apache/flink/pull/25360 ## What is the purpose of the change This PR makes read/write state requests execute in different executors. ## Brief change log - Add `EXECUTOR_READ_IO_PARALLELISM` and `EXE

[jira] [Created] (FLINK-36321) Execute read/write state request in different executor

2024-09-18 Thread Yanfei Lei (Jira)
Yanfei Lei created FLINK-36321: -- Summary: Execute read/write state request in different executor Key: FLINK-36321 URL: https://issues.apache.org/jira/browse/FLINK-36321 Project: Flink Issue Type

Re: [PR] [FLINK-36192][autocaler] Autocaler supports adjusting the parallelism of source vertex based on the number of partitions in Kafka or pulsars [flink-kubernetes-operator]

2024-09-18 Thread via GitHub
1996fanrui commented on code in PR #879: URL: https://github.com/apache/flink-kubernetes-operator/pull/879#discussion_r1766114467 ## flink-autoscaler/src/main/java/org/apache/flink/autoscaler/JobVertexScaler.java: ## @@ -389,15 +407,61 @@ protected static int scale(

Re: [PR] [FLINK-36112][Connector/Filesystem].Add Support for CreateFlag.NO_LOCAL_WRITE in FLINK on YARN's File Creation to Manage Disk Space and Network Load in Labeled YARN Nodes [flink]

2024-09-18 Thread via GitHub
liangyu-1 commented on PR #25226: URL: https://github.com/apache/flink/pull/25226#issuecomment-2359924523 @flinkbot run azure re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] [FLINK-36112][Connector/Filesystem].Add Support for CreateFlag.NO_LOCAL_WRITE in FLINK on YARN's File Creation to Manage Disk Space and Network Load in Labeled YARN Nodes [flink]

2024-09-18 Thread via GitHub
liangyu-1 commented on PR #25226: URL: https://github.com/apache/flink/pull/25226#issuecomment-2359924470 > @liangyu-1 Thanks for addressing my comments. I think the PR is very close to a mergable state. I left only one minor inline comment. In addition, the CI is failing due to the usage o

[jira] [Closed] (FLINK-36250) Remove CheckpointStorage-related configuration getters/setters that return/set complex Java objects

2024-09-18 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-36250. --- Resolution: Done df412add3895e5fa88a54c26b67f188940345d0c > Remove CheckpointStorage-related configuration

Re: [PR] [FLINK-36250][streaming-java] Remove CheckpointStorage-related configuration getters/setters that return/set complex Java objects. [flink]

2024-09-18 Thread via GitHub
zhuzhurk closed pull request #25332: [FLINK-36250][streaming-java] Remove CheckpointStorage-related configuration getters/setters that return/set complex Java objects. URL: https://github.com/apache/flink/pull/25332 -- This is an automated message from the Apache Git Service. To respond to t

Re: [PR] [FLINK-35360] support Flink cdc pipeline Yarn application mode. [flink-cdc]

2024-09-18 Thread via GitHub
yuxiqian commented on code in PR #3599: URL: https://github.com/apache/flink-cdc/pull/3599#discussion_r1766099350 ## flink-cdc-composer/src/main/java/org/apache/flink/cdc/composer/flink/deployment/YarnApplicationDeploymentExecutor.java: ## @@ -0,0 +1,132 @@ +/* + * Licensed to t

[jira] [Commented] (FLINK-35652) FLIP-462: Support Custom Data Distribution for Input Stream of Lookup Join

2024-09-18 Thread Benchao Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17882854#comment-17882854 ] Benchao Li commented on FLINK-35652: [~Weijie Guo] Hi Weijie, may I ask what's the s

Re: [PR] [FLINK-36112][Connector/Filesystem].Add Support for CreateFlag.NO_LOCAL_WRITE in FLINK on YARN's File Creation to Manage Disk Space and Network Load in Labeled YARN Nodes [flink]

2024-09-18 Thread via GitHub
liangyu-1 commented on code in PR #25226: URL: https://github.com/apache/flink/pull/25226#discussion_r1766097518 ## flink-connectors/flink-connector-files/src/main/java/org/apache/flink/connector/file/sink/FileSink.java: ## @@ -580,6 +584,11 @@ public T withRollingPolicy(Checkpo

[jira] [Created] (FLINK-36320) Use Protobuf Nested timestamp field as event time column and watermark

2024-09-18 Thread haiqingchen (Jira)
haiqingchen created FLINK-36320: --- Summary: Use Protobuf Nested timestamp field as event time column and watermark Key: FLINK-36320 URL: https://issues.apache.org/jira/browse/FLINK-36320 Project: Flink

Re: [PR] [FLINK-36282][pipeline-connector][cdc-connector][mysql]fix incorrect data type of TINYINT(1) in mysql pipeline connector [flink-cdc]

2024-09-18 Thread via GitHub
yuxiqian commented on code in PR #3608: URL: https://github.com/apache/flink-cdc/pull/3608#discussion_r1766088822 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-mysql/src/test/java/org/apache/flink/cdc/connectors/mysql/source/MySqlPipelineITCase.java: ##

[jira] [Resolved] (FLINK-35503) OracleE2eITCase fails with error ORA-12528 on Mac M2

2024-09-18 Thread Zhongqiang Gong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongqiang Gong resolved FLINK-35503. - Fix Version/s: cdc-3.3.0 Resolution: Fixed flink-cdc master: a5b666a3254b87b44b9a

[jira] [Updated] (FLINK-35503) OracleE2eITCase fails with error ORA-12528 on Mac M2

2024-09-18 Thread Zhongqiang Gong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongqiang Gong updated FLINK-35503: Issue Type: Improvement (was: Bug) > OracleE2eITCase fails with error ORA-12528 on Mac M2

Re: [PR] [FLINK-35503] Add support for running Oracle connector unit test on ARM architecture [flink-cdc]

2024-09-18 Thread via GitHub
GOODBOY008 merged PR #3600: URL: https://github.com/apache/flink-cdc/pull/3600 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.

Re: [PR] [FLINK-35510][statebackend] Implement basic incremental checkpoint fo… [flink]

2024-09-18 Thread via GitHub
zoltar9264 commented on PR #24879: URL: https://github.com/apache/flink/pull/24879#issuecomment-2359840384 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

Re: [PR] [FLINK-36117] Internal adaptor from State v1 interfaces to v2 [flink]

2024-09-18 Thread via GitHub
fredia commented on code in PR #25345: URL: https://github.com/apache/flink/pull/25345#discussion_r1766045101 ## flink-runtime/src/main/java/org/apache/flink/runtime/state/v2/internal/InternalAppendingState.java: ## @@ -0,0 +1,33 @@ +/* + * Licensed to the Apache Software Founda

Re: [PR] [FLINK-33977][runtime] Adaptive scheduler may not minimize the number of TMs during downscaling [flink]

2024-09-18 Thread via GitHub
1996fanrui commented on code in PR #25218: URL: https://github.com/apache/flink/pull/25218#discussion_r1765985891 ## flink-runtime/src/main/java/org/apache/flink/runtime/scheduler/adaptive/allocator/StateLocalitySlotAssigner.java: ## @@ -139,6 +154,36 @@ public Collection assign

[jira] [Commented] (FLINK-35600) Data read duplication during the full-to-incremental conversion phase

2024-09-18 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17882846#comment-17882846 ] Ruan Hang commented on FLINK-35600: --- Thanks for [~diwu] . Assign this to you. This si

[jira] [Assigned] (FLINK-35600) Data read duplication during the full-to-incremental conversion phase

2024-09-18 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang reassigned FLINK-35600: - Assignee: Di Wu > Data read duplication during the full-to-incremental conversion phase > -

Re: [PR] [FLINK-35600] Add timestamp for low and high watermark [flink-cdc]

2024-09-18 Thread via GitHub
ruanhang1993 commented on PR #3415: URL: https://github.com/apache/flink-cdc/pull/3415#issuecomment-2359809213 @JNSimba Thanks for this PR. Please add some tests to cover the changes. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G

Re: [PR] [FLINK-36112][Connector/Filesystem].Add Support for CreateFlag.NO_LOCAL_WRITE in FLINK on YARN's File Creation to Manage Disk Space and Network Load in Labeled YARN Nodes [flink]

2024-09-18 Thread via GitHub
xintongsong commented on code in PR #25226: URL: https://github.com/apache/flink/pull/25226#discussion_r1765979509 ## flink-connectors/flink-connector-files/src/main/java/org/apache/flink/connector/file/sink/FileSink.java: ## @@ -580,6 +584,11 @@ public T withRollingPolicy(Check

Re: [PR] [Kafka]Kafka sink numRecordsOutByIncremental metrics [flink-cdc]

2024-09-18 Thread via GitHub
github-actions[bot] commented on PR #3471: URL: https://github.com/apache/flink-cdc/pull/3471#issuecomment-2359649772 This pull request has been automatically marked as stale because it has not had recent activity for 60 days. It will be closed in 30 days if no further activity occurs. --

Re: [PR] [FLINK-35500][Connectors/DynamoDB] DynamoDb Table API Sink fails to delete elements due to key not found [flink-connector-aws]

2024-09-18 Thread via GitHub
nicusX commented on code in PR #152: URL: https://github.com/apache/flink-connector-aws/pull/152#discussion_r1765718042 ## flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/table/DynamoDbDynamicSinkFactory.java: ## @@ -58,6 +58,17 @@

Re: [PR] [FLINK-35500][Connectors/DynamoDB] DynamoDb Table API Sink fails to delete elements due to key not found [flink-connector-aws]

2024-09-18 Thread via GitHub
robg-eb commented on code in PR #152: URL: https://github.com/apache/flink-connector-aws/pull/152#discussion_r1765712462 ## flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/table/DynamoDbDynamicSinkFactory.java: ## @@ -58,6 +58,17 @

Re: [PR] [FLINK-35500][Connectors/DynamoDB] DynamoDb Table API Sink fails to delete elements due to key not found [flink-connector-aws]

2024-09-18 Thread via GitHub
robg-eb commented on code in PR #152: URL: https://github.com/apache/flink-connector-aws/pull/152#discussion_r1765702206 ## flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/table/DynamoDbDynamicSinkFactory.java: ## @@ -58,6 +58,17 @

Re: [PR] [FLINK-35500][Connectors/DynamoDB] DynamoDb Table API Sink fails to delete elements due to key not found [flink-connector-aws]

2024-09-18 Thread via GitHub
robg-eb commented on code in PR #152: URL: https://github.com/apache/flink-connector-aws/pull/152#discussion_r1765691788 ## flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/table/DynamoDbDynamicSink.java: ## @@ -62,7 +63,8 @@ protec

Re: [PR] [FLINK-28770][table-planner] CREATE TABLE AS SELECT supports explain [flink]

2024-09-18 Thread via GitHub
flinkbot commented on PR #25359: URL: https://github.com/apache/flink/pull/25359#issuecomment-2359124041 ## CI report: * 0d10b3725c1a6e0815debb5c2e1330eb32b96741 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-28770) CREATE TABLE AS SELECT supports explain

2024-09-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-28770: --- Labels: pull-request-available (was: ) > CREATE TABLE AS SELECT supports explain >

[PR] [FLINK-28770][table-planner] CREATE TABLE AS SELECT supports explain [flink]

2024-09-18 Thread via GitHub
spena opened a new pull request, #25359: URL: https://github.com/apache/flink/pull/25359 ## What is the purpose of the change Add `EXPLAIN` support for CTAS and RTAS statements. i.e. ``` EXPLAIN CREATE TABLE t2 WITH ('format'='csv', 'connector'='filesystem', 'path'='/t

Re: [PR] [master][FLINK-36318] Fix deserializing from 1.18 savepoint with RAW types [flink]

2024-09-18 Thread via GitHub
flinkbot commented on PR #25358: URL: https://github.com/apache/flink/pull/25358#issuecomment-2359071137 ## CI report: * d9fc0d2348a5d49a0441a2fec7f105ecca84ad31 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-36319) FAIL behavior on non-retriable write errors causes an infinite loop when restarting from checkpoint

2024-09-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36319: --- Labels: pull-request-available (was: ) > FAIL behavior on non-retriable write errors causes

[PR] [FLINK-36319][Connector/Prometheus] Fixed error handling behavior on non-retriable errors [flink-connector-prometheus]

2024-09-18 Thread via GitHub
nicusX opened a new pull request, #7: URL: https://github.com/apache/flink-connector-prometheus/pull/7 Modified the default behavior for non-retriable errors to "discard and continue". Blocked the ability to set non-retriable error handling behavior to "fail" -- This is an automated me

Re: [PR] [FLINK-20625][pubsub,e2e] Add PubSubSource connector using FLIP-27 [flink-connector-gcp-pubsub]

2024-09-18 Thread via GitHub
markma0215 commented on PR #2: URL: https://github.com/apache/flink-connector-gcp-pubsub/pull/2#issuecomment-2359005823 could I know when this PR will be merged and release in which version? thx -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [PR] [FLINK-36318] Fix deserializing from 1.18 savepoint with RAW types [flink]

2024-09-18 Thread via GitHub
flinkbot commented on PR #25357: URL: https://github.com/apache/flink/pull/25357#issuecomment-2358957518 ## CI report: * 37429ee80d2ef9314b807144bdc6c536848cef80 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[PR] [master][FLINK-36318] Fix deserializing from 1.18 savepoint with RAW types [flink]

2024-09-18 Thread via GitHub
dawidwys opened a new pull request, #25358: URL: https://github.com/apache/flink/pull/25358 ## What is the purpose of the change The commit fixes restoring from savepoints which were created for SQL queries which used functions such as LAG/LEAD/ARRAY_AGG which use a RAW type for

[jira] [Resolved] (FLINK-36016) Synchronize initialization time and clock usage

2024-09-18 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl resolved FLINK-36016. --- Fix Version/s: 2.0-preview Resolution: Fixed master: [78c19a1278edf54f679b196ec5ef13

Re: [PR] [FLINK-36016] [runtime] Synchronize initialization time and clock usage in DefaultStateTransitionManager [flink]

2024-09-18 Thread via GitHub
XComp merged PR #25319: URL: https://github.com/apache/flink/pull/25319 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.

Re: [PR] [FLINK-36015] [runtime] Align rescale parameters [flink]

2024-09-18 Thread via GitHub
flinkbot commented on PR #25356: URL: https://github.com/apache/flink/pull/25356#issuecomment-2358895828 ## CI report: * 488a4ce4eae2015855ec47ea18b0c5d2122bef2e UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-36240][runtime/metrics] Fix incorrect Ports display in the PrometheusReporter constructor in case of the httpServer creation failure [flink]

2024-09-18 Thread via GitHub
eon2208 commented on PR #25339: URL: https://github.com/apache/flink/pull/25339#issuecomment-2358892542 Thanks for the reminder.I changed one thing after the spotless apply and auroformatting made a mess of it (Have seen the docs on setting up the IDE and will do it later).I have double che

[jira] [Assigned] (FLINK-36319) FAIL behavior on non-retriable write errors causes an infinite loop when restarting from checkpoint

2024-09-18 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Liang Teoh reassigned FLINK-36319: --- Assignee: Lorenzo Nicora > FAIL behavior on non-retriable write errors causes an in

[jira] [Updated] (FLINK-36319) FAIL behavior on non-retriable write errors causes an infinite loop when restarting from checkpoint

2024-09-18 Thread Lorenzo Nicora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lorenzo Nicora updated FLINK-36319: --- Description: The {{FAIL}} (default) error handling behavior when a write request is rejected

[jira] [Created] (FLINK-36319) FAIL behavior on non-retriable write errors causes an infinite loop when restarting from checkpoint

2024-09-18 Thread Lorenzo Nicora (Jira)
Lorenzo Nicora created FLINK-36319: -- Summary: FAIL behavior on non-retriable write errors causes an infinite loop when restarting from checkpoint Key: FLINK-36319 URL: https://issues.apache.org/jira/browse/FLINK-

Re: [PR] [FLINK-36318] Fix deserializing from 1.18 savepoint with RAW types [flink]

2024-09-18 Thread via GitHub
dawidwys commented on code in PR #25357: URL: https://github.com/apache/flink/pull/25357#discussion_r1765312051 ## flink-core/src/main/java/org/apache/flink/util/InstantiationUtil.java: ## @@ -146,144 +144,93 @@ protected Class resolveProxyClass(String[] interfaces) }

[PR] [FLINK-36318] Fix deserializing from 1.18 savepoint with RAW types [flink]

2024-09-18 Thread via GitHub
dawidwys opened a new pull request, #25357: URL: https://github.com/apache/flink/pull/25357 ## What is the purpose of the change The commit fixes restoring from savepoints which were created for SQL queries which used functions such as LAG/LEAD/ARRAY_AGG which use a RAW type

[jira] [Updated] (FLINK-36318) Fail to restore from 1.18 if LAG function is used

2024-09-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36318: --- Labels: pull-request-available (was: ) > Fail to restore from 1.18 if LAG function is used

Re: [PR] [FLINK-33750][config] Remove deprecated runtime config option [flink]

2024-09-18 Thread via GitHub
flinkbot commented on PR #25355: URL: https://github.com/apache/flink/pull/25355#issuecomment-2358808581 ## CI report: * 9fa03d9ade6608cd4bef0fb183b66d0066138bf1 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-36015) Align rescale parameters

2024-09-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36015: --- Labels: pull-request-available (was: ) > Align rescale parameters > ---

[PR] [FLINK-36015] [runtime] Align rescale parameters [flink]

2024-09-18 Thread via GitHub
ztison opened a new pull request, #25356: URL: https://github.com/apache/flink/pull/25356 ## What is the purpose of the change This PR aligns the configuration naming for parameters used in the Adaptive Scheduler in different states. ## Brief change log - Param

Re: [PR] [FLINK-36240][runtime/metrics] Fix incorrect Ports display in the PrometheusReporter constructor in case of the httpServer creation failure [flink]

2024-09-18 Thread via GitHub
ferenc-csaky commented on PR #25339: URL: https://github.com/apache/flink/pull/25339#issuecomment-2358805053 FYI: compile failed because of code style, make sure to run `mvn spotless:apply` to format your code. -- This is an automated message from the Apache Git Service. To respond to the

Re: [PR] [FLINK-35510][statebackend] Implement basic incremental checkpoint fo… [flink]

2024-09-18 Thread via GitHub
zoltar9264 commented on PR #24879: URL: https://github.com/apache/flink/pull/24879#issuecomment-2358799727 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[jira] [Comment Edited] (FLINK-36295) AdaptiveSchedulerClusterITCase. testCheckpointStatsPersistedAcrossRescale failed with

2024-09-18 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17882734#comment-17882734 ] Matthias Pohl edited comment on FLINK-36295 at 9/18/24 3:16 PM: --

[jira] [Created] (FLINK-36317) Populate the ArchivedExecutionGraph with CheckpointStatsSnapshot data if in WaitingForResources state with a previousExecutionGraph being set

2024-09-18 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-36317: - Summary: Populate the ArchivedExecutionGraph with CheckpointStatsSnapshot data if in WaitingForResources state with a previousExecutionGraph being set Key: FLINK-36317 URL: htt

Re: [PR] [FLINK-36240][runtime/metrics] Fix incorrect Ports display in the PrometheusReporter constructor in case of the httpServer creation failure [flink]

2024-09-18 Thread via GitHub
ferenc-csaky commented on PR #25339: URL: https://github.com/apache/flink/pull/25339#issuecomment-2358746805 Logic LGTM, lets wait for the CI run, will approve when it is successful. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

[PR] [FLINK-33750][config] Remove deprecated runtime config option [flink]

2024-09-18 Thread via GitHub
Sxnan opened a new pull request, #25355: URL: https://github.com/apache/flink/pull/25355 ## What is the purpose of the change *(For example: This pull request makes task deployment go through the blob server, rather than through RPC. That way we avoid re-transferring them on e

Re: [PR] [FLINK-36240][runtime/metrics] Fix incorrect Ports display in the PrometheusReporter constructor in case of the httpServer creation failure [flink]

2024-09-18 Thread via GitHub
eon2208 commented on PR #25339: URL: https://github.com/apache/flink/pull/25339#issuecomment-2358666335 @ferenc-csaky Done! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Comment Edited] (FLINK-36295) AdaptiveSchedulerClusterITCase. testCheckpointStatsPersistedAcrossRescale failed with

2024-09-18 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17882734#comment-17882734 ] Matthias Pohl edited comment on FLINK-36295 at 9/18/24 2:26 PM: --

[jira] [Commented] (FLINK-36295) AdaptiveSchedulerClusterITCase. testCheckpointStatsPersistedAcrossRescale failed with

2024-09-18 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17882734#comment-17882734 ] Matthias Pohl commented on FLINK-36295: --- I'm lowering the priority of this issue a

[jira] [Updated] (FLINK-36295) AdaptiveSchedulerClusterITCase. testCheckpointStatsPersistedAcrossRescale failed with

2024-09-18 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl updated FLINK-36295: -- Priority: Critical (was: Blocker) > AdaptiveSchedulerClusterITCase. testCheckpointStatsPersis

[jira] [Resolved] (FLINK-31922) Port over Kinesis Client configurations for retry and backoff

2024-09-18 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Liang Teoh resolved FLINK-31922. - Resolution: Fixed  merged commit [{{22f154b}}|https://github.com/apache/flink-connector

[jira] [Comment Edited] (FLINK-36295) AdaptiveSchedulerClusterITCase. testCheckpointStatsPersistedAcrossRescale failed with

2024-09-18 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17882730#comment-17882730 ] Matthias Pohl edited comment on FLINK-36295 at 9/18/24 2:21 PM: --

[jira] [Comment Edited] (FLINK-36295) AdaptiveSchedulerClusterITCase. testCheckpointStatsPersistedAcrossRescale failed with

2024-09-18 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17882730#comment-17882730 ] Matthias Pohl edited comment on FLINK-36295 at 9/18/24 2:21 PM: --

Re: [PR] [FLINK-31922][Connectors/AWS] Port over Kinesis Client configurations for retry and backoff strategies [flink-connector-aws]

2024-09-18 Thread via GitHub
hlteoh37 merged PR #165: URL: https://github.com/apache/flink-connector-aws/pull/165 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@

Re: [PR] [FLINK-33977][runtime] Adaptive scheduler may not minimize the number of TMs during downscaling [flink]

2024-09-18 Thread via GitHub
RocMarshal commented on code in PR #25218: URL: https://github.com/apache/flink/pull/25218#discussion_r1765150610 ## flink-runtime/src/main/java/org/apache/flink/runtime/scheduler/adaptive/allocator/SlotAssigner.java: ## @@ -32,4 +46,77 @@ Collection assignSlots( Co

[jira] [Commented] (FLINK-36295) AdaptiveSchedulerClusterITCase. testCheckpointStatsPersistedAcrossRescale failed with

2024-09-18 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17882730#comment-17882730 ] Matthias Pohl commented on FLINK-36295: --- I guess I found the reason why we do not

Re: [PR] [docs] Update Java 17 compatibility docs [flink]

2024-09-18 Thread via GitHub
mbalassi merged PR #25342: URL: https://github.com/apache/flink/pull/25342 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apac

Re: [PR] [FLINK-31922][Connectors/AWS] Port over Kinesis Client configurations for retry and backoff strategies [flink-connector-aws]

2024-09-18 Thread via GitHub
hlteoh37 commented on code in PR #165: URL: https://github.com/apache/flink-connector-aws/pull/165#discussion_r1765101564 ## flink-connector-aws/flink-connector-aws-kinesis-streams/src/main/java/org/apache/flink/connector/kinesis/source/config/KinesisSourceConfigOptions.java: #

Re: [PR] [hotfix][docs] Fix typo in Hive connector overview Python example [flink]

2024-09-18 Thread via GitHub
flinkbot commented on PR #25354: URL: https://github.com/apache/flink/pull/25354#issuecomment-2358530729 ## CI report: * 4c5e0a0209810925fd8361f394e3416c1ecea47f UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

  1   2   >