Re: [PR] Kubernetes Operator 1.11.0 release [flink-web]

2025-03-03 Thread via GitHub
gyfora merged PR #775: URL: https://github.com/apache/flink-web/pull/775 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache

[jira] [Updated] (FLINK-37413) Introduce append-only RowTimeDeduplicateFunction with Async State API

2025-03-03 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-37413: --- Reporter: Piotr Nowojski (was: Xuyang Zhong) > Introduce append-only RowTimeDeduplicateFunc

Re: [PR] [FLINK-36855] Source API implementation [flink-connector-kudu]

2025-03-03 Thread via GitHub
martongreber commented on code in PR #8: URL: https://github.com/apache/flink-connector-kudu/pull/8#discussion_r1977734299 ## flink-connector-kudu/src/main/java/org/apache/flink/connector/kudu/source/KuduSource.java: ## @@ -0,0 +1,130 @@ +/* + * Licensed to the Apache Software

Re: [PR] [FLINK-36855] Source API implementation [flink-connector-kudu]

2025-03-03 Thread via GitHub
martongreber commented on code in PR #8: URL: https://github.com/apache/flink-connector-kudu/pull/8#discussion_r1977733939 ## flink-connector-kudu/src/main/java/org/apache/flink/connector/kudu/source/reader/KuduSourceReader.java: ## @@ -0,0 +1,70 @@ +/* + * Licensed to the Apac

Re: [PR] [FLINK-36855] Source API implementation [flink-connector-kudu]

2025-03-03 Thread via GitHub
martongreber commented on code in PR #8: URL: https://github.com/apache/flink-connector-kudu/pull/8#discussion_r1977732794 ## flink-connector-kudu/src/main/java/org/apache/flink/connector/kudu/source/reader/KuduSourceReader.java: ## @@ -0,0 +1,70 @@ +/* + * Licensed to the Apac

Re: [PR] [FLINK-36203][Connectors/DynamoDB] Added polling delay between getrecords calls [flink-connector-aws]

2025-03-03 Thread via GitHub
gguptp commented on code in PR #190: URL: https://github.com/apache/flink-connector-aws/pull/190#discussion_r1977837166 ## flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/source/reader/PollingDynamoDbStreamsShardSplitReader.java: #

Re: [PR] [FLINK-36203][Connectors/DynamoDB] Added polling delay between getrecords calls [flink-connector-aws]

2025-03-03 Thread via GitHub
gguptp commented on code in PR #190: URL: https://github.com/apache/flink-connector-aws/pull/190#discussion_r1977837807 ## flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/source/reader/PollingDynamoDbStreamsShardSplitReader.java: #

Re: [PR] [FLINK-36203][Connectors/DynamoDB] Added polling delay between getrecords calls [flink-connector-aws]

2025-03-03 Thread via GitHub
gguptp commented on code in PR #190: URL: https://github.com/apache/flink-connector-aws/pull/190#discussion_r1977838611 ## flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/source/reader/PollingDynamoDbStreamsShardSplitReader.java: #

Re: [PR] [FLINK-36203][Connectors/DynamoDB] Added polling delay between getrecords calls [flink-connector-aws]

2025-03-03 Thread via GitHub
gguptp commented on code in PR #190: URL: https://github.com/apache/flink-connector-aws/pull/190#discussion_r1977840254 ## flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/source/config/DynamodbStreamsSourceConfigConstants.java: ##

[jira] [Assigned] (FLINK-37410) Split-level Watermark Metrics

2025-03-03 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-37410: -- Assignee: Efrat Levitan > Split-level Watermark Metrics > ---

Re: [PR] [FLINK-36855] Source API implementation [flink-connector-kudu]

2025-03-03 Thread via GitHub
martongreber commented on code in PR #8: URL: https://github.com/apache/flink-connector-kudu/pull/8#discussion_r1977722483 ## flink-connector-kudu/src/main/java/org/apache/flink/connector/kudu/source/config/ContinuousBoundingSettings.java: ## @@ -0,0 +1,81 @@ +/* + * Licensed t

Re: [PR] [FLINK-36855] Source API implementation [flink-connector-kudu]

2025-03-03 Thread via GitHub
martongreber commented on code in PR #8: URL: https://github.com/apache/flink-connector-kudu/pull/8#discussion_r1977721833 ## flink-connector-kudu/pom.xml: ## @@ -64,11 +69,22 @@ under the License. flink-table-runtime +

Re: [PR] [FLINK-36855] Source API implementation [flink-connector-kudu]

2025-03-03 Thread via GitHub
martongreber commented on code in PR #8: URL: https://github.com/apache/flink-connector-kudu/pull/8#discussion_r1977724995 ## flink-connector-kudu/src/main/java/org/apache/flink/connector/kudu/source/enumerator/KuduSourceEnumerator.java: ## @@ -0,0 +1,256 @@ +/* + * Licensed to

Re: [PR] [FLINK-36855] Source API implementation [flink-connector-kudu]

2025-03-03 Thread via GitHub
martongreber commented on code in PR #8: URL: https://github.com/apache/flink-connector-kudu/pull/8#discussion_r1977724631 ## flink-connector-kudu/src/main/java/org/apache/flink/connector/kudu/source/enumerator/KuduSourceEnumerator.java: ## @@ -0,0 +1,256 @@ +/* + * Licensed to

Re: [PR] [FLINK-36855] Source API implementation [flink-connector-kudu]

2025-03-03 Thread via GitHub
martongreber commented on code in PR #8: URL: https://github.com/apache/flink-connector-kudu/pull/8#discussion_r1977726108 ## flink-connector-kudu/src/main/java/org/apache/flink/connector/kudu/source/enumerator/KuduSourceEnumerator.java: ## @@ -0,0 +1,256 @@ +/* + * Licensed to

Re: [PR] [FLINK-36855] Source API implementation [flink-connector-kudu]

2025-03-03 Thread via GitHub
martongreber commented on code in PR #8: URL: https://github.com/apache/flink-connector-kudu/pull/8#discussion_r1977733401 ## flink-connector-kudu/src/main/java/org/apache/flink/connector/kudu/source/reader/KuduSourceReader.java: ## @@ -0,0 +1,70 @@ +/* + * Licensed to the Apac

Re: [PR] SQL Server CDC support - fixing the issues in the outstanding pull request by another author [flink-cdc]

2025-03-03 Thread via GitHub
arielmoraes commented on PR #3507: URL: https://github.com/apache/flink-cdc/pull/3507#issuecomment-2695015536 Can we reopen this? It's a much required connector. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [cdc-connector][sqlserver]Flink cdc pipeline support sqlserver source [flink-cdc]

2025-03-03 Thread via GitHub
arielmoraes commented on PR #3445: URL: https://github.com/apache/flink-cdc/pull/3445#issuecomment-2695018809 Is there any news on this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

[jira] [Assigned] (FLINK-37387) License check behaves differently for different jdk versions

2025-03-03 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin reassigned FLINK-37387: --- Assignee: Sergey Nuyanzin > License check behaves differently for different jdk ver

[jira] [Resolved] (FLINK-37387) License check behaves differently for different jdk versions

2025-03-03 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin resolved FLINK-37387. - Fix Version/s: 2.1.0 2.0.1 Resolution: Fixed > License check b

Re: [PR] Update table_api.md with modern Docker Compose syntax [flink]

2025-03-03 Thread via GitHub
nilmadhab commented on PR #26235: URL: https://github.com/apache/flink/pull/26235#issuecomment-2693854941 > do we still need this PR if another PR was raised an this one is based on 1.16 which is not supported anymore? Yes this can be closed. Closing now -- This is an automated mes

Re: [PR] Update table_api.md with modern Docker Compose syntax [flink]

2025-03-03 Thread via GitHub
nilmadhab closed pull request #26235: Update table_api.md with modern Docker Compose syntax URL: https://github.com/apache/flink/pull/26235 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

[PR] [FLINK-29549]- Flink Glue Catalog integration [flink-connector-aws]

2025-03-03 Thread via GitHub
FranMorilloAWS opened a new pull request, #191: URL: https://github.com/apache/flink-connector-aws/pull/191 ## Purpose of the change *For example: Implements the Table API for the Kinesis Source.* ## Verifying this change Please make sure both new and modified tes

Re: [PR] [FLINK-29549]- Flink Glue Catalog integration [flink-connector-aws]

2025-03-03 Thread via GitHub
boring-cyborg[bot] commented on PR #191: URL: https://github.com/apache/flink-connector-aws/pull/191#issuecomment-2693884736 Thanks for opening this pull request! Please check out our contributing guidelines. (https://flink.apache.org/contributing/how-to-contribute.html) -- This is a

[jira] [Updated] (FLINK-37352) Write full changelog to Paimon Sink.

2025-03-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-37352: --- Labels: pull-request-available (was: ) > Write full changelog to Paimon Sink. > ---

Re: [PR] [FLINK-37352] Write full changelog to PaimonSink. [flink-cdc]

2025-03-03 Thread via GitHub
lvyanquan commented on PR #3935: URL: https://github.com/apache/flink-cdc/pull/3935#issuecomment-2694009083 @MOBIN-F PTAL as you are familiar with Paimon connector. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

[jira] [Commented] (FLINK-37387) License check behaves differently for different jdk versions

2025-03-03 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17931896#comment-17931896 ] Sergey Nuyanzin commented on FLINK-37387: - Merged as [f1a5add443d38af9975d21cde

Re: [PR] [FLINK-37402][table] Emit watermarks after record in TestSourceFunction and TestValuesRuntimeFunctions [flink]

2025-03-03 Thread via GitHub
snuyanzin commented on code in PR #26236: URL: https://github.com/apache/flink/pull/26236#discussion_r1977069808 ## flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/plan/nodes/exec/testutils/SemanticTestBase.java: ## @@ -135,6 +130,25 @@ void runTests

[PR] a lame attempt to introduce cdc benchmark [flink-cdc]

2025-03-03 Thread via GitHub
yuxiqian opened a new pull request, #3934: URL: https://github.com/apache/flink-cdc/pull/3934 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e

Re: [PR] a lame attempt to introduce cdc benchmark [flink-cdc]

2025-03-03 Thread via GitHub
yuxiqian closed pull request #3934: a lame attempt to introduce cdc benchmark URL: https://github.com/apache/flink-cdc/pull/3934 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [FLINK-32097][Connectors/Kinesis] Implement support for Kinesis deaggregation [flink-connector-aws]

2025-03-03 Thread via GitHub
hlteoh37 commented on code in PR #188: URL: https://github.com/apache/flink-connector-aws/pull/188#discussion_r1977101009 ## flink-connector-aws/flink-connector-aws-kinesis-streams/src/main/java/org/apache/flink/connector/kinesis/source/reader/KinesisShardSplitReaderBase.java:

Re: [PR] [FLINK-3154][API] Upgrade from Kryo 2.x to Kryo 5.x. Removed twitter … [flink]

2025-03-03 Thread via GitHub
gyfora commented on PR #25896: URL: https://github.com/apache/flink/pull/25896#issuecomment-2693784863 @kurtostfeld , it would be good to merge this soon. The most important thing related to the Avro types in the first step is to not introduce any regressions. -- This is an automated me

[jira] [Created] (FLINK-37412) Add slot allocation strategy to for selecting TMs first that have already slots assigned

2025-03-03 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-37412: - Summary: Add slot allocation strategy to for selecting TMs first that have already slots assigned Key: FLINK-37412 URL: https://issues.apache.org/jira/browse/FLINK-37412

Re: [PR] [FLINK-37387][build] Enable license check for jdk17 and jdk21 [flink]

2025-03-03 Thread via GitHub
snuyanzin merged PR #26240: URL: https://github.com/apache/flink/pull/26240 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apa

Re: [PR] [FLINK-36827] CDC quickstart tidyup [flink-cdc]

2025-03-03 Thread via GitHub
rmoff commented on PR #3771: URL: https://github.com/apache/flink-cdc/pull/3771#issuecomment-269387 @Sukang1002 I'm not planning to progress this PR further. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Commented] (FLINK-37352) Write full changelog to Paimon Sink.

2025-03-03 Thread Yanquan Lv (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17931916#comment-17931916 ] Yanquan Lv commented on FLINK-37352: I'm willing to take this. > Write full changel

Re: [PR] [FLINK-36827] CDC quickstart tidyup [flink-cdc]

2025-03-03 Thread via GitHub
Sukang1002 commented on PR #3771: URL: https://github.com/apache/flink-cdc/pull/3771#issuecomment-2693790611 Ok, thank you for your reply, then I will further improve this document. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] [FLINK-35599] Introduce JDBC pipeline sink connector [flink-cdc]

2025-03-03 Thread via GitHub
lvyanquan commented on code in PR #3916: URL: https://github.com/apache/flink-cdc/pull/3916#discussion_r1977066005 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-jdbc/src/main/java/org/apache/flink/cdc/connectors/jdbc/catalog/JdbcCatalog.java: ##

[jira] [Created] (FLINK-37411) Introduce the rollback mechanism for Autoscaler

2025-03-03 Thread Rui Fan (Jira)
Rui Fan created FLINK-37411: --- Summary: Introduce the rollback mechanism for Autoscaler Key: FLINK-37411 URL: https://issues.apache.org/jira/browse/FLINK-37411 Project: Flink Issue Type: New Featur

Re: [PR] [FLINK-37005][table] Make StreamExecDeduplicate ouput insert only where possible [flink]

2025-03-03 Thread via GitHub
pnowojski merged PR #26051: URL: https://github.com/apache/flink/pull/26051 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apa

[jira] [Closed] (FLINK-37005) Make StreamExecDeduplicate ouput insert only where possible

2025-03-03 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-37005. -- Fix Version/s: 2.1.0 Release Note: Newly submitted deduplication "keep first row" SQL que

Re: [PR] [FLINK-37380] Change TransactionalIdPrefix to a required option if Exactly once [flink-connector-kafka]

2025-03-03 Thread via GitHub
loserwang1024 commented on PR #156: URL: https://github.com/apache/flink-connector-kafka/pull/156#issuecomment-2694108513 > Did you check if documentation (for SQL) reflects that this is a required property? https://github.com/user-attachments/assets/3e0aa060-32cc-4f70-9472-7f6b1439f

Re: [PR] [FLINK-36931][cdc] FlinkCDC YAML supports batch mode [flink-cdc]

2025-03-03 Thread via GitHub
lvyanquan commented on code in PR #3812: URL: https://github.com/apache/flink-cdc/pull/3812#discussion_r1976998390 ## flink-cdc-common/src/main/java/org/apache/flink/cdc/common/pipeline/PipelineOptions.java: ## @@ -45,6 +45,12 @@ public class PipelineOptions {

Re: [PR] [FLINK-37203] Alter table comment or column comment [flink-cdc]

2025-03-03 Thread via GitHub
lvyanquan commented on code in PR #3893: URL: https://github.com/apache/flink-cdc/pull/3893#discussion_r1977159664 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-mysql/src/main/java/org/apache/flink/cdc/connectors/mysql/source/parser/CustomAlterTablePars

Re: [PR] [hotfix][tests] Use Junit5 import. [flink]

2025-03-03 Thread via GitHub
snuyanzin commented on code in PR #26193: URL: https://github.com/apache/flink/pull/26193#discussion_r1977502632 ## flink-connectors/flink-connector-files/src/test/java/org/apache/flink/connector/file/sink/FileSinkTest.java: ## @@ -41,6 +41,6 @@ public void testCreateFileWriterW

Re: [PR] [hotfix][tests] Use Junit5 import. [flink]

2025-03-03 Thread via GitHub
snuyanzin commented on code in PR #26193: URL: https://github.com/apache/flink/pull/26193#discussion_r1977501988 ## flink-connectors/flink-connector-files/src/test/java/org/apache/flink/connector/file/sink/FileSinkTest.java: ## @@ -23,11 +23,11 @@ import org.apache.flink.conne

[jira] [Created] (FLINK-37413) Introduce append-only RowTimeDeduplicateFunction with Async State API

2025-03-03 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-37413: -- Summary: Introduce append-only RowTimeDeduplicateFunction with Async State API Key: FLINK-37413 URL: https://issues.apache.org/jira/browse/FLINK-37413 Project: Fl

[jira] [Assigned] (FLINK-37413) Introduce append-only RowTimeDeduplicateFunction with Async State API

2025-03-03 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-37413: -- Assignee: (was: Xuyang Zhong) > Introduce append-only RowTimeDeduplicateFunction

[jira] [Commented] (FLINK-37413) Introduce append-only RowTimeDeduplicateFunction with Async State API

2025-03-03 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17931962#comment-17931962 ] Piotr Nowojski commented on FLINK-37413: FLINK-37005 introduced the sync only ve

Re: [PR] [FLINK-37402][table] Emit watermarks after record in TestSourceFunction and TestValuesRuntimeFunctions [flink]

2025-03-03 Thread via GitHub
twalthr merged PR #26236: URL: https://github.com/apache/flink/pull/26236 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apach

Re: [PR] [FLINK-36652] Upgrade Apache ORC Version to 1.9.4 [flink]

2025-03-03 Thread via GitHub
dyccode commented on PR #26195: URL: https://github.com/apache/flink/pull/26195#issuecomment-2694402812 > Failing CI @davidradl I'm sorry for not noticing this issue in a timely manner. I have now resolved it -- This is an automated message from the Apache Git Service. To respond t

[jira] [Closed] (FLINK-37402) SQL testing sources produce incorrect watermarks

2025-03-03 Thread Timo Walther (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timo Walther closed FLINK-37402. Fix Version/s: 2.1.0 Resolution: Fixed Fixed in master: d5ffb88df4d033b357a72a3def6d45ebc80

Re: [PR] [FLINK-36652] Upgrade Apache ORC Version to 1.9.4 [flink]

2025-03-03 Thread via GitHub
snuyanzin commented on PR #26195: URL: https://github.com/apache/flink/pull/26195#issuecomment-2694417557 we need to have the PR rebased (not merge only) Currently if you open commit history for this PR there is a merge commit which is a no go. Need to rebase first to eliminate it --

[jira] [Commented] (FLINK-37411) Introduce the rollback mechanism for Autoscaler

2025-03-03 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17931941#comment-17931941 ] Gyula Fora commented on FLINK-37411: It feels like this rollback mechanism should be

[jira] [Closed] (FLINK-36673) Operator is not properly handling failed deployments without savepoints

2025-03-03 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora closed FLINK-36673. -- Fix Version/s: kubernetes-operator-1.11.0 Resolution: Fixed > Operator is not properly handling

[jira] [Commented] (FLINK-36673) Operator is not properly handling failed deployments without savepoints

2025-03-03 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17931954#comment-17931954 ] Gyula Fora commented on FLINK-36673: [~alnzng] 1.11.0 was released today , it will s

Re: [PR] [FLINK-37005][table] Make StreamExecDeduplicate ouput insert only where possible [flink]

2025-03-03 Thread via GitHub
pnowojski commented on PR #26051: URL: https://github.com/apache/flink/pull/26051#issuecomment-2693914171 Thanks for the reviews. Everything is finally green. Sorry for the delay, but I had to deal with some other things in the mean time. -- This is an automated message from the Apache Gi

Re: [PR] [FLINK-37379][state/forst] Double list LRU in ForSt state and cache reload [flink]

2025-03-03 Thread via GitHub
Zakelly commented on PR #26237: URL: https://github.com/apache/flink/pull/26237#issuecomment-2694631063 Also, additional two commits to enhance the user experience are attached. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[jira] [Updated] (FLINK-37410) [FLIP-513] Split-level Watermark Metrics

2025-03-03 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-37410: --- Summary: [FLIP-513] Split-level Watermark Metrics (was: Split-level Watermark Metrics) > [

[jira] [Commented] (FLINK-37412) Add slot allocation strategy to for selecting TMs first that have already slots assigned

2025-03-03 Thread Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17932121#comment-17932121 ] Liu commented on FLINK-37412: - Hello, [~mapohl]. I would like to implement it. Can you assig

Re: [PR] [FLINK-3154][API] Upgrade from Kryo 2.x to Kryo 5.x. Removed twitter … [flink]

2025-03-03 Thread via GitHub
kurtostfeld commented on code in PR #25896: URL: https://github.com/apache/flink/pull/25896#discussion_r1978482869 ## flink-formats/flink-avro/src/main/java/org/apache/flink/formats/avro/utils/AvroKryoSerializerUtils.java: ## @@ -106,11 +105,55 @@ public void write(Kryo kryo, Ou

Re: [PR] [FLINK-3154][API] Upgrade from Kryo 2.x to Kryo 5.x. Removed twitter … [flink]

2025-03-03 Thread via GitHub
kurtostfeld commented on code in PR #25896: URL: https://github.com/apache/flink/pull/25896#discussion_r1978477882 ## flink-formats/flink-avro/src/main/java/org/apache/flink/formats/avro/utils/AvroKryoSerializerUtils.java: ## @@ -106,11 +105,55 @@ public void write(Kryo kryo, Ou

Re: [PR] [FLINK-36203][Connectors/DynamoDB] Added polling delay between getrecords calls [flink-connector-aws]

2025-03-03 Thread via GitHub
gguptp commented on code in PR #190: URL: https://github.com/apache/flink-connector-aws/pull/190#discussion_r1977895665 ## flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/source/config/DynamodbStreamsSourceConfigConstants.java: ##

Re: [PR] [FLINK-36203][Connectors/DynamoDB] Added polling delay between getrecords calls [flink-connector-aws]

2025-03-03 Thread via GitHub
gguptp commented on code in PR #190: URL: https://github.com/apache/flink-connector-aws/pull/190#discussion_r1977896339 ## flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/source/reader/PollingDynamoDbStreamsShardSplitReader.java: #

Re: [PR] [FLINK-36855] Source API implementation [flink-connector-kudu]

2025-03-03 Thread via GitHub
martongreber commented on code in PR #8: URL: https://github.com/apache/flink-connector-kudu/pull/8#discussion_r1977735111 ## flink-connector-kudu/src/test/java/org/apache/flink/connector/kudu/testutils/KuduSourceITBase.java: ## @@ -0,0 +1,36 @@ +/* + * Licensed to the Apache S

Re: [PR] [FLINK-36203][Connectors/DynamoDB] Added polling delay between getrecords calls [flink-connector-aws]

2025-03-03 Thread via GitHub
gguptp commented on code in PR #190: URL: https://github.com/apache/flink-connector-aws/pull/190#discussion_r1977899145 ## flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/source/DynamoDbStreamsSource.java: ## @@ -133,13 +135,20 @@

Re: [PR] [FLINK-36203][Connectors/DynamoDB] Added polling delay between getrecords calls [flink-connector-aws]

2025-03-03 Thread via GitHub
gguptp commented on code in PR #190: URL: https://github.com/apache/flink-connector-aws/pull/190#discussion_r1977896339 ## flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/source/reader/PollingDynamoDbStreamsShardSplitReader.java: #

[jira] [Assigned] (FLINK-37407) Add meta information to SQL state connector

2025-03-03 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi reassigned FLINK-37407: - Assignee: Gabor Somogyi > Add meta information to SQL state connector > ---

[jira] [Closed] (FLINK-37043) [Umbrella] Test Flink Release 2.0

2025-03-03 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-37043. Resolution: Done > [Umbrella] Test Flink Release 2.0 > - > >

Re: [PR] [FLINK-37203] Alter table comment or column comment [flink-cdc]

2025-03-03 Thread via GitHub
ChaomingZhangCN commented on code in PR #3893: URL: https://github.com/apache/flink-cdc/pull/3893#discussion_r1978748419 ## flink-cdc-common/src/main/java/org/apache/flink/cdc/common/event/AlterTableCommentEvent.java: ## @@ -0,0 +1,89 @@ +/* + * Licensed to the Apache Software F

Re: [PR] [FLINK-37203] Alter table comment or column comment [flink-cdc]

2025-03-03 Thread via GitHub
ChaomingZhangCN commented on code in PR #3893: URL: https://github.com/apache/flink-cdc/pull/3893#discussion_r1978701396 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-mysql/src/main/java/org/apache/flink/cdc/connectors/mysql/source/parser/CustomAlterTab

[jira] [Commented] (FLINK-35810) OOM in AsyncWaitOperatorTest.testProcessingTimeRepeatedCompleteUnorderedWithRetry

2025-03-03 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17932160#comment-17932160 ] Weijie Guo commented on FLINK-35810: Thanks [~yunfengzhou] for the careful investiga

[jira] [Updated] (FLINK-37414) Java heap space OOM in test_cron_azure core

2025-03-03 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-37414: --- Affects Version/s: 1.20.1 > Java heap space OOM in test_cron_azure core > --

[PR] [FLINK-35810] Fix AsyncWaitOperatorTest missing endInput bug [flink]

2025-03-03 Thread via GitHub
yunfengzhou-hub opened a new pull request, #26241: URL: https://github.com/apache/flink/pull/26241 ## What is the purpose of the change This PR fixes the bug that AsyncWaitOperator might be triggering mailboxExecutor.execute() after the mailbox has been quiesced in AsyncWaitOperatorT

[PR] [hotfix][tests] Fix MySQL test case failure in exact UTC timezone [flink-cdc]

2025-03-03 Thread via GitHub
yuxiqian opened a new pull request, #3936: URL: https://github.com/apache/flink-cdc/pull/3936 As noted in https://github.com/apache/flink-cdc/actions/runs/13623293435/job/38139886612?pr=3912, if JVM timezone is randomly set to GMT+0:00, it will be "smartly" converted to `"GMT"` (w/o offset

Re: [PR] [FLINK-37204] Add missing StarRocks connector options for 1.2.10. [flink-cdc]

2025-03-03 Thread via GitHub
ChaomingZhangCN commented on code in PR #3883: URL: https://github.com/apache/flink-cdc/pull/3883#discussion_r1978689655 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-starrocks/src/main/java/org/apache/flink/cdc/connectors/starrocks/sink/StarRocksDataSi

[jira] [Updated] (FLINK-37379) Lack of state cache load for ForSt after recovery

2025-03-03 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song updated FLINK-37379: - Fix Version/s: 2.0.0 > Lack of state cache load for ForSt after recovery > -

[jira] [Closed] (FLINK-36437) Hive connector failed to compile with JDK 11

2025-03-03 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo closed FLINK-36437. -- Resolution: Not A Problem > Hive connector failed to compile with JDK 11 > ---

[jira] [Commented] (FLINK-37414) Java heap space OOM in test_cron_azure core

2025-03-03 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17932159#comment-17932159 ] Weijie Guo commented on FLINK-37414: Looking at the history, this has existed at lea

[jira] [Updated] (FLINK-3154) Update Kryo version from 2.24.0 to latest Kryo LTS version

2025-03-03 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-3154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song updated FLINK-3154: Fix Version/s: 2.0.0 > Update Kryo version from 2.24.0 to latest Kryo LTS version > ---

[jira] [Updated] (FLINK-3154) Update Kryo version from 2.24.0 to latest Kryo LTS version

2025-03-03 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-3154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song updated FLINK-3154: Priority: Blocker (was: Not a Priority) > Update Kryo version from 2.24.0 to latest Kryo LTS versi

Re: [PR] [FLINK-3154][API] Upgrade from Kryo 2.x to Kryo 5.x. Removed twitter … [flink]

2025-03-03 Thread via GitHub
kurtostfeld commented on code in PR #25896: URL: https://github.com/apache/flink/pull/25896#discussion_r1978578476 ## flink-formats/flink-avro/src/main/java/org/apache/flink/formats/avro/utils/AvroKryoSerializerUtils.java: ## @@ -106,11 +105,55 @@ public void write(Kryo kryo, Ou

Re: [PR] [FLINK-3154][API] Upgrade from Kryo 2.x to Kryo 5.x. Removed twitter … [flink]

2025-03-03 Thread via GitHub
kurtostfeld commented on PR #25896: URL: https://github.com/apache/flink/pull/25896#issuecomment-2696147722 @gyfora I've rewritten the Avro GenericRecord Kryo serializer and the Avro GenericData.Array serializer. Avro is also a serialization library, so the Kryo serializers just basically w

[PR] [FLINK-35810] Fix AsyncWaitOperatorTest missing endInput bug [flink]

2025-03-03 Thread via GitHub
yunfengzhou-hub opened a new pull request, #26242: URL: https://github.com/apache/flink/pull/26242 ## What is the purpose of the change This PR fixes the bug that AsyncWaitOperator might be triggering mailboxExecutor.execute() after the mailbox has been quiesced in AsyncWaitOperatorT

Re: [PR] [FLINK-37403] Convert interval join to regular join for updating source [flink]

2025-03-03 Thread via GitHub
bvarghese1 commented on code in PR #26230: URL: https://github.com/apache/flink/pull/26230#discussion_r1978609329 ## flink-table/flink-table-planner/src/main/scala/org/apache/flink/table/planner/plan/optimize/program/FlinkChangelogModeInferenceProgram.scala: ## @@ -287,6 +287,39

Re: [PR] [FLINK-35810] Fix AsyncWaitOperatorTest missing endInput bug [flink]

2025-03-03 Thread via GitHub
flinkbot commented on PR #26242: URL: https://github.com/apache/flink/pull/26242#issuecomment-2696197701 ## CI report: * 28f55fee43f26ebf2473a534bbda2dc638b58e84 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-37414) Java heap space OOM in test_cron_azure core

2025-03-03 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-37414: --- Description:   {code:java} Mar 03 05:22:14 java.lang.OutOfMemoryError: Java heap space Mar 03 05:22:

[jira] [Created] (FLINK-37414) Java heap space OOM in test_cron_azure core

2025-03-03 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-37414: -- Summary: Java heap space OOM in test_cron_azure core Key: FLINK-37414 URL: https://issues.apache.org/jira/browse/FLINK-37414 Project: Flink Issue Type: Bug

[jira] [Updated] (FLINK-37414) Java heap space OOM in test_cron_azure core

2025-03-03 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-37414: --- Affects Version/s: 2.0.0 2.1.0 > Java heap space OOM in test_cron_azure core

[jira] [Updated] (FLINK-37414) Java heap space OOM in test_cron_azure core

2025-03-03 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-37414: --- Description:   {code:java} Mar 03 05:22:14 java.lang.OutOfMemoryError: Java heap space Mar 03 05:22:

Re: [PR] [FLINK-37379][state/forst] Double list LRU in ForSt state and cache reload [flink]

2025-03-03 Thread via GitHub
fredia commented on code in PR #26237: URL: https://github.com/apache/flink/pull/26237#discussion_r1978510149 ## flink-state-backends/flink-statebackend-forst/src/main/java/org/apache/flink/state/forst/fs/cache/CachedDataOutputStream.java: ## @@ -64,58 +66,80 @@ public CachedDat

Re: [PR] [hotfix][tests] Use Junit5 import in FileSinkTest. [flink]

2025-03-03 Thread via GitHub
slfan1989 commented on PR #26193: URL: https://github.com/apache/flink/pull/26193#issuecomment-2696031316 > Please also change commit name and PR description. > I'm pretty sure you're not going to change to junit5 everywhere in Flink within this PR, > in this case current name is wrong

[PR] Add Flink 2.0.0 release [flink-web]

2025-03-03 Thread via GitHub
xintongsong opened a new pull request, #777: URL: https://github.com/apache/flink-web/pull/777 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

Re: [PR] [FLINK-37379][state/forst] Double list LRU in ForSt state and cache reload [flink]

2025-03-03 Thread via GitHub
Zakelly commented on code in PR #26237: URL: https://github.com/apache/flink/pull/26237#discussion_r1978519401 ## flink-state-backends/flink-statebackend-forst/src/main/java/org/apache/flink/state/forst/fs/cache/CachedDataOutputStream.java: ## @@ -64,58 +66,80 @@ public CachedDa

Re: [PR] [FLINK-37379][state/forst] Double list LRU in ForSt state and cache reload [flink]

2025-03-03 Thread via GitHub
fredia commented on code in PR #26237: URL: https://github.com/apache/flink/pull/26237#discussion_r1978538199 ## flink-state-backends/flink-statebackend-forst/src/main/java/org/apache/flink/state/forst/fs/cache/CachedDataOutputStream.java: ## @@ -64,58 +66,80 @@ public CachedDat

Re: [PR] [FLINK-37386] Emit CreateTableEvent only when met the related SourceRecord. [flink-cdc]

2025-03-03 Thread via GitHub
yuxiqian commented on code in PR #3932: URL: https://github.com/apache/flink-cdc/pull/3932#discussion_r1978539251 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-mysql/src/main/java/org/apache/flink/cdc/connectors/mysql/source/reader/MySqlPipelineRecordEm

Re: [PR] [FLINK-37379][state/forst] Double list LRU in ForSt state and cache reload [flink]

2025-03-03 Thread via GitHub
fredia commented on PR #26237: URL: https://github.com/apache/flink/pull/26237#issuecomment-2696072001 Thanks for the update, `ForStFlinkFileSystemTest#testSstFileInCache ` failed because we reserved the space. The design and implementation are fine for me. -- This is an automated mess

Re: [PR] [FLINK-34558][state] Support tracking state size [flink]

2025-03-03 Thread via GitHub
hejufang commented on PR #25837: URL: https://github.com/apache/flink/pull/25837#issuecomment-2696066319 @Zakelly @masteryhx Could you please take a look when you have time? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub an

Re: [PR] [FLINK-36203][Connectors/DynamoDB] Added polling delay between getrecords calls [flink-connector-aws]

2025-03-03 Thread via GitHub
gguptp commented on PR #190: URL: https://github.com/apache/flink-connector-aws/pull/190#issuecomment-2696094301 @hlteoh37 i have addressed the comments and updated the PR. Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

[jira] [Assigned] (FLINK-35810) OOM in AsyncWaitOperatorTest.testProcessingTimeRepeatedCompleteUnorderedWithRetry

2025-03-03 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo reassigned FLINK-35810: -- Assignee: Yunfeng Zhou (was: Weijie Guo) > OOM in > AsyncWaitOperatorTest.testProcessingTim

  1   2   >