Re: [PR] [FLINK-37204] Add missing StarRocks connector options for 1.2.10. [flink-cdc]

2025-03-03 Thread via GitHub
ChaomingZhangCN commented on code in PR #3883: URL: https://github.com/apache/flink-cdc/pull/3883#discussion_r1978689655 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-starrocks/src/main/java/org/apache/flink/cdc/connectors/starrocks/sink/StarRocksDataSi

[PR] [hotfix][tests] Fix MySQL test case failure in exact UTC timezone [flink-cdc]

2025-03-03 Thread via GitHub
yuxiqian opened a new pull request, #3936: URL: https://github.com/apache/flink-cdc/pull/3936 As noted in https://github.com/apache/flink-cdc/actions/runs/13623293435/job/38139886612?pr=3912, if JVM timezone is randomly set to GMT+0:00, it will be "smartly" converted to `"GMT"` (w/o offset

Re: [PR] [FLINK-37203] Alter table comment or column comment [flink-cdc]

2025-03-03 Thread via GitHub
ChaomingZhangCN commented on code in PR #3893: URL: https://github.com/apache/flink-cdc/pull/3893#discussion_r1978748419 ## flink-cdc-common/src/main/java/org/apache/flink/cdc/common/event/AlterTableCommentEvent.java: ## @@ -0,0 +1,89 @@ +/* + * Licensed to the Apache Software F

[jira] [Updated] (FLINK-37414) Java heap space OOM in test_cron_azure core

2025-03-03 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-37414: --- Affects Version/s: 1.20.1 > Java heap space OOM in test_cron_azure core > --

[jira] [Commented] (FLINK-35810) OOM in AsyncWaitOperatorTest.testProcessingTimeRepeatedCompleteUnorderedWithRetry

2025-03-03 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17932160#comment-17932160 ] Weijie Guo commented on FLINK-35810: Thanks [~yunfengzhou] for the careful investiga

Re: [PR] [FLINK-37203] Alter table comment or column comment [flink-cdc]

2025-03-03 Thread via GitHub
ChaomingZhangCN commented on code in PR #3893: URL: https://github.com/apache/flink-cdc/pull/3893#discussion_r1978701396 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-mysql/src/main/java/org/apache/flink/cdc/connectors/mysql/source/parser/CustomAlterTab

Re: [PR] [hotfix] make SplitFetcherManager honor job configuration [flink-connector-aws]

2025-03-03 Thread via GitHub
boring-cyborg[bot] commented on PR #192: URL: https://github.com/apache/flink-connector-aws/pull/192#issuecomment-2696348311 Thanks for opening this pull request! Please check out our contributing guidelines. (https://flink.apache.org/contributing/how-to-contribute.html) -- This is a

[PR] [hotfix] make SplitFetcherManager honor job configuration [flink-connector-aws]

2025-03-03 Thread via GitHub
lukaszkrawiec opened a new pull request, #192: URL: https://github.com/apache/flink-connector-aws/pull/192 ## Purpose of the change SplitFetcherManager relies on correct Configuration be passed to its constructor such that it can honor flink options such as - ALLOW_UNALIGNED_SOURC

[jira] [Closed] (FLINK-37038) [Release-2.0] Cross team testing

2025-03-03 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-37038. Resolution: Done > [Release-2.0] Cross team testing > > >

[jira] [Created] (FLINK-37415) [Release-2.0] Prepare RC1 release

2025-03-03 Thread Xintong Song (Jira)
Xintong Song created FLINK-37415: Summary: [Release-2.0] Prepare RC1 release Key: FLINK-37415 URL: https://issues.apache.org/jira/browse/FLINK-37415 Project: Flink Issue Type: Sub-task

[jira] [Closed] (FLINK-37035) [Release-2.0] Create a release branch

2025-03-03 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-37035. Resolution: Done > [Release-2.0] Create a release branch > --

[jira] [Closed] (FLINK-37036) [Release-2.0] Prepare RC0 release

2025-03-03 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-37036. Resolution: Done > [Release-2.0] Prepare RC0 release > - > >

[jira] [Updated] (FLINK-35810) OOM in AsyncWaitOperatorTest.testProcessingTimeRepeatedCompleteUnorderedWithRetry

2025-03-03 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-35810: --- Priority: Critical (was: Blocker) > OOM in > AsyncWaitOperatorTest.testProcessingTimeRepeatedCompl

[jira] [Closed] (FLINK-37034) [Release-2.0] Select executing Release Manager

2025-03-03 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-37034. Resolution: Done > [Release-2.0] Select executing Release Manager > -

[jira] [Updated] (FLINK-3154) Update Kryo version from 2.24.0 to latest Kryo LTS version

2025-03-03 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-3154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song updated FLINK-3154: Priority: Blocker (was: Not a Priority) > Update Kryo version from 2.24.0 to latest Kryo LTS versi

[jira] [Updated] (FLINK-3154) Update Kryo version from 2.24.0 to latest Kryo LTS version

2025-03-03 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-3154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song updated FLINK-3154: Fix Version/s: 2.0.0 > Update Kryo version from 2.24.0 to latest Kryo LTS version > ---

[jira] [Commented] (FLINK-37414) Java heap space OOM in test_cron_azure core

2025-03-03 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17932159#comment-17932159 ] Weijie Guo commented on FLINK-37414: Looking at the history, this has existed at lea

[jira] [Updated] (FLINK-37379) Lack of state cache load for ForSt after recovery

2025-03-03 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song updated FLINK-37379: - Fix Version/s: 2.0.0 > Lack of state cache load for ForSt after recovery > -

[jira] [Closed] (FLINK-36437) Hive connector failed to compile with JDK 11

2025-03-03 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo closed FLINK-36437. -- Resolution: Not A Problem > Hive connector failed to compile with JDK 11 > ---

[jira] [Updated] (FLINK-36437) Hive connector failed to compile with JDK 11

2025-03-03 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-36437: --- Priority: Critical (was: Blocker) > Hive connector failed to compile with JDK 11 >

[jira] [Updated] (FLINK-37414) Java heap space OOM in test_cron_azure core

2025-03-03 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-37414: --- Description:   {code:java} Mar 03 05:22:14 java.lang.OutOfMemoryError: Java heap space Mar 03 05:22:

[jira] [Updated] (FLINK-37414) Java heap space OOM in test_cron_azure core

2025-03-03 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-37414: --- Affects Version/s: 2.0.0 2.1.0 > Java heap space OOM in test_cron_azure core

[jira] [Created] (FLINK-37414) Java heap space OOM in test_cron_azure core

2025-03-03 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-37414: -- Summary: Java heap space OOM in test_cron_azure core Key: FLINK-37414 URL: https://issues.apache.org/jira/browse/FLINK-37414 Project: Flink Issue Type: Bug

[jira] [Updated] (FLINK-37414) Java heap space OOM in test_cron_azure core

2025-03-03 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-37414: --- Description:   {code:java} Mar 03 05:22:14 java.lang.OutOfMemoryError: Java heap space Mar 03 05:22:

[jira] [Closed] (FLINK-37043) [Umbrella] Test Flink Release 2.0

2025-03-03 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-37043. Resolution: Done > [Umbrella] Test Flink Release 2.0 > - > >

Re: [PR] [FLINK-35810] Fix AsyncWaitOperatorTest missing endInput bug [flink]

2025-03-03 Thread via GitHub
flinkbot commented on PR #26242: URL: https://github.com/apache/flink/pull/26242#issuecomment-2696197701 ## CI report: * 28f55fee43f26ebf2473a534bbda2dc638b58e84 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-37403] Convert interval join to regular join for updating source [flink]

2025-03-03 Thread via GitHub
bvarghese1 commented on code in PR #26230: URL: https://github.com/apache/flink/pull/26230#discussion_r1978609329 ## flink-table/flink-table-planner/src/main/scala/org/apache/flink/table/planner/plan/optimize/program/FlinkChangelogModeInferenceProgram.scala: ## @@ -287,6 +287,39

Re: [PR] [FLINK-37403] Convert interval join to regular join for updating source [flink]

2025-03-03 Thread via GitHub
bvarghese1 commented on code in PR #26230: URL: https://github.com/apache/flink/pull/26230#discussion_r1978609329 ## flink-table/flink-table-planner/src/main/scala/org/apache/flink/table/planner/plan/optimize/program/FlinkChangelogModeInferenceProgram.scala: ## @@ -287,6 +287,39

Re: [PR] [FLINK-37403] Convert interval join to regular join for updating source [flink]

2025-03-03 Thread via GitHub
bvarghese1 commented on code in PR #26230: URL: https://github.com/apache/flink/pull/26230#discussion_r1978608886 ## flink-table/flink-table-planner/src/main/scala/org/apache/flink/table/planner/plan/optimize/program/FlinkChangelogModeInferenceProgram.scala: ## @@ -287,6 +287,39

[PR] [FLINK-35810] Fix AsyncWaitOperatorTest missing endInput bug [flink]

2025-03-03 Thread via GitHub
yunfengzhou-hub opened a new pull request, #26242: URL: https://github.com/apache/flink/pull/26242 ## What is the purpose of the change This PR fixes the bug that AsyncWaitOperator might be triggering mailboxExecutor.execute() after the mailbox has been quiesced in AsyncWaitOperatorT

Re: [PR] [FLINK-3154][API] Upgrade from Kryo 2.x to Kryo 5.x. Removed twitter … [flink]

2025-03-03 Thread via GitHub
kurtostfeld commented on PR #25896: URL: https://github.com/apache/flink/pull/25896#issuecomment-2696147722 @gyfora I've rewritten the Avro GenericRecord Kryo serializer and the Avro GenericData.Array serializer. Avro is also a serialization library, so the Kryo serializers just basically w

Re: [PR] [FLINK-3154][API] Upgrade from Kryo 2.x to Kryo 5.x. Removed twitter … [flink]

2025-03-03 Thread via GitHub
kurtostfeld commented on code in PR #25896: URL: https://github.com/apache/flink/pull/25896#discussion_r1978578476 ## flink-formats/flink-avro/src/main/java/org/apache/flink/formats/avro/utils/AvroKryoSerializerUtils.java: ## @@ -106,11 +105,55 @@ public void write(Kryo kryo, Ou

Re: [PR] [FLINK-3154][API] Upgrade from Kryo 2.x to Kryo 5.x. Removed twitter … [flink]

2025-03-03 Thread via GitHub
kurtostfeld commented on code in PR #25896: URL: https://github.com/apache/flink/pull/25896#discussion_r1978576867 ## flink-formats/flink-avro/src/main/java/org/apache/flink/formats/avro/utils/AvroKryoSerializerUtils.java: ## @@ -106,11 +105,55 @@ public void write(Kryo kryo, Ou

[jira] [Commented] (FLINK-35810) OOM in AsyncWaitOperatorTest.testProcessingTimeRepeatedCompleteUnorderedWithRetry

2025-03-03 Thread Yunfeng Zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17932145#comment-17932145 ] Yunfeng Zhou commented on FLINK-35810: -- Hi all, I reproduced the bug locally and ra

[jira] [Assigned] (FLINK-35810) OOM in AsyncWaitOperatorTest.testProcessingTimeRepeatedCompleteUnorderedWithRetry

2025-03-03 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo reassigned FLINK-35810: -- Assignee: Yunfeng Zhou (was: Weijie Guo) > OOM in > AsyncWaitOperatorTest.testProcessingTim

Re: [PR] [FLINK-35810] Fix AsyncWaitOperatorTest missing endInput bug [flink]

2025-03-03 Thread via GitHub
flinkbot commented on PR #26241: URL: https://github.com/apache/flink/pull/26241#issuecomment-2696127884 ## CI report: * e340d6112bf22608eefd16a4341b91f2d5683835 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[PR] [FLINK-35810] Fix AsyncWaitOperatorTest missing endInput bug [flink]

2025-03-03 Thread via GitHub
yunfengzhou-hub opened a new pull request, #26241: URL: https://github.com/apache/flink/pull/26241 ## What is the purpose of the change This PR fixes the bug that AsyncWaitOperator might be triggering mailboxExecutor.execute() after the mailbox has been quiesced in AsyncWaitOperatorT

Re: [PR] [FLINK-36203][Connectors/DynamoDB] Added polling delay between getrecords calls [flink-connector-aws]

2025-03-03 Thread via GitHub
gguptp commented on PR #190: URL: https://github.com/apache/flink-connector-aws/pull/190#issuecomment-2696094301 @hlteoh37 i have addressed the comments and updated the PR. Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

Re: [PR] [FLINK-37379][state/forst] Double list LRU in ForSt state and cache reload [flink]

2025-03-03 Thread via GitHub
fredia commented on PR #26237: URL: https://github.com/apache/flink/pull/26237#issuecomment-2696072001 Thanks for the update, `ForStFlinkFileSystemTest#testSstFileInCache ` failed because we reserved the space. The design and implementation are fine for me. -- This is an automated mess

Re: [PR] [FLINK-37386] Emit CreateTableEvent only when met the related SourceRecord. [flink-cdc]

2025-03-03 Thread via GitHub
yuxiqian commented on code in PR #3932: URL: https://github.com/apache/flink-cdc/pull/3932#discussion_r1978539251 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-mysql/src/main/java/org/apache/flink/cdc/connectors/mysql/source/reader/MySqlPipelineRecordEm

Re: [PR] [FLINK-37379][state/forst] Double list LRU in ForSt state and cache reload [flink]

2025-03-03 Thread via GitHub
fredia commented on code in PR #26237: URL: https://github.com/apache/flink/pull/26237#discussion_r1978538199 ## flink-state-backends/flink-statebackend-forst/src/main/java/org/apache/flink/state/forst/fs/cache/CachedDataOutputStream.java: ## @@ -64,58 +66,80 @@ public CachedDat

Re: [PR] [FLINK-34558][state] Support tracking state size [flink]

2025-03-03 Thread via GitHub
hejufang commented on PR #25837: URL: https://github.com/apache/flink/pull/25837#issuecomment-2696066319 @Zakelly @masteryhx Could you please take a look when you have time? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub an

[PR] Add Flink 2.0.0 release [flink-web]

2025-03-03 Thread via GitHub
xintongsong opened a new pull request, #777: URL: https://github.com/apache/flink-web/pull/777 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

Re: [PR] [FLINK-37379][state/forst] Double list LRU in ForSt state and cache reload [flink]

2025-03-03 Thread via GitHub
Zakelly commented on code in PR #26237: URL: https://github.com/apache/flink/pull/26237#discussion_r1978519401 ## flink-state-backends/flink-statebackend-forst/src/main/java/org/apache/flink/state/forst/fs/cache/CachedDataOutputStream.java: ## @@ -64,58 +66,80 @@ public CachedDa

Re: [PR] [hotfix][tests] Use Junit5 import in FileSinkTest. [flink]

2025-03-03 Thread via GitHub
slfan1989 commented on PR #26193: URL: https://github.com/apache/flink/pull/26193#issuecomment-2696031316 > Please also change commit name and PR description. > I'm pretty sure you're not going to change to junit5 everywhere in Flink within this PR, > in this case current name is wrong

Re: [PR] [FLINK-37379][state/forst] Double list LRU in ForSt state and cache reload [flink]

2025-03-03 Thread via GitHub
fredia commented on code in PR #26237: URL: https://github.com/apache/flink/pull/26237#discussion_r1978510149 ## flink-state-backends/flink-statebackend-forst/src/main/java/org/apache/flink/state/forst/fs/cache/CachedDataOutputStream.java: ## @@ -64,58 +66,80 @@ public CachedDat

Re: [PR] [FLINK-3154][API] Upgrade from Kryo 2.x to Kryo 5.x. Removed twitter … [flink]

2025-03-03 Thread via GitHub
kurtostfeld commented on code in PR #25896: URL: https://github.com/apache/flink/pull/25896#discussion_r1978482869 ## flink-formats/flink-avro/src/main/java/org/apache/flink/formats/avro/utils/AvroKryoSerializerUtils.java: ## @@ -106,11 +105,55 @@ public void write(Kryo kryo, Ou

Re: [PR] [FLINK-3154][API] Upgrade from Kryo 2.x to Kryo 5.x. Removed twitter … [flink]

2025-03-03 Thread via GitHub
kurtostfeld commented on code in PR #25896: URL: https://github.com/apache/flink/pull/25896#discussion_r1978477882 ## flink-formats/flink-avro/src/main/java/org/apache/flink/formats/avro/utils/AvroKryoSerializerUtils.java: ## @@ -106,11 +105,55 @@ public void write(Kryo kryo, Ou

[jira] [Commented] (FLINK-37412) Add slot allocation strategy to for selecting TMs first that have already slots assigned

2025-03-03 Thread Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17932121#comment-17932121 ] Liu commented on FLINK-37412: - Hello, [~mapohl]. I would like to implement it. Can you assig

[jira] [Updated] (FLINK-37410) [FLIP-513] Split-level Watermark Metrics

2025-03-03 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-37410: --- Summary: [FLIP-513] Split-level Watermark Metrics (was: Split-level Watermark Metrics) > [

Re: [PR] [FLINK-36855] Source API implementation [flink-connector-kudu]

2025-03-03 Thread via GitHub
martongreber commented on code in PR #8: URL: https://github.com/apache/flink-connector-kudu/pull/8#discussion_r1977735111 ## flink-connector-kudu/src/test/java/org/apache/flink/connector/kudu/testutils/KuduSourceITBase.java: ## @@ -0,0 +1,36 @@ +/* + * Licensed to the Apache S

[jira] [Assigned] (FLINK-37407) Add meta information to SQL state connector

2025-03-03 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi reassigned FLINK-37407: - Assignee: Gabor Somogyi > Add meta information to SQL state connector > ---

Re: [PR] [FLINK-36203][Connectors/DynamoDB] Added polling delay between getrecords calls [flink-connector-aws]

2025-03-03 Thread via GitHub
gguptp commented on code in PR #190: URL: https://github.com/apache/flink-connector-aws/pull/190#discussion_r1977899145 ## flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/source/DynamoDbStreamsSource.java: ## @@ -133,13 +135,20 @@

Re: [PR] [FLINK-36203][Connectors/DynamoDB] Added polling delay between getrecords calls [flink-connector-aws]

2025-03-03 Thread via GitHub
gguptp commented on code in PR #190: URL: https://github.com/apache/flink-connector-aws/pull/190#discussion_r1977896339 ## flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/source/reader/PollingDynamoDbStreamsShardSplitReader.java: #

Re: [PR] [FLINK-36203][Connectors/DynamoDB] Added polling delay between getrecords calls [flink-connector-aws]

2025-03-03 Thread via GitHub
gguptp commented on code in PR #190: URL: https://github.com/apache/flink-connector-aws/pull/190#discussion_r1977896339 ## flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/source/reader/PollingDynamoDbStreamsShardSplitReader.java: #

Re: [PR] [FLINK-36203][Connectors/DynamoDB] Added polling delay between getrecords calls [flink-connector-aws]

2025-03-03 Thread via GitHub
gguptp commented on code in PR #190: URL: https://github.com/apache/flink-connector-aws/pull/190#discussion_r1977895665 ## flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/source/config/DynamodbStreamsSourceConfigConstants.java: ##

Re: [PR] [cdc-connector][sqlserver]Flink cdc pipeline support sqlserver source [flink-cdc]

2025-03-03 Thread via GitHub
arielmoraes commented on PR #3445: URL: https://github.com/apache/flink-cdc/pull/3445#issuecomment-2695018809 Is there any news on this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

Re: [PR] SQL Server CDC support - fixing the issues in the outstanding pull request by another author [flink-cdc]

2025-03-03 Thread via GitHub
arielmoraes commented on PR #3507: URL: https://github.com/apache/flink-cdc/pull/3507#issuecomment-2695015536 Can we reopen this? It's a much required connector. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [FLINK-36203][Connectors/DynamoDB] Added polling delay between getrecords calls [flink-connector-aws]

2025-03-03 Thread via GitHub
gguptp commented on code in PR #190: URL: https://github.com/apache/flink-connector-aws/pull/190#discussion_r1977840254 ## flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/source/config/DynamodbStreamsSourceConfigConstants.java: ##

Re: [PR] [FLINK-36203][Connectors/DynamoDB] Added polling delay between getrecords calls [flink-connector-aws]

2025-03-03 Thread via GitHub
gguptp commented on code in PR #190: URL: https://github.com/apache/flink-connector-aws/pull/190#discussion_r1977838611 ## flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/source/reader/PollingDynamoDbStreamsShardSplitReader.java: #

Re: [PR] [FLINK-36203][Connectors/DynamoDB] Added polling delay between getrecords calls [flink-connector-aws]

2025-03-03 Thread via GitHub
gguptp commented on code in PR #190: URL: https://github.com/apache/flink-connector-aws/pull/190#discussion_r1977837807 ## flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/source/reader/PollingDynamoDbStreamsShardSplitReader.java: #

Re: [PR] [FLINK-36203][Connectors/DynamoDB] Added polling delay between getrecords calls [flink-connector-aws]

2025-03-03 Thread via GitHub
gguptp commented on code in PR #190: URL: https://github.com/apache/flink-connector-aws/pull/190#discussion_r1977837166 ## flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/source/reader/PollingDynamoDbStreamsShardSplitReader.java: #

Re: [PR] [FLINK-36855] Source API implementation [flink-connector-kudu]

2025-03-03 Thread via GitHub
martongreber commented on code in PR #8: URL: https://github.com/apache/flink-connector-kudu/pull/8#discussion_r1977732794 ## flink-connector-kudu/src/main/java/org/apache/flink/connector/kudu/source/reader/KuduSourceReader.java: ## @@ -0,0 +1,70 @@ +/* + * Licensed to the Apac

Re: [PR] [FLINK-36855] Source API implementation [flink-connector-kudu]

2025-03-03 Thread via GitHub
martongreber commented on code in PR #8: URL: https://github.com/apache/flink-connector-kudu/pull/8#discussion_r1977734299 ## flink-connector-kudu/src/main/java/org/apache/flink/connector/kudu/source/KuduSource.java: ## @@ -0,0 +1,130 @@ +/* + * Licensed to the Apache Software

Re: [PR] [FLINK-36855] Source API implementation [flink-connector-kudu]

2025-03-03 Thread via GitHub
martongreber commented on code in PR #8: URL: https://github.com/apache/flink-connector-kudu/pull/8#discussion_r1977733939 ## flink-connector-kudu/src/main/java/org/apache/flink/connector/kudu/source/reader/KuduSourceReader.java: ## @@ -0,0 +1,70 @@ +/* + * Licensed to the Apac

Re: [PR] [FLINK-36855] Source API implementation [flink-connector-kudu]

2025-03-03 Thread via GitHub
martongreber commented on code in PR #8: URL: https://github.com/apache/flink-connector-kudu/pull/8#discussion_r1977733401 ## flink-connector-kudu/src/main/java/org/apache/flink/connector/kudu/source/reader/KuduSourceReader.java: ## @@ -0,0 +1,70 @@ +/* + * Licensed to the Apac

Re: [PR] [FLINK-36855] Source API implementation [flink-connector-kudu]

2025-03-03 Thread via GitHub
martongreber commented on code in PR #8: URL: https://github.com/apache/flink-connector-kudu/pull/8#discussion_r1977726108 ## flink-connector-kudu/src/main/java/org/apache/flink/connector/kudu/source/enumerator/KuduSourceEnumerator.java: ## @@ -0,0 +1,256 @@ +/* + * Licensed to

Re: [PR] [FLINK-36855] Source API implementation [flink-connector-kudu]

2025-03-03 Thread via GitHub
martongreber commented on code in PR #8: URL: https://github.com/apache/flink-connector-kudu/pull/8#discussion_r1977724995 ## flink-connector-kudu/src/main/java/org/apache/flink/connector/kudu/source/enumerator/KuduSourceEnumerator.java: ## @@ -0,0 +1,256 @@ +/* + * Licensed to

Re: [PR] [FLINK-36855] Source API implementation [flink-connector-kudu]

2025-03-03 Thread via GitHub
martongreber commented on code in PR #8: URL: https://github.com/apache/flink-connector-kudu/pull/8#discussion_r1977724631 ## flink-connector-kudu/src/main/java/org/apache/flink/connector/kudu/source/enumerator/KuduSourceEnumerator.java: ## @@ -0,0 +1,256 @@ +/* + * Licensed to

Re: [PR] [FLINK-36855] Source API implementation [flink-connector-kudu]

2025-03-03 Thread via GitHub
martongreber commented on code in PR #8: URL: https://github.com/apache/flink-connector-kudu/pull/8#discussion_r1977721833 ## flink-connector-kudu/pom.xml: ## @@ -64,11 +69,22 @@ under the License. flink-table-runtime +

Re: [PR] [FLINK-36855] Source API implementation [flink-connector-kudu]

2025-03-03 Thread via GitHub
martongreber commented on code in PR #8: URL: https://github.com/apache/flink-connector-kudu/pull/8#discussion_r1977722483 ## flink-connector-kudu/src/main/java/org/apache/flink/connector/kudu/source/config/ContinuousBoundingSettings.java: ## @@ -0,0 +1,81 @@ +/* + * Licensed t

[jira] [Assigned] (FLINK-37410) Split-level Watermark Metrics

2025-03-03 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-37410: -- Assignee: Efrat Levitan > Split-level Watermark Metrics > ---

[jira] [Updated] (FLINK-37413) Introduce append-only RowTimeDeduplicateFunction with Async State API

2025-03-03 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-37413: --- Reporter: Piotr Nowojski (was: Xuyang Zhong) > Introduce append-only RowTimeDeduplicateFunc

Re: [PR] Kubernetes Operator 1.11.0 release [flink-web]

2025-03-03 Thread via GitHub
gyfora merged PR #775: URL: https://github.com/apache/flink-web/pull/775 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache

Re: [PR] [FLINK-37379][state/forst] Double list LRU in ForSt state and cache reload [flink]

2025-03-03 Thread via GitHub
Zakelly commented on PR #26237: URL: https://github.com/apache/flink/pull/26237#issuecomment-2694631063 Also, additional two commits to enhance the user experience are attached. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [PR] [FLINK-36652] Upgrade Apache ORC Version to 1.9.4 [flink]

2025-03-03 Thread via GitHub
snuyanzin commented on PR #26195: URL: https://github.com/apache/flink/pull/26195#issuecomment-2694417557 we need to have the PR rebased (not merge only) Currently if you open commit history for this PR there is a merge commit which is a no go. Need to rebase first to eliminate it --

[jira] [Closed] (FLINK-37402) SQL testing sources produce incorrect watermarks

2025-03-03 Thread Timo Walther (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timo Walther closed FLINK-37402. Fix Version/s: 2.1.0 Resolution: Fixed Fixed in master: d5ffb88df4d033b357a72a3def6d45ebc80

Re: [PR] [FLINK-36652] Upgrade Apache ORC Version to 1.9.4 [flink]

2025-03-03 Thread via GitHub
dyccode commented on PR #26195: URL: https://github.com/apache/flink/pull/26195#issuecomment-2694402812 > Failing CI @davidradl I'm sorry for not noticing this issue in a timely manner. I have now resolved it -- This is an automated message from the Apache Git Service. To respond t

Re: [PR] [FLINK-37402][table] Emit watermarks after record in TestSourceFunction and TestValuesRuntimeFunctions [flink]

2025-03-03 Thread via GitHub
twalthr merged PR #26236: URL: https://github.com/apache/flink/pull/26236 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apach

[jira] [Assigned] (FLINK-37413) Introduce append-only RowTimeDeduplicateFunction with Async State API

2025-03-03 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-37413: -- Assignee: (was: Xuyang Zhong) > Introduce append-only RowTimeDeduplicateFunction

[jira] [Commented] (FLINK-37413) Introduce append-only RowTimeDeduplicateFunction with Async State API

2025-03-03 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17931962#comment-17931962 ] Piotr Nowojski commented on FLINK-37413: FLINK-37005 introduced the sync only ve

[jira] [Created] (FLINK-37413) Introduce append-only RowTimeDeduplicateFunction with Async State API

2025-03-03 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-37413: -- Summary: Introduce append-only RowTimeDeduplicateFunction with Async State API Key: FLINK-37413 URL: https://issues.apache.org/jira/browse/FLINK-37413 Project: Fl

Re: [PR] [hotfix][tests] Use Junit5 import. [flink]

2025-03-03 Thread via GitHub
snuyanzin commented on code in PR #26193: URL: https://github.com/apache/flink/pull/26193#discussion_r1977502632 ## flink-connectors/flink-connector-files/src/test/java/org/apache/flink/connector/file/sink/FileSinkTest.java: ## @@ -41,6 +41,6 @@ public void testCreateFileWriterW

Re: [PR] [hotfix][tests] Use Junit5 import. [flink]

2025-03-03 Thread via GitHub
snuyanzin commented on code in PR #26193: URL: https://github.com/apache/flink/pull/26193#discussion_r1977501988 ## flink-connectors/flink-connector-files/src/test/java/org/apache/flink/connector/file/sink/FileSinkTest.java: ## @@ -23,11 +23,11 @@ import org.apache.flink.conne

[jira] [Commented] (FLINK-36673) Operator is not properly handling failed deployments without savepoints

2025-03-03 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17931954#comment-17931954 ] Gyula Fora commented on FLINK-36673: [~alnzng] 1.11.0 was released today , it will s

Re: [PR] [FLINK-37005][table] Make StreamExecDeduplicate ouput insert only where possible [flink]

2025-03-03 Thread via GitHub
pnowojski commented on PR #26051: URL: https://github.com/apache/flink/pull/26051#issuecomment-2693914171 Thanks for the reviews. Everything is finally green. Sorry for the delay, but I had to deal with some other things in the mean time. -- This is an automated message from the Apache Gi

[jira] [Closed] (FLINK-36673) Operator is not properly handling failed deployments without savepoints

2025-03-03 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora closed FLINK-36673. -- Fix Version/s: kubernetes-operator-1.11.0 Resolution: Fixed > Operator is not properly handling

Re: [PR] [FLINK-37203] Alter table comment or column comment [flink-cdc]

2025-03-03 Thread via GitHub
lvyanquan commented on code in PR #3893: URL: https://github.com/apache/flink-cdc/pull/3893#discussion_r1977159664 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-mysql/src/main/java/org/apache/flink/cdc/connectors/mysql/source/parser/CustomAlterTablePars

[jira] [Commented] (FLINK-37411) Introduce the rollback mechanism for Autoscaler

2025-03-03 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17931941#comment-17931941 ] Gyula Fora commented on FLINK-37411: It feels like this rollback mechanism should be

Re: [PR] [FLINK-37380] Change TransactionalIdPrefix to a required option if Exactly once [flink-connector-kafka]

2025-03-03 Thread via GitHub
loserwang1024 commented on PR #156: URL: https://github.com/apache/flink-connector-kafka/pull/156#issuecomment-2694108513 > Did you check if documentation (for SQL) reflects that this is a required property? https://github.com/user-attachments/assets/3e0aa060-32cc-4f70-9472-7f6b1439f

Re: [PR] [FLINK-37352] Write full changelog to PaimonSink. [flink-cdc]

2025-03-03 Thread via GitHub
lvyanquan commented on PR #3935: URL: https://github.com/apache/flink-cdc/pull/3935#issuecomment-2694009083 @MOBIN-F PTAL as you are familiar with Paimon connector. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

[jira] [Updated] (FLINK-37352) Write full changelog to Paimon Sink.

2025-03-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-37352: --- Labels: pull-request-available (was: ) > Write full changelog to Paimon Sink. > ---

[jira] [Created] (FLINK-37412) Add slot allocation strategy to for selecting TMs first that have already slots assigned

2025-03-03 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-37412: - Summary: Add slot allocation strategy to for selecting TMs first that have already slots assigned Key: FLINK-37412 URL: https://issues.apache.org/jira/browse/FLINK-37412

[jira] [Closed] (FLINK-37005) Make StreamExecDeduplicate ouput insert only where possible

2025-03-03 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-37005. -- Fix Version/s: 2.1.0 Release Note: Newly submitted deduplication "keep first row" SQL que

Re: [PR] [FLINK-37005][table] Make StreamExecDeduplicate ouput insert only where possible [flink]

2025-03-03 Thread via GitHub
pnowojski merged PR #26051: URL: https://github.com/apache/flink/pull/26051 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apa

[jira] [Created] (FLINK-37411) Introduce the rollback mechanism for Autoscaler

2025-03-03 Thread Rui Fan (Jira)
Rui Fan created FLINK-37411: --- Summary: Introduce the rollback mechanism for Autoscaler Key: FLINK-37411 URL: https://issues.apache.org/jira/browse/FLINK-37411 Project: Flink Issue Type: New Featur

Re: [PR] [FLINK-29549]- Flink Glue Catalog integration [flink-connector-aws]

2025-03-03 Thread via GitHub
boring-cyborg[bot] commented on PR #191: URL: https://github.com/apache/flink-connector-aws/pull/191#issuecomment-2693884736 Thanks for opening this pull request! Please check out our contributing guidelines. (https://flink.apache.org/contributing/how-to-contribute.html) -- This is a

[PR] [FLINK-29549]- Flink Glue Catalog integration [flink-connector-aws]

2025-03-03 Thread via GitHub
FranMorilloAWS opened a new pull request, #191: URL: https://github.com/apache/flink-connector-aws/pull/191 ## Purpose of the change *For example: Implements the Table API for the Kinesis Source.* ## Verifying this change Please make sure both new and modified tes

Re: [PR] Update table_api.md with modern Docker Compose syntax [flink]

2025-03-03 Thread via GitHub
nilmadhab closed pull request #26235: Update table_api.md with modern Docker Compose syntax URL: https://github.com/apache/flink/pull/26235 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

Re: [PR] Update table_api.md with modern Docker Compose syntax [flink]

2025-03-03 Thread via GitHub
nilmadhab commented on PR #26235: URL: https://github.com/apache/flink/pull/26235#issuecomment-2693854941 > do we still need this PR if another PR was raised an this one is based on 1.16 which is not supported anymore? Yes this can be closed. Closing now -- This is an automated mes

  1   2   >