[jira] [Created] (FLINK-37622) Exactly once Kafka sink does not produce any records in batch mode

2025-04-07 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-37622: --- Summary: Exactly once Kafka sink does not produce any records in batch mode Key: FLINK-37622 URL: https://issues.apache.org/jira/browse/FLINK-37622 Project: Flink

[jira] [Assigned] (FLINK-36648) Release flink-connector-kafka v4.0.0 for Flink 2.0

2025-04-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise reassigned FLINK-36648: --- Assignee: Arvid Heise (was: Yanquan Lv) > Release flink-connector-kafka v4.0.0 for Flink 2

Re: [PR] [hotfix] fix ci failure due to code style [flink-cdc]

2025-04-07 Thread via GitHub
MOBIN-F commented on PR #3980: URL: https://github.com/apache/flink-cdc/pull/3980#issuecomment-2785142817 ci failed. I'll check again later -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

Re: [PR] [FLINK-36684][cdc-connector][mysql] Support read changelog as append only mode [flink-cdc]

2025-04-07 Thread via GitHub
ruanhang1993 commented on code in PR #3708: URL: https://github.com/apache/flink-cdc/pull/3708#discussion_r2032439969 ## docs/content/docs/connectors/flink-sources/mysql-cdc.md: ## @@ -426,6 +426,19 @@ During a snapshot operation, the connector will query each included table to

Re: [PR] [FLINK-36456] [Runtime/Configuration] Improve Security in DatadogHttpReporterFactory by providing ENV alternative to retrieve API key [flink]

2025-04-07 Thread via GitHub
github-actions[bot] commented on PR #25470: URL: https://github.com/apache/flink/pull/25470#issuecomment-2785362064 This PR is being marked as stale since it has not had any activity in the last 90 days. If you would like to keep this PR alive, please leave a comment asking for a review

Re: [PR] Add timestamp_mapping.legacy option to avro filesystem and avro-confluent format [flink]

2025-04-07 Thread via GitHub
github-actions[bot] commented on PR #25439: URL: https://github.com/apache/flink/pull/25439#issuecomment-2785361786 This PR is being marked as stale since it has not had any activity in the last 90 days. If you would like to keep this PR alive, please leave a comment asking for a review

Re: [PR] [runtime-web] chore: update Angular to v15 [flink]

2025-04-07 Thread via GitHub
github-actions[bot] commented on PR #25450: URL: https://github.com/apache/flink/pull/25450#issuecomment-2785361905 This PR is being marked as stale since it has not had any activity in the last 90 days. If you would like to keep this PR alive, please leave a comment asking for a review

Re: [PR] Updated readme with stream-processing [flink]

2025-04-07 Thread via GitHub
github-actions[bot] commented on PR #25455: URL: https://github.com/apache/flink/pull/25455#issuecomment-2785361975 This PR is being marked as stale since it has not had any activity in the last 90 days. If you would like to keep this PR alive, please leave a comment asking for a review

[PR] [FLINK-37628] Fix reference counting in ForSt file cache [flink]

2025-04-07 Thread via GitHub
Zakelly opened a new pull request, #26415: URL: https://github.com/apache/flink/pull/26415 ## What is the purpose of the change There is a concurrency issue for reference counting in ForSt file cache, which could lead to a read error in some special scenarios (e.g. extremely frequent

[PR] [hotfix] Rename registeredSlots to allocatedSlots [flink]

2025-04-07 Thread via GitHub
beliefer opened a new pull request, #26417: URL: https://github.com/apache/flink/pull/26417 ## What is the purpose of the change This PR aims to improve the readability of `DefaultAllocatedSlotPool`. The original name `registeredSlots` can't tell developers any useful information.

[jira] [Updated] (FLINK-37553) Make ForStKeyedStateBackend consider namespaceSerializer compatibility when restoring state

2025-04-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-37553: --- Labels: pull-request-available (was: ) > Make ForStKeyedStateBackend consider namespaceSeri

Re: [PR] [FLINK-37628] Fix reference counting in ForSt file cache [flink]

2025-04-07 Thread via GitHub
fredia commented on code in PR #26415: URL: https://github.com/apache/flink/pull/26415#discussion_r2032341068 ## flink-state-backends/flink-statebackend-forst/src/main/java/org/apache/flink/state/forst/fs/cache/CachedDataInputStream.java: ## @@ -102,62 +102,81 @@ private FSDataI

[PR] [FLINK-37553] Make ForStKeyedStateBackend update NamespaceSerializer during restoring state [flink]

2025-04-07 Thread via GitHub
mayuehappy opened a new pull request, #26416: URL: https://github.com/apache/flink/pull/26416 …during restoring state ## What is the purpose of the change Make ForStKeyedStateBackend update NamespaceSerializer during restoring state ## Brief change log

Re: [PR] [FLINK-37628] Fix reference counting in ForSt file cache [flink]

2025-04-07 Thread via GitHub
flinkbot commented on PR #26415: URL: https://github.com/apache/flink/pull/26415#issuecomment-2785105538 ## CI report: * 7b963ba791e89acf37bb95e08dcfdc724dee6624 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Assigned] (FLINK-37458) Forbid enableAsyncState() for synchronous operators

2025-04-07 Thread Yanfei Lei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanfei Lei reassigned FLINK-37458: -- Assignee: Yanfei Lei > Forbid enableAsyncState() for synchronous operators >

[jira] [Commented] (FLINK-37458) Forbid enableAsyncState() for synchronous operators

2025-04-07 Thread Yanfei Lei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17941759#comment-17941759 ] Yanfei Lei commented on FLINK-37458: Merged into release-2.0 via 14e85eced10e98bc758

[PR] [hotfix] fix ci failure due to code style [flink-cdc]

2025-04-07 Thread via GitHub
MOBIN-F opened a new pull request, #3980: URL: https://github.com/apache/flink-cdc/pull/3980 Code style verifier has been updated to JUnit 5 ![image](https://github.com/user-attachments/assets/316c7713-b6af-41a7-9efd-5850c9ac5f19) -- This is an automated message from the Apache Git

Re: [PR] [hotfix] fix ci failure due to code style [flink-cdc]

2025-04-07 Thread via GitHub
leonardBang commented on PR #3980: URL: https://github.com/apache/flink-cdc/pull/3980#issuecomment-2785104152 Thanks @MOBIN-F for the quickfix -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Updated] (FLINK-37628) Wrong reference counting in ForSt file cache

2025-04-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-37628: --- Labels: pull-request-available (was: ) > Wrong reference counting in ForSt file cache > ---

Re: [PR] [FLINK-37553] Make ForStKeyedStateBackend update NamespaceSerializer during restoring state [flink]

2025-04-07 Thread via GitHub
flinkbot commented on PR #26416: URL: https://github.com/apache/flink/pull/26416#issuecomment-2785176177 ## CI report: * 8f4cfd9ee17624cda10a40d69b8891bd1edd4593 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [hotfix] Rename registeredSlots to allocatedSlots [flink]

2025-04-07 Thread via GitHub
flinkbot commented on PR #26417: URL: https://github.com/apache/flink/pull/26417#issuecomment-2785177001 ## CI report: * 7fd9bfbbd3106b4c43f3f14d69c056550fa66aff UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [postgres] fix when backfill will scan all table schame which match config [flink-cdc]

2025-04-07 Thread via GitHub
hql0312 commented on PR #3979: URL: https://github.com/apache/flink-cdc/pull/3979#issuecomment-2785178413 > Please check the code style. @hql0312 ok,done -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

[PR] [hotfix] Unify the name for the collection of SlotOffer with slotOffers [flink]

2025-04-07 Thread via GitHub
beliefer opened a new pull request, #26418: URL: https://github.com/apache/flink/pull/26418 ## What is the purpose of the change This PR aims to unify the name for the collection of `SlotOffer`. Currently, there are two name of variable about collection of `SlotOffer`. One is `slot

Re: [PR] [FLINK-37628] Fix reference counting in ForSt file cache [flink]

2025-04-07 Thread via GitHub
Zakelly commented on code in PR #26415: URL: https://github.com/apache/flink/pull/26415#discussion_r2032354803 ## flink-state-backends/flink-statebackend-forst/src/main/java/org/apache/flink/state/forst/fs/cache/CachedDataInputStream.java: ## @@ -102,62 +102,81 @@ private FSData

[jira] [Assigned] (FLINK-37623) Async state support for `process()` in Datastream API

2025-04-07 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan reassigned FLINK-37623: --- Assignee: Yanfei Lei (was: Zakelly Lan) > Async state support for `process()` in Datastre

Re: [PR] [hotfix] Unify the name for the collection of SlotOffer with slotOffers [flink]

2025-04-07 Thread via GitHub
flinkbot commented on PR #26418: URL: https://github.com/apache/flink/pull/26418#issuecomment-2785194374 ## CI report: * 43a54812fb035d279a21137de5f65d667500142d UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [hotfix] Fixing flaky tests in flink-table-planner /hints [flink]

2025-04-07 Thread via GitHub
github-actions[bot] commented on PR #25486: URL: https://github.com/apache/flink/pull/25486#issuecomment-2785362205 This PR is being marked as stale since it has not had any activity in the last 90 days. If you would like to keep this PR alive, please leave a comment asking for a review

[jira] [Resolved] (FLINK-36683) Support metadata 'row_kind' virtual column for Mongo CDC Connector

2025-04-07 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu resolved FLINK-36683. Resolution: Resolved Resolved via master: 2e4abdb68ed960f09610cb8be332b770a07ba53e > Support meta

Re: [PR] [FLINK-37583] Upgrade to Kafka 4.0.0 client. [flink-connector-kafka]

2025-04-07 Thread via GitHub
tomncooper commented on code in PR #161: URL: https://github.com/apache/flink-connector-kafka/pull/161#discussion_r2030882248 ## flink-connector-kafka/src/test/java/org/apache/flink/connector/kafka/sink/KafkaWriterFaultToleranceITCase.java: ## @@ -40,7 +40,7 @@ public class Kaf

[jira] [Assigned] (FLINK-37626) Flaky test: ForStFlinkFileSystemTest.testSstFileInCache

2025-04-07 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan reassigned FLINK-37626: --- Assignee: Zakelly Lan > Flaky test: ForStFlinkFileSystemTest.testSstFileInCache > -

Re: [PR] [FLINK-37620][state/forst] ForSt Sync mode support remote storage [flink]

2025-04-07 Thread via GitHub
flinkbot commented on PR #26412: URL: https://github.com/apache/flink/pull/26412#issuecomment-2782507746 ## CI report: * f818133916a63feec3aba9361323b2c2231d0afd UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-37620][state/forst] ForSt Sync mode support remote storage [flink]

2025-04-07 Thread via GitHub
davidradl commented on code in PR #26412: URL: https://github.com/apache/flink/pull/26412#discussion_r2030769398 ## docs/layouts/shortcodes/generated/forst_configuration.html: ## @@ -116,6 +116,12 @@ String The primary directory where ForSt puts its SST

Re: [PR] [FLINK-37596][metrics] Close metric group of a finished split [flink]

2025-04-07 Thread via GitHub
pnowojski commented on code in PR #26388: URL: https://github.com/apache/flink/pull/26388#discussion_r2030767818 ## flink-runtime/src/main/java/org/apache/flink/runtime/metrics/groups/InternalSourceSplitMetricGroup.java: ## @@ -191,4 +191,17 @@ public Boolean isIdle() { pub

Re: [PR] [hotfix] Update copyright NOTICE year to 2025 [flink]

2025-04-07 Thread via GitHub
flinkbot commented on PR #26413: URL: https://github.com/apache/flink/pull/26413#issuecomment-2782943869 ## CI report: * 15cc4c070ca4a56aa1057071d421c0a95a10dd89 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-37598][table] Support list and map state in PTFs [flink]

2025-04-07 Thread via GitHub
twalthr commented on PR #26396: URL: https://github.com/apache/flink/pull/26396#issuecomment-2783419929 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Assigned] (FLINK-36090) Bug with IngestDB restore operation for priority queue state in backend

2025-04-07 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-36090: -- Assignee: Maxim Vershinin > Bug with IngestDB restore operation for priority queue st

Re: [PR] [FLINK-37511][rest] Use Jackson serialization in JobPlanInfo.Plan [flink]

2025-04-07 Thread via GitHub
akalash commented on code in PR #26320: URL: https://github.com/apache/flink/pull/26320#discussion_r2031317302 ## docs/layouts/shortcodes/generated/rest_v1_dispatcher.html: ## @@ -2879,7 +3009,72 @@ "properties" : { "plan" : { "type" : "object", - "id" : "ur

[jira] [Resolved] (FLINK-36090) Bug with IngestDB restore operation for priority queue state in backend

2025-04-07 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter resolved FLINK-36090. Assignee: (was: Maxim Vershinin) Resolution: Duplicate Already fixed in FLINK-35

Re: [PR] [FLINK-36683][cdc-connector][mongo] Support metadata 'row_kind' virtual column [flink-cdc]

2025-04-07 Thread via GitHub
leonardBang merged PR #3705: URL: https://github.com/apache/flink-cdc/pull/3705 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink

Re: [PR] Bump org.apache.kafka:kafka-clients from 3.4.0 to 3.7.1 [flink-connector-kafka]

2025-04-07 Thread via GitHub
prshnt commented on PR #135: URL: https://github.com/apache/flink-connector-kafka/pull/135#issuecomment-2782506369 @dependabot rebase -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] [FLINK-36947][Connectors/Kinesis] Fix issue where excessive GetRecords calls are made on idle source causing high CPU utilisation and throttling [flink-connector-aws]

2025-04-07 Thread via GitHub
gguptp commented on code in PR #195: URL: https://github.com/apache/flink-connector-aws/pull/195#discussion_r2030973955 ## flink-connector-aws/flink-connector-aws-kinesis-streams/src/main/java/org/apache/flink/connector/kinesis/source/reader/polling/PollingKinesisShardSplitReader.java:

Re: [PR] [FLINK-36947][Connectors/Kinesis] Fix issue where excessive GetRecords calls are made on idle source causing high CPU utilisation and throttling [flink-connector-aws]

2025-04-07 Thread via GitHub
darenwkt commented on code in PR #195: URL: https://github.com/apache/flink-connector-aws/pull/195#discussion_r2030971648 ## flink-connector-aws/flink-connector-aws-kinesis-streams/src/main/java/org/apache/flink/connector/kinesis/source/reader/polling/PollingKinesisShardSplitReader.jav

Re: [PR] [FLINK-37618][table-planner] Fix PTFs INTERVAL argument [flink]

2025-04-07 Thread via GitHub
juntaozhang commented on code in PR #26410: URL: https://github.com/apache/flink/pull/26410#discussion_r2031022714 ## flink-table/flink-table-common/src/main/java/org/apache/flink/table/types/logical/utils/LogicalTypeCasts.java: ## @@ -538,6 +539,11 @@ private CastAvoidanceCheck

[jira] [Commented] (FLINK-35466) Cannot pass all columns to SQL UDFs using `*`

2025-04-07 Thread Lorenzo Affetti (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17941590#comment-17941590 ] Lorenzo Affetti commented on FLINK-35466: - I would like to take this one > Cann

[jira] [Commented] (FLINK-37621) EnableAsyncState doesn't seem to do anything on DataStream API and misleading error message

2025-04-07 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17941475#comment-17941475 ] Zakelly Lan commented on FLINK-37621: - Seems we lack support for `process()` with as

[jira] [Assigned] (FLINK-37621) EnableAsyncState doesn't seem to do anything on DataStream API and misleading error message

2025-04-07 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan reassigned FLINK-37621: --- Assignee: Zakelly Lan > EnableAsyncState doesn't seem to do anything on DataStream API and

Re: [PR] [hotfix] Avoid copy Set for variable implementedRpcGateways [flink]

2025-04-07 Thread via GitHub
1996fanrui merged PR #26372: URL: https://github.com/apache/flink/pull/26372 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.ap

[jira] [Created] (FLINK-37624) Support enableAsyncState and switch operator after datastream transformation

2025-04-07 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37624: --- Summary: Support enableAsyncState and switch operator after datastream transformation Key: FLINK-37624 URL: https://issues.apache.org/jira/browse/FLINK-37624 Project: F

[jira] [Created] (FLINK-37623) Async state support for `process()` in Datastream API

2025-04-07 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37623: --- Summary: Async state support for `process()` in Datastream API Key: FLINK-37623 URL: https://issues.apache.org/jira/browse/FLINK-37623 Project: Flink Issue Ty

Re: [PR] [hotfix] Avoid duplicate fetch the size of memory segment [flink]

2025-04-07 Thread via GitHub
1996fanrui merged PR #26367: URL: https://github.com/apache/flink/pull/26367 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.ap

Re: [PR] [FLINK-37407][state] Add savepoint metadata SQL built-in process function [flink]

2025-04-07 Thread via GitHub
Zakelly commented on code in PR #26393: URL: https://github.com/apache/flink/pull/26393#discussion_r2030677692 ## flink-libraries/flink-state-processing-api/src/main/java/org/apache/flink/state/table/SavepointMetadataTableFunction.java: ## @@ -0,0 +1,72 @@ +/* + * Licensed to th

[jira] [Resolved] (FLINK-37143) Update version of flink-connector-kafka to 4.0-SNAPSHOT

2025-04-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise resolved FLINK-37143. - Assignee: Yanquan Lv Resolution: Fixed > Update version of flink-connector-kafka to 4.0-SN

Re: [PR] [FLINK-37407][state] Add savepoint metadata SQL built-in process function [flink]

2025-04-07 Thread via GitHub
gaborgsomogyi commented on code in PR #26393: URL: https://github.com/apache/flink/pull/26393#discussion_r2030693310 ## flink-libraries/flink-state-processing-api/src/main/java/org/apache/flink/state/table/SavepointMetadataTableFunction.java: ## @@ -0,0 +1,72 @@ +/* + * Licensed

Re: [PR] [FLINK-37583] Upgrade to Kafka 4.0.0 client. [flink-connector-kafka]

2025-04-07 Thread via GitHub
tomncooper commented on PR #161: URL: https://github.com/apache/flink-connector-kafka/pull/161#issuecomment-2782791845 > @tomncooper @MartijnVisser @AHeise I suggest we move to Kafka 4.0..0 client when we do Kafka connector v4 for Flink 2. WDYT? ( assuming we can sort out the tests) >

Re: [PR] [FLINK-37620][state/forst] ForSt Sync mode support remote storage [flink]

2025-04-07 Thread via GitHub
Zakelly commented on code in PR #26412: URL: https://github.com/apache/flink/pull/26412#discussion_r2030928114 ## docs/content.zh/docs/ops/state/disaggregated_state.md: ## @@ -150,6 +150,18 @@ state.backend.forst.primary-dir: s3://your-bucket/forst-state checkpoint and fast re

[PR] [hotfix] Update copyright NOTICE year to 2025 [flink]

2025-04-07 Thread via GitHub
Zakelly opened a new pull request, #26413: URL: https://github.com/apache/flink/pull/26413 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-ma

[jira] [Created] (FLINK-37626) Flaky test: ForStFlinkFileSystemTest.testSstFileInCache

2025-04-07 Thread Gabor Somogyi (Jira)
Gabor Somogyi created FLINK-37626: - Summary: Flaky test: ForStFlinkFileSystemTest.testSstFileInCache Key: FLINK-37626 URL: https://issues.apache.org/jira/browse/FLINK-37626 Project: Flink Iss

[jira] [Updated] (FLINK-37626) Flaky test: ForStFlinkFileSystemTest.testSstFileInCache

2025-04-07 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi updated FLINK-37626: -- Description: https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/re

Re: [PR] [FLINK-37620][state/forst] ForSt Sync mode support remote storage [flink]

2025-04-07 Thread via GitHub
fredia commented on PR #26412: URL: https://github.com/apache/flink/pull/26412#issuecomment-2783112395 > Should we also use ResourceGuard like [FLINK-37597](https://issues.apache.org/jira/browse/FLINK-37597) when using sync mode to access remote storage ? `ResourceGuard` is used to e

Re: [PR] [FLINK-36813][cdc-connectors][mysql] support mysql sync part columns [flink-cdc]

2025-04-07 Thread via GitHub
JNSimba commented on PR #3767: URL: https://github.com/apache/flink-cdc/pull/3767#issuecomment-2783640913 > @JNSimba Could we provide this feature by `SupportsProjectionPushDown`? `debezium.column.include.list` and `debezium.column.exclude.list` is hard for users to understand and use. We c

Re: [PR] [docs] Translate "Table ID" Page for Flink CDC Chinese Documentation [flink-cdc]

2025-04-07 Thread via GitHub
leonardBang merged PR #3888: URL: https://github.com/apache/flink-cdc/pull/3888 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink

Re: [PR] [FLINK-34554] Introduce transaction strategies [flink-connector-kafka]

2025-04-07 Thread via GitHub
fapaul commented on code in PR #154: URL: https://github.com/apache/flink-connector-kafka/pull/154#discussion_r2031443184 ## flink-connector-kafka/src/main/java/org/apache/flink/connector/kafka/sink/internal/TransactionOwnership.java: ## @@ -0,0 +1,205 @@ +/* + * Licensed to th

[jira] [Assigned] (FLINK-36611) Add schema info to output of Kafka sink

2025-04-07 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reassigned FLINK-36611: -- Assignee: MOBIN > Add schema info to output of Kafka sink > ---

[jira] [Resolved] (FLINK-36611) Add schema info to output of Kafka sink

2025-04-07 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu resolved FLINK-36611. Resolution: Implemented Implemented via master: 3457a922b5da331243fb3a4a1bc26a1b58e81b36 > Add sc

Re: [PR] [FLINK-36611][pipeline-connector][kafka] Add schema info to output of Kafka sink [flink-cdc]

2025-04-07 Thread via GitHub
leonardBang merged PR #3791: URL: https://github.com/apache/flink-cdc/pull/3791 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink

Re: [PR] [cdc-cli] fix duplicated option in CliFrontendOptions [flink-cdc]

2025-04-07 Thread via GitHub
leonardBang merged PR #3848: URL: https://github.com/apache/flink-cdc/pull/3848 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink

Re: [PR] [minor][pipeline-connectors][doris]Fix deprecated method usage in DorisSchemaChangeManager [flink-cdc]

2025-04-07 Thread via GitHub
leonardBang merged PR #3959: URL: https://github.com/apache/flink-cdc/pull/3959 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink

Re: [PR] [FLINK-34554] Introduce transaction strategies [flink-connector-kafka]

2025-04-07 Thread via GitHub
AHeise commented on code in PR #154: URL: https://github.com/apache/flink-connector-kafka/pull/154#discussion_r2031458928 ## flink-connector-kafka/src/main/java/org/apache/flink/connector/kafka/sink/internal/TransactionOwnership.java: ## @@ -0,0 +1,205 @@ +/* + * Licensed to th

Re: [PR] [FLINK-36648] Bump Flink version to Flink 2.0.0 [flink-connector-kafka]

2025-04-07 Thread via GitHub
FranMorilloAWS commented on PR #140: URL: https://github.com/apache/flink-connector-kafka/pull/140#issuecomment-2783947758 When is this releasing? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] [FLINK-37548] Add Model DDL methods in TABLE API [flink]

2025-04-07 Thread via GitHub
snuyanzin commented on code in PR #26385: URL: https://github.com/apache/flink/pull/26385#discussion_r2031778448 ## flink-table/flink-table-api-java/src/main/java/org/apache/flink/table/api/ModelDescriptor.java: ## @@ -0,0 +1,244 @@ +/* + * Licensed to the Apache Software Founda

Re: [PR] [FLINK-36947][Connectors/Kinesis] Fix issue where excessive GetRecords calls are made on idle source causing high CPU utilisation and throttling [flink-connector-aws]

2025-04-07 Thread via GitHub
leekeiabstraction commented on code in PR #195: URL: https://github.com/apache/flink-connector-aws/pull/195#discussion_r2031062113 ## flink-connector-aws/flink-connector-aws-kinesis-streams/src/main/java/org/apache/flink/connector/kinesis/source/reader/polling/PollingKinesisShardSplitR

Re: [PR] [FLINK-37620][state/forst] ForSt Sync mode support remote storage [flink]

2025-04-07 Thread via GitHub
masteryhx commented on PR #26412: URL: https://github.com/apache/flink/pull/26412#issuecomment-2783084846 Thanks for the PR. Just an extra comment: Should we also use ResourceGuard like [FLINK-37597](https://issues.apache.org/jira/browse/FLINK-37597) when using sync mode to access remote

[jira] [Updated] (FLINK-37616) PyFlink incorrectly unpickles Row fields within a Row

2025-04-07 Thread Mika Naylor (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mika Naylor updated FLINK-37616: Summary: PyFlink incorrectly unpickles Row fields within a Row (was: PyFlink incorrectly unpickle

Re: [PR] [hotfix] [docs] Fix typo in docker.md [flink]

2025-04-07 Thread via GitHub
DanRoscigno commented on PR #25194: URL: https://github.com/apache/flink/pull/25194#issuecomment-2783710846 Please can this be reviewed? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

[jira] [Created] (FLINK-37628) Wrong reference counting in ForSt file cache

2025-04-07 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37628: --- Summary: Wrong reference counting in ForSt file cache Key: FLINK-37628 URL: https://issues.apache.org/jira/browse/FLINK-37628 Project: Flink Issue Type: Bug

Re: [PR] [FLINK-37407][state] Add savepoint metadata SQL built-in process function [flink]

2025-04-07 Thread via GitHub
gaborgsomogyi merged PR #26393: URL: https://github.com/apache/flink/pull/26393 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink

[jira] [Created] (FLINK-37627) Restarting from a checkpoint/savepoint which coincides with shard split causes data loss

2025-04-07 Thread Keith Lee (Jira)
Keith Lee created FLINK-37627: - Summary: Restarting from a checkpoint/savepoint which coincides with shard split causes data loss Key: FLINK-37627 URL: https://issues.apache.org/jira/browse/FLINK-37627 Pr

[PR] [FLINK-37625][python] Don't skip type validation for Rows made with positional arguments [flink]

2025-04-07 Thread via GitHub
autophagy opened a new pull request, #26414: URL: https://github.com/apache/flink/pull/26414 ## What is the purpose of the change When creating a table using `TableEnvironment.from_elements`, the Table API skips type validation on any Row elements that were created using positional a

Re: [PR] [FLINK-37625][python] Don't skip type validation for Rows made with positional arguments [flink]

2025-04-07 Thread via GitHub
flinkbot commented on PR #26414: URL: https://github.com/apache/flink/pull/26414#issuecomment-2783296378 ## CI report: * 92e7cc3e8e13c1c011ae107921c0b43b31cbc1d7 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-37601] Remove Unirest dependency in PrometheusReporterTest [flink]

2025-04-07 Thread via GitHub
hlteoh37 merged PR #26387: URL: https://github.com/apache/flink/pull/26387 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apac

Re: [PR] [FLINK-37548] Add Model DDL methods in TABLE API [flink]

2025-04-07 Thread via GitHub
snuyanzin commented on code in PR #26385: URL: https://github.com/apache/flink/pull/26385#discussion_r2031879610 ## flink-table/flink-table-api-java/src/main/java/org/apache/flink/table/api/ModelDescriptor.java: ## @@ -0,0 +1,244 @@ +/* + * Licensed to the Apache Software Founda

Re: [PR] [FLINK-37548] Add Model DDL methods in TABLE API [flink]

2025-04-07 Thread via GitHub
snuyanzin commented on code in PR #26385: URL: https://github.com/apache/flink/pull/26385#discussion_r2031900150 ## flink-python/pyflink/table/table_environment.py: ## @@ -1071,6 +1128,88 @@ def create_view(self, self._j_tenv.createView(view_path, table, ignore_if_exi

Re: [PR] [FLINK-37548] Add Model DDL methods in TABLE API [flink]

2025-04-07 Thread via GitHub
snuyanzin commented on code in PR #26385: URL: https://github.com/apache/flink/pull/26385#discussion_r2031904769 ## flink-table/flink-table-api-java/src/test/java/org/apache/flink/table/catalog/CatalogManagerTest.java: ## @@ -343,12 +343,14 @@ public void testModelModificationLi

[jira] [Comment Edited] (FLINK-37627) Restarting from a checkpoint/savepoint which coincides with shard split causes data loss

2025-04-07 Thread Arun Lakshman (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17941693#comment-17941693 ] Arun Lakshman edited comment on FLINK-37627 at 4/7/25 7:19 PM: ---

Re: [PR] [hotfix] Avoid copy Set for variable implementedRpcGateways [flink]

2025-04-07 Thread via GitHub
beliefer commented on PR #26372: URL: https://github.com/apache/flink/pull/26372#issuecomment-2782469397 @1996fanrui @davidradl Thank you all! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Updated] (FLINK-37620) ForSt Sync mode support remote storage and provide configurable options

2025-04-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-37620: --- Labels: pull-request-available (was: ) > ForSt Sync mode support remote storage and provide

[jira] [Commented] (FLINK-37585) The data of the newly added table cannot be read

2025-04-07 Thread Xin Gong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17941499#comment-17941499 ] Xin Gong commented on FLINK-37585: -- You can see this discussion [https://github.com/ap

Re: [PR] [FLINK-37618][table-planner] Fix PTFs INTERVAL argument [flink]

2025-04-07 Thread via GitHub
davidradl commented on code in PR #26410: URL: https://github.com/apache/flink/pull/26410#discussion_r2030762088 ## flink-table/flink-table-common/src/main/java/org/apache/flink/table/types/logical/utils/LogicalTypeCasts.java: ## @@ -538,6 +539,11 @@ private CastAvoidanceChecker

[jira] [Commented] (FLINK-25672) FileSource enumerator remembers paths of all already processed files which can result in large state

2025-04-07 Thread Nickel Fang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17941577#comment-17941577 ] Nickel Fang commented on FLINK-25672: - We had the same issue (OOM in job manager) an

Re: [PR] [hotfix][docs] Fix broken tabs and PTF example argument errors [flink]

2025-04-07 Thread via GitHub
twalthr merged PR #26406: URL: https://github.com/apache/flink/pull/26406 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apach

[jira] [Commented] (FLINK-37607) Blocklist timeout check may lost

2025-04-07 Thread Heart Zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17941594#comment-17941594 ] Heart Zhou commented on FLINK-37607: I would like to work on this issue.  > Blockli

Re: [PR] [FLINK-37548] Add Model DDL methods in TABLE API [flink]

2025-04-07 Thread via GitHub
snuyanzin commented on code in PR #26385: URL: https://github.com/apache/flink/pull/26385#discussion_r2031795676 ## flink-table/flink-table-api-java/src/test/java/org/apache/flink/table/api/TableEnvironmentTest.java: ## @@ -158,6 +167,121 @@ void testTableFromDescriptor() {

Re: [PR] [FLINK-37548] Add Model DDL methods in TABLE API [flink]

2025-04-07 Thread via GitHub
snuyanzin commented on code in PR #26385: URL: https://github.com/apache/flink/pull/26385#discussion_r2031813534 ## flink-table/flink-table-api-java/src/test/java/org/apache/flink/table/api/TableEnvironmentTest.java: ## @@ -158,6 +167,121 @@ void testTableFromDescriptor() {

Re: [PR] [FLINK-37548] Add Model DDL methods in TABLE API [flink]

2025-04-07 Thread via GitHub
snuyanzin commented on code in PR #26385: URL: https://github.com/apache/flink/pull/26385#discussion_r2031798763 ## flink-table/flink-table-api-java/src/test/java/org/apache/flink/table/api/TableEnvironmentTest.java: ## @@ -212,4 +336,39 @@ private static void assertTemporaryCr

Re: [PR] [FLINK-37548] Add Model DDL methods in TABLE API [flink]

2025-04-07 Thread via GitHub
snuyanzin commented on code in PR #26385: URL: https://github.com/apache/flink/pull/26385#discussion_r2031803406 ## flink-table/flink-table-api-java/src/test/java/org/apache/flink/table/api/TableEnvironmentTest.java: ## @@ -212,4 +336,39 @@ private static void assertTemporaryCr

Re: [PR] [FLINK-37548] Add Model DDL methods in TABLE API [flink]

2025-04-07 Thread via GitHub
snuyanzin commented on code in PR #26385: URL: https://github.com/apache/flink/pull/26385#discussion_r2031821725 ## flink-table/flink-table-api-java/src/test/java/org/apache/flink/table/api/TableEnvironmentTest.java: ## @@ -212,4 +336,39 @@ private static void assertTemporaryCr

Re: [PR] [FLINK-37548] Add Model DDL methods in TABLE API [flink]

2025-04-07 Thread via GitHub
snuyanzin commented on code in PR #26385: URL: https://github.com/apache/flink/pull/26385#discussion_r2031838881 ## flink-table/flink-table-api-java/src/main/java/org/apache/flink/table/api/internal/TableEnvironmentImpl.java: ## @@ -564,6 +565,36 @@ public boolean createView(Str

Re: [PR] [FLINK-37548] Add Model DDL methods in TABLE API [flink]

2025-04-07 Thread via GitHub
snuyanzin commented on code in PR #26385: URL: https://github.com/apache/flink/pull/26385#discussion_r2031786003 ## flink-table/flink-table-api-java/src/test/java/org/apache/flink/table/api/TableEnvironmentTest.java: ## @@ -158,6 +167,121 @@ void testTableFromDescriptor() {

Re: [PR] [FLINK-37548] Add Model DDL methods in TABLE API [flink]

2025-04-07 Thread via GitHub
snuyanzin commented on code in PR #26385: URL: https://github.com/apache/flink/pull/26385#discussion_r2031798763 ## flink-table/flink-table-api-java/src/test/java/org/apache/flink/table/api/TableEnvironmentTest.java: ## @@ -212,4 +336,39 @@ private static void assertTemporaryCr

Re: [PR] [FLINK-37548] Add Model DDL methods in TABLE API [flink]

2025-04-07 Thread via GitHub
snuyanzin commented on code in PR #26385: URL: https://github.com/apache/flink/pull/26385#discussion_r2031827083 ## flink-table/flink-table-api-java/src/main/java/org/apache/flink/table/catalog/CatalogManager.java: ## @@ -1647,6 +1675,8 @@ private void execute(

  1   2   >