Re: [PR] [FLINK-37383][flink-examples]Correct throttling logic on ThrottledIterator [flink]

2025-04-10 Thread via GitHub
rafaelzimmermann commented on PR #26203: URL: https://github.com/apache/flink/pull/26203#issuecomment-2795988413 Hey @davidradl, can you have another look at this PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[jira] [Commented] (FLINK-37644) flink-sql-connector-kafka leaks Guava dependency

2025-04-10 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17943428#comment-17943428 ] Arvid Heise commented on FLINK-37644: - Merged into main as d44f57458d4198389f804f81

Re: [PR] [hotfix][docs] Fix Apache Avro Specification Link [flink]

2025-04-10 Thread via GitHub
github-actions[bot] commented on PR #25850: URL: https://github.com/apache/flink/pull/25850#issuecomment-2795950567 This PR is being marked as stale since it has not had any activity in the last 90 days. If you would like to keep this PR alive, please leave a comment asking for a review

Re: [PR] [FLINK-36992][table] Migrate SplitAggregateRule to java [flink]

2025-04-10 Thread via GitHub
github-actions[bot] commented on PR #25883: URL: https://github.com/apache/flink/pull/25883#issuecomment-2795950661 This PR is being marked as stale since it has not had any activity in the last 90 days. If you would like to keep this PR alive, please leave a comment asking for a review

Re: [PR] [FLINK-xx][table] Remove RelBuilder [flink]

2025-04-10 Thread via GitHub
github-actions[bot] commented on PR #25823: URL: https://github.com/apache/flink/pull/25823#issuecomment-2795950513 This PR is being marked as stale since it has not had any activity in the last 90 days. If you would like to keep this PR alive, please leave a comment asking for a review

[jira] [Assigned] (FLINK-37644) flink-sql-connector-kafka leaks Guava dependency

2025-04-10 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise reassigned FLINK-37644: --- Assignee: Arvid Heise (was: Yanquan Lv) > flink-sql-connector-kafka leaks Guava dependency

[jira] [Updated] (FLINK-37644) flink-sql-connector-kafka leaks Guava dependency

2025-04-10 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-37644: Summary: flink-sql-connector-kafka leaks Guava dependency (was: Include guava dependency to packa

Re: [PR] [hotfix] Avoid duplicate call on checkNotNull while calling fromProgramOptions [flink]

2025-04-10 Thread via GitHub
beliefer commented on PR #26429: URL: https://github.com/apache/flink/pull/26429#issuecomment-2795931303 ping @kl0u -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsu

Re: [PR] [FLINK-37638] Avoid duplicate call on getEffectiveConfiguration [flink]

2025-04-10 Thread via GitHub
beliefer commented on PR #26428: URL: https://github.com/apache/flink/pull/26428#issuecomment-2795928329 ping @ferenc-csaky @kl0u @wangyang0918 cc @1996fanrui @davidradl @GOODBOY008 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

[jira] [Updated] (FLINK-37644) Include guava dependency to package of Kafka connector release and shade

2025-04-10 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-37644: Issue Type: Bug (was: Improvement) > Include guava dependency to package of Kafka connector relea

Re: [PR] [FLINK-37644] Straighten dependencies [flink-connector-kafka]

2025-04-10 Thread via GitHub
AHeise merged PR #170: URL: https://github.com/apache/flink-connector-kafka/pull/170 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@

[jira] [Updated] (FLINK-37627) Restarting from a checkpoint/savepoint which coincides with shard split causes data loss

2025-04-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-37627: --- Labels: pull-request-available (was: ) > Restarting from a checkpoint/savepoint which coinc

Re: [PR] [FLINK-37627][BugFix][Connectors/Kinesis] Restarting from a checkpoint/savepoint which coincides with shard split causes data loss [flink-connector-aws]

2025-04-10 Thread via GitHub
boring-cyborg[bot] commented on PR #198: URL: https://github.com/apache/flink-connector-aws/pull/198#issuecomment-2795923065 Thanks for opening this pull request! Please check out our contributing guidelines. (https://flink.apache.org/contributing/how-to-contribute.html) -- This is a

[PR] [FLINK-37627][BugFix][Connectors/Kinesis] Restarting from a checkpoint/savepoint which coincides with shard split causes data loss [flink-connector-aws]

2025-04-10 Thread via GitHub
arunlakshman opened a new pull request, #198: URL: https://github.com/apache/flink-connector-aws/pull/198 ## Purpose of the change *For example: Implements the Table API for the Kinesis Source.* ## Verifying this change Please make sure both new and modifi

[jira] [Commented] (FLINK-37479) postgres cdc connector support discover PARTITIONED TABLE

2025-04-10 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17943427#comment-17943427 ] Hongshun Wang commented on FLINK-37479: --- [~phamvinh1712] As I discussed in [https

[jira] [Updated] (FLINK-37653) Incremental snapshot framework supports assigning multiple StreamSplit

2025-04-10 Thread yux (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yux updated FLINK-37653: Description: Currently, HybridSplitAssigners and StreamSplitAssigners in incremental snapshot framework implicitl

[jira] [Commented] (FLINK-37652) [Connectors/Opensearch] Move to Flink to 2.0.0

2025-04-10 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17943424#comment-17943424 ] Sergey Nuyanzin commented on FLINK-37652: - done, thank you for driving this > [

[jira] [Assigned] (FLINK-37652) [Connectors/Opensearch] Move to Flink to 2.0.0

2025-04-10 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin reassigned FLINK-37652: --- Assignee: Andriy Redko > [Connectors/Opensearch] Move to Flink to 2.0.0 > -

Re: [PR] [FLINK-35404] Report all metrics of KafkaConsumer in new Kafka source [flink-connector-kafka]

2025-04-10 Thread via GitHub
hmit commented on PR #103: URL: https://github.com/apache/flink-connector-kafka/pull/103#issuecomment-2795888382 @tomncooper thanks for taking the time to look at it and providing feedback! I've updated the PR description with some details, is it possible to give this another look?

[jira] [Commented] (FLINK-34992) FLIP-437: Support ML Models in Flink SQL

2025-04-10 Thread Hao Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17943418#comment-17943418 ] Hao Li commented on FLINK-34992: Hi [~fsk119] ,  These are good question as I'm startin

[jira] [Assigned] (FLINK-37653) Incremental snapshot framework supports assigning multiple StreamSplit

2025-04-10 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reassigned FLINK-37653: -- Assignee: yux > Incremental snapshot framework supports assigning multiple StreamSplit >

Re: [PR] [FLINK-37623][datastream] Async state support for process() in Datastream API [flink]

2025-04-10 Thread via GitHub
flinkbot commented on PR #26439: URL: https://github.com/apache/flink/pull/26439#issuecomment-2795702739 ## CI report: * c01e43d7f1356c0c40af2511cfce58dca12f0afe UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Commented] (FLINK-34992) FLIP-437: Support ML Models in Flink SQL

2025-04-10 Thread dalongliu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17943406#comment-17943406 ] dalongliu commented on FLINK-34992: --- Hi [~lihaosky], it will be a great work if we can

[PR] [FLINK-37623][datastream] Async state support for process() in Datastream API [flink]

2025-04-10 Thread via GitHub
fredia opened a new pull request, #26439: URL: https://github.com/apache/flink/pull/26439 Backport https://github.com/apache/flink/pull/26419 to release-2.0 ## What is the purpose of the change This PR adds async state support for `process()` in Datastream API ## Brie

Re: [PR] [FLINK-37649][datagen] Datagen connector cannot set length for collection type [flink]

2025-04-10 Thread via GitHub
reswqa commented on PR #26437: URL: https://github.com/apache/flink/pull/26437#issuecomment-2795690581 > I wonder if we should add the test case mentioned in the Jira to the datagen docs as an example WDYT? @davidradl The documentation indeed is not very friendly especially when it d

Re: [PR] [hotfix] Remove the redundant config for execution target [flink]

2025-04-10 Thread via GitHub
beliefer commented on PR #26425: URL: https://github.com/apache/flink/pull/26425#issuecomment-2795689343 ping @guoweiM @1996fanrui cc @davidradl @GOODBOY008 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

Re: [PR] [hotfix] Rename loadJarFile to checkJarFile [flink]

2025-04-10 Thread via GitHub
beliefer commented on PR #26427: URL: https://github.com/apache/flink/pull/26427#issuecomment-2795687276 ping @tisonkun cc @1996fanrui @davidradl @GOODBOY008 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[jira] [Resolved] (FLINK-37623) Async state support for `process()` in Datastream API

2025-04-10 Thread Yanfei Lei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanfei Lei resolved FLINK-37623. Resolution: Fixed Merged into master via 98000fbe598ca20eedf6411672509af9624a58ac > Async state s

Re: [PR] [FLINK-37623][datastream] Async state support for process() in Datastream API [flink]

2025-04-10 Thread via GitHub
fredia merged PR #26419: URL: https://github.com/apache/flink/pull/26419 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache

Re: [PR] [hotfix] Avoid duplicate call on checkNotNull while calling fromProgramOptions [flink]

2025-04-10 Thread via GitHub
beliefer commented on PR #26429: URL: https://github.com/apache/flink/pull/26429#issuecomment-2795677694 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [FLINK-36813][cdc-connectors][mysql] support mysql sync part columns [flink-cdc]

2025-04-10 Thread via GitHub
JNSimba commented on PR #3767: URL: https://github.com/apache/flink-cdc/pull/3767#issuecomment-2795676279 > @JNSimba In the backfill task, there may be one problem for projection. See `RecordUtils.upsertBinlog` in `SnapshotSplitReader#pollSplitRecords`. > > For tables with PK, we use

[jira] [Created] (FLINK-37653) Incremental snapshot framework supports assigning multiple StreamSplit

2025-04-10 Thread yux (Jira)
yux created FLINK-37653: --- Summary: Incremental snapshot framework supports assigning multiple StreamSplit Key: FLINK-37653 URL: https://issues.apache.org/jira/browse/FLINK-37653 Project: Flink Issue T

Re: [PR] [FLINK-37644] Include guava dependency and shade it. [flink-connector-kafka]

2025-04-10 Thread via GitHub
lvyanquan closed pull request #167: [FLINK-37644] Include guava dependency and shade it. URL: https://github.com/apache/flink-connector-kafka/pull/167 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] [FLINK-37644] Include guava dependency and shade it. [flink-connector-kafka]

2025-04-10 Thread via GitHub
lvyanquan commented on PR #167: URL: https://github.com/apache/flink-connector-kafka/pull/167#issuecomment-2795614887 Closed as https://github.com/apache/flink-connector-kafka/pull/170 provided a more thorough solution -- This is an automated message from the Apache Git Service. To respo

[jira] [Commented] (FLINK-37652) [Connectors/Opensearch] Move to Flink to 2.0.0

2025-04-10 Thread Andriy Redko (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17943402#comment-17943402 ] Andriy Redko commented on FLINK-37652: -- [~Sergey Nuyanzin] could you please assign

Re: [PR] [hotfix][doc] Fix typo in 'Full Window Partition Processing on DataStream' example code [flink]

2025-04-10 Thread via GitHub
yeoleobun closed pull request #26021: [hotfix][doc] Fix typo in 'Full Window Partition Processing on DataStream' example code URL: https://github.com/apache/flink/pull/26021 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[jira] [Updated] (FLINK-37652) [Connectors/Opensearch] Move to Flink to 2.0.0

2025-04-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-37652: --- Labels: pull-request-available (was: ) > [Connectors/Opensearch] Move to Flink to 2.0.0 > -

[jira] [Updated] (FLINK-37652) [Connectors/Opensearch] Move to Flink to 2.0.0

2025-04-10 Thread Andriy Redko (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andriy Redko updated FLINK-37652: - Fix Version/s: (was: 3.0.0) > [Connectors/Opensearch] Move to Flink to 2.0.0 > -

[jira] [Created] (FLINK-37652) [Connectors/Opensearch] Move to Flink to 2.0.0

2025-04-10 Thread Andriy Redko (Jira)
Andriy Redko created FLINK-37652: Summary: [Connectors/Opensearch] Move to Flink to 2.0.0 Key: FLINK-37652 URL: https://issues.apache.org/jira/browse/FLINK-37652 Project: Flink Issue Type: Bu

Re: [PR] [FLINK-34820][postgressql] Not recycle but reuse fetcher for all data to improve performant [flink-cdc]

2025-04-10 Thread via GitHub
hql0312 commented on PR #3983: URL: https://github.com/apache/flink-cdc/pull/3983#issuecomment-2795541630 > > and the change code how to performance the logic ? > > Hi, @Mrart , @hql0312 . this pr is mainly focused on most situations. As I discussed in #2571, In snapshot split phase,

Re: [PR] [FLINK-37628] Fix reference counting in ForSt file cache [flink]

2025-04-10 Thread via GitHub
davidradl commented on code in PR #26415: URL: https://github.com/apache/flink/pull/26415#discussion_r2033079768 ## flink-state-backends/flink-statebackend-forst/src/main/java/org/apache/flink/state/forst/fs/cache/CachedDataInputStream.java: ## @@ -196,72 +213,87 @@ synchronized

[jira] [Updated] (FLINK-37642) Use the mailboxExecutor for operator in Async state processing

2025-04-10 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan updated FLINK-37642: Fix Version/s: 2.1.0 > Use the mailboxExecutor for operator in Async state processing > --

Re: [PR] [BP-1.19][FLINK-35241][table]Support SQL FLOOR and CEIL functions with SECOND and MINUTE for TIMESTAMP_TLZ [flink]

2025-04-10 Thread via GitHub
github-actions[bot] commented on PR #25878: URL: https://github.com/apache/flink/pull/25878#issuecomment-2788406161 This PR is being marked as stale since it has not had any activity in the last 90 days. If you would like to keep this PR alive, please leave a comment asking for a review

[jira] [Updated] (FLINK-30371) JdbcOutputFormat is at risk of database connection leaks

2025-04-10 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-30371: -- Fix Version/s: jdbc-4.0.0 (was: jdbc-3.3.0) > JdbcOutputFormat is at risk of da

Re: [PR] Fix flaky tests in classes PartitionableSourceTest and PushPartitionIntoTableSourceScanRuleTest [flink]

2025-04-10 Thread via GitHub
github-actions[bot] commented on PR #25471: URL: https://github.com/apache/flink/pull/25471#issuecomment-2785362107 This PR is being marked as stale since it has not had any activity in the last 90 days. If you would like to keep this PR alive, please leave a comment asking for a review

Re: [PR] Test [flink]

2025-04-10 Thread via GitHub
github-actions[bot] commented on PR #25696: URL: https://github.com/apache/flink/pull/25696#issuecomment-2788405525 This PR is being marked as stale since it has not had any activity in the last 90 days. If you would like to keep this PR alive, please leave a comment asking for a review

[jira] [Updated] (FLINK-36516) Migrate deprecated SinkV2 API to new API introduced in FLIP-372

2025-04-10 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-36516: Issue Type: Technical Debt (was: Improvement) > Migrate deprecated SinkV2 API to new API introdu

[jira] [Updated] (FLINK-37625) PyFlink Table API skips validation for Rows created with positional arguments

2025-04-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-37625: --- Labels: pull-request-available (was: ) > PyFlink Table API skips validation for Rows create

Re: [PR] [FLINK-37643] Support partial deletes when converting to external data structures [flink]

2025-04-10 Thread via GitHub
dawidwys commented on code in PR #26436: URL: https://github.com/apache/flink/pull/26436#discussion_r2036846898 ## flink-table/flink-table-runtime/src/test/java/org/apache/flink/table/data/DataStructureConvertersTest.java: ## @@ -355,7 +355,62 @@ static List testData() {

[jira] [Closed] (FLINK-37407) Add meta information to SQL state connector

2025-04-10 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi closed FLINK-37407. - > Add meta information to SQL state connector > --- > >

[jira] [Created] (FLINK-37642) Use the mailboxExecutor for operator in Async state processing

2025-04-10 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37642: --- Summary: Use the mailboxExecutor for operator in Async state processing Key: FLINK-37642 URL: https://issues.apache.org/jira/browse/FLINK-37642 Project: Flink

Re: [PR] [FLINK-36061][iceberg] Add Iceberg Sink. [flink-cdc]

2025-04-10 Thread via GitHub
lvyanquan commented on code in PR #3904: URL: https://github.com/apache/flink-cdc/pull/3904#discussion_r2034717354 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-iceberg/src/main/java/org/apache/flink/cdc/connectors/iceberg/sink/v2/IcebergWriter.java: ##

Re: [PR] [FLINK-37511][rest] Use Jackson serialization in JobPlanInfo.Plan [flink]

2025-04-10 Thread via GitHub
rkhachatryan commented on code in PR #26320: URL: https://github.com/apache/flink/pull/26320#discussion_r2032884834 ## docs/layouts/shortcodes/generated/rest_v1_dispatcher.html: ## @@ -509,7 +509,72 @@ "properties" : { "plan" : { "type" : "object", - "id" :

Re: [PR] [FLINK-36679][runtime] Add a metric to track checkpoint _metadata size [flink]

2025-04-10 Thread via GitHub
github-actions[bot] commented on PR #25634: URL: https://github.com/apache/flink/pull/25634#issuecomment-2788405114 This PR is being marked as stale since it has not had any activity in the last 90 days. If you would like to keep this PR alive, please leave a comment asking for a review

Re: [PR] [hotfix] fix ci failure due to code style [flink-cdc]

2025-04-10 Thread via GitHub
loserwang1024 commented on code in PR #3980: URL: https://github.com/apache/flink-cdc/pull/3980#discussion_r2034743082 ## docs/content/docs/connectors/pipeline-connectors/kafka.md: ## @@ -149,7 +149,7 @@ Pipeline Connector Options Custom table mappings for each table from

Re: [PR] [FLINK-37644] Include guava dependency and shade it. [flink-connector-kafka]

2025-04-10 Thread via GitHub
lvyanquan closed pull request #168: [FLINK-37644] Include guava dependency and shade it. URL: https://github.com/apache/flink-connector-kafka/pull/168 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] [FLINK-37640][table-planner] Fix timestamp_ltz is converted timestamp in scan reuse [flink]

2025-04-10 Thread via GitHub
davidradl commented on code in PR #26430: URL: https://github.com/apache/flink/pull/26430#discussion_r2035559270 ## flink-table/flink-table-planner/src/main/java/org/apache/flink/table/planner/plan/reuse/ScanReuserUtils.java: ## @@ -203,7 +204,13 @@ private static WatermarkPushD

Re: [PR] [FLINK-37511][rest] Use Jackson serialization in JobPlanInfo.Plan [flink]

2025-04-10 Thread via GitHub
akalash commented on code in PR #26320: URL: https://github.com/apache/flink/pull/26320#discussion_r2031268020 ## docs/layouts/shortcodes/generated/rest_v1_dispatcher.html: ## @@ -509,7 +509,72 @@ "properties" : { "plan" : { "type" : "object", - "id" : "urn:

[jira] [Updated] (FLINK-35363) FLIP-449: Reorganization of flink-connector-jdbc

2025-04-10 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-35363: -- Fix Version/s: jdbc-4.0.0 (was: jdbc-3.3.0) > FLIP-449: Reorganization of flink

Re: [PR] [FLINK-29549]- Flink Glue Catalog integration [flink-connector-aws]

2025-04-10 Thread via GitHub
FranMorilloAWS commented on code in PR #191: URL: https://github.com/apache/flink-connector-aws/pull/191#discussion_r2034866646 ## flink-catalog-aws-glue/src/main/java/com/amazonaws/services/msf/GlueCatalogFactory.java: ## @@ -0,0 +1,66 @@ +package com.amazonaws.services.msf; +

Re: [PR] [FLINK-37548] Add Model DDL methods in TABLE API [flink]

2025-04-10 Thread via GitHub
snuyanzin commented on code in PR #26385: URL: https://github.com/apache/flink/pull/26385#discussion_r2031805203 ## flink-table/flink-table-api-java/src/test/java/org/apache/flink/table/api/TableEnvironmentTest.java: ## @@ -212,4 +336,39 @@ private static void assertTemporaryCr

[jira] [Closed] (FLINK-37476) Update Kafka connector's ChangelogMode

2025-04-10 Thread Dawid Wysakowicz (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dawid Wysakowicz closed FLINK-37476. Resolution: Implemented > Update Kafka connector's ChangelogMode > ---

Re: [PR] [FLINK-37548] Add Model DDL methods in TABLE API [flink]

2025-04-10 Thread via GitHub
snuyanzin commented on code in PR #26385: URL: https://github.com/apache/flink/pull/26385#discussion_r2031880386 ## flink-table/flink-table-api-java/src/main/java/org/apache/flink/table/api/ModelDescriptor.java: ## @@ -0,0 +1,244 @@ +/* + * Licensed to the Apache Software Founda

[jira] [Updated] (FLINK-37629) Use Checkpointed Offset while migrating clusters in DynamicKafkaSource

2025-04-10 Thread Chirag Dewan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chirag Dewan updated FLINK-37629: - Description: In my use case, I have a 2 cluster Kafka deployment. One is primary and other one

Re: [PR] [FLINK-36925][table] Introduce SemiAntiJoinOperator in Join with Async State API [flink]

2025-04-10 Thread via GitHub
github-actions[bot] commented on PR #25814: URL: https://github.com/apache/flink/pull/25814#issuecomment-2788406083 This PR is being marked as stale since it has not had any activity in the last 90 days. If you would like to keep this PR alive, please leave a comment asking for a review

Re: [PR] [hotfix] [docs] Fix size of PyFlink INT [flink]

2025-04-10 Thread via GitHub
rmetzger merged PR #25511: URL: https://github.com/apache/flink/pull/25511 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apac

Re: [PR] Bump org.apache.kafka:kafka-clients from 3.4.0 to 3.7.1 [flink-connector-kafka]

2025-04-10 Thread via GitHub
dependabot[bot] commented on PR #135: URL: https://github.com/apache/flink-connector-kafka/pull/135#issuecomment-2782506506 Sorry, only users with push access can use that command. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

Re: [PR] [FLINK-37548] Add Model DDL methods in TABLE API [flink]

2025-04-10 Thread via GitHub
snuyanzin commented on code in PR #26385: URL: https://github.com/apache/flink/pull/26385#discussion_r2031789883 ## flink-table/flink-table-api-java/src/test/java/org/apache/flink/table/api/TableEnvironmentTest.java: ## @@ -158,6 +167,121 @@ void testTableFromDescriptor() {

[jira] [Resolved] (FLINK-36832) Remove deprecated class in flink-connector-kafka

2025-04-10 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise resolved FLINK-36832. - Resolution: Fixed > Remove deprecated class in flink-connector-kafka > -

Re: [PR] Fix typo from MARCO to MACRO [flink]

2025-04-10 Thread via GitHub
github-actions[bot] commented on PR #25614: URL: https://github.com/apache/flink/pull/25614#issuecomment-2788405035 This PR is being marked as stale since it has not had any activity in the last 90 days. If you would like to keep this PR alive, please leave a comment asking for a review

Re: [PR] [hotfix] Rename loadJarFile to checkJarFile [flink]

2025-04-10 Thread via GitHub
beliefer commented on code in PR #26427: URL: https://github.com/apache/flink/pull/26427#discussion_r2035317560 ## flink-clients/src/main/java/org/apache/flink/client/program/PackagedProgram.java: ## @@ -440,7 +440,7 @@ private static String getEntryPointClassNameFromJar(URL ja

Re: [PR] [FLINK-37553] Make ForStKeyedStateBackend update NamespaceSerializer during restoring state [flink]

2025-04-10 Thread via GitHub
mayuehappy commented on code in PR #26416: URL: https://github.com/apache/flink/pull/26416#discussion_r2034907530 ## flink-state-backends/flink-statebackend-forst/src/main/java/org/apache/flink/state/forst/ForStKeyedStateBackend.java: ## @@ -445,6 +445,22 @@ private Registered

[jira] [Updated] (FLINK-36058) OperatorTestHarness is always using checkpointId=0 for state recovery

2025-04-10 Thread Rodrigo Meneses (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rodrigo Meneses updated FLINK-36058: Description: OperatorTestHarness last completed checkpoint for recovery is always reset to

Re: [PR] [FLINK-36931][cdc] FlinkCDC YAML supports batch mode [flink-cdc]

2025-04-10 Thread via GitHub
aiwenmo commented on code in PR #3812: URL: https://github.com/apache/flink-cdc/pull/3812#discussion_r2034617315 ## flink-cdc-common/src/main/java/org/apache/flink/cdc/common/factories/DataSourceFactory.java: ## @@ -28,4 +28,10 @@ public interface DataSourceFactory extends Facto

Re: [PR] [docs-zh]The description of creating a materialized table does not match the example code,The description states 1 hour, while the code states 10 minutes [flink]

2025-04-10 Thread via GitHub
github-actions[bot] commented on PR #25442: URL: https://github.com/apache/flink/pull/25442#issuecomment-2785361816 This PR is being marked as stale since it has not had any activity in the last 90 days. If you would like to keep this PR alive, please leave a comment asking for a review

[jira] [Closed] (FLINK-25380) Introduce DynamicTableSink & DynamicTableSource for RabbitMQ

2025-04-10 Thread RocMarshal (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] RocMarshal closed FLINK-25380. -- Resolution: Won't Fix > Introduce DynamicTableSink & DynamicTableSource for RabbitMQ > ---

Re: [PR] [FLINK-37583] Upgrade to Kafka 4.0.0 client. [flink-connector-kafka]

2025-04-10 Thread via GitHub
davidradl commented on code in PR #161: URL: https://github.com/apache/flink-connector-kafka/pull/161#discussion_r2030661476 ## flink-connector-kafka/src/test/java/org/apache/flink/connector/kafka/sink/KafkaWriterFaultToleranceITCase.java: ## @@ -40,7 +40,7 @@ public class Kafk

Re: [PR] [postgres] fix when backfill will scan all table schame which match config [flink-cdc]

2025-04-10 Thread via GitHub
hql0312 commented on PR #3979: URL: https://github.com/apache/flink-cdc/pull/3979#issuecomment-2785088218 @leonardBang can you review it ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

[jira] [Resolved] (FLINK-34554) FLIP-511: Using EXACTLY_ONCE with KafkaSink cause broker's OOM due to newly created transactionalId per checkpoint

2025-04-10 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise resolved FLINK-34554. - Release Note: Sinks now support to reuse transactional ids to reduce the pressure on Kafka broke

Re: [PR] [FLINK-37548] Add Model DDL methods in TABLE API [flink]

2025-04-10 Thread via GitHub
snuyanzin commented on code in PR #26385: URL: https://github.com/apache/flink/pull/26385#discussion_r2031813534 ## flink-table/flink-table-api-java/src/test/java/org/apache/flink/table/api/TableEnvironmentTest.java: ## @@ -158,6 +167,121 @@ void testTableFromDescriptor() {

[jira] [Commented] (FLINK-35811) Add the documentation sections to describe the usage of users-oriented interfaces

2025-04-10 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17942094#comment-17942094 ] Ruan Hang commented on FLINK-35811: --- This issue is not a blocker for jdbc-3.3.0. Move

Re: [PR] [FLINK-37640][table-planner] Fix timestamp_ltz is converted timestamp in scan reuse [flink]

2025-04-10 Thread via GitHub
davidradl commented on code in PR #26430: URL: https://github.com/apache/flink/pull/26430#discussion_r2035552895 ## flink-table/flink-table-planner/src/main/java/org/apache/flink/table/planner/plan/reuse/ScanReuserUtils.java: ## @@ -203,7 +204,13 @@ private static WatermarkPushD

[PR] [FLINK-37104] Refactor transform module, code cleanup [flink-cdc]

2025-04-10 Thread via GitHub
yuxiqian opened a new pull request, #3986: URL: https://github.com/apache/flink-cdc/pull/3986 This closes FLINK-37104. ...by refactoring transform module to improve code readability and maintainability. No behavior changes are expected for all valid use cases. Kindly ping @aiwe

Re: [PR] [FLINK-37603] QueryOperation SQL Serialization customization [flink]

2025-04-10 Thread via GitHub
dawidwys merged PR #26389: URL: https://github.com/apache/flink/pull/26389 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apac

[jira] [Updated] (FLINK-35811) Add the documentation sections to describe the usage of users-oriented interfaces

2025-04-10 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang updated FLINK-35811: -- Fix Version/s: jdbc-4.0.0 (was: jdbc-3.3.0) > Add the documentation sections to

Re: [PR] [hotfix] Remove the redundant config for execution target [flink]

2025-04-10 Thread via GitHub
flinkbot commented on PR #26425: URL: https://github.com/apache/flink/pull/26425#issuecomment-2788693483 ## CI report: * de930a07369941248b65473c2abfbdcfa8fd28cc UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Created] (FLINK-37649) Datagen connector cannot set length for collection type

2025-04-10 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-37649: -- Summary: Datagen connector cannot set length for collection type Key: FLINK-37649 URL: https://issues.apache.org/jira/browse/FLINK-37649 Project: Flink Issue Typ

Re: [PR] [FLINK-37637] Avoid dead lock for Configuration's addAll [flink]

2025-04-10 Thread via GitHub
beliefer commented on PR #26426: URL: https://github.com/apache/flink/pull/26426#issuecomment-2789624251 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [FLINK-37643] Support partial deletes when converting to external data structures [flink]

2025-04-10 Thread via GitHub
dawidwys commented on code in PR #26436: URL: https://github.com/apache/flink/pull/26436#discussion_r2036845844 ## flink-table/flink-table-runtime/src/test/java/org/apache/flink/table/data/DataStructureConvertersTest.java: ## @@ -355,7 +355,62 @@ static List testData() {

Re: [PR] [FLINK-37637] Avoid dead lock for Configuration's addAll [flink]

2025-04-10 Thread via GitHub
beliefer commented on PR #26426: URL: https://github.com/apache/flink/pull/26426#issuecomment-2792283654 ping @StephanEwen cc @1996fanrui @davidradl @GOODBOY008 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [FLINK-36931][cdc] FlinkCDC YAML supports batch mode [flink-cdc]

2025-04-10 Thread via GitHub
aiwenmo commented on code in PR #3812: URL: https://github.com/apache/flink-cdc/pull/3812#discussion_r2034621913 ## flink-cdc-runtime/src/main/java/org/apache/flink/cdc/runtime/operators/schema/common/SchemaManager.java: ## @@ -73,6 +73,12 @@ public SchemaManager() { be

Re: [PR] [FLINK-37623][datastream] Async state support for process() in Datastream API [flink]

2025-04-10 Thread via GitHub
davidradl commented on code in PR #26419: URL: https://github.com/apache/flink/pull/26419#discussion_r2032812978 ## flink-runtime/src/main/java/org/apache/flink/streaming/api/datastream/KeyedStream.java: ## @@ -358,9 +359,10 @@ public SingleOutputStreamOperator process( @I

Re: [PR] [hotfix] fix ci failure due to code style [flink-cdc]

2025-04-10 Thread via GitHub
MOBIN-F commented on PR #3980: URL: https://github.com/apache/flink-cdc/pull/3980#issuecomment-2785098828 @leonardBang PTAL -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [FLINK-33634] Add Conditions to Flink CRD's Status field [flink-kubernetes-operator]

2025-04-10 Thread via GitHub
davidradl commented on code in PR #957: URL: https://github.com/apache/flink-kubernetes-operator/pull/957#discussion_r2037057434 ## flink-kubernetes-operator-api/src/main/java/org/apache/flink/kubernetes/operator/api/status/FlinkDeploymentStatus.java: ## @@ -55,4 +60,188 @@ pub

Re: [PR] [FLINK-37628] Fix reference counting in ForSt file cache [flink]

2025-04-10 Thread via GitHub
davidradl commented on code in PR #26415: URL: https://github.com/apache/flink/pull/26415#discussion_r2032837282 ## flink-state-backends/flink-statebackend-forst/src/main/java/org/apache/flink/state/forst/fs/cache/CachedDataInputStream.java: ## @@ -102,62 +102,81 @@ private FSDa

Re: [PR] Bump org.apache.avro:avro from 1.8.2 to 1.11.4 in /flink-connectors/flink-connector-hive [flink]

2025-04-10 Thread via GitHub
github-actions[bot] commented on PR #25749: URL: https://github.com/apache/flink/pull/25749#issuecomment-2788405884 This PR is being marked as stale since it has not had any activity in the last 90 days. If you would like to keep this PR alive, please leave a comment asking for a review

[jira] [Closed] (FLINK-37626) Flaky test: ForStFlinkFileSystemTest.testSstFileInCache

2025-04-10 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan closed FLINK-37626. --- Fix Version/s: 2.1.0 Resolution: Resolved > Flaky test: ForStFlinkFileSystemTest.testSstFileI

[jira] [Created] (FLINK-37629) Use Checkpointed Offset while migrating clusters in DynamicKafkaSource

2025-04-10 Thread Chirag Dewan (Jira)
Chirag Dewan created FLINK-37629: Summary: Use Checkpointed Offset while migrating clusters in DynamicKafkaSource Key: FLINK-37629 URL: https://issues.apache.org/jira/browse/FLINK-37629 Project: Flink

[jira] [Updated] (FLINK-36648) Release flink-connector-kafka v4.0.0 for Flink 2.0

2025-04-10 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-36648: Fix Version/s: (was: kafka-4.0.0) > Release flink-connector-kafka v4.0.0 for Flink 2.0 > -

Re: [PR] [FLINK-37610] Check if orderBy keys exists before accessing [flink]

2025-04-10 Thread via GitHub
snuyanzin commented on code in PR #26407: URL: https://github.com/apache/flink/pull/26407#discussion_r2032433700 ## flink-table/flink-table-planner/src/main/scala/org/apache/flink/table/planner/plan/optimize/program/FlinkChangelogModeInferenceProgram.scala: ## @@ -310,18 +310,26

  1   2   >