[jira] [Updated] (FLINK-36115) Allow to scan newly table DDL during binlog reading stage.

2024-08-21 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu updated FLINK-36115: --- Summary: Allow to scan newly table DDL during binlog reading stage. (was: Allow to scan newly table

[jira] [Assigned] (FLINK-36115) Allow to scan newly table DDL during incremental reading stage.

2024-08-21 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reassigned FLINK-36115: -- Assignee: Leonard Xu (was: LvYanquan) > Allow to scan newly table DDL during incremental rea

[jira] [Assigned] (FLINK-33677) Remove flink-conf.yaml from flink dist

2024-08-21 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-33677: --- Assignee: Junrui Li > Remove flink-conf.yaml from flink dist >

[jira] [Updated] (FLINK-36129) Autoscaler is compatible with Flink 1.20

2024-08-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36129: --- Labels: pull-request-available (was: ) > Autoscaler is compatible with Flink 1.20 > ---

[PR] [FLINK-36129][autoscaler] Autoscaler is compatible with Flink 1.20 [flink-kubernetes-operator]

2024-08-21 Thread via GitHub
1996fanrui opened a new pull request, #869: URL: https://github.com/apache/flink-kubernetes-operator/pull/869 ## What is the purpose of the change AggregatedMetric added the skew field in Flink 1.20, it caused the AggregatedMetric of old version cannot parse the AggregatedMetric of 1.

[jira] [Created] (FLINK-36129) Autoscaler is compatible with Flink 1.20

2024-08-21 Thread Rui Fan (Jira)
Rui Fan created FLINK-36129: --- Summary: Autoscaler is compatible with Flink 1.20 Key: FLINK-36129 URL: https://issues.apache.org/jira/browse/FLINK-36129 Project: Flink Issue Type: Improvement

Re: [PR] [FLINK-36114] Make `SchemaRegistryRequestHandler` thread safe by blocking more schema change events [flink-cdc]

2024-08-21 Thread via GitHub
leonardBang commented on PR #3563: URL: https://github.com/apache/flink-cdc/pull/3563#issuecomment-2303778928 Thanks @yuxiqian for the contribution, I left some comments @loserwang1024 Would you like to take a look at this PR whrn you have time? -- This is an automated message from the Ap

Re: [PR] [FLINK-36114] Make `SchemaRegistryRequestHandler` thread safe by blocking more schema change events [flink-cdc]

2024-08-21 Thread via GitHub
leonardBang commented on code in PR #3563: URL: https://github.com/apache/flink-cdc/pull/3563#discussion_r1726328254 ## flink-cdc-runtime/src/main/java/org/apache/flink/cdc/runtime/operators/schema/SchemaOperator.java: ## @@ -435,13 +421,26 @@ private void handleSchemaChangeEven

[jira] [Resolved] (FLINK-36115) Allow to scan newly table DDL during incremental reading stage.

2024-08-21 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu resolved FLINK-36115. Resolution: Resolved master: 565032e3af66677cffd8a797de9af7c9f4490f57 > Allow to scan newly table

[jira] [Updated] (FLINK-36115) Allow to scan newly table DDL during incremental reading stage.

2024-08-21 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu updated FLINK-36115: --- Fix Version/s: cdc-3.3.0 (was: cdc-3.2.0) > Allow to scan newly table DDL dur

Re: [PR] [FLINK-36115][pipeline-connector][mysql] add scan.incremental.newly-added-table.enabled option [flink-cdc]

2024-08-21 Thread via GitHub
leonardBang merged PR #3560: URL: https://github.com/apache/flink-cdc/pull/3560 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink

[jira] [Updated] (FLINK-36105) CDC pipeline job could not restore from state in Flink 1.20

2024-08-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36105: --- Labels: pull-request-available (was: ) > CDC pipeline job could not restore from state in F

[jira] [Assigned] (FLINK-36093) PreTransform operator wrongly filters out columns when multiple transform rules were defined

2024-08-21 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reassigned FLINK-36093: -- Assignee: MOBIN > PreTransform operator wrongly filters out columns when multiple transform

Re: [PR] [FLINK-36074][Connectors/mongodb] Support insert overwrite semantics for mongodb table sink [flink-connector-mongodb]

2024-08-21 Thread via GitHub
Jiabao-Sun commented on PR #43: URL: https://github.com/apache/flink-connector-mongodb/pull/43#issuecomment-2303601017 Hi @leonardBang, could you help take a look when you have time? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G

Re: [PR] [Mysql Pipline] Support mysql pipline rate limit [flink-cdc]

2024-08-21 Thread via GitHub
yuxiqian commented on PR #3547: URL: https://github.com/apache/flink-cdc/pull/3547#issuecomment-2303600839 Will [FLIP-238](https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=217385972) be helpful when implementing rate limited source? -- This is an automated message from th

Re: [PR] [Mysql Pipline] Support mysql pipline rate limit [flink-cdc]

2024-08-21 Thread via GitHub
gaoyan1998 commented on PR #3547: URL: https://github.com/apache/flink-cdc/pull/3547#issuecomment-2303594608 > Thanks @gaoyan1998 for the contribution, FLIP 27 Source API also has a basic rate limiting design, Would you consider develop base on that one? yes i can do it. Can you give

[jira] [Updated] (FLINK-36076) Hotfix: Set isSchemaChangeApplying as volatile for thread safe.

2024-08-21 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-36076: -- Fix Version/s: cdc-3.2.0 (was: cdc-3.3.0) > Hotfix: Set isSchemaChangeA

[jira] [Updated] (FLINK-36094) CDC SchemaRegistryRequestHandler should throw exception which is not SchemaEvolveException

2024-08-21 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-36094: -- Priority: Blocker (was: Critical) > CDC SchemaRegistryRequestHandler should throw exception w

[jira] [Updated] (FLINK-36076) Hotfix: Set isSchemaChangeApplying as volatile for thread safe.

2024-08-21 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-36076: -- Affects Version/s: cdc-3.1.1 (was: cdc-3.2.0) > Hotfix: Set isSchem

[jira] [Updated] (FLINK-36076) Hotfix: Set isSchemaChangeApplying as volatile for thread safe.

2024-08-21 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-36076: -- Priority: Blocker (was: Major) > Hotfix: Set isSchemaChangeApplying as volatile for thread sa

[jira] [Updated] (FLINK-36114) Schema registry should block when handling existing requests

2024-08-21 Thread yux (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yux updated FLINK-36114: Issue Type: Bug (was: Improvement) > Schema registry should block when handling existing requests > -

[jira] [Updated] (FLINK-36105) CDC pipeline job could not restore from state in Flink 1.20

2024-08-21 Thread yux (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yux updated FLINK-36105: Priority: Blocker (was: Major) > CDC pipeline job could not restore from state in Flink 1.20 > --

[jira] [Updated] (FLINK-36114) Schema registry should block when handling existing requests

2024-08-21 Thread yux (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yux updated FLINK-36114: Priority: Blocker (was: Major) > Schema registry should block when handling existing requests > -

[jira] [Updated] (FLINK-36128) Promote LENIENT mode as the default schema evolution behavior

2024-08-21 Thread yux (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yux updated FLINK-36128: Issue Type: Bug (was: Improvement) > Promote LENIENT mode as the default schema evolution behavior >

[jira] [Updated] (FLINK-36128) Promote LENIENT mode as the default schema evolution behavior

2024-08-21 Thread yux (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yux updated FLINK-36128: Priority: Blocker (was: Major) > Promote LENIENT mode as the default schema evolution behavior >

Re: [PR] [FLINK-36117] Implement AsyncKeyedStateBackend for RocksDBKeyedStateBackend and HeapKeyedStateBackend [flink]

2024-08-21 Thread via GitHub
flinkbot commented on PR #25233: URL: https://github.com/apache/flink/pull/25233#issuecomment-2303571956 ## CI report: * 9305ec8f3d4036d1c8262bccbfc76940c2c2657a UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-36117) Implement AsyncKeyedStateBackend for RocksDBKeyedStateBackend and HeapKeyedStateBackend.

2024-08-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36117: --- Labels: pull-request-available (was: ) > Implement AsyncKeyedStateBackend for RocksDBKeyedS

[PR] [FLINK-36117] Implement AsyncKeyedStateBackend for RocksDBKeyedStateBackend and HeapKeyedStateBackend [flink]

2024-08-21 Thread via GitHub
wqshr12345 opened a new pull request, #25233: URL: https://github.com/apache/flink/pull/25233 ## What is the purpose of the change This pull request implements the AsyncKeyedStateBackend interface for RocksDBKeyedStateBackend and HeapKeyedStateBackend, enabling both RocksDBStateB

Re: [PR] [FLINK-36096] Add synchronous interfaces for State V2 API. [flink]

2024-08-21 Thread via GitHub
wqshr12345 commented on code in PR #25221: URL: https://github.com/apache/flink/pull/25221#discussion_r1726156403 ## flink-state-backends/flink-statebackend-forst/src/test/java/org/apache/flink/state/forst/ForStDBOperationTestBase.java: ## @@ -129,6 +137,16 @@ static class TestS

Re: [PR] [FLINK-36096] Add synchronous interfaces for State V2 API. [flink]

2024-08-21 Thread via GitHub
wqshr12345 commented on code in PR #25221: URL: https://github.com/apache/flink/pull/25221#discussion_r1726156261 ## flink-runtime/src/main/java/org/apache/flink/runtime/state/v2/SyncIteratorWrapper.java: ## @@ -0,0 +1,53 @@ +/* + * Licensed to the Apache Software Foundation (AS

Re: [PR] [FLINK-36096] Add synchronous interfaces for State V2 API. [flink]

2024-08-21 Thread via GitHub
wqshr12345 commented on code in PR #25221: URL: https://github.com/apache/flink/pull/25221#discussion_r1726156110 ## flink-core-api/src/main/java/org/apache/flink/api/common/state/v2/AppendingState.java: ## @@ -54,12 +55,40 @@ public interface AppendingState extends State {

[jira] [Commented] (FLINK-36125) File not found exception on restoring state handles with file merging

2024-08-21 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17875713#comment-17875713 ] Zakelly Lan commented on FLINK-36125: - > The file does not exist in the directory. S

[jira] [Assigned] (FLINK-36125) File not found exception on restoring state handles with file merging

2024-08-21 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan reassigned FLINK-36125: --- Assignee: Zakelly Lan > File not found exception on restoring state handles with file mergi

[jira] [Updated] (FLINK-36114) Schema registry should block when handling existing requests

2024-08-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36114: --- Labels: pull-request-available (was: ) > Schema registry should block when handling existin

[PR] [FLINK-36114] Make `SchemaRegistryRequestHandler` thread safe by blocking more schema change events [flink-cdc]

2024-08-21 Thread via GitHub
yuxiqian opened a new pull request, #3563: URL: https://github.com/apache/flink-cdc/pull/3563 This closes FLINK-36114. Currently, SchemaRegistry asynchronously receives schema change requests from SchemaOperator, and results of multiple requests might got mixed up together, causing i

Re: [PR] [FLINK-36094] CDC SchemaRegistryRequestHandler should throw exception which is not SchemaEvolveException [flink-cdc]

2024-08-21 Thread via GitHub
leonardBang merged PR #3558: URL: https://github.com/apache/flink-cdc/pull/3558 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink

Re: [PR] [FLINK-36127][web] support sort watermark [flink]

2024-08-21 Thread via GitHub
canda commented on PR #25232: URL: https://github.com/apache/flink/pull/25232#issuecomment-2303477786 @1996fanrui Could you please review this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Created] (FLINK-36128) Promote LENIENT mode as the default schema evolution behavior

2024-08-21 Thread yux (Jira)
yux created FLINK-36128: --- Summary: Promote LENIENT mode as the default schema evolution behavior Key: FLINK-36128 URL: https://issues.apache.org/jira/browse/FLINK-36128 Project: Flink Issue Type: Impr

[jira] [Resolved] (FLINK-33681) Display source/sink numRecordsIn/Out & numBytesIn/Out on UI

2024-08-21 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved FLINK-33681. -- Fix Version/s: 2.0.0 Release Note: The Source and Sink IO metrics are not reported to the

[jira] [Updated] (FLINK-33681) Display source/sink numRecordsIn/Out & numBytesIn/Out on UI

2024-08-21 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-33681: - Affects Version/s: 1.19.1 1.20.0 > Display source/sink numRecordsIn/Out &

Re: [PR] [FLINK-33681] Reuse input/output metrics of SourceOperator/SinkWriterOperator for task [flink]

2024-08-21 Thread via GitHub
becketqin commented on PR #23998: URL: https://github.com/apache/flink/pull/23998#issuecomment-2303180660 Merged to master: 0309f13e8af62f9b523e227a3a66ff59e838a1b4 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

Re: [PR] [FLINK-33681] Reuse input/output metrics of SourceOperator/SinkWriterOperator for task [flink]

2024-08-21 Thread via GitHub
becketqin merged PR #23998: URL: https://github.com/apache/flink/pull/23998 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apa

[jira] [Commented] (FLINK-36126) Qualification of current catalog and current database should happen during execution, not parsing

2024-08-21 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17875669#comment-17875669 ] Sergey Nuyanzin commented on FLINK-36126: - Merged as [e217fa15c28e18ca2ede90126

[jira] [Resolved] (FLINK-36126) Qualification of current catalog and current database should happen during execution, not parsing

2024-08-21 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin resolved FLINK-36126. - Fix Version/s: 2.0.0 Resolution: Fixed > Qualification of current catalog and cur

Re: [PR] [FLINK-36126] Qualification of current catalog and current database should happen during execution, not parsing [flink]

2024-08-21 Thread via GitHub
snuyanzin merged PR #25230: URL: https://github.com/apache/flink/pull/25230 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apa

[PR] Add insert-only change stream option [flink-cdc]

2024-08-21 Thread via GitHub
henneberger opened a new pull request, #3562: URL: https://github.com/apache/flink-cdc/pull/3562 Adds the option to do an insert-only stream for connectors that support specifying a changelog mode. This allows debezium connectors to be imported into flink as stream tables to take advantage

[jira] [Commented] (FLINK-35056) when initial sqlserver table that's primary key is datetime type, it org.apache.flink.table.api.ValidationException: Timestamp precision must be between 0 and 9 (both

2024-08-21 Thread Sergei Morozov (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17875604#comment-17875604 ] Sergei Morozov commented on FLINK-35056: I submitted a pull request with a test

[jira] [Updated] (FLINK-35056) when initial sqlserver table that's primary key is datetime type, it org.apache.flink.table.api.ValidationException: Timestamp precision must be between 0 and 9 (both i

2024-08-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35056: --- Labels: pull-request-available (was: ) > when initial sqlserver table that's primary key is

Re: [PR] [FLINK-31664][table]Add ARRAY_INTERSECT function [flink]

2024-08-21 Thread via GitHub
hanyuzheng7 closed pull request #23171: [FLINK-31664][table]Add ARRAY_INTERSECT function URL: https://github.com/apache/flink/pull/23171 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] [FLINK-36127][web] support sort watermark [flink]

2024-08-21 Thread via GitHub
flinkbot commented on PR #25232: URL: https://github.com/apache/flink/pull/25232#issuecomment-2302547372 ## CI report: * f6845ba4c741f18c9c3f056cf1800a6402a6296c UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-36127) Support sorting watermark on flink web

2024-08-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36127: --- Labels: pull-request-available (was: ) > Support sorting watermark on flink web > -

[PR] [FLINK-36127][web] support sort watermark [flink]

2024-08-21 Thread via GitHub
canda opened a new pull request, #25232: URL: https://github.com/apache/flink/pull/25232 ## What is the purpose of the change To facilitate the observation of Watermark conditions among different Subtasks, the UI supports sorting by Watermark. ## Brief change log Add so

Re: [PR] [FLINK-27146] [Filesystem] Migrate to Junit5 [flink]

2024-08-21 Thread via GitHub
ferenc-csaky commented on code in PR #22789: URL: https://github.com/apache/flink/pull/22789#discussion_r172533 ## flink-filesystems/flink-azure-fs-hadoop/src/test/java/org/apache/flink/fs/azurefs/AzureBlobRecoverableWriterTest.java: ## @@ -46,8 +45,13 @@ class AzureBlobReco

[jira] [Closed] (FLINK-35716) Fix use of AsyncScalarFunction in join conditions

2024-08-21 Thread Timo Walther (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timo Walther closed FLINK-35716. Fix Version/s: 2.0.0 Assignee: Alan Sheinberg Resolution: Fixed Fixed in master: 9

Re: [PR] [FLINK-35716] Adds a rule which splits out async calls from join cond… [flink]

2024-08-21 Thread via GitHub
twalthr merged PR #24992: URL: https://github.com/apache/flink/pull/24992 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apach

[jira] [Created] (FLINK-36127) Support sorting watermark on flink web

2024-08-21 Thread Yu Chen (Jira)
Yu Chen created FLINK-36127: --- Summary: Support sorting watermark on flink web Key: FLINK-36127 URL: https://issues.apache.org/jira/browse/FLINK-36127 Project: Flink Issue Type: Improvement

[jira] [Commented] (FLINK-36125) File not found exception on restoring state handles with file merging

2024-08-21 Thread Burak Ozakinci (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17875516#comment-17875516 ] Burak Ozakinci commented on FLINK-36125: Hello [~zakelly], thanks for rapid resp

Re: [PR] [FLINK-36126] Qualification of current catalog and current database should happen during execution, not parsing [flink]

2024-08-21 Thread via GitHub
snuyanzin commented on PR #25230: URL: https://github.com/apache/flink/pull/25230#issuecomment-2302202733 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Updated] (FLINK-36125) File not found exception on restoring state handles with file merging

2024-08-21 Thread Burak Ozakinci (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Ozakinci updated FLINK-36125: --- Description: 1.20 app with file merging with across checkpoints option enabled. {*}executio

Re: [PR] [FLINK-36126] Qualification of current catalog and current database should happen during execution, not parsing [flink]

2024-08-21 Thread via GitHub
snuyanzin commented on code in PR #25230: URL: https://github.com/apache/flink/pull/25230#discussion_r1725135735 ## flink-table/flink-table-api-java/src/main/java/org/apache/flink/table/operations/AbstractShowOperation.java: ## @@ -55,6 +57,18 @@ public AbstractShowOperation(

[jira] [Updated] (FLINK-36125) File not found exception on restoring state handles with file merging

2024-08-21 Thread Burak Ozakinci (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Ozakinci updated FLINK-36125: --- Description: 1.20 app with file merging with across checkpoints option enabled. {*}executio

[jira] [Closed] (FLINK-35932) Add REGEXP_COUNT function

2024-08-21 Thread lincoln lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lincoln lee closed FLINK-35932. --- Fix Version/s: 2.0.0 Resolution: Fixed Fixed in master: 8189bba195326d899a9830d3a19b50cafa092

[jira] [Closed] (FLINK-35962) Add REGEXP_INSTR function

2024-08-21 Thread lincoln lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lincoln lee closed FLINK-35962. --- Fix Version/s: 2.0.0 Assignee: Dylan He Resolution: Fixed Fixed in master: cbbb1cd17

[jira] [Closed] (FLINK-35931) Add REGEXP_EXTRACT_ALL function

2024-08-21 Thread lincoln lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lincoln lee closed FLINK-35931. --- Fix Version/s: 2.0.0 Resolution: Fixed Fixed in master: 7fa4ebad057bca765b661a553f4ccc2df7861

[jira] [Closed] (FLINK-35963) Add REGEXP_SUBSTR function

2024-08-21 Thread lincoln lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lincoln lee closed FLINK-35963. --- Fix Version/s: 2.0.0 Assignee: Dylan He Resolution: Fixed Fixed in master: e8c1d1b9d

Re: [PR] [FLINK-35931][table] Add the built-in functions REGEXP_COUNT & REGEXP_EXTRACT_ALL & REGEXP_INSTR & REGEXP_SUBSTR [flink]

2024-08-21 Thread via GitHub
lincoln-lil merged PR #25137: URL: https://github.com/apache/flink/pull/25137 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.a

Re: [PR] [FLINK-36124][connectors][aws]Make S3RecoverableFsDataOutputStream.sync not to close the stream [flink]

2024-08-21 Thread via GitHub
flinkbot commented on PR #25231: URL: https://github.com/apache/flink/pull/25231#issuecomment-2302147409 ## CI report: * 94e945759fc30328a3991c52e22d4be15189ba59 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-36124][connectors][aws]Make S3RecoverableFsDataOutputStream.sync not to close the stream [flink]

2024-08-21 Thread via GitHub
gaborgsomogyi commented on PR #25231: URL: https://github.com/apache/flink/pull/25231#issuecomment-2302142121 cc @dannycranmer @hlteoh37 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

[jira] [Updated] (FLINK-36124) S3RecoverableFsDataOutputStream.sync closes the stream and further write operations throw exception

2024-08-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36124: --- Labels: pull-request-available (was: ) > S3RecoverableFsDataOutputStream.sync closes the st

[PR] [FLINK-36124][connectors][aws]Make S3RecoverableFsDataOutputStream.sync not to close the stream [flink]

2024-08-21 Thread via GitHub
gaborgsomogyi opened a new pull request, #25231: URL: https://github.com/apache/flink/pull/25231 ## What is the purpose of the change At the moment `S3RecoverableFsDataOutputStream.sync` closing the stream and all upcoming `write` operations fail consistently with the following except

Re: [PR] [FLINK-36126] Qualification of current catalog and current database should happen during execution, not parsing [flink]

2024-08-21 Thread via GitHub
twalthr commented on code in PR #25230: URL: https://github.com/apache/flink/pull/25230#discussion_r1725111678 ## flink-table/flink-table-api-java/src/main/java/org/apache/flink/table/operations/ShowFunctionsOperation.java: ## @@ -105,6 +107,14 @@ protected Collection retrieveD

Re: [PR] [FLINK-36126] Qualification of current catalog and current database should happen during execution, not parsing [flink]

2024-08-21 Thread via GitHub
snuyanzin commented on code in PR #25230: URL: https://github.com/apache/flink/pull/25230#discussion_r1725096632 ## flink-table/flink-sql-parser/src/main/java/org/apache/flink/sql/parser/dql/SqlShowCall.java: ## @@ -30,6 +30,7 @@ import java.util.List; import java.util.Objects

Re: [PR] [FLINK-36126] Qualification of current catalog and current database should happen during execution, not parsing [flink]

2024-08-21 Thread via GitHub
flinkbot commented on PR #25230: URL: https://github.com/apache/flink/pull/25230#issuecomment-2302105773 ## CI report: * 003783058c3f43613358cc1e4d210170c96036fa UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-36126) Qualification of current catalog and current database should happen during execution, not parsing

2024-08-21 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin updated FLINK-36126: Description: This is the unfortunate side effect of FLINK-36085 which should be fixed > Q

[jira] [Updated] (FLINK-36126) Qualification of current catalog and current database should happen during execution, not parsing

2024-08-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36126: --- Labels: pull-request-available (was: ) > Qualification of current catalog and current datab

[PR] [FLINK-36126] Qualification of current catalog and current database should happen during execution, not parsing [flink]

2024-08-21 Thread via GitHub
snuyanzin opened a new pull request, #25230: URL: https://github.com/apache/flink/pull/25230 ## What is the purpose of the change The behavior was changed in FLINK-36085 while refactoring this PR makes the behavior as before and adds some tests for it Also adds some missing j

[jira] [Created] (FLINK-36126) Qualification of current catalog and current database should happen during execution, not parsing

2024-08-21 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-36126: --- Summary: Qualification of current catalog and current database should happen during execution, not parsing Key: FLINK-36126 URL: https://issues.apache.org/jira/browse/FLINK-

[jira] [Commented] (FLINK-36125) File not found exception on restoring state handles with file merging

2024-08-21 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17875488#comment-17875488 ] Zakelly Lan commented on FLINK-36125: - [~burakoz] Thanks for reporting this! Actuall

[jira] [Updated] (FLINK-36124) S3RecoverableFsDataOutputStream.sync closes the stream and further write operations throw exception

2024-08-21 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi updated FLINK-36124: -- Summary: S3RecoverableFsDataOutputStream.sync closes the stream and further write operations t

Re: [PR] [FLINK-36115][pipeline-connector][mysql] add scan.incremental.newly-added-table.enabled option [flink-cdc]

2024-08-21 Thread via GitHub
leonardBang commented on PR #3560: URL: https://github.com/apache/flink-cdc/pull/3560#issuecomment-2302041115 @Jiabao-Sun @GOODBOY008 Would you like to take a look at this PR if you have time? -- This is an automated message from the Apache Git Service. To respond to the message, please l

[jira] [Assigned] (FLINK-36115) Allow to scan newly table DDL during incremental reading stage.

2024-08-21 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reassigned FLINK-36115: -- Assignee: LvYanquan > Allow to scan newly table DDL during incremental reading stage. > -

Re: [PR] [FLINK-FLINK-36115][pipeline-connector][mysql] add scan.incremental.newly-added-table.enabled option [flink-cdc]

2024-08-21 Thread via GitHub
leonardBang commented on code in PR #3560: URL: https://github.com/apache/flink-cdc/pull/3560#discussion_r1725037516 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-mysql/src/main/java/org/apache/flink/cdc/connectors/mysql/factory/MySqlDataSourceFactory.j

[jira] [Updated] (FLINK-36125) File not found exception on restoring state handles with file merging

2024-08-21 Thread Burak Ozakinci (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Ozakinci updated FLINK-36125: --- Attachment: app_code.txt > File not found exception on restoring state handles with file mer

[jira] [Assigned] (FLINK-36124) S3RecoverableFsDataOutputStream.sync closes the stream and further write operation throw exception

2024-08-21 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi reassigned FLINK-36124: - Assignee: Gabor Somogyi > S3RecoverableFsDataOutputStream.sync closes the stream and fu

[jira] [Created] (FLINK-36125) File not found exception on restoring state handles with file merging

2024-08-21 Thread Burak Ozakinci (Jira)
Burak Ozakinci created FLINK-36125: -- Summary: File not found exception on restoring state handles with file merging Key: FLINK-36125 URL: https://issues.apache.org/jira/browse/FLINK-36125 Project: Fl

Re: [PR] [FLINK-23598] [core] Fix a bug that caused position to be updated twice when writing a string to a byte array [flink]

2024-08-21 Thread via GitHub
sn-12-3 commented on PR #23563: URL: https://github.com/apache/flink/pull/23563#issuecomment-2301998434 @injae-kim , I was looking at the change, this line in [here](https://github.com/apache/flink/blob/bf63127aaa34a5863bccfe0e019b8d6036c7f9c0/flink-core/src/main/java/org/apache/flink/core/m

Re: [PR] [FLINK-35931][table] Add the built-in functions REGEXP_COUNT & REGEXP_EXTRACT_ALL & REGEXP_INSTR & REGEXP_SUBSTR [flink]

2024-08-21 Thread via GitHub
lincoln-lil commented on PR #25137: URL: https://github.com/apache/flink/pull/25137#issuecomment-2301958242 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

[jira] [Commented] (FLINK-34996) Custom Deserializer can't be instantiated when connector-kafka installed into Flink Libs

2024-08-21 Thread Hugo Gu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17875463#comment-17875463 ] Hugo Gu commented on FLINK-34996: - [~renqs] , I have raised [PR|https://github.com/apac

[jira] [Assigned] (FLINK-36124) S3RecoverableFsDataOutputStream.sync closes the stream and further write operation throw exception

2024-08-21 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi reassigned FLINK-36124: - Assignee: (was: Gabor Somogyi) > S3RecoverableFsDataOutputStream.sync closes the st

Re: [PR] [hotfix][API/DataStream] Log the right syncDurationMillis time [flink]

2024-08-21 Thread via GitHub
pnowojski merged PR #25220: URL: https://github.com/apache/flink/pull/25220 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apa

[jira] [Assigned] (FLINK-36124) S3RecoverableFsDataOutputStream.sync closes the stream and further write operation throw exception

2024-08-21 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi reassigned FLINK-36124: - Assignee: Gabor Somogyi > S3RecoverableFsDataOutputStream.sync closes the stream and fu

[jira] [Created] (FLINK-36124) S3RecoverableFsDataOutputStream.sync closes the stream and further write operation throw exception

2024-08-21 Thread Gabor Somogyi (Jira)
Gabor Somogyi created FLINK-36124: - Summary: S3RecoverableFsDataOutputStream.sync closes the stream and further write operation throw exception Key: FLINK-36124 URL: https://issues.apache.org/jira/browse/FLINK-361

Re: [PR] [FLINK-28513] Fix Flink Table API CSV streaming sink throws SerializedThrowable exception [flink]

2024-08-21 Thread via GitHub
gaborgsomogyi commented on code in PR #21458: URL: https://github.com/apache/flink/pull/21458#discussion_r1724904768 ## flink-filesystems/flink-s3-fs-base/src/main/java/org/apache/flink/fs/s3/common/writer/S3RecoverableFsDataOutputStream.java: ## @@ -126,7 +126,16 @@ public long

[jira] [Created] (FLINK-36123) Add PERCENTILE function

2024-08-21 Thread Dylan He (Jira)
Dylan He created FLINK-36123: Summary: Add PERCENTILE function Key: FLINK-36123 URL: https://issues.apache.org/jira/browse/FLINK-36123 Project: Flink Issue Type: Sub-task Components: Ta

Re: [PR] [FLINK-28513] Fix Flink Table API CSV streaming sink throws SerializedThrowable exception [flink]

2024-08-21 Thread via GitHub
gaborgsomogyi commented on code in PR #21458: URL: https://github.com/apache/flink/pull/21458#discussion_r1724907247 ## flink-filesystems/flink-s3-fs-base/src/main/java/org/apache/flink/fs/s3/common/writer/S3RecoverableFsDataOutputStream.java: ## @@ -126,7 +126,16 @@ public long

Re: [PR] [FLINK-28513] Fix Flink Table API CSV streaming sink throws SerializedThrowable exception [flink]

2024-08-21 Thread via GitHub
gaborgsomogyi commented on code in PR #21458: URL: https://github.com/apache/flink/pull/21458#discussion_r1724904768 ## flink-filesystems/flink-s3-fs-base/src/main/java/org/apache/flink/fs/s3/common/writer/S3RecoverableFsDataOutputStream.java: ## @@ -126,7 +126,16 @@ public long

Re: [PR] [FLINK-28513] Fix Flink Table API CSV streaming sink throws SerializedThrowable exception [flink]

2024-08-21 Thread via GitHub
gaborgsomogyi commented on code in PR #21458: URL: https://github.com/apache/flink/pull/21458#discussion_r1724904768 ## flink-filesystems/flink-s3-fs-base/src/main/java/org/apache/flink/fs/s3/common/writer/S3RecoverableFsDataOutputStream.java: ## @@ -126,7 +126,16 @@ public long

Re: [PR] [FLINK-FLINK-36115][pipeline-connector][mysql] add scan.incremental.newly-added-table.enabled option [flink-cdc]

2024-08-21 Thread via GitHub
leonardBang commented on code in PR #3560: URL: https://github.com/apache/flink-cdc/pull/3560#discussion_r1724886711 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-mysql/src/test/java/org/apache/flink/cdc/connectors/mysql/source/MysqlPipelineNewlyAddedTa

Re: [PR] [FLINK-FLINK-36115][pipeline-connector][mysql] add scan.incremental.newly-added-table.enabled option [flink-cdc]

2024-08-21 Thread via GitHub
leonardBang commented on code in PR #3560: URL: https://github.com/apache/flink-cdc/pull/3560#discussion_r1724885602 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-mysql/src/main/java/org/apache/flink/cdc/connectors/mysql/source/MySqlDataSourceOptions.ja

Re: [PR] [FLINK-36094] CDC SchemaRegistryRequestHandler should throw exception which is not SchemaEvolveException [flink-cdc]

2024-08-21 Thread via GitHub
loserwang1024 commented on code in PR #3558: URL: https://github.com/apache/flink-cdc/pull/3558#discussion_r1724874641 ## flink-cdc-e2e-tests/flink-cdc-pipeline-e2e-tests/src/test/java/org/apache/flink/cdc/pipeline/tests/utils/PipelineTestEnvironment.java: ## @@ -88,7 +88,7 @@ p

  1   2   >