Re: [PR] [DRAFT][FLINK-36336] Remove deprecated dataset API dependency exclude table module [flink]

2024-09-19 Thread via GitHub
flinkbot commented on PR #25365: URL: https://github.com/apache/flink/pull/25365#issuecomment-2362935906 ## CI report: * cb7c7d40218c4db5d1f00557631805803e8e5f0b UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-36336) Remove deprecated dataset API

2024-09-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36336: --- Labels: pull-request-available (was: ) > Remove deprecated dataset API > --

[PR] [DRAFT][FLINK-36336] Remove deprecated dataset API dependency exclude table module [flink]

2024-09-19 Thread via GitHub
codenohup opened a new pull request, #25365: URL: https://github.com/apache/flink/pull/25365 ## What is the purpose of the change Remove deprecated dataset API dependency exclude table module ## Brief change log - Remove deprecated dataset API dependency exclude t

Re: [PR] [FLINK-36284][format-avro] Support extracting Avro type with new DataType stack [flink]

2024-09-19 Thread via GitHub
xuyangzhong commented on PR #25336: URL: https://github.com/apache/flink/pull/25336#issuecomment-2362915645 @davidradl Hi, could you please take another look at my comments on your proposal? This work blocks the removal of the old `toAppendStream` method, which needs to be completed in the

[jira] [Created] (FLINK-36336) Remove deprecated dataset API

2024-09-19 Thread xuhuang (Jira)
xuhuang created FLINK-36336: --- Summary: Remove deprecated dataset API Key: FLINK-36336 URL: https://issues.apache.org/jira/browse/FLINK-36336 Project: Flink Issue Type: New Feature Repor

Re: [PR] [FLINK-36327][table] Remove dependency about flink-scala and flink-streaming-scala in table module [flink]

2024-09-19 Thread via GitHub
flinkbot commented on PR #25364: URL: https://github.com/apache/flink/pull/25364#issuecomment-2362898937 ## CI report: * 721fb996271a15059a601fa90d91b58cbc14d83d UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Created] (FLINK-36335) Improving Method Reusability in StreamGraphGenerator with JobVertexBuildContext

2024-09-19 Thread Lei Yang (Jira)
Lei Yang created FLINK-36335: Summary: Improving Method Reusability in StreamGraphGenerator with JobVertexBuildContext Key: FLINK-36335 URL: https://issues.apache.org/jira/browse/FLINK-36335 Project: Flin

[jira] [Updated] (FLINK-36327) Remove the dependencies of the flink-scala and flink-streaming-scala modules from the table module.

2024-09-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36327: --- Labels: pull-request-available (was: ) > Remove the dependencies of the flink-scala and fli

[PR] [FLINK-36327][table] Remove dependency about flink-scala and flink-streaming-scala in table module [flink]

2024-09-19 Thread via GitHub
xuyangzhong opened a new pull request, #25364: URL: https://github.com/apache/flink/pull/25364 ## What is the purpose of the change *Remove dependency about flink-scala and flink-streaming-scala in table module.* ## Brief change log - *Copy utils and tests from fli

[jira] [Updated] (FLINK-36306) Remove deprecated API for 2.0-preview

2024-09-19 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-36306: --- Description: ||Module||Contributor||IsDone|| |flink-sql-connector-hive-3.1.3_2.12|[~xuyangzhong]|fal

Re: [PR] [yarn] add a non empty check in registerMultipleLocalResources [flink]

2024-09-19 Thread via GitHub
wangjunyou closed pull request #16991: [yarn] add a non empty check in registerMultipleLocalResources URL: https://github.com/apache/flink/pull/16991 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] Resolve the error in OperatorIDPairTest.jar compilation report: Too many files with unapproved license [flink]

2024-09-19 Thread via GitHub
wangjunyou closed pull request #25338: Resolve the error in OperatorIDPairTest.jar compilation report: Too many files with unapproved license URL: https://github.com/apache/flink/pull/25338 -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [PR] Remove extra commas from the "create" page [flink]

2024-09-19 Thread via GitHub
wangjunyou closed pull request #16299: Remove extra commas from the "create" page URL: https://github.com/apache/flink/pull/16299 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[jira] [Updated] (FLINK-36334) Remove the Disable markers from the tests in the various TypeSerializerUpgradeTestBase subclasses in flink-table-api-scala module

2024-09-19 Thread xuyang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xuyang updated FLINK-36334: --- Summary: Remove the Disable markers from the tests in the various TypeSerializerUpgradeTestBase subclasses i

[jira] [Created] (FLINK-36334) Remove the Disable markers from the tests in the various TypeSerializerUpgradeTestBase subclasses that have been moved from the flink-table-api-scala module

2024-09-19 Thread xuyang (Jira)
xuyang created FLINK-36334: -- Summary: Remove the Disable markers from the tests in the various TypeSerializerUpgradeTestBase subclasses that have been moved from the flink-table-api-scala module Key: FLINK-36334 URL: ht

Re: [PR] FLINK-36332 Add option to select the Fabric8 httpclient implemention [flink-kubernetes-operator]

2024-09-19 Thread via GitHub
SamBarker commented on code in PR #881: URL: https://github.com/apache/flink-kubernetes-operator/pull/881#discussion_r1767991593 ## pom.xml: ## @@ -110,6 +110,7 @@ under the License. 10.15.2.0 +24.1.0 Review Comment: Required by `KubernetesAutoS

Re: [PR] FLINK-36332 Add option to select the Fabric8 httpclient implemention [flink-kubernetes-operator]

2024-09-19 Thread via GitHub
SamBarker commented on code in PR #881: URL: https://github.com/apache/flink-kubernetes-operator/pull/881#discussion_r1767990141 ## flink-kubernetes-operator/pom.xml: ## @@ -413,6 +425,22 @@ under the License. + +dep

[jira] [Updated] (FLINK-36332) Allow the Operator http client to be customised

2024-09-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36332: --- Labels: pull-request-available (was: ) > Allow the Operator http client to be customised >

[PR] FLINK-36332 Add option to select the Fabric8 httpclient implemention [flink-kubernetes-operator]

2024-09-19 Thread via GitHub
SamBarker opened a new pull request, #881: URL: https://github.com/apache/flink-kubernetes-operator/pull/881 ## What is the purpose of the change Enable the building of the operator using alternative Fabric8 http clients. ## Brief change log Enable the building of

[jira] [Created] (FLINK-36333) FLIP-475: Support Adaptive Skewed Join Optimization

2024-09-19 Thread Lei Yang (Jira)
Lei Yang created FLINK-36333: Summary: FLIP-475: Support Adaptive Skewed Join Optimization Key: FLINK-36333 URL: https://issues.apache.org/jira/browse/FLINK-36333 Project: Flink Issue Type: New F

Re: [PR] [FLINK-35780] Support state migration between disabling and enabling State TTL for RocksDBState [flink]

2024-09-19 Thread via GitHub
Zakelly commented on code in PR #25035: URL: https://github.com/apache/flink/pull/25035#discussion_r1767916246 ## flink-runtime/src/main/java/org/apache/flink/runtime/state/ttl/TtlValueState.java: ## @@ -32,7 +32,7 @@ * @param The type of the namespace * @param Type of the

Re: [PR] [FLINK-34975][state/forst] Execute read/write state request in different executors [flink]

2024-09-19 Thread via GitHub
fredia commented on code in PR #25360: URL: https://github.com/apache/flink/pull/25360#discussion_r1767934829 ## flink-state-backends/flink-statebackend-forst/src/main/java/org/apache/flink/state/forst/ForStStateExecutor.java: ## @@ -52,22 +52,32 @@ public class ForStStateExecut

[jira] [Updated] (FLINK-36332) Allow the Operator http client to be customised

2024-09-19 Thread Sam Barker (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Barker updated FLINK-36332: --- Description: We are looking to produce a build of the Flink Kubernetes operator however for interna

[jira] [Updated] (FLINK-36332) Allow the Operator http client to be customised

2024-09-19 Thread Sam Barker (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Barker updated FLINK-36332: --- Description: We are looking to produce a build of the Flink Kubernetes operator however for interna

[jira] [Created] (FLINK-36332) Allow the Operator http client to be customised

2024-09-19 Thread Sam Barker (Jira)
Sam Barker created FLINK-36332: -- Summary: Allow the Operator http client to be customised Key: FLINK-36332 URL: https://issues.apache.org/jira/browse/FLINK-36332 Project: Flink Issue Type: Impro

Re: [PR] [FLINK-34975][state/forst] Support multiget when db all in local [flink]

2024-09-19 Thread via GitHub
flinkbot commented on PR #25363: URL: https://github.com/apache/flink/pull/25363#issuecomment-2362714740 ## CI report: * e003cb105f6d493f5bca7505b2828e043df28766 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[PR] [FLINK-34975][state/forst] Support multiget when db all in local [flink]

2024-09-19 Thread via GitHub
fredia opened a new pull request, #25363: URL: https://github.com/apache/flink/pull/25363 ## What is the purpose of the change Support multiget when db all in local. ## Brief change log - Add `isRemoteDb` check - Modify `ForStGeneralMultiGetOperation`

[jira] [Created] (FLINK-36331) Support multiGet when DB all in local

2024-09-19 Thread Yanfei Lei (Jira)
Yanfei Lei created FLINK-36331: -- Summary: Support multiGet when DB all in local Key: FLINK-36331 URL: https://issues.apache.org/jira/browse/FLINK-36331 Project: Flink Issue Type: Sub-task

Re: [PR] [FLINK-34975][state/forst] Execute read/write state request in different executors [flink]

2024-09-19 Thread via GitHub
Zakelly commented on code in PR #25360: URL: https://github.com/apache/flink/pull/25360#discussion_r1767892068 ## flink-state-backends/flink-statebackend-forst/src/main/java/org/apache/flink/state/forst/ForStStateExecutor.java: ## @@ -52,22 +52,32 @@ public class ForStStateExecu

Re: [PR] [FLINK-33750][config] Remove deprecated runtime config option [flink]

2024-09-19 Thread via GitHub
Sxnan commented on PR #25355: URL: https://github.com/apache/flink/pull/25355#issuecomment-2362562245 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [FLINK-36285] Pass default value expression in AlterColumnTypeEvent [flink-cdc]

2024-09-19 Thread via GitHub
yuxiqian commented on PR #3614: URL: https://github.com/apache/flink-cdc/pull/3614#issuecomment-2362534461 Doris connector ignores all default value fields for now. Will add test cases after https://github.com/apache/doris-flink-connector/pull/490 got merged. -- This is an automated messa

[jira] [Commented] (FLINK-36293) RocksDBWriteBatchWrapperTest.testAsyncCancellation

2024-09-19 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17883097#comment-17883097 ] Arvid Heise commented on FLINK-36293: - Another instance https://dev.azure.com/apach

Re: [PR] [FLINK-36278] Reduce log size [flink-connector-kafka]

2024-09-19 Thread via GitHub
AHeise commented on code in PR #119: URL: https://github.com/apache/flink-connector-kafka/pull/119#discussion_r1767400568 ## flink-connector-kafka/src/test/java/org/apache/flink/connector/kafka/testutils/KafkaUtil.java: ## @@ -81,24 +89,19 @@ public static KafkaContainer create

Re: [PR] [FLINK-36278] Reduce log size [flink-connector-kafka]

2024-09-19 Thread via GitHub
AHeise commented on code in PR #119: URL: https://github.com/apache/flink-connector-kafka/pull/119#discussion_r1767405829 ## flink-connector-kafka/src/test/resources/log4j2-test.properties: ## @@ -27,15 +27,41 @@ appender.testlogger.target = SYSTEM_ERR appender.testlogger.layo

[jira] [Resolved] (FLINK-36240) Incorrect Port display in the PrometheusReporter constructor

2024-09-19 Thread Ferenc Csaky (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferenc Csaky resolved FLINK-36240. -- Fix Version/s: 2.0-preview Resolution: Fixed [20e9826|https://github.com/apache/flink/c

[jira] [Resolved] (FLINK-36316) Move PortRange util to flink-core

2024-09-19 Thread Ferenc Csaky (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferenc Csaky resolved FLINK-36316. -- Resolution: Fixed [8302e12|https://github.com/apache/flink/commit/8302e12e7842726a442d07bc80e4

Re: [PR] [FLINK-36240][runtime/metrics] Fix incorrect Ports display in the PrometheusReporter constructor in case of the httpServer creation failure [flink]

2024-09-19 Thread via GitHub
ferenc-csaky merged PR #25339: URL: https://github.com/apache/flink/pull/25339 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.

[PR] Bump com.google.protobuf:protobuf-java from 3.21.7 to 3.25.5 [flink-benchmarks]

2024-09-19 Thread via GitHub
dependabot[bot] opened a new pull request, #96: URL: https://github.com/apache/flink-benchmarks/pull/96 Bumps [com.google.protobuf:protobuf-java](https://github.com/protocolbuffers/protobuf) from 3.21.7 to 3.25.5. Commits https://github.com/protocolbuffers/protobuf/commit/9d0e

[PR] Bump com.google.protobuf:protobuf-java from 3.21.9 to 3.25.5 [flink-connector-pulsar]

2024-09-19 Thread via GitHub
dependabot[bot] opened a new pull request, #97: URL: https://github.com/apache/flink-connector-pulsar/pull/97 Bumps [com.google.protobuf:protobuf-java](https://github.com/protocolbuffers/protobuf) from 3.21.9 to 3.25.5. Commits https://github.com/protocolbuffers/protobuf/commi

[PR] Bump com.google.protobuf:protobuf-java from 3.21.7 to 3.25.5 [flink-connector-aws]

2024-09-19 Thread via GitHub
dependabot[bot] opened a new pull request, #169: URL: https://github.com/apache/flink-connector-aws/pull/169 Bumps [com.google.protobuf:protobuf-java](https://github.com/protocolbuffers/protobuf) from 3.21.7 to 3.25.5. Commits https://github.com/protocolbuffers/protobuf/commit

Re: [PR] [FLINK-36278] Reduce log size [flink-connector-kafka]

2024-09-19 Thread via GitHub
fapaul commented on code in PR #119: URL: https://github.com/apache/flink-connector-kafka/pull/119#discussion_r1767018924 ## flink-connector-kafka/src/test/resources/log4j2-test.properties: ## @@ -27,15 +27,41 @@ appender.testlogger.target = SYSTEM_ERR appender.testlogger.layo

Re: [PR] [FLINK-36330] Session Window TVFs with named parameters don't support column expansion [flink]

2024-09-19 Thread via GitHub
flinkbot commented on PR #25362: URL: https://github.com/apache/flink/pull/25362#issuecomment-2361150599 ## CI report: * 6a0672b975f6fc7b00c4ef9545d53685372fe1e6 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Assigned] (FLINK-36330) Session Window TVFs with named parameters don't support column expansion

2024-09-19 Thread Jim Hughes (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Hughes reassigned FLINK-36330: -- Assignee: Jim Hughes > Session Window TVFs with named parameters don't support column expansi

[jira] [Updated] (FLINK-36330) Session Window TVFs with named parameters don't support column expansion

2024-09-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36330: --- Labels: pull-request-available (was: ) > Session Window TVFs with named parameters don't su

[PR] [FLINK-36330] Session Window TVFs with named parameters don't support column expansion [flink]

2024-09-19 Thread via GitHub
jnh5y opened a new pull request, #25362: URL: https://github.com/apache/flink/pull/25362 ## What is the purpose of the change * Adds column expansion for Session Windows in FlinkCalciteSqlValidator. ## Verifying this change This change added tests and can be verified as f

[jira] [Commented] (FLINK-35764) TimerGauge is incorrect when update is called during a measurement

2024-09-19 Thread Liu Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17883025#comment-17883025 ] Liu Liu commented on FLINK-35764: - [~pnowojski] Hello, I see you edited the TimerGauge c

[jira] [Created] (FLINK-36330) Session Window TVFs with named parameters don't support column expansion

2024-09-19 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-36330: --- Summary: Session Window TVFs with named parameters don't support column expansion Key: FLINK-36330 URL: https://issues.apache.org/jira/browse/FLINK-36330 Projec

[jira] [Commented] (FLINK-30899) FileSystemTableSource with CSV format incorrectly selects fields if filtering for partition

2024-09-19 Thread Mate Czagany (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17883018#comment-17883018 ] Mate Czagany commented on FLINK-30899: -- Hi [~luoyuxia]  Can you please take a look

[jira] [Updated] (FLINK-36329) DDB Streams connector not retrying some SDK exceptions

2024-09-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36329: --- Labels: pull-request-available (was: ) > DDB Streams connector not retrying some SDK except

[PR] [FLINK-36329][Connectors/DynamoDB] Changing retry strategy to use SDK retries to catch all retryable exceptions [flink-connector-aws]

2024-09-19 Thread via GitHub
gguptp opened a new pull request, #168: URL: https://github.com/apache/flink-connector-aws/pull/168 ## Purpose of the change DDB Connector is not retrying all SDK exceptions. Changing the retry strategy to SDK default adaptive strategy to fix this ## Verifying t

[jira] [Updated] (FLINK-36329) DDB Streams connector not retrying some SDK exceptions

2024-09-19 Thread Abhi Gupta (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhi Gupta updated FLINK-36329: --- Issue Type: Bug (was: Improvement) > DDB Streams connector not retrying some SDK exceptions > -

[jira] [Resolved] (FLINK-36328) Making the log for child not found as debug

2024-09-19 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Liang Teoh resolved FLINK-36328. - Resolution: Fixed merged commit [{{3a0e4f5}}|https://github.com/apache/flink-connector-

Re: [PR] [FLINK-36328][Connectors/DynamoDB] Making the child split not found log as debug log instead of warn log [flink-connector-aws]

2024-09-19 Thread via GitHub
hlteoh37 merged PR #167: URL: https://github.com/apache/flink-connector-aws/pull/167 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@

[jira] [Created] (FLINK-36329) DDB Streams connector not retrying some SDK exceptions

2024-09-19 Thread Abhi Gupta (Jira)
Abhi Gupta created FLINK-36329: -- Summary: DDB Streams connector not retrying some SDK exceptions Key: FLINK-36329 URL: https://issues.apache.org/jira/browse/FLINK-36329 Project: Flink Issue Type

Re: [PR] [FLINK-35411] Optimize buffer triggering of async state requests [flink]

2024-09-19 Thread via GitHub
flinkbot commented on PR #25361: URL: https://github.com/apache/flink/pull/25361#issuecomment-2360874824 ## CI report: * 35c8a9ef754254e2860a2d1d4d020b1ff669c779 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-35411) Optimize buffer triggering of async state requests

2024-09-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35411: --- Labels: pull-request-available (was: ) > Optimize buffer triggering of async state requests

[PR] [FLINK-35411] Optimize buffer triggering of async state requests [flink]

2024-09-19 Thread via GitHub
Zakelly opened a new pull request, #25361: URL: https://github.com/apache/flink/pull/25361 ## What is the purpose of the change This PR optimize the trigger logic of `AEC`. Including draining and timeout trigger. ## Brief change log ## Verifying this change Th

Re: [PR] [FLINK-36285] Pass default value expression in AlterColumnTypeEvent [flink-cdc]

2024-09-19 Thread via GitHub
yuxiqian commented on PR #3614: URL: https://github.com/apache/flink-cdc/pull/3614#issuecomment-2360820617 @qg-lin @lvyanquan PTAL -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

[PR] [FLINK-36328][Connectors/DynamoDB] Making the child split not found log as debug log instead of warn log [flink-connector-aws]

2024-09-19 Thread via GitHub
gguptp opened a new pull request, #167: URL: https://github.com/apache/flink-connector-aws/pull/167 ## Purpose of the change For stream which are always at tip and shards have not been discovered yet, we will continuously see this log, so making it a debug log #

[jira] [Updated] (FLINK-36328) Making the log for child not found as debug

2024-09-19 Thread Abhi Gupta (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhi Gupta updated FLINK-36328: --- Description: In DDB Flink connector, we are getting this warn message quite a lot:   "splitId: {}

[jira] [Updated] (FLINK-36328) Making the log for child not found as debug

2024-09-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36328: --- Labels: pull-request-available (was: ) > Making the log for child not found as debug >

[jira] [Assigned] (FLINK-36328) Making the log for child not found as debug

2024-09-19 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Liang Teoh reassigned FLINK-36328: --- Assignee: Abhi Gupta > Making the log for child not found as debug > --

[jira] [Updated] (FLINK-36285) Modify column type failed when downstream's column with defalut value

2024-09-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36285: --- Labels: pull-request-available (was: ) > Modify column type failed when downstream's column

[PR] [FLINK-36285] Pass default value expression in AlterColumnTypeEvent [flink-cdc]

2024-09-19 Thread via GitHub
yuxiqian opened a new pull request, #3614: URL: https://github.com/apache/flink-cdc/pull/3614 This closes FLINK-36285. Doris sink connector requires specifying default value expression explicitly when altering column types. However, default value fields are not present in `AlterColum

[jira] [Created] (FLINK-36328) Making the log for child not found as debug

2024-09-19 Thread Abhi Gupta (Jira)
Abhi Gupta created FLINK-36328: -- Summary: Making the log for child not found as debug Key: FLINK-36328 URL: https://issues.apache.org/jira/browse/FLINK-36328 Project: Flink Issue Type: Improveme

[jira] [Updated] (FLINK-31737) Hide the rescaling buttons for batch jobs in the WEB UI

2024-09-19 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl updated FLINK-31737: -- Labels: starter (was: ) > Hide the rescaling buttons for batch jobs in the WEB UI > -

[jira] [Closed] (FLINK-31608) Re-evaluate 'min-parallelism-increase' option

2024-09-19 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl closed FLINK-31608. - Resolution: Invalid This topic was covered by [FLIP-472|https://cwiki.apache.org/confluence/dis

[jira] [Updated] (FLINK-36326) Newly added table failed in mysql pipeline connector

2024-09-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36326: --- Labels: pull-request-available (was: ) > Newly added table failed in mysql pipeline connect

Re: [PR] [FLINK-36296][Connectors/DynamoDB] Add support for incremental shard discovery [flink-connector-aws]

2024-09-19 Thread via GitHub
gguptp closed pull request #166: [FLINK-36296][Connectors/DynamoDB] Add support for incremental shard discovery URL: https://github.com/apache/flink-connector-aws/pull/166 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

Re: [PR] [FLINK-36326] Fix auto scan newly-added table after restart [flink-cdc]

2024-09-19 Thread via GitHub
yuxiqian commented on PR #3613: URL: https://github.com/apache/flink-cdc/pull/3613#issuecomment-2360766286 cc @qg-lin @ruanhang1993 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

[jira] [Comment Edited] (FLINK-33634) Add Conditions to Flink CRD's Status field

2024-09-19 Thread lajith (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17882940#comment-17882940 ] lajith edited comment on FLINK-33634 at 9/19/24 8:56 AM: - Propos

[jira] [Updated] (FLINK-36112) Add Support for CreateFlag.NO_LOCAL_WRITE in FLINK on YARN's File Creation to Manage Disk Space and Network Load in Labeled YARN Nodes

2024-09-19 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song updated FLINK-36112: - Component/s: Connectors / FileSystem > Add Support for CreateFlag.NO_LOCAL_WRITE in FLINK on YAR

[jira] [Closed] (FLINK-36112) Add Support for CreateFlag.NO_LOCAL_WRITE in FLINK on YARN's File Creation to Manage Disk Space and Network Load in Labeled YARN Nodes

2024-09-19 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-36112. Fix Version/s: 2.0-preview Assignee: liang yu Resolution: Done master (2.0): 55591

Re: [PR] [FLINK-36015] [runtime] Align rescale parameters [flink]

2024-09-19 Thread via GitHub
XComp merged PR #25356: URL: https://github.com/apache/flink/pull/25356 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.

Re: [PR] [FLINK-36112][Connector/Filesystem].Add Support for CreateFlag.NO_LOCAL_WRITE in FLINK on YARN's File Creation to Manage Disk Space and Network Load in Labeled YARN Nodes [flink]

2024-09-19 Thread via GitHub
xintongsong closed pull request #25226: [FLINK-36112][Connector/Filesystem].Add Support for CreateFlag.NO_LOCAL_WRITE in FLINK on YARN's File Creation to Manage Disk Space and Network Load in Labeled YARN Nodes URL: https://github.com/apache/flink/pull/25226 -- This is an automated message f

Re: [PR] [FLINK-36314][state/forst] Support state V1 interface in forst statebackend [flink]

2024-09-19 Thread via GitHub
fredia commented on PR #25349: URL: https://github.com/apache/flink/pull/25349#issuecomment-2360485724 > I didn't go through all the changes, but overall LGTM since the most of the code is from RocksDB state backend. > > And is there any existing IT cases for StateBackend that we can

[jira] [Updated] (FLINK-30899) FileSystemTableSource with CSV format incorrectly selects fields if filtering for partition

2024-09-19 Thread Mate Czagany (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mate Czagany updated FLINK-30899: - Labels: pull-request-available (was: pull-request-available stale-assigned) > FileSystemTableSo

Re: [PR] Support mysql pipline rate [flink-cdc]

2024-09-19 Thread via GitHub
yuxiqian commented on code in PR #3607: URL: https://github.com/apache/flink-cdc/pull/3607#discussion_r1766431500 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-mysql/src/main/java/org/apache/flink/cdc/connectors/mysql/factory/MySqlDataSourceFactory.java

[jira] [Created] (FLINK-36327) Remove the dependencies of the flink-scala and flink-streaming-scala modules from the table module.

2024-09-19 Thread xuyang (Jira)
xuyang created FLINK-36327: -- Summary: Remove the dependencies of the flink-scala and flink-streaming-scala modules from the table module. Key: FLINK-36327 URL: https://issues.apache.org/jira/browse/FLINK-36327

Re: [PR] Support mysql pipline rate [flink-cdc]

2024-09-19 Thread via GitHub
gaoyan1998 commented on code in PR #3607: URL: https://github.com/apache/flink-cdc/pull/3607#discussion_r1766433469 ## flink-cdc-common/src/main/java/org/apache/flink/cdc/common/pipeline/PipelineOptions.java: ## Review Comment: done -- This is an automated message from

[jira] [Commented] (FLINK-35765) Support Fine Grained Resource Specifications for Adaptive Scheduler

2024-09-19 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17882976#comment-17882976 ] Matthias Pohl commented on FLINK-35765: --- Hi [~RocMarshal], I hope you're well. Wha

[jira] [Commented] (FLINK-36117) Implement AsyncKeyedStateBackend for RocksDBKeyedStateBackend and HeapKeyedStateBackend.

2024-09-19 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17882974#comment-17882974 ] Zakelly Lan commented on FLINK-36117: - Merged b20eebb ... e81da99 into master > Im

Re: [PR] [FLINK-36117] Internal adaptor from State v1 interfaces to v2 [flink]

2024-09-19 Thread via GitHub
Zakelly merged PR #25345: URL: https://github.com/apache/flink/pull/25345 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apach

[jira] [Commented] (FLINK-35412) Batch execution of async state request callback

2024-09-19 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17882970#comment-17882970 ] Zakelly Lan commented on FLINK-35412: - Merge 9a831ebfec68ad7b257c25416e790bcba5965df

[jira] [Updated] (FLINK-35411) Optimize buffer triggering of async state requests

2024-09-19 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan updated FLINK-35411: Summary: Optimize buffer triggering of async state requests (was: Optimize wait logic in draining

[jira] [Assigned] (FLINK-35411) Optimize wait logic in draining of async state requests

2024-09-19 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan reassigned FLINK-35411: --- Assignee: Zakelly Lan (was: Yanfei Lei) > Optimize wait logic in draining of async state r

[jira] [Resolved] (FLINK-35412) Batch execution of async state request callback

2024-09-19 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan resolved FLINK-35412. - Fix Version/s: 2.0-preview Resolution: Fixed > Batch execution of async state request cal

[jira] [Updated] (FLINK-35510) Implement basic incremental checkpoint for ForStStateBackend

2024-09-19 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan updated FLINK-35510: Fix Version/s: 2.0-preview > Implement basic incremental checkpoint for ForStStateBackend > --

Re: [PR] [FLINK-35412][State/Runtime] Batch execution of async state request callback [flink]

2024-09-19 Thread via GitHub
Zakelly merged PR #24832: URL: https://github.com/apache/flink/pull/24832 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apach

Re: [PR] [FLINK-35412][State/Runtime] Batch execution of async state request callback [flink]

2024-09-19 Thread via GitHub
Zakelly commented on PR #24832: URL: https://github.com/apache/flink/pull/24832#issuecomment-2360654102 Based on our testing, we were able to get some performance improvements with this PR. Will merge this. -- This is an automated message from the Apache Git Service. To respond to the

Re: [PR] Support mysql pipline rate [flink-cdc]

2024-09-19 Thread via GitHub
yuxiqian commented on code in PR #3607: URL: https://github.com/apache/flink-cdc/pull/3607#discussion_r1766431500 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-mysql/src/main/java/org/apache/flink/cdc/connectors/mysql/factory/MySqlDataSourceFactory.java

[jira] [Created] (FLINK-36326) Newly added table failed in mysql pipeline connector

2024-09-19 Thread linqigeng (Jira)
linqigeng created FLINK-36326: - Summary: Newly added table failed in mysql pipeline connector Key: FLINK-36326 URL: https://issues.apache.org/jira/browse/FLINK-36326 Project: Flink Issue Type: Bu

Re: [PR] Support mysql pipline rate [flink-cdc]

2024-09-19 Thread via GitHub
gaoyan1998 commented on code in PR #3607: URL: https://github.com/apache/flink-cdc/pull/3607#discussion_r1766500129 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-mysql/src/main/java/org/apache/flink/cdc/connectors/mysql/factory/MySqlDataSourceFactory.ja

[jira] [Assigned] (FLINK-36174) CDC yaml without pipeline will throw NullPointException

2024-09-19 Thread Ruan Hang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruan Hang reassigned FLINK-36174: - Assignee: Hongshun Wang > CDC yaml without pipeline will throw NullPointException > ---

Re: [PR] Support mysql pipline rate [flink-cdc]

2024-09-19 Thread via GitHub
gaoyan1998 commented on code in PR #3607: URL: https://github.com/apache/flink-cdc/pull/3607#discussion_r1766461205 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-mysql/src/main/java/org/apache/flink/cdc/connectors/mysql/factory/MySqlDataSourceFactory.ja

Re: [PR] Support mysql pipline rate [flink-cdc]

2024-09-19 Thread via GitHub
yuxiqian commented on code in PR #3607: URL: https://github.com/apache/flink-cdc/pull/3607#discussion_r1766476402 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-mysql/src/main/java/org/apache/flink/cdc/connectors/mysql/factory/MySqlDataSourceFactory.java

Re: [PR] Support mysql pipline rate [flink-cdc]

2024-09-19 Thread via GitHub
gaoyan1998 commented on code in PR #3607: URL: https://github.com/apache/flink-cdc/pull/3607#discussion_r1766407179 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-mysql/src/main/java/org/apache/flink/cdc/connectors/mysql/source/MySqlDataSource.java:

[jira] [Comment Edited] (FLINK-33634) Add Conditions to Flink CRD's Status field

2024-09-19 Thread lajith (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17882940#comment-17882940 ] lajith edited comment on FLINK-33634 at 9/19/24 8:54 AM: - Propos

[jira] [Commented] (FLINK-33634) Add Conditions to Flink CRD's Status field

2024-09-19 Thread lajith (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17882940#comment-17882940 ] lajith commented on FLINK-33634: Proposal has been updated , and discussion thread is [

Re: [PR] Support mysql pipline rate [flink-cdc]

2024-09-19 Thread via GitHub
yuxiqian commented on code in PR #3607: URL: https://github.com/apache/flink-cdc/pull/3607#discussion_r1766431500 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-mysql/src/main/java/org/apache/flink/cdc/connectors/mysql/factory/MySqlDataSourceFactory.java

  1   2   >