Re: [PR] [FLINK-36066][runtime] Introducing the AdaptiveGraphManager component [flink]

2024-10-17 Thread via GitHub
JunRuiLee commented on code in PR #25414: URL: https://github.com/apache/flink/pull/25414#discussion_r1805761682 ## flink-runtime/src/main/java/org/apache/flink/runtime/jobgraph/forwardgroup/StreamNodeForwardGroup.java: ## @@ -0,0 +1,177 @@ +/* + * Licensed to the Apache Softwar

[jira] [Updated] (FLINK-36559) [docs]Add flink cdc elasticsearch pipeline sink to docs

2024-10-17 Thread JunboWang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JunboWang updated FLINK-36559: -- Description: (was: Duplicate with 36052.) > [docs]Add flink cdc elasticsearch pipeline sink to doc

[jira] [Comment Edited] (FLINK-36052) add elasticsearch.md for elasticsearch pipeline connector

2024-10-17 Thread JunboWang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17890794#comment-17890794 ] JunboWang edited comment on FLINK-36052 at 10/18/24 5:49 AM: -

[jira] [Commented] (FLINK-36541) Occasional met commit conflict problem in PaimonSink.

2024-10-17 Thread LvYanquan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17890800#comment-17890800 ] LvYanquan commented on FLINK-36541: --- I would like to try to fix it. > Occasional met

[jira] [Commented] (FLINK-36052) add elasticsearch.md for elasticsearch pipeline connector

2024-10-17 Thread JunboWang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17890794#comment-17890794 ] JunboWang commented on FLINK-36052: --- Could we add Component/s as FLINK-CDC? > add ela

[jira] [Updated] (FLINK-36559) [docs]Add flink cdc elasticsearch pipeline sink to docs

2024-10-17 Thread JunboWang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JunboWang updated FLINK-36559: -- Description: Duplicate with 36052. > [docs]Add flink cdc elasticsearch pipeline sink to docs > ---

[jira] [Closed] (FLINK-36559) [docs]Add flink cdc elasticsearch pipeline sink to docs

2024-10-17 Thread JunboWang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JunboWang closed FLINK-36559. - Resolution: Duplicate Duplicate with FLINK-36052. > [docs]Add flink cdc elasticsearch pipeline sink to

[jira] [Created] (FLINK-36567) Planner module didn't use the setting from flink-conf.yaml

2024-10-17 Thread liting liu (Jira)
liting liu created FLINK-36567: -- Summary: Planner module didn't use the setting from flink-conf.yaml Key: FLINK-36567 URL: https://issues.apache.org/jira/browse/FLINK-36567 Project: Flink Issue

Re: [PR] [FLINK-36565] Route module allows merging Decimals with various precisions [flink-cdc]

2024-10-17 Thread via GitHub
yuxiqian commented on PR #3651: URL: https://github.com/apache/flink-cdc/pull/3651#issuecomment-2421296255 Could @melin please take a look? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

[jira] [Updated] (FLINK-36565) Pipeline YAML should allow merging decimal with different precisions

2024-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36565: --- Labels: pull-request-available (was: ) > Pipeline YAML should allow merging decimal with di

[PR] [FLINK-36565] Route module allows merging Decimals with various precisions [flink-cdc]

2024-10-17 Thread via GitHub
yuxiqian opened a new pull request, #3651: URL: https://github.com/apache/flink-cdc/pull/3651 This closes FLINK-36565. Currently, table-merging router does not allow coercing `Decimal` fields with different precisions from upstream, which means some lossless conversions are actually

[jira] [Created] (FLINK-36566) Code optimization: always identify DataChangeEvent before SchemaChangeEvent in Operator

2024-10-17 Thread LvYanquan (Jira)
LvYanquan created FLINK-36566: - Summary: Code optimization: always identify DataChangeEvent before SchemaChangeEvent in Operator Key: FLINK-36566 URL: https://issues.apache.org/jira/browse/FLINK-36566 Pro

Re: [PR] [FLINK-35029][state/forst] Store timer in JVM heap when use async state backend [flink]

2024-10-17 Thread via GitHub
Zakelly commented on code in PR #25501: URL: https://github.com/apache/flink/pull/25501#discussion_r1805798857 ## flink-runtime/src/main/java/org/apache/flink/streaming/api/operators/AbstractStreamOperatorV2.java: ## @@ -220,7 +220,7 @@ public void initializeState(StreamTaskStat

Re: [PR] [FLINK-33977][runtime] Adaptive scheduler may not minimize the number of TMs during downscaling [flink]

2024-10-17 Thread via GitHub
1996fanrui commented on PR #25218: URL: https://github.com/apache/flink/pull/25218#issuecomment-2421167238 Hey @XComp @ztison , sorry, I'd like to discuss with you again about this PR. Could we fix the issue for `DefaultSlotAssigner` and `Application Mode` first? I prefer to fix it fi

Re: [PR] [BP-1.18][FLINK-36421] [fs] [checkpoint] Sync outputStream before returning handle in FsCheckpointStreamFactory [flink]

2024-10-17 Thread via GitHub
Zakelly commented on PR #25479: URL: https://github.com/apache/flink/pull/25479#issuecomment-2421167188 Will merge this without CI green -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

Re: [PR] FLINK-36540.[Runtime / Task] Add Support for Hadoop Caller Context when using Flink to operate hdfs. [flink]

2024-10-17 Thread via GitHub
liangyu-1 commented on PR #25516: URL: https://github.com/apache/flink/pull/25516#issuecomment-2421163090 @dmvk @fapaul Hi, would you please help me check this issue? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] [FLINK-35109] Drop support for Flink 1.17 & 1.18 and fix tests for 1.20-SNAPSHOT [flink-connector-kafka]

2024-10-17 Thread via GitHub
ruanhang1993 closed pull request #102: [FLINK-35109] Drop support for Flink 1.17 & 1.18 and fix tests for 1.20-SNAPSHOT URL: https://github.com/apache/flink-connector-kafka/pull/102 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [PR] [FLINK-36474] Support merging timestamp columns when routing [flink-cdc]

2024-10-17 Thread via GitHub
yuxiqian commented on PR #3636: URL: https://github.com/apache/flink-cdc/pull/3636#issuecomment-2421159128 Squashed & rebased with `master`. Could @ruanhang1993 please take a look? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

[jira] [Commented] (FLINK-36562) Running CI in random timezone to expose more time related bugs

2024-10-17 Thread LvYanquan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17890773#comment-17890773 ] LvYanquan commented on FLINK-36562: --- Closed as this is duplicated with FLINK-36564 >

[jira] [Closed] (FLINK-36562) Running CI in random timezone to expose more time related bugs

2024-10-17 Thread LvYanquan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LvYanquan closed FLINK-36562. - Release Note: Duplicated with FLINK-36564. Resolution: Duplicate > Running CI in random timezone

[jira] [Closed] (FLINK-36563) Running CI in random timezone to expose more time related bugs

2024-10-17 Thread LvYanquan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LvYanquan closed FLINK-36563. - Resolution: Duplicate > Running CI in random timezone to expose more time related bugs > -

[jira] [Commented] (FLINK-36563) Running CI in random timezone to expose more time related bugs

2024-10-17 Thread LvYanquan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17890772#comment-17890772 ] LvYanquan commented on FLINK-36563: --- Closed as this is duplicated with FLINK-36564. >

[jira] [Created] (FLINK-36565) Pipeline YAML should allow merging decimal with different precisions

2024-10-17 Thread yux (Jira)
yux created FLINK-36565: --- Summary: Pipeline YAML should allow merging decimal with different precisions Key: FLINK-36565 URL: https://issues.apache.org/jira/browse/FLINK-36565 Project: Flink Issue Typ

Re: [PR] [FLINK-36530][state] Fix S3 performance issue with uncompressed state restore [flink]

2024-10-17 Thread via GitHub
Zakelly commented on code in PR #25509: URL: https://github.com/apache/flink/pull/25509#discussion_r1805752878 ## flink-runtime/src/main/java/org/apache/flink/runtime/state/CompressibleFSDataInputStream.java: ## @@ -31,19 +31,21 @@ public class CompressibleFSDataInputStream exte

Re: [PR] [FLINK-36564][ci] Running CI in random timezone to expose more time related bugs. [flink-cdc]

2024-10-17 Thread via GitHub
lvyanquan commented on PR #3650: URL: https://github.com/apache/flink-cdc/pull/3650#issuecomment-2421138664 @yuxiqian PTAL. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Updated] (FLINK-36564) Running CI in random timezone to expose more time related bugs

2024-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36564: --- Labels: pull-request-available (was: ) > Running CI in random timezone to expose more time

[jira] [Created] (FLINK-36564) Running CI in random timezone to expose more time related bugs

2024-10-17 Thread LvYanquan (Jira)
LvYanquan created FLINK-36564: - Summary: Running CI in random timezone to expose more time related bugs Key: FLINK-36564 URL: https://issues.apache.org/jira/browse/FLINK-36564 Project: Flink Is

[jira] [Created] (FLINK-36563) Running CI in random timezone to expose more time related bugs

2024-10-17 Thread LvYanquan (Jira)
LvYanquan created FLINK-36563: - Summary: Running CI in random timezone to expose more time related bugs Key: FLINK-36563 URL: https://issues.apache.org/jira/browse/FLINK-36563 Project: Flink I

[jira] [Created] (FLINK-36562) Running CI in random timezone to expose more time related bugs

2024-10-17 Thread LvYanquan (Jira)
LvYanquan created FLINK-36562: - Summary: Running CI in random timezone to expose more time related bugs Key: FLINK-36562 URL: https://issues.apache.org/jira/browse/FLINK-36562 Project: Flink I

Re: [PR] [FLINK-36530][state] Fix S3 performance issue with uncompressed state restore [flink]

2024-10-17 Thread via GitHub
mateczagany commented on PR #25509: URL: https://github.com/apache/flink/pull/25509#issuecomment-2420140089 > Are you saying that the exact same state data with default S3 Hadoop configs is slow uncompressed and fast compressed? That would be better case. Yes, that's correct, I did no

[jira] [Updated] (FLINK-36561) ResultSet.wasNull() does not reflect null values in Flink JDBC Driver

2024-10-17 Thread Ilya Soin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ilya Soin updated FLINK-36561: -- Language: (was: jav) > ResultSet.wasNull() does not reflect null values in Flink JDBC Driver > -

[jira] [Created] (FLINK-36561) ResultSet.wasNull() does not reflect null values in Flink JDBC Driver

2024-10-17 Thread Ilya Soin (Jira)
Ilya Soin created FLINK-36561: - Summary: ResultSet.wasNull() does not reflect null values in Flink JDBC Driver Key: FLINK-36561 URL: https://issues.apache.org/jira/browse/FLINK-36561 Project: Flink

[jira] [Commented] (FLINK-36356) HadoopRecoverableWriterTest.testRecoverWithState due to IOException

2024-10-17 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17890500#comment-17890500 ] Piotr Nowojski commented on FLINK-36356: https://dev.azure.com/apache-flink/apac

Re: [PR] [FLINK-33696][metrics] Add OpenTelemetryMetricReporter and OpenTelemetryTraceReporter [flink]

2024-10-17 Thread via GitHub
pnowojski commented on PR #25539: URL: https://github.com/apache/flink/pull/25539#issuecomment-2419944369 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] Upgrade Kafka connector to 3.3.0 [flink-web]

2024-10-17 Thread via GitHub
AHeise merged PR #757: URL: https://github.com/apache/flink-web/pull/757 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache

Re: [PR] [FLINK-36510][rpc] bump pekko to 1.1.2, remove netty 3 [flink]

2024-10-17 Thread via GitHub
ferenc-csaky commented on PR #25494: URL: https://github.com/apache/flink/pull/25494#issuecomment-2419808148 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

Re: [PR] [FLINK-36510][rpc] bump pekko to 1.1.2, remove netty 3 [flink]

2024-10-17 Thread via GitHub
ferenc-csaky commented on code in PR #25494: URL: https://github.com/apache/flink/pull/25494#discussion_r1804959664 ## flink-rpc/flink-rpc-akka/pom.xml: ## @@ -94,8 +94,8 @@ under the License. io.netty -

Re: [PR] [FLINK-36530][state] Fix S3 performance issue with uncompressed state restore [flink]

2024-10-17 Thread via GitHub
gaborgsomogyi commented on PR #25509: URL: https://github.com/apache/flink/pull/25509#issuecomment-2419716967 > Could you reproduce this issue with state compression enabled? I've slightly touched compressed state and yeah, seen either slowness and/or huge amount of re-opens. The

Re: [PR] [FLINK-36530][state] Fix S3 performance issue with uncompressed state restore [flink]

2024-10-17 Thread via GitHub
gaborgsomogyi commented on code in PR #25509: URL: https://github.com/apache/flink/pull/25509#discussion_r1804812888 ## flink-runtime/src/main/java/org/apache/flink/runtime/state/CompressibleFSDataInputStream.java: ## @@ -31,19 +31,21 @@ public class CompressibleFSDataInputStrea

Re: [PR] [FLINK-36530][state] Fix S3 performance issue with uncompressed state restore [flink]

2024-10-17 Thread via GitHub
Zakelly commented on code in PR #25509: URL: https://github.com/apache/flink/pull/25509#discussion_r1804708194 ## flink-runtime/src/main/java/org/apache/flink/runtime/state/CompressibleFSDataInputStream.java: ## @@ -31,19 +31,21 @@ public class CompressibleFSDataInputStream exte

Re: [PR] [FLINK-36326] Fix auto scan newly-added table after restart [flink-cdc]

2024-10-17 Thread via GitHub
lvyanquan commented on PR #3613: URL: https://github.com/apache/flink-cdc/pull/3613#issuecomment-2419385239 According to feedback from community users, cherrypicking this pr has indeed solved the problem. -- This is an automated message from the Apache Git Service. To respond to the messa

Re: [PR] [FLINK-35268][state] Add ttl interface for Async State API && implement TtlListStateV2/TtlValueStateV2 [flink]

2024-10-17 Thread via GitHub
Zakelly commented on code in PR #25515: URL: https://github.com/apache/flink/pull/25515#discussion_r1804486595 ## flink-runtime/src/main/java/org/apache/flink/runtime/state/v2/AbstractAggregatingState.java: ## @@ -59,7 +59,7 @@ public AbstractAggregatingState( } prot

[jira] [Updated] (FLINK-36559) [docs]Add flink cdc elasticsearch pipeline sink to docs

2024-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36559: --- Labels: pull-request-available (was: ) > [docs]Add flink cdc elasticsearch pipeline sink to

Re: [PR] [FLINK-36517][cdc-connect][paimon] use filterAndCommit API for Avoid commit the same datafile duplicate [flink-cdc]

2024-10-17 Thread via GitHub
lvyanquan commented on code in PR #3639: URL: https://github.com/apache/flink-cdc/pull/3639#discussion_r1804467910 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-paimon/src/test/java/org/apache/flink/cdc/connectors/paimon/sink/v2/PaimonSinkITCase.java: #

Re: [PR] [FLINK-36517][cdc-connect][paimon] use filterAndCommit API for Avoid commit the same datafile duplicate [flink-cdc]

2024-10-17 Thread via GitHub
lvyanquan commented on code in PR #3639: URL: https://github.com/apache/flink-cdc/pull/3639#discussion_r1804454752 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-paimon/src/test/java/org/apache/flink/cdc/connectors/paimon/sink/v2/PaimonSinkITCase.java: #

Re: [PR] [FLINK-35029][state/forst] Store timer in JVM heap when use async state backend [flink]

2024-10-17 Thread via GitHub
Zakelly commented on code in PR #25501: URL: https://github.com/apache/flink/pull/25501#discussion_r1804441714 ## flink-runtime/src/main/java/org/apache/flink/streaming/api/operators/InternalTimeServiceManager.java: ## @@ -111,6 +112,7 @@ interface Provider extends Serializable

[jira] [Commented] (FLINK-35031) Latency marker emitting under async execution model

2024-10-17 Thread Yanfei Lei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17890390#comment-17890390 ] Yanfei Lei commented on FLINK-35031: Merged into master via ecb41150dab63c0c12b8dc3c

[jira] [Resolved] (FLINK-35031) Latency marker emitting under async execution model

2024-10-17 Thread Yanfei Lei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanfei Lei resolved FLINK-35031. Assignee: Yanfei Lei Resolution: Resolved > Latency marker emitting under async execution mo

Re: [PR] [FLINK-36560][pipeline-connector][paimon] fix the issue that timestamp_ltz field is not correctly converted. [flink-cdc]

2024-10-17 Thread via GitHub
lvyanquan commented on PR #3648: URL: https://github.com/apache/flink-cdc/pull/3648#issuecomment-2419036919 @beryllw @yuxiqian @ruanhang1993 could you please help to review this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[jira] [Updated] (FLINK-36560) Fix the issue of timestamp_ltz increasing by 8 hours in Paimon

2024-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36560: --- Labels: pull-request-available (was: ) > Fix the issue of timestamp_ltz increasing by 8 hou

Re: [PR] [FLINK-35031][runtime] LatencyMarker/RecordAttribute emitting under async execution model [flink]

2024-10-17 Thread via GitHub
fredia merged PR #25503: URL: https://github.com/apache/flink/pull/25503 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache

[jira] [Commented] (FLINK-36560) Fix the issue of timestamp_ltz increasing by 8 hours in Paimon

2024-10-17 Thread LvYanquan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17890385#comment-17890385 ] LvYanquan commented on FLINK-36560: --- I've found the issue in code, and willing to fix

[jira] [Created] (FLINK-36560) Fix the issue of timestamp_ltz increasing by 8 hours in Paimon

2024-10-17 Thread LvYanquan (Jira)
LvYanquan created FLINK-36560: - Summary: Fix the issue of timestamp_ltz increasing by 8 hours in Paimon Key: FLINK-36560 URL: https://issues.apache.org/jira/browse/FLINK-36560 Project: Flink Iss

Re: [PR] [FLINK-33696][metrics] Add OpenTelemetryMetricReporter and OpenTelemetryTraceReporter [flink]

2024-10-17 Thread via GitHub
pnowojski commented on code in PR #25539: URL: https://github.com/apache/flink/pull/25539#discussion_r1804401532 ## flink-metrics/flink-metrics-otel/pom.xml: ## @@ -0,0 +1,141 @@ + + +http://maven.apache.org/POM/4.0.0"; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; +

Re: [PR] [FLINK-33696][metrics] Add OpenTelemetryMetricReporter and OpenTelemetryTraceReporter [flink]

2024-10-17 Thread via GitHub
pnowojski commented on code in PR #25539: URL: https://github.com/apache/flink/pull/25539#discussion_r1804401155 ## flink-metrics/flink-metrics-otel/pom.xml: ## @@ -0,0 +1,141 @@ + + +http://maven.apache.org/POM/4.0.0"; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; +

Re: [PR] [FLINK-33410] Add a test for UNBOUNDED PRECEDING [flink]

2024-10-17 Thread via GitHub
dawidwys merged PR #25536: URL: https://github.com/apache/flink/pull/25536 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apac

Re: [PR] [FLINK-36527][autoscaler] Introduce a parameter to support autoscaler adopt a more radical strategy when source vertex or upstream shuffle is keyBy [flink-kubernetes-operator]

2024-10-17 Thread via GitHub
huyuanfeng2018 commented on PR #904: URL: https://github.com/apache/flink-kubernetes-operator/pull/904#issuecomment-2418982398 > I'm lacking context for the change so my comments could be missing the mark but I think that means I represent a lot of people trying to consume the proposed con

Re: [PR] [FLINK-36530][state] Fix S3 performance issue with uncompressed state restore [flink]

2024-10-17 Thread via GitHub
mateczagany commented on PR #25509: URL: https://github.com/apache/flink/pull/25509#issuecomment-2418969804 I have reproduced this issue easily, but I could not reproduce it if snapshot compression is turned on. IIUC when using snapshot compression, `SnappyFramedInputStream#available

Re: [PR] FLINK-36479 remove deprecated method Table getSchema as [flink]

2024-10-17 Thread via GitHub
davidradl commented on code in PR #25540: URL: https://github.com/apache/flink/pull/25540#discussion_r1804348228 ## flink-table/flink-table-api-java/src/main/java/org/apache/flink/table/api/Table.java: ## @@ -161,27 +147,6 @@ TemporalTableFunction createTemporalTableFunction(

[jira] [Updated] (FLINK-4602) Move RocksDB backend to proper package

2024-10-17 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-4602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan updated FLINK-4602: --- Parent: (was: FLINK-3957) Issue Type: Technical Debt (was: Sub-task) > Move RocksDB back

[jira] [Assigned] (FLINK-4602) Move RocksDB backend to proper package

2024-10-17 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-4602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan reassigned FLINK-4602: -- Assignee: Han Yin > Move RocksDB backend to proper package > -

Re: [PR] [FLINK-36527][autoscaler] Introduce a parameter to support autoscaler adopt a more radical strategy when source vertex or upstream shuffle is keyBy [flink-kubernetes-operator]

2024-10-17 Thread via GitHub
SamBarker commented on code in PR #904: URL: https://github.com/apache/flink-kubernetes-operator/pull/904#discussion_r1804328631 ## flink-autoscaler/src/main/java/org/apache/flink/autoscaler/JobVertexScaler.java: ## @@ -416,21 +416,31 @@ protected static > int scale(

[jira] [Updated] (FLINK-36559) [docs]Add flink cdc elasticsearch pipeline sink to docs

2024-10-17 Thread JunboWang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JunboWang updated FLINK-36559: -- Summary: [docs]Add flink cdc elasticsearch pipeline sink to docs (was: [docs]Add elasticsearch sink t

[jira] [Updated] (FLINK-36559) [docs]Add elasticsearch sink to docs

2024-10-17 Thread JunboWang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JunboWang updated FLINK-36559: -- Component/s: Flink CDC (was: Documentation) > [docs]Add elasticsearch sink to doc

[jira] [Created] (FLINK-36559) [docs]Add elasticsearch sink to docs

2024-10-17 Thread JunboWang (Jira)
JunboWang created FLINK-36559: - Summary: [docs]Add elasticsearch sink to docs Key: FLINK-36559 URL: https://issues.apache.org/jira/browse/FLINK-36559 Project: Flink Issue Type: Improvement

Re: [PR] [FLINK-33410] Add a test for UNBOUNDED PRECEDING [flink]

2024-10-17 Thread via GitHub
dawidwys commented on PR #25536: URL: https://github.com/apache/flink/pull/25536#issuecomment-2418841891 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [FLINK-36510][rpc] bump pekko to 1.1.2, remove netty 3 [flink]

2024-10-17 Thread via GitHub
SamBarker commented on code in PR #25494: URL: https://github.com/apache/flink/pull/25494#discussion_r1804065549 ## flink-rpc/flink-rpc-akka/pom.xml: ## @@ -94,8 +94,8 @@ under the License. io.netty -

[jira] [Updated] (FLINK-36527) Introduce a parameter to support the autoscaler to adopt a more aggressive strategy when Source or upstream shuffle is keyBy

2024-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36527: --- Labels: pull-request-available (was: ) > Introduce a parameter to support the autoscaler to

[PR] [FLINK-36527][autoscaler] Introduce a parameter to support autoscaler adopt a more radical strategy when source vertex or upstream shuffle is keyBy [flink-kubernetes-operator]

2024-10-17 Thread via GitHub
huyuanfeng2018 opened a new pull request, #904: URL: https://github.com/apache/flink-kubernetes-operator/pull/904 ## What is the purpose of the change Introduce a parameter to support autoscaler adopt a more radical strategy when source vertex or upstream shuffle is keyBy #