[jira] [Updated] (FLINK-36835) Memory lease in flink-s3-fs module due to hadoop aws version 3.x

2024-12-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36835: --- Labels: pull-request-available (was: ) > Memory lease in flink-s3-fs module due to hadoop a

[PR] [FLINK-36835][flink-s3-fs-hadoop] Fix memory lease in flink-s3-fs-hadoop [flink]

2024-12-02 Thread via GitHub
TJX2014 opened a new pull request, #25725: URL: https://github.com/apache/flink/pull/25725 ## What is the purpose of the change Fix memory lease in flink-s3-fs-hadoop From https://issues.apache.org/jira/browse/HADOOP-13028 introduce org.apache.hadoop.fs.s3a.S3AInstrumenta

[jira] [Commented] (FLINK-36826) Default configurations fail to start Flink java 17 images

2024-12-02 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17902534#comment-17902534 ] Arvid Heise commented on FLINK-36826: - Just looking from it from the perspective of

[jira] [Created] (FLINK-36834) Custom data distribution key

2024-12-02 Thread Jira
林健昌 created FLINK-36834: --- Summary: Custom data distribution key Key: FLINK-36834 URL: https://issues.apache.org/jira/browse/FLINK-36834 Project: Flink Issue Type: Bug Components: Flink CDC

[jira] [Updated] (FLINK-36832) Remove deprecated class in flink-connector-kafka

2024-12-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36832: --- Labels: pull-request-available (was: ) > Remove deprecated class in flink-connector-kafka >

Re: [PR] [FLINK-36832] Remove Deprecated classes and relevant tests. [flink-connector-kafka]

2024-12-02 Thread via GitHub
boring-cyborg[bot] commented on PR #139: URL: https://github.com/apache/flink-connector-kafka/pull/139#issuecomment-2513741916 Thanks for opening this pull request! Please check out our contributing guidelines. (https://flink.apache.org/contributing/how-to-contribute.html) -- This is

[jira] [Created] (FLINK-36833) In the case of database sharding, the target table is created with the primary key plus the sharding key.

2024-12-02 Thread Jira
林健昌 created FLINK-36833: --- Summary: In the case of database sharding, the target table is created with the primary key plus the sharding key. Key: FLINK-36833 URL: https://issues.apache.org/jira/browse/FLINK-36833

[jira] [Commented] (FLINK-36648) Release flink-connector-kafka v4.0.0 for Flink 2.0

2024-12-02 Thread Yanquan Lv (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17902529#comment-17902529 ] Yanquan Lv commented on FLINK-36648: Hi, [~tomncooper]  Thanks for pointing out this

Re: [PR] [FLINK-35156][Runtime] Rework: Make operators of DataStream V2 integrate with async state processing framework [flink]

2024-12-02 Thread via GitHub
Zakelly commented on PR #25722: URL: https://github.com/apache/flink/pull/25722#issuecomment-2513700804 Oops... I missed the IT cases. Fixed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

[jira] [Created] (FLINK-36832) Remove deprecated class in flink-connector-kafka

2024-12-02 Thread Yanquan Lv (Jira)
Yanquan Lv created FLINK-36832: -- Summary: Remove deprecated class in flink-connector-kafka Key: FLINK-36832 URL: https://issues.apache.org/jira/browse/FLINK-36832 Project: Flink Issue Type: Impr

[jira] [Assigned] (FLINK-36759) Intrdouce REST API to deploy script

2024-12-02 Thread Shengkai Fang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shengkai Fang reassigned FLINK-36759: - Assignee: Shengkai Fang > Intrdouce REST API to deploy script > --

Re: [PR] [FLINK-36758][sql-gateway] Introduce driver to load the application in application mode [flink]

2024-12-02 Thread via GitHub
flinkbot commented on PR #25724: URL: https://github.com/apache/flink/pull/25724#issuecomment-2513620678 ## CI report: * ba8960865075415a3f5c773cb9fd732edf54665d UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Commented] (FLINK-36756) Bump up the sql-gateway rest api version

2024-12-02 Thread Shengkai Fang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17902520#comment-17902520 ] Shengkai Fang commented on FLINK-36756: --- Merged into master: 129da74af5cc934551ca6

Re: [PR] [FLINK-36756][sql-gateway] Bump up the sql gateway rest version [flink]

2024-12-02 Thread via GitHub
fsk119 merged PR #25705: URL: https://github.com/apache/flink/pull/25705 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache

[jira] [Closed] (FLINK-36756) Bump up the sql-gateway rest api version

2024-12-02 Thread Shengkai Fang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shengkai Fang closed FLINK-36756. - Fix Version/s: 2.0.0 Resolution: Implemented > Bump up the sql-gateway rest api version >

Re: [PR] [FLINK-36756][sql-gateway] Bump up the sql gateway rest version [flink]

2024-12-02 Thread via GitHub
fsk119 commented on PR #25705: URL: https://github.com/apache/flink/pull/25705#issuecomment-2513616312 Merging... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubsc

[jira] [Updated] (FLINK-36758) Introduce driver to load the application in application mode

2024-12-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36758: --- Labels: pull-request-available (was: ) > Introduce driver to load the application in applic

[PR] [FLINK-36758][sql-gateway] Introduce driver to load the application in application mode [flink]

2024-12-02 Thread via GitHub
fsk119 opened a new pull request, #25724: URL: https://github.com/apache/flink/pull/25724 ## What is the purpose of the change *Add a SqlDriver to load the ScriptRunner to execute the script. It supports to read file from remote filesystem or http(s) service.* ## Br

Re: [PR] [FLINK-36831][table] Introduce AppendOnlyTopNFunction in Rank with Async State API [flink]

2024-12-02 Thread via GitHub
flinkbot commented on PR #25723: URL: https://github.com/apache/flink/pull/25723#issuecomment-2513609853 ## CI report: * 77455753e15710830941c62a23eb36596ec2e854 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-36831) Introduce AppendOnlyTopNFunction in Rank with Async State API

2024-12-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36831: --- Labels: pull-request-available (was: ) > Introduce AppendOnlyTopNFunction in Rank with Asyn

[PR] [FLINK-36831][table] Introduce AppendOnlyTopNFunction in Rank with Async State API [flink]

2024-12-02 Thread via GitHub
xuyangzhong opened a new pull request, #25723: URL: https://github.com/apache/flink/pull/25723 ## What is the purpose of the change Introduce AppendOnlyTopNFunction in Rank with Async State API. ## Brief change log - *Support variable rank end for async state top-n func

Re: [PR] [FLINK-36625] add lineage helper class for connector integration [flink]

2024-12-02 Thread via GitHub
HuangZhenQiu commented on code in PR #25712: URL: https://github.com/apache/flink/pull/25712#discussion_r1866926644 ## flink-streaming-java/src/main/java/org/apache/flink/streaming/api/lineage/TypeDatasetFacetProvider.java: ## @@ -0,0 +1,34 @@ +/* + * Licensed to the Apache Soft

[jira] [Assigned] (FLINK-36825) Introduce FastTop1Function in Rank with Async State API

2024-12-02 Thread Shengkai Fang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shengkai Fang reassigned FLINK-36825: - Assignee: xuyang > Introduce FastTop1Function in Rank with Async State API > --

Re: [PR] [FLINK-35156][Runtime] Rework: Make operators of DataStream V2 integrate with async state processing framework [flink]

2024-12-02 Thread via GitHub
Zakelly commented on code in PR #25722: URL: https://github.com/apache/flink/pull/25722#discussion_r1867000341 ## flink-datastream/src/main/java/org/apache/flink/datastream/impl/operators/ProcessOperator.java: ## @@ -98,6 +100,21 @@ protected Object currentKey() { throw

[jira] [Assigned] (FLINK-36831) Introduce AppendOnlyTopNFunction in Rank with Async State API

2024-12-02 Thread Shengkai Fang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shengkai Fang reassigned FLINK-36831: - Assignee: xuyang > Introduce AppendOnlyTopNFunction in Rank with Async State API >

[jira] [Created] (FLINK-36831) Introduce AppendOnlyTopNFunction in Rank with Async State API

2024-12-02 Thread xuyang (Jira)
xuyang created FLINK-36831: -- Summary: Introduce AppendOnlyTopNFunction in Rank with Async State API Key: FLINK-36831 URL: https://issues.apache.org/jira/browse/FLINK-36831 Project: Flink Issue Type

Re: [PR] [FLINK-35156][Runtime] Rework: Make operators of DataStream V2 integrate with async state processing framework [flink]

2024-12-02 Thread via GitHub
reswqa commented on code in PR #25722: URL: https://github.com/apache/flink/pull/25722#discussion_r1866994993 ## flink-datastream/src/main/java/org/apache/flink/datastream/impl/operators/ProcessOperator.java: ## @@ -98,6 +100,21 @@ protected Object currentKey() { throw

[jira] [Resolved] (FLINK-36823) Drain state requests after the user function perform snapshotState

2024-12-02 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan resolved FLINK-36823. - Fix Version/s: 2.0.0 Resolution: Fixed > Drain state requests after the user function per

[jira] [Commented] (FLINK-36823) Drain state requests after the user function perform snapshotState

2024-12-02 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17902504#comment-17902504 ] Zakelly Lan commented on FLINK-36823: - Merge 8203192 into master > Drain state requ

Re: [PR] [FLINK-36689][Runtime/Web Frontend] Update ng-zorro-antd to v18 [flink]

2024-12-02 Thread via GitHub
simplejason commented on PR #25713: URL: https://github.com/apache/flink/pull/25713#issuecomment-2513466578 All the code for the upgrade has been committed, and this pr does not contain node-related changes, as the node version has already been upgraded in #25670. @reswqa Can you re-run the

Re: [PR] [FLINK-35156][Runtime] Rework: Make operators of DataStream V2 integrate with async state processing framework [flink]

2024-12-02 Thread via GitHub
flinkbot commented on PR #25722: URL: https://github.com/apache/flink/pull/25722#issuecomment-2513466506 ## CI report: * d412e40bd31c00bf63ffa111043e248abf38f9d8 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-36823][Checkpointing] Drain state requests after the user function perform snapshotState [flink]

2024-12-02 Thread via GitHub
Zakelly merged PR #25715: URL: https://github.com/apache/flink/pull/25715 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apach

[PR] [FLINK-35156][Runtime] Rework: Make operators of DataStream V2 integrate with async state processing framework [flink]

2024-12-02 Thread via GitHub
Zakelly opened a new pull request, #25722: URL: https://github.com/apache/flink/pull/25722 ## What is the purpose of the change Make DS V2 use the State API V2 and the async state processing. ## Brief change log - Modify the operators in DS V2, let them extend the `Abst

Re: [PR] Update maxwell.md [flink]

2024-12-02 Thread via GitHub
flinkbot commented on PR #25721: URL: https://github.com/apache/flink/pull/25721#issuecomment-2513437431 ## CI report: * b396041619579756e8df2c1c6d49f8f3864fa42e UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Commented] (FLINK-36816) Support source parallelism setting for JDBC connector

2024-12-02 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17902495#comment-17902495 ] Hongshun Wang commented on FLINK-36816: --- [~grzegorz.kolakowski] , thanks for your

Re: [PR] [FLINK-36821] Update to Kafka 3.9.0 [flink-connector-kafka]

2024-12-02 Thread via GitHub
loserwang1024 commented on PR #138: URL: https://github.com/apache/flink-connector-kafka/pull/138#issuecomment-2513440759 > Updates the Confluent Kafka and Zookeeper images to be in-line with the 3.9.0 Kafka versions. Whether the 3.9.0 version Kafka client is compability with the low

[PR] Update maxwell.md [flink]

2024-12-02 Thread via GitHub
Altku opened a new pull request, #25721: URL: https://github.com/apache/flink/pull/25721 the sample data for maxwell json. One more comma ## What is the purpose of the change *(For example: This pull request makes task deployment go through the blob server, rather than

Re: [PR] [FLINK-36689][Runtime/Web Frontend] Update ng-zorro-antd to v18 [flink]

2024-12-02 Thread via GitHub
simplejason commented on PR #25713: URL: https://github.com/apache/flink/pull/25713#issuecomment-2513432836 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

[jira] [Resolved] (FLINK-36535) Optimize the scale down logic based on historical parallelism

2024-12-02 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan resolved FLINK-36535. - Fix Version/s: kubernetes-operator-1.11.0 Resolution: Fixed Merged to main(1.11.0) via: d9e8cce85

Re: [PR] [FLINK-36689][Runtime/Web Frontend] Update ng-zorro-antd to v18 [flink]

2024-12-02 Thread via GitHub
simplejason commented on PR #25713: URL: https://github.com/apache/flink/pull/25713#issuecomment-2513416121 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

Re: [PR] [FLINK-33389][runtime] Support tasks balancing at slot level for Adaptive Scheduler [flink]

2024-12-02 Thread via GitHub
RocMarshal commented on code in PR #25504: URL: https://github.com/apache/flink/pull/25504#discussion_r1866860510 ## flink-runtime/src/main/java/org/apache/flink/runtime/scheduler/TaskBalancedExecutionSlotSharingGroupBuilder.java: ## @@ -0,0 +1,260 @@ +/* + * Licensed to the Apa

Re: [PR] [FLINK-36535][autoscaler] Optimize the scale down logic based on historical parallelism to reduce the rescale frequency [flink-kubernetes-operator]

2024-12-02 Thread via GitHub
1996fanrui merged PR #920: URL: https://github.com/apache/flink-kubernetes-operator/pull/920 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsu

Re: [PR] [FLINK-36535][autoscaler] Optimize the scale down logic based on historical parallelism to reduce the rescale frequency [flink-kubernetes-operator]

2024-12-02 Thread via GitHub
1996fanrui commented on PR #920: URL: https://github.com/apache/flink-kubernetes-operator/pull/920#issuecomment-2513414949 Thanks all for the patient review! We could discuss https://github.com/apache/flink-kubernetes-operator/pull/920#discussion_r1858987790 asynchronously, so let

Re: [PR] [FLINK-36625] add lineage helper class for connector integration [flink]

2024-12-02 Thread via GitHub
HuangZhenQiu commented on code in PR #25712: URL: https://github.com/apache/flink/pull/25712#discussion_r1866929769 ## flink-streaming-java/src/main/java/org/apache/flink/streaming/api/lineage/LineageUtils.java: ## @@ -0,0 +1,53 @@ +/* + * Licensed to the Apache Software Foundat

[jira] [Closed] (FLINK-36815) series bugs of DSv2

2024-12-02 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo closed FLINK-36815. -- Fix Version/s: 2.0.0 Resolution: Fixed master(2.0) via dbd21cf56af950045f75ca38b536ef06d4c8cb8f

Re: [PR] [FLINK-36815][API] Fix series bugs of DSv2 [flink]

2024-12-02 Thread via GitHub
reswqa merged PR #25706: URL: https://github.com/apache/flink/pull/25706 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache

Re: [PR] [FLINK-36813][cdc-connectors][mysql] support mysql sync part columns [flink-cdc]

2024-12-02 Thread via GitHub
JNSimba commented on PR #3767: URL: https://github.com/apache/flink-cdc/pull/3767#issuecomment-2513396379 @leonardBang @ruanhang1993 PTAL, Thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[jira] [Commented] (FLINK-34554) Using EXACTLY_ONCE with KafkaSink cause broker's OOM due to newly created transactionalId per checkpoint

2024-12-02 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17902488#comment-17902488 ] Hongshun Wang commented on FLINK-34554: --- [~arvid] , It seems that  Kafka client 3.

Re: [PR] [FLINK-35490] Migrate tests to JUnit 5 and AssertJ [flink-cdc]

2024-12-02 Thread via GitHub
yuxiqian commented on PR #3742: URL: https://github.com/apache/flink-cdc/pull/3742#issuecomment-2513390492 Addressed comments and resolved conflicts. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [PR] [FLINK-36688][table-planner] Sort metadata keys when reusing source [flink]

2024-12-02 Thread via GitHub
snuyanzin commented on PR #25681: URL: https://github.com/apache/flink/pull/25681#issuecomment-2513069651 @davidradl thanks for the review, do you have anything in your mind what else could be improved? I'm asking since I'm going to merge it in coming days -- This is an automated messa

Re: [PR] [FLINK-36585][connector / common] SplitFetcherManager.close() should not chain runnables to the element queue future in a tight loop. [flink]

2024-12-02 Thread via GitHub
becketqin commented on code in PR #25569: URL: https://github.com/apache/flink/pull/25569#discussion_r1866671173 ## flink-connectors/flink-connector-base/src/test/java/org/apache/flink/connector/base/source/reader/fetcher/SplitFetcherManagerTest.java: ## @@ -100,6 +102,50 @@ voi

[jira] [Commented] (FLINK-36648) Release flink-connector-kafka v4.0.0 for Flink 2.0

2024-12-02 Thread Thomas Cooper (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17902306#comment-17902306 ] Thomas Cooper commented on FLINK-36648: --- Has there been any progress on this? I ca

[jira] [Commented] (FLINK-36766) Use pyflink to create remote env

2024-12-02 Thread William Que (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17902365#comment-17902365 ] William Que commented on FLINK-36766: - Is there no one following up on this issue?

[PR] [docs] Fix ToC to include H1 [flink-cdc]

2024-12-02 Thread via GitHub
rmoff opened a new pull request, #3773: URL: https://github.com/apache/flink-cdc/pull/3773 The existing Table of Contents on the right-hand side of the page does not display H1 elements. H1 are used throughout the docs as part of the logical presentation of content. Therefore it make

[jira] [Commented] (FLINK-36824) Backport from Calcite 1.37.0 support table function calls in FROM clause without TABLE() wrapper

2024-12-02 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17902277#comment-17902277 ] Sergey Nuyanzin commented on FLINK-36824: - Merged as [e383400ef20934a9ba3275c5d

[jira] [Commented] (FLINK-36647) Support TimestampDiff function in cdc pipeline transform

2024-12-02 Thread Wenkai Qi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17902293#comment-17902293 ] Wenkai Qi commented on FLINK-36647: --- [~ruanhang1993] Hi. thx. No. They only have diff

Re: [PR] Update flink-architecture.md [flink]

2024-12-02 Thread via GitHub
flinkbot commented on PR #25720: URL: https://github.com/apache/flink/pull/25720#issuecomment-2512439356 ## CI report: * d794174859a5c8f6bdb76e4724ed4bd5fe20093e UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Commented] (FLINK-36648) Release flink-connector-kafka v4.0.0 for Flink 2.0

2024-12-02 Thread Thomas Cooper (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17902317#comment-17902317 ] Thomas Cooper commented on FLINK-36648: --- I assume, as a minimum, we need to remove

[PR] Update flink-architecture.md [flink]

2024-12-02 Thread via GitHub
harikamisetty opened a new pull request, #25720: URL: https://github.com/apache/flink/pull/25720 Removed extra "are" word ## What is the purpose of the change *(For example: This pull request makes task deployment go through the blob server, rather than through RPC. Tha

[jira] [Commented] (FLINK-36061) Support Apache iceberg for pipeline connector

2024-12-02 Thread Robin Moffatt (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17902380#comment-17902380 ] Robin Moffatt commented on FLINK-36061: --- is this a duplicate of https://issues.apa

Re: [PR] [FLINK-36451][runtime] Replaces LeaderElection#hasLeadership with LeaderElection#runAsLeader [flink]

2024-12-02 Thread via GitHub
XComp commented on code in PR #25679: URL: https://github.com/apache/flink/pull/25679#discussion_r1865897573 ## flink-runtime/src/main/java/org/apache/flink/runtime/leaderelection/LeaderElection.java: ## @@ -39,17 +44,37 @@ public interface LeaderElection extends AutoCloseable {

[jira] [Resolved] (FLINK-36824) Backport from Calcite 1.37.0 support table function calls in FROM clause without TABLE() wrapper

2024-12-02 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin resolved FLINK-36824. - Fix Version/s: 2.0.0 Resolution: Fixed > Backport from Calcite 1.37.0 support tab

Re: [PR] [FLINK-36824][table] Backport from Calcite 1.37.0 support table function calls in FROM clause without TABLE() wrapper [flink]

2024-12-02 Thread via GitHub
snuyanzin merged PR #25716: URL: https://github.com/apache/flink/pull/25716 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apa

Re: [PR] [FLINK-36652] Upgrade Apache ORC Version to 1.9.4 [flink]

2024-12-02 Thread via GitHub
MartijnVisser commented on code in PR #25711: URL: https://github.com/apache/flink/pull/25711#discussion_r1865735599 ## flink-formats/flink-orc/pom.xml: ## @@ -141,6 +149,34 @@ under the License. org.slf4j

Re: [PR] [FLINK-36535][autoscaler] Optimize the scale down logic based on historical parallelism to reduce the rescale frequency [flink-kubernetes-operator]

2024-12-02 Thread via GitHub
1996fanrui commented on code in PR #920: URL: https://github.com/apache/flink-kubernetes-operator/pull/920#discussion_r1865495287 ## flink-autoscaler/src/main/java/org/apache/flink/autoscaler/JobVertexScaler.java: ## @@ -289,21 +274,26 @@ private ParallelismChange applyScaleDow

[PR] [docs] Cleanup pipeline example / remove 'will soon' from reference to transform support [flink-cdc]

2024-12-02 Thread via GitHub
rmoff opened a new pull request, #3772: URL: https://github.com/apache/flink-cdc/pull/3772 - **Remove non-mandatory sections from the bare-basics example YAML** - **At least one pipeline parameter must be specified** - **s/will soon//** -- This is an automated message from the Ap

Re: [PR] [FLINK-36830][table] Override json-path version in Calcite to deal with CVE [flink]

2024-12-02 Thread via GitHub
tomncooper commented on PR #25602: URL: https://github.com/apache/flink/pull/25602#issuecomment-2511372760 @MartijnVisser I have create a separate JIRA issue ([FLINK-36830](https://issues.apache.org/jira/browse/FLINK-36830)) for this PR which links out to the others discussed here. If you w

Re: [PR] [FLINK-36830][table] Override json-path version in Calcite to deal with CVE [flink]

2024-12-02 Thread via GitHub
tomncooper commented on code in PR #25602: URL: https://github.com/apache/flink/pull/25602#discussion_r1865741269 ## flink-table/flink-table-calcite-bridge/pom.xml: ## @@ -152,9 +152,21 @@ under the License. org.locationtech.proj4j

[jira] [Updated] (FLINK-36830) Override json-path version used by Calcite Bridge

2024-12-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36830: --- Labels: pull-request-available (was: ) > Override json-path version used by Calcite Bridge

[jira] [Updated] (FLINK-36830) Override json-path version used by Calcite Bridge

2024-12-02 Thread Thomas Cooper (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Cooper updated FLINK-36830: -- Summary: Override json-path version used by Calcite Bridge (was: Overried json-path version u

[jira] [Created] (FLINK-36830) Overried json-path version used by Calcite Bridge

2024-12-02 Thread Thomas Cooper (Jira)
Thomas Cooper created FLINK-36830: - Summary: Overried json-path version used by Calcite Bridge Key: FLINK-36830 URL: https://issues.apache.org/jira/browse/FLINK-36830 Project: Flink Issue Typ

[jira] [Created] (FLINK-36829) Add better validation of pipeline config

2024-12-02 Thread Robin Moffatt (Jira)
Robin Moffatt created FLINK-36829: - Summary: Add better validation of pipeline config Key: FLINK-36829 URL: https://issues.apache.org/jira/browse/FLINK-36829 Project: Flink Issue Type: Improv

Re: [PR] [FLINK-36643][filesystems] Update aws-java-sdk-core to 1.12.779 [1.19] [flink]

2024-12-02 Thread via GitHub
flinkbot commented on PR #25719: URL: https://github.com/apache/flink/pull/25719#issuecomment-2511306421 ## CI report: * 5cf26ee459f82c5c886358270eb9bcb25f54d8b8 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[PR] [FLINK-36643][filesystems] Update aws-java-sdk-core to 1.12.779 to fi… [flink]

2024-12-02 Thread via GitHub
tomncooper opened a new pull request, #25719: URL: https://github.com/apache/flink/pull/25719 ## What is the purpose of the change This is backport of #25600. The current version of `aws-java-sdk-core`, used in the `flink-s3-fs-base` module, has a high severity vulnerability

Re: [PR] [FLINK-36821] Update to Kafka 3.9.0 [flink-connector-kafka]

2024-12-02 Thread via GitHub
tomncooper commented on code in PR #138: URL: https://github.com/apache/flink-connector-kafka/pull/138#discussion_r1865696228 ## flink-connector-kafka/src/main/java/org/apache/flink/streaming/connectors/kafka/internals/FlinkKafkaInternalProducer.java: ## @@ -156,6 +157,11 @@ pu

Re: [PR] [FLINK-36643][filesystems] Update aws-java-sdk-core to 1.12.779 [1.20] [flink]

2024-12-02 Thread via GitHub
tomncooper commented on PR #25709: URL: https://github.com/apache/flink/pull/25709#issuecomment-2511277097 @snuyanzin 1.19 backport: #25719 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

Re: [PR] [FLINK-36821] Update to Kafka 3.9.0 [flink-connector-kafka]

2024-12-02 Thread via GitHub
davidradl commented on code in PR #138: URL: https://github.com/apache/flink-connector-kafka/pull/138#discussion_r1865676563 ## flink-connector-kafka/src/main/java/org/apache/flink/streaming/connectors/kafka/internals/FlinkKafkaInternalProducer.java: ## @@ -156,6 +157,11 @@ pub

[jira] [Updated] (FLINK-36827) [Docs] Tidy up Flink CDC Doris/MySQL quickstart page

2024-12-02 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu updated FLINK-36827: --- Component/s: Documentation > [Docs] Tidy up Flink CDC Doris/MySQL quickstart page >

[jira] [Updated] (FLINK-36740) Update frontend dependencies to address vulnerabilities

2024-12-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36740: --- Labels: pull-request-available (was: ) > Update frontend dependencies to address vulnerabil

Re: [PR] [FLINK-33389][runtime] Support tasks balancing at slot level for Adaptive Scheduler [flink]

2024-12-02 Thread via GitHub
1996fanrui commented on code in PR #25504: URL: https://github.com/apache/flink/pull/25504#discussion_r1865646824 ## flink-runtime/src/main/java/org/apache/flink/runtime/scheduler/TaskBalancedExecutionSlotSharingGroupBuilder.java: ## @@ -0,0 +1,260 @@ +/* + * Licensed to the Apa

[jira] [Comment Edited] (FLINK-36716) Address vulnerabilities in Flink UI

2024-12-02 Thread Mehdi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17902241#comment-17902241 ] Mehdi edited comment on FLINK-36716 at 12/2/24 10:59 AM: - [~mart

[jira] [Commented] (FLINK-36716) Address vulnerabilities in Flink UI

2024-12-02 Thread Mehdi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17902241#comment-17902241 ] Mehdi commented on FLINK-36716: --- [~martijnvisser] Thanks for your review/merge of the bump

Re: [PR] [FLINK-36740] [WebFrontend] Update frontend dependencies to address vulnerabilities [flink]

2024-12-02 Thread via GitHub
flinkbot commented on PR #25718: URL: https://github.com/apache/flink/pull/25718#issuecomment-2511215502 ## CI report: * 0df64737f3fea0a5a214d3b0def25fda527f8cce UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[PR] [FLINK-36740] [WebFrontend] Update frontend dependencies to address vulnerabilities [flink]

2024-12-02 Thread via GitHub
mehdid93 opened a new pull request, #25718: URL: https://github.com/apache/flink/pull/25718 Follow up of https://issues.apache.org/jira/browse/FLINK-36739 Contribute-to: https://issues.apache.org/jira/browse/FLINK-36740 ## What is the purpose of the change This PR aims to bu

[jira] [Updated] (FLINK-36827) [Docs] Tidy up Flink CDC Doris/MySQL quickstart page

2024-12-02 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu updated FLINK-36827: --- Fix Version/s: cdc-3.3.0 > [Docs] Tidy up Flink CDC Doris/MySQL quickstart page > --

[jira] [Updated] (FLINK-36827) [Docs] Tidy up Flink CDC Doris/MySQL quickstart page

2024-12-02 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu updated FLINK-36827: --- Component/s: Flink CDC > [Docs] Tidy up Flink CDC Doris/MySQL quickstart page >

[jira] [Commented] (FLINK-36827) [Docs] Tidy up Flink CDC Doris/MySQL quickstart page

2024-12-02 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17902233#comment-17902233 ] Leonard Xu commented on FLINK-36827: Thanks [~rmoff] for reporting this issue, assig

[jira] [Assigned] (FLINK-36827) [Docs] Tidy up Flink CDC Doris/MySQL quickstart page

2024-12-02 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reassigned FLINK-36827: -- Assignee: Robin Moffatt > [Docs] Tidy up Flink CDC Doris/MySQL quickstart page >

[jira] [Created] (FLINK-36828) Implement example for customers to perform KPL Deaggregation

2024-12-02 Thread Hong Liang Teoh (Jira)
Hong Liang Teoh created FLINK-36828: --- Summary: Implement example for customers to perform KPL Deaggregation Key: FLINK-36828 URL: https://issues.apache.org/jira/browse/FLINK-36828 Project: Flink

[jira] [Updated] (FLINK-36826) Default configurations fail to start Flink java 17 images

2024-12-02 Thread Fabian Paul (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Paul updated FLINK-36826: Summary: Default configurations fail to start Flink java 17 images (was: Default configurations f

[jira] [Updated] (FLINK-36827) [Docs] Tidy up Flink CDC Doris/MySQL quickstart page

2024-12-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36827: --- Labels: pull-request-available (was: ) > [Docs] Tidy up Flink CDC Doris/MySQL quickstart pa

[PR] [FLINK-36827] CDC quickstart tidyup [flink-cdc]

2024-12-02 Thread via GitHub
rmoff opened a new pull request, #3771: URL: https://github.com/apache/flink-cdc/pull/3771 This makes some small improvements to the structure of the quickstart to make it easier to follow, and fixes a few nits (e.g. capitalization). It also adds the use of `privileged: true` flag in the Do

[jira] [Created] (FLINK-36827) [Docs] Tidy up Flink CDC Doris/MySQL quickstart page

2024-12-02 Thread Robin Moffatt (Jira)
Robin Moffatt created FLINK-36827: - Summary: [Docs] Tidy up Flink CDC Doris/MySQL quickstart page Key: FLINK-36827 URL: https://issues.apache.org/jira/browse/FLINK-36827 Project: Flink Issue

Re: [PR] [FLINK-36451][runtime] Replaces LeaderElection#hasLeadership with LeaderElection#runAsLeader [flink]

2024-12-02 Thread via GitHub
zentol commented on code in PR #25679: URL: https://github.com/apache/flink/pull/25679#discussion_r1865559170 ## flink-runtime/src/main/java/org/apache/flink/runtime/leaderelection/LeaderElection.java: ## @@ -39,17 +44,37 @@ public interface LeaderElection extends AutoCloseable

[jira] [Commented] (FLINK-36716) Address vulnerabilities in Flink UI

2024-12-02 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17902219#comment-17902219 ] Martijn Visser commented on FLINK-36716: [~mehdidb1993][~simplejason] With http

[jira] [Updated] (FLINK-36826) Default configurations fail all to start Flink java 17 images

2024-12-02 Thread Fabian Paul (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Paul updated FLINK-36826: Description: When trying to deploy the following deployment with the operator the job fails to st

[jira] [Created] (FLINK-36826) Default configurations fail all to start Flink java 17 images

2024-12-02 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-36826: --- Summary: Default configurations fail all to start Flink java 17 images Key: FLINK-36826 URL: https://issues.apache.org/jira/browse/FLINK-36826 Project: Flink

[jira] [Closed] (FLINK-36739) Update NodeJS to v22 (LTS)

2024-12-02 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martijn Visser closed FLINK-36739. -- Resolution: Fixed > Update NodeJS to v22 (LTS) > -- > >

[jira] [Commented] (FLINK-36739) Update NodeJS to v22 (LTS)

2024-12-02 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17902218#comment-17902218 ] Martijn Visser commented on FLINK-36739: Fixed in apache/flink:master 1ba5631ac8

Re: [PR] [FLINK-36739] [WebFrontend] Update the NodeJS to v22.11.0 (LTS) [flink]

2024-12-02 Thread via GitHub
MartijnVisser merged PR #25670: URL: https://github.com/apache/flink/pull/25670 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink

  1   2   >