Re: [ANNOUNCE] New Apache Flink PMC Member - Qingsheng Ren

2023-04-23 Thread Zhanghao Chen
Congratulations, Qingsheng! Best, Zhanghao Chen From: Shammon FY Sent: Sunday, April 23, 2023 17:22 To: dev@flink.apache.org Subject: Re: [ANNOUNCE] New Apache Flink PMC Member - Qingsheng Ren Congratulations, Qingsheng! Best, Shammon FY On Sun, Apr 23, 2023

Re: [ANNOUNCE] New Apache Flink PMC Member - Leonard Xu

2023-04-23 Thread Zhanghao Chen
Congratulations, Leonard! Best, Zhanghao Chen From: Shammon FY Sent: Sunday, April 23, 2023 17:22 To: dev@flink.apache.org Subject: Re: [ANNOUNCE] New Apache Flink PMC Member - Leonard Xu Congratulations, Leonard! Best, Shammon FY On Sun, Apr 23, 2023 at 5

Re: Permission issue : Flink Code Push

2023-05-03 Thread Zhanghao Chen
to a fork of an upstream repository. docs.github.com  Best, Zhanghao Chen From: Archit Goyal Sent: Wednesday, May 3, 2023 1:50 To: dev@flink.apache.org Subject: Permission issue : Flink Code Push Hi, I am new to the Flink community and am working on the

[VOTE] FLIP-367: Support Setting Parallelism for Table/SQL Sources

2023-10-08 Thread Zhanghao Chen
uence/pages/viewpage.action?pageId=263429150 [2] https://lists.apache.org/thread/gtpswl42jzv0c9o3clwqskpllnw8rh87 Best, Zhanghao Chen

Re: [DISCUSS] FLIP-375: Built-in cross-platform powerful java profiler on taskmanagers

2023-10-09 Thread Zhanghao Chen
r the job manager as well. In the OLAP scenario and sometimes in the streaming scenario (when there're some heavy operations during execution plan generation or in operator coordinators), the JM can have bottleneck as well. Best, Zhanghao Chen From: Yu Chen Se

[DISCUSS][FLINK-33240] Document deprecated options as well

2023-10-11 Thread Zhanghao Chen
s. I propose to document deprecated options as well, with a "(deprecated)" tag placed at the beginning of the option description to highlight the deprecation status [1]. Looking forward to your feedbacks on it. [1] https://issues.apache.org/jira/browse/FLINK-33240 Best, Zhanghao Chen

[RESULT][VOTE] FLIP-367: Support Setting Parallelism for Table/SQL Sources

2023-10-12 Thread Zhanghao Chen
/pages/viewpage.action?pageId=263429150 [2] https://lists.apache.org/thread/bzlcw28jn0xx1hh45q0ry8wnxf0xoptg Best, Zhanghao Chen

Re: [VOTE] FLIP-366: Support standard YAML for FLINK configuration

2023-10-12 Thread Zhanghao Chen
+1 (non-binding) Best, Zhanghao Chen From: Junrui Lee Sent: Friday, October 13, 2023 10:12 To: dev@flink.apache.org Subject: [VOTE] FLIP-366: Support standard YAML for FLINK configuration Hi all, Thank you to everyone for the feedback on FLIP-366[1]: Support

Re: [VOTE] FLIP-375: Built-in cross-platform powerful java profiler

2023-10-17 Thread Zhanghao Chen
+1 (non-binding) Best, Zhanghao Chen From: Yu Chen Sent: Tuesday, October 17, 2023 15:51 To: dev@flink.apache.org Cc: myas...@live.com Subject: [VOTE] FLIP-375: Built-in cross-platform powerful java profiler Hi all, Thank you to everyone for the feedback and

Re: [DISCUSS][FLINK-33240] Document deprecated options as well

2023-11-01 Thread Zhanghao Chen
options. Best, Zhanghao Chen From: Alexander Fedulov Sent: Tuesday, October 31, 2023 18:12 To: dev@flink.apache.org Cc: u...@flink.apache.org Subject: Re: [DISCUSS][FLINK-33240] Document deprecated options as well Hi Zhanghao, Thanks for the proposition. In general

Re: [DISCUSS][FLINK-33240] Document deprecated options as well

2023-11-01 Thread Zhanghao Chen
cated because the related API/module is entirely deprecated, e.g. DataSet API. In that case, users would not search for replacement on an individual option but rather need to migrate to a new API, and it would be better to move these options to a separate section. WDYT? Best, Zhanghao

Re: [VOTE] FLIP-376: Add DISTRIBUTED BY clause

2023-11-07 Thread Zhanghao Chen
+1 (non-binding) Best, Zhanghao Chen From: Timo Walther Sent: Monday, November 6, 2023 19:38 To: dev Subject: [VOTE] FLIP-376: Add DISTRIBUTED BY clause Hi everyone, I'd like to start a vote on FLIP-376: Add DISTRIBUTED BY clause[1] which has been discuss

[DISCUSS] FLIP-395: Deprecate Global Aggregator Manager

2023-11-20 Thread Zhanghao Chen
Best, Zhanghao Chen

[DISCUSS] FLIP-397: Add config options for administrator JVM options

2023-11-27 Thread Zhanghao Chen
FLINK/FLIP-397%3A+Add+config+options+for+administrator+JVM+options [2] https://issues.apache.org/jira/browse/SPARK-23472 Best, Zhanghao Chen

Re: [DISCUSS] Contribute Flink Doris Connector to the Flink community

2023-11-27 Thread Zhanghao Chen
Sounds great. Thanks for driving this. Best, Zhanghao Chen From: wudi <676366...@qq.com.INVALID> Sent: Sunday, November 26, 2023 18:22 To: dev@flink.apache.org Subject: [DISCUSS] Contribute Flink Doris Connector to the Flink community Hi all, At present,

Re: [VOTE] FLIP-391: Deprecate RuntimeContext#getExecutionConfig

2023-11-28 Thread Zhanghao Chen
+1 (non-binding) Best, Zhanghao Chen From: Junrui Lee Sent: Tuesday, November 28, 2023 12:34 To: dev@flink.apache.org Subject: [VOTE] FLIP-391: Deprecate RuntimeContext#getExecutionConfig Hi everyone, Thank you to everyone for the feedback on FLIP-391

Re: [VOTE] FLIP-364: Improve the restart-strategy

2023-11-30 Thread Zhanghao Chen
+1 (non-binding) Best, Zhanghao Chen From: Rui Fan <1996fan...@gmail.com> Sent: Monday, November 13, 2023 11:01 To: dev Subject: [VOTE] FLIP-364: Improve the restart-strategy Hi everyone, Thank you to everyone for the feedback on FLIP-364: Improve the r

Re: [DISCUSS] FLIP-395: Deprecate Global Aggregator Manager

2023-12-04 Thread Zhanghao Chen
users. I'm also ccing the email to Piotr and David for their suggestions on this. Best, Zhanghao Chen From: Benchao Li Sent: Monday, November 27, 2023 13:03 To: dev@flink.apache.org Subject: Re: [DISCUSS] FLIP-395: Deprecate Global Aggregator Manager +1 fo

Re: [DISCUSS] FLIP-403: High Availability Services for OLAP Scenarios

2023-12-26 Thread Zhanghao Chen
comment on naming: would it better to rename PersistentServices to PersistenceServices, as usually we put a noun before Services? Best, Zhanghao Chen From: Yangze Guo Sent: Tuesday, December 19, 2023 17:33 To: dev Subject: [DISCUSS] FLIP-403: High Availability

Re: [DISCUSS] FLIP-397: Add config options for administrator JVM options

2023-12-26 Thread Zhanghao Chen
Thanks everyone. I'll start voting after the New Year's holiday if there's no further comment. Best, Zhanghao Chen From: Benchao Li Sent: Friday, December 22, 2023 21:18 To: dev@flink.apache.org Subject: Re: [DISCUSS] FLIP-397: Add con

Re: [VOTE] FLIP-398: Improve Serialization Configuration And Usage In Flink

2023-12-26 Thread Zhanghao Chen
+1 (non-binding) Best, Zhanghao Chen From: Yong Fang Sent: Wednesday, December 27, 2023 14:54 To: dev Subject: [VOTE] FLIP-398: Improve Serialization Configuration And Usage In Flink Hi devs, Thanks for all feedback about the FLIP-398: Improve Serialization

Re: [DISCUSS] FLIP-397: Add config options for administrator JVM options

2024-01-01 Thread Zhanghao Chen
of JVM args in most times, there're cases where different set of JVM args are preferable. So I am leaning towards the current design, WDYT? Best, Zhanghao Chen From: xiangyu feng Sent: Friday, December 29, 2023 20:20 To: dev@flink.apache.org Subjec

Re: [ANNOUNCE] New Apache Flink Committer - Alexander Fedulov

2024-01-02 Thread Zhanghao Chen
Congrats, Alex! Best, Zhanghao Chen From: Maximilian Michels Sent: Tuesday, January 2, 2024 20:15 To: dev Cc: Alexander Fedulov Subject: [ANNOUNCE] New Apache Flink Committer - Alexander Fedulov Happy New Year everyone, I'd like to start the year o

[DISCUSS] FLIP 411: Chaining-agnostic Operator ID generation for improved state compatibility on parallelism change

2024-01-02 Thread Zhanghao Chen
FLIP-411%3A+Chaining-agnostic+Operator+ID+generation+for+improved+state+compatibility+on+parallelism+change Best, Zhanghao Chen

Re: [Discuss] FLIP-407: Improve Flink Client performance in interactive scenarios

2024-01-03 Thread Zhanghao Chen
Thanks for driving this effort on improving the interactive use experience of Flink. The proposal overall looks good to me. Best, Zhanghao Chen From: xiangyu feng Sent: Tuesday, December 26, 2023 16:51 To: dev@flink.apache.org Subject: [Discuss] FLIP-407

[VOTE] FLIP-397: Add config options for administrator JVM options

2024-01-03 Thread Zhanghao Chen
Best, Zhanghao Chen

Re: [DISCUSS] FLIP-402: Extend ZooKeeper Curator configurations

2024-01-03 Thread Zhanghao Chen
nfigs may help users in certain scenarios sooner or later. [1] https://issues.apache.org/jira/browse/FLINK-31780 Best, Zhanghao Chen From: Alex Nitavsky Sent: Thursday, December 14, 2023 21:20 To: dev@flink.apache.org Subject: [DISCUSS] FLIP-402: Extend ZooK

Re: FLIP-413: Enable unaligned checkpoints by default

2024-01-07 Thread Zhanghao Chen
s and incidents. From my point of view, we'd better not enable it by default before removing all the limitations listed in https://nightlies.apache.org/flink/flink-docs-release-1.18/docs/ops/state/checkpointing_under_backpressure/#limitations. Best, Zhanghao Chen F

Re: [VOTE] FLIP-397: Add config options for administrator JVM options

2024-01-08 Thread Zhanghao Chen
Thank you all! Closing the vote. The result will be sent in a separate email. Best, Zhanghao Chen From: Zhanghao Chen Sent: Thursday, January 4, 2024 10:29 To: dev Subject: [VOTE] FLIP-397: Add config options for administrator JVM options Hi everyone, Thanks

[RESULT][VOTE] FLIP-397: Add config options for administrator JVM options

2024-01-08 Thread Zhanghao Chen
ving votes. Thanks again to everyone who participated in the discussion and voting. [1] https://lists.apache.org/thread/5qlr0xl0oyc9dnvcjr0q39pcrzyx4ohb Best, Zhanghao Chen

Re: [DISCUSS] FLIP 411: Chaining-agnostic Operator ID generation for improved state compatibility on parallelism change

2024-01-09 Thread Zhanghao Chen
s and has unaligned checkpoints enabled, we will encounter the same issue if they decide to break the chain on a later restart and try to recover from a retained cp. [1] https://nightlies.apache.org/flink/flink-docs-release-1.18/docs/ops/state/checkpointing_under_backpressure/ Best, Zhanghao

Re: [DISCUSS] FLIP 411: Chaining-agnostic Operator ID generation for improved state compatibility on parallelism change

2024-01-10 Thread Zhanghao Chen
any suggestions on this? Best, Zhanghao Chen From: Yu Chen Sent: Thursday, January 11, 2024 13:52 To: dev@flink.apache.org Cc: Piotr Nowojski ; zhanghao.c...@outlook.com Subject: Re: [DISCUSS] FLIP 411: Chaining-agnostic Operator ID generation for improved stat

Re: [DISCUSS] FLIP 411: Chaining-agnostic Operator ID generation for improved state compatibility on parallelism change

2024-01-11 Thread Zhanghao Chen
Thanks for the input, Piotr. It might still be possible to make it compatible with the old snapshots, following the direction of FLINK-5290<https://issues.apache.org/jira/browse/FLINK-5290> suggested by Yu. I'll discuss with Yu on more details. Best, Zh

Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-02-27 Thread Zhanghao Chen
Thanks for driving this topic. I think this FLIP could help clean up the codebase to make it easier to maintain. +1 on it. Best, Zhanghao Chen From: Weihua Hu Sent: Monday, February 27, 2023 20:40 To: dev Subject: [DISCUSS] FLIP-298: Unifying the Implementation

[DISCUSS] Deprecating GlobalAggregateManager

2023-02-27 Thread Zhanghao Chen
t reset the state of GlobalAggregateManager when rescaling - ASF JIRA (apache.org)<https://issues.apache.org/jira/browse/FLINK-31245?page=com.atlassian.jira.plugin.system.issuetabpanels%3Aall-tabpanel> Best, Zhanghao Chen

Re: [VOTE] FLIP-291: Externalized Declarative Resource Management

2023-02-28 Thread Zhanghao Chen
Thanks for driving this. +1 (non-binding) Best, Zhanghao Chen From: David Mor?vek Sent: Tuesday, February 28, 2023 21:46 To: dev Subject: [VOTE] FLIP-291: Externalized Declarative Resource Management Hi Everyone, I want to start the vote on FLIP-291

Re: [Vote] FLIP-298: Unifying the Implementation of SlotManager

2023-03-10 Thread Zhanghao Chen
Thanks Weihua. +1 (non-binding) Best, Zhanghao Chen From: Weihua Hu Sent: Thursday, March 9, 2023 13:27 To: dev Subject: [Vote] FLIP-298: Unifying the Implementation of SlotManager Hi Everyone, I would like to start the vote on FLIP-298: Unifying the

Re: [VOTE] FLIP-407: Improve Flink Client performance in interactive scenarios

2024-01-15 Thread Zhanghao Chen
+1 (non-binding) Best, Zhanghao Chen From: xiangyu feng Sent: Thursday, January 11, 2024 19:44 To: dev@flink.apache.org Subject: [VOTE] FLIP-407: Improve Flink Client performance in interactive scenarios Hi all, I would like to start the vote for FLIP-407

Re: [NOTICE] master branch cannot compile for now

2024-01-26 Thread Zhanghao Chen
Hi devs, The issue has already been resolved via a separate PR [1]. Feel free to rebase master and proceed~ [1] https://github.com/apache/flink/pull/24200 Best, Zhanghao Chen From: Benchao Li Sent: Friday, January 26, 2024 11:39 To: dev Subject: [NOTICE

Re: [DISCUSS] FLIP 411: Chaining-agnostic Operator ID generation for improved state compatibility on parallelism change

2024-02-07 Thread Zhanghao Chen
ough offline discussion and code debugging help to make this possible. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-411%3A+Chaining-agnostic+Operator+ID+generation+for+improved+state+compatibility+on+parallelism+change [2] https://issues.apache.org/jira/browse/FLIN

Re: [DISCUSS] FLIP 411: Chaining-agnostic Operator ID generation for improved state compatibility on parallelism change

2024-02-07 Thread Zhanghao Chen
t that multiple companies have developed or trying to develop similar hasher changes in their internal distribution, including ByteDance, Xiaohongshu, and Bilibili. It'll be great if we can improve the SQL experience for all community users as well, WDYT? Best, Zhanghao Chen

Re: [DISCUSS] FLIP 411: Chaining-agnostic Operator ID generation for improved state compatibility on parallelism change

2024-02-08 Thread Zhanghao Chen
lines deleted + extending the OperatorIdPair data structure) without much extra effort. Best, Zhanghao Chen From: Piotr Nowojski Sent: Thursday, February 8, 2024 14:50 To: Zhanghao Chen Cc: Chesnay Schepler ; dev@flink.apache.org ; Yu Chen Subject: Re: [DISCUSS

Re: [DISCUSS] FLIP 411: Chaining-agnostic Operator ID generation for improved state compatibility on parallelism change

2024-02-08 Thread Zhanghao Chen
. The user then configures different parallelism for the source and the remaining part of the job, which breaks a chain, and leads to state-incompatibility. Best, Zhanghao Chen From: Chesnay Schepler Sent: Thursday, February 8, 2024 18:12 To: dev@flink.apach

Re: [ANNOUNCE] New Apache Flink Committer - Jiabao Sun

2024-02-19 Thread Zhanghao Chen
Congrats, Jiaba! Best, Zhanghao Chen From: Qingsheng Ren Sent: Monday, February 19, 2024 17:53 To: dev ; jiabao...@apache.org Subject: [ANNOUNCE] New Apache Flink Committer - Jiabao Sun Hi everyone, On behalf of the PMC, I'm happy to announce Jiabao Sun

Re: [VOTE] FLIP-314: Support Customized Job Lineage Listener

2024-02-28 Thread Zhanghao Chen
+1 (non-binding) Best, Zhanghao Chen From: Yong Fang Sent: Wednesday, February 28, 2024 10:12 To: dev Subject: [VOTE] FLIP-314: Support Customized Job Lineage Listener Hi devs, I would like to restart a vote about FLIP-314: Support Customized Job Lineage

Re: [ANNOUNCE] Apache Paimon is graduated to Top Level Project

2024-03-28 Thread Zhanghao Chen
Congratulations! Best, Zhanghao Chen From: Yu Li Sent: Thursday, March 28, 2024 15:55 To: d...@paimon.apache.org Cc: dev ; user Subject: Re: [ANNOUNCE] Apache Paimon is graduated to Top Level Project CC the Flink user and dev mailing list. Paimon originated

Re: [ANNOUNCE] New Apache Flink Committer - Zakelly Lan

2024-04-16 Thread Zhanghao Chen
Congrats, Zakelly! Best, Zhanghao Chen From: Shawn Huang Sent: Wednesday, April 17, 2024 9:59 To: dev@flink.apache.org Subject: Re: [ANNOUNCE] New Apache Flink Committer - Zakelly Lan Congratulations, Zakelly! Best, Shawn Huang Feng Jin 于2024年4月17日周三 00:16写

[DISCUSS] FLIP-460: Display source/sink I/O metrics on Flink Web UI

2024-05-28 Thread Zhanghao Chen
tps://cwiki.apache.org/confluence/display/FLINK/FLIP-33%3A+Standardize+Connector+Metrics Best, Zhanghao Chen

Re: [ANNOUNCE] New Apache Flink PMC Member - Weijie Guo

2024-06-04 Thread Zhanghao Chen
Congrats, Weijie! Best, Zhanghao Chen From: Hang Ruan Sent: Tuesday, June 4, 2024 16:37 To: dev@flink.apache.org Subject: Re: [ANNOUNCE] New Apache Flink PMC Member - Weijie Guo Congratulations Weijie! Best, Hang Yanfei Lei 于2024年6月4日周二 16:24写道

Re: [ANNOUNCE] New Apache Flink PMC Member - Fan Rui

2024-06-05 Thread Zhanghao Chen
Congrats, Rui! Best, Zhanghao Chen From: Piotr Nowojski Sent: Wednesday, June 5, 2024 18:01 To: dev ; rui fan <1996fan...@gmail.com> Subject: [ANNOUNCE] New Apache Flink PMC Member - Fan Rui Hi everyone, On behalf of the PMC, I'm very happy to annou

Re: Poor Load Balancing across TaskManagers for Multiple Kafka Sources

2024-06-05 Thread Zhanghao Chen
Hi Kevin, The problem here is about how to evenly distribute partitions from multiple Kafka topics to tasks, while FLIP-370 is only concerned about how to evenly distribute tasks to slots & taskmanagers, so FLIP-370 won't help here. Best, Zhanghao Chen

Re: [June 15 Feature Freeze][SUMMARY] Flink 1.20 Release Sync 11/06/2024

2024-06-11 Thread Zhanghao Chen
Hi Rui, Thanks for the summary! A quick update here: FLIP-398 was decided not to go into 1.20, as it was just found that the effort to add dedicated serialization support for Maps, Sets and Lists, will break state-compatibility. I will revert the relevant changes soon. Best, Zhanghao Chen

Re: [DISCUSS] FLIP-462: Support Custom Data Distribution for Input Stream of Lookup Join

2024-06-11 Thread Zhanghao Chen
ategy. Could you give a more concrete example in production on when a custom partitioning strategy will outperform partitioning by key? Since you've mentioned Paimon in doc, maybe an example on Paimon. Best, Zhanghao Chen From: weijie guo Sent: Friday, June

Re: [DISCUSS] FLIP-462: Support Custom Data Distribution for Input Stream of Lookup Join

2024-06-11 Thread Zhanghao Chen
Thanks for the clarification, that makes sense. +1 for the proposal. Best, Zhanghao Chen From: weijie guo Sent: Wednesday, June 12, 2024 14:20 To: dev@flink.apache.org Subject: Re: [DISCUSS] FLIP-462: Support Custom Data Distribution for Input Stream of Lookup

Re: [VOTE] FLIP-462: Support Custom Data Distribution for Input Stream of Lookup Join

2024-06-16 Thread Zhanghao Chen
+1 (unbinding) Best, Zhanghao Chen From: weijie guo Sent: Monday, June 17, 2024 10:13 To: dev Subject: [VOTE] FLIP-462: Support Custom Data Distribution for Input Stream of Lookup Join Hi everyone, Thanks for all the feedback about the FLIP-462: Support

Re: [VOTE] FLIP-461: Synchronize rescaling with checkpoint creation to minimize reprocessing for the AdaptiveScheduler

2024-06-17 Thread Zhanghao Chen
+1 (non-binding) Best, Zhanghao Chen From: Matthias Pohl Sent: Monday, June 17, 2024 16:24 To: dev@flink.apache.org Subject: [VOTE] FLIP-461: Synchronize rescaling with checkpoint creation to minimize reprocessing for the AdaptiveScheduler Hi everyone, the

Re: [DISCUSS] FLIP-460: Display source/sink I/O metrics on Flink Web UI

2024-07-15 Thread Zhanghao Chen
Thanks for all. As the discussion is quite concluded, I'll start voting in a separate thread. From: Leonard Xu Sent: Monday, July 15, 2024 11:22 To: dev Subject: Re: [DISCUSS] FLIP-460: Display source/sink I/O metrics on Flink Web UI Thanks for zhanghao for kick

[VOTE] FLIP-460: Display source/sink I/O metrics on Flink Web UI

2024-07-15 Thread Zhanghao Chen
https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=309496355 [2] https://lists.apache.org/thread/sy271nhd2jr1r942f29xbvbgq7fsd841 Best, Zhanghao Chen

[RESULT][VOTE] FLIP-460: Display source/sink I/O metrics on Flink Web UI

2024-07-18 Thread Zhanghao Chen
- Rui Fan (binding) - Zakelly Lan (binding) - Yanquan Lv (non-binding) - Hang Ruan (binding) - Xiqian Yu (non-binding) - Yuepeng Pan (non-binding) There were no votes against. [1] https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=309496355 Best, Zhanghao Chen

Re: [VOTE] FLIP-468: Introducing StreamGraph-Based Job Submission

2024-07-26 Thread Zhanghao Chen
Thanks for driving it. +1 (non-binding) Best, Zhanghao Chen From: Junrui Lee Sent: Friday, July 26, 2024 11:02 To: dev@flink.apache.org Subject: [VOTE] FLIP-468: Introducing StreamGraph-Based Job Submission Hi everyone, Thanks for all the feedback about FLIP

Re: [ANNOUNCE] New Apache Flink Committer - Junrui Li

2024-11-05 Thread Zhanghao Chen
Congrats, Junrui! Best, Zhanghao Chen From: Zhu Zhu Sent: Tuesday, November 5, 2024 19:59 To: dev ; Junrui Lee Subject: [ANNOUNCE] New Apache Flink Committer - Junrui Li Hi everyone, On behalf of the PMC, I'm happy to announce that Junrui Li has become

Re: [DISCUSS] Is it a bug that the AdaptiveScheduler does not prioritize releasing TaskManagers during downscaling in Application mode?

2025-02-04 Thread Zhanghao Chen
Thanks for the effort, Yuepeng! The approach LGTM. Best, Zhanghao Chen From: Yuepeng Pan Sent: Saturday, January 25, 2025 21:36 To: dev@flink.apache.org Subject: Re: [DISCUSS] Is it a bug that the AdaptiveScheduler does not prioritize releasing TaskManagers

Re: [ANNOUNCE] New Apache Flink PMC Member - Zakelly Lan

2025-04-01 Thread Zhanghao Chen
Congrats, Zakelly! Best, Zhanghao Chen From: Yuan Mei Sent: Tuesday, April 1, 2025 15:51 To: dev Subject: [ANNOUNCE] New Apache Flink PMC Member - Zakelly Lan On behalf of the PMC, I'm very happy to announce a new Apache Flink PMC Member - Zakelly Lan. Za

Re: [DISCUSS] FlinkSQL support enableObjectReuse to optimize CopyingChainingOutput

2025-04-23 Thread Zhanghao Chen
Simply setting config pipeline.object-reuse=true should work for that. Best, Zhanghao Chen From: Winterchill <809025...@qq.com.INVALID> Sent: Wednesday, April 23, 2025 20:12 To: dev Subject: [DISCUSS] FlinkSQL support enableObjectReuse to op

Re: [DISCUSS] FlinkSQL support enableObjectReuse to optimize CopyingChainingOutput

2025-04-24 Thread Zhanghao Chen
try cached in Op A is also updated as object is reused. Best, Zhanghao Chen From: Winterchill <809025...@qq.com.INVALID> Sent: Thursday, April 24, 2025 19:01 To: dev Subject: Re: [DISCUSS] FlinkSQL support enableObjectReuse to optimize CopyingChainingOutput

Re: [VOTE] FLIP-506: Support Reuse Multiple Table Sinks in Planner

2025-02-23 Thread Zhanghao Chen
+1 (non-binding) Thanks for driving this. It's a nice useability improvement for performing partial-updates on datalakes. Best, Zhanghao Chen From: xiangyu feng Sent: Sunday, February 23, 2025 10:44 To: dev@flink.apache.org Subject: [VOTE] FLIP-506: Su

Re: [DISCUSSION] Upgrade to Kryo 5 for Flink 2.0

2025-02-25 Thread Zhanghao Chen
arting new applications can introduce their own serialization stack in this case to resolve Java compatibility issue is this case or for other performance issues. [1] https://spark.apache.org/docs/latest/configuration.html Best, Zhanghao Chen From: Gyula F?ra Se

[jira] [Created] (FLINK-31936) Support setting scale up max factor

2023-04-25 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-31936: - Summary: Support setting scale up max factor Key: FLINK-31936 URL: https://issues.apache.org/jira/browse/FLINK-31936 Project: Flink Issue Type

[jira] [Created] (FLINK-31991) Update Autoscaler doc to reflect the changes brought by the new source scaling logic

2023-05-03 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-31991: - Summary: Update Autoscaler doc to reflect the changes brought by the new source scaling logic Key: FLINK-31991 URL: https://issues.apache.org/jira/browse/FLINK-31991

[jira] [Created] (FLINK-32037) The edge on Web UI is wrong after parallelism changes via parallelism overrides or AdaptiveScheduler

2023-05-08 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-32037: - Summary: The edge on Web UI is wrong after parallelism changes via parallelism overrides or AdaptiveScheduler Key: FLINK-32037 URL: https://issues.apache.org/jira/browse/FLINK

[jira] [Created] (FLINK-32124) Add option to enable partition alignment for sources

2023-05-17 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-32124: - Summary: Add option to enable partition alignment for sources Key: FLINK-32124 URL: https://issues.apache.org/jira/browse/FLINK-32124 Project: Flink Issue

[jira] [Created] (FLINK-32127) Source busy time is inaccurate in many cases

2023-05-17 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-32127: - Summary: Source busy time is inaccurate in many cases Key: FLINK-32127 URL: https://issues.apache.org/jira/browse/FLINK-32127 Project: Flink Issue Type

[jira] [Created] (FLINK-32820) ParameterTool is mistakenly marked as deprecated

2023-08-09 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-32820: - Summary: ParameterTool is mistakenly marked as deprecated Key: FLINK-32820 URL: https://issues.apache.org/jira/browse/FLINK-32820 Project: Flink Issue

[jira] [Created] (FLINK-32821) Streaming examples failed to execute due to error in packaging

2023-08-09 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-32821: - Summary: Streaming examples failed to execute due to error in packaging Key: FLINK-32821 URL: https://issues.apache.org/jira/browse/FLINK-32821 Project: Flink

[jira] [Created] (FLINK-32822) Add connector option to control whether to enable auto-commit of offsets when checkpoints is enabled

2023-08-09 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-32822: - Summary: Add connector option to control whether to enable auto-commit of offsets when checkpoints is enabled Key: FLINK-32822 URL: https://issues.apache.org/jira/browse/FLINK

[jira] [Created] (FLINK-32868) Document the need to backport FLINK-30213 for using autoscaler with older version Flinks

2023-08-14 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-32868: - Summary: Document the need to backport FLINK-30213 for using autoscaler with older version Flinks Key: FLINK-32868 URL: https://issues.apache.org/jira/browse/FLINK-32868

[jira] [Created] (FLINK-32872) Add option to control the default partitioner when the parallelism of upstream and downstream operator does not match

2023-08-15 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-32872: - Summary: Add option to control the default partitioner when the parallelism of upstream and downstream operator does not match Key: FLINK-32872 URL: https://issues.apache.org

[jira] [Created] (FLINK-32980) Support env.java.opts.all & env.java.opts.cli config for starting Session clusters

2023-08-28 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-32980: - Summary: Support env.java.opts.all & env.java.opts.cli config for starting Session clusters Key: FLINK-32980 URL: https://issues.apache.org/jira/browse/FLINK-3

[jira] [Created] (FLINK-32983) Support setting env.java.opts.all & env.java.opts.cli configs via dynamic properties on the CLI side

2023-08-28 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-32983: - Summary: Support setting env.java.opts.all & env.java.opts.cli configs via dynamic properties on the CLI side Key: FLINK-32983 URL: https://issues.apache.org/jira/browse/F

[jira] [Created] (FLINK-33123) Wrong dynamic replacement of partitioner from FORWARD to REBLANCE for autoscaler and adaptive scheduler and

2023-09-20 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-33123: - Summary: Wrong dynamic replacement of partitioner from FORWARD to REBLANCE for autoscaler and adaptive scheduler and Key: FLINK-33123 URL: https://issues.apache.org/jira

[jira] [Created] (FLINK-33146) FLIP-363: Unify the Representation of TaskManager Location in REST API and Web UI

2023-09-24 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-33146: - Summary: FLIP-363: Unify the Representation of TaskManager Location in REST API and Web UI Key: FLINK-33146 URL: https://issues.apache.org/jira/browse/FLINK-33146

[jira] [Created] (FLINK-33147) Introduce a new "endpoint" field in REST API to represent TaskManager endpoint (host + port) and deprecate the "host" field

2023-09-24 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-33147: - Summary: Introduce a new "endpoint" field in REST API to represent TaskManager endpoint (host + port) and deprecate the "host" field Key: FLINK-33147

[jira] [Created] (FLINK-33148) Update Web UI to adopt the new "endpoint" field in REST API

2023-09-24 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-33148: - Summary: Update Web UI to adopt the new "endpoint" field in REST API Key: FLINK-33148 URL: https://issues.apache.org/jira/browse/FLINK-33148 Proj

[jira] [Created] (FLINK-33166) Support setting root logger level by config

2023-09-27 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-33166: - Summary: Support setting root logger level by config Key: FLINK-33166 URL: https://issues.apache.org/jira/browse/FLINK-33166 Project: Flink Issue Type

[jira] [Created] (FLINK-33204) Add description for missing options in the all jobmanager/taskmanager options section in document

2023-10-07 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-33204: - Summary: Add description for missing options in the all jobmanager/taskmanager options section in document Key: FLINK-33204 URL: https://issues.apache.org/jira/browse/FLINK

[jira] [Created] (FLINK-33205) Replace Akka with Pekko in the description of "pekko.ssl.enabled"

2023-10-07 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-33205: - Summary: Replace Akka with Pekko in the description of "pekko.ssl.enabled" Key: FLINK-33205 URL: https://issues.apache.org/jira/browse/FLINK-33205 Proj

[jira] [Created] (FLINK-33221) Add config options for administrator JVM options

2023-10-09 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-33221: - Summary: Add config options for administrator JVM options Key: FLINK-33221 URL: https://issues.apache.org/jira/browse/FLINK-33221 Project: Flink Issue

[jira] [Created] (FLINK-33236) Remove the unused high-availability.zookeeper.path.running-registry option

2023-10-10 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-33236: - Summary: Remove the unused high-availability.zookeeper.path.running-registry option Key: FLINK-33236 URL: https://issues.apache.org/jira/browse/FLINK-33236 Project

[jira] [Created] (FLINK-33240) Generate docs for deprecated options as well

2023-10-11 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-33240: - Summary: Generate docs for deprecated options as well Key: FLINK-33240 URL: https://issues.apache.org/jira/browse/FLINK-33240 Project: Flink Issue Type

[jira] [Created] (FLINK-33261) FLIP-367: Support Setting Parallelism for Table/SQL Sources

2023-10-12 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-33261: - Summary: FLIP-367: Support Setting Parallelism for Table/SQL Sources Key: FLINK-33261 URL: https://issues.apache.org/jira/browse/FLINK-33261 Project: Flink

[jira] [Created] (FLINK-33262) Extend source provider interfaces with the new parallelism provider interface

2023-10-12 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-33262: - Summary: Extend source provider interfaces with the new parallelism provider interface Key: FLINK-33262 URL: https://issues.apache.org/jira/browse/FLINK-33262

[jira] [Created] (FLINK-33263) Implement ParallelismProvider for sources in Blink planner

2023-10-12 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-33263: - Summary: Implement ParallelismProvider for sources in Blink planner Key: FLINK-33263 URL: https://issues.apache.org/jira/browse/FLINK-33263 Project: Flink

[jira] [Created] (FLINK-33264) Support source parallelism setting for DataGen connector

2023-10-12 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-33264: - Summary: Support source parallelism setting for DataGen connector Key: FLINK-33264 URL: https://issues.apache.org/jira/browse/FLINK-33264 Project: Flink

[jira] [Created] (FLINK-33265) Support source parallelism setting for Kafka connector

2023-10-12 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-33265: - Summary: Support source parallelism setting for Kafka connector Key: FLINK-33265 URL: https://issues.apache.org/jira/browse/FLINK-33265 Project: Flink

[jira] [Created] (FLINK-33681) Display source/sink numRecordsIn/Out & numBytesIn/Out on UI

2023-11-28 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-33681: - Summary: Display source/sink numRecordsIn/Out & numBytesIn/Out on UI Key: FLINK-33681 URL: https://issues.apache.org/jira/browse/FLINK-33681 Project: F

[jira] [Created] (FLINK-33682) Reuse source operator input records/bytes metrics for SourceOperatorStreamTask

2023-11-28 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-33682: - Summary: Reuse source operator input records/bytes metrics for SourceOperatorStreamTask Key: FLINK-33682 URL: https://issues.apache.org/jira/browse/FLINK-33682

[jira] [Created] (FLINK-33891) Remove the obsolete SingleJobGraphStore

2023-12-19 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-33891: - Summary: Remove the obsolete SingleJobGraphStore Key: FLINK-33891 URL: https://issues.apache.org/jira/browse/FLINK-33891 Project: Flink Issue Type

[jira] [Created] (FLINK-33940) Update Update the auto-derivation rule of max parallelism for enlarged upscaling space

2023-12-25 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-33940: - Summary: Update Update the auto-derivation rule of max parallelism for enlarged upscaling space Key: FLINK-33940 URL: https://issues.apache.org/jira/browse/FLINK-33940

[jira] [Created] (FLINK-33962) Chaining-agnostic OperatorID generation for improved state compatibility on parallelism change

2024-01-01 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-33962: - Summary: Chaining-agnostic OperatorID generation for improved state compatibility on parallelism change Key: FLINK-33962 URL: https://issues.apache.org/jira/browse/FLINK-33962

[jira] [Created] (FLINK-33977) Adaptive scheduler may not minimize the number of TMs during downscaling

2024-01-03 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-33977: - Summary: Adaptive scheduler may not minimize the number of TMs during downscaling Key: FLINK-33977 URL: https://issues.apache.org/jira/browse/FLINK-33977 Project

  1   2   >