[DISCUSS] FLIP-538: Support Custom Generic Type Serializer

2025-07-27 Thread Zhanghao Chen
e.org/confluence/display/FLINK/FLIP+538%3A+Support+Custom+Generic+Type+Serializer [2] https://cwiki.apache.org/confluence/display/FLINK/FLIP-317%3A+Upgrade+Kryo+from+2.24.0+to+5.5.0 [3] https://fory.apache.org/ Best, Zhanghao Chen

[jira] [Created] (FLINK-38078) DataStream API Execution Configuration doc contains deleted API usage

2025-07-10 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-38078: - Summary: DataStream API Execution Configuration doc contains deleted API usage Key: FLINK-38078 URL: https://issues.apache.org/jira/browse/FLINK-38078 Project

[jira] [Created] (FLINK-37735) Replace class.newInstance with constructor.newInstance

2025-04-26 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-37735: - Summary: Replace class.newInstance with constructor.newInstance Key: FLINK-37735 URL: https://issues.apache.org/jira/browse/FLINK-37735 Project: Flink

[jira] [Created] (FLINK-37722) Eliminate redundant field initialization when deserializing POJOs

2025-04-24 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-37722: - Summary: Eliminate redundant field initialization when deserializing POJOs Key: FLINK-37722 URL: https://issues.apache.org/jira/browse/FLINK-37722 Project: Flink

Re: [DISCUSS] FlinkSQL support enableObjectReuse to optimize CopyingChainingOutput

2025-04-24 Thread Zhanghao Chen
try cached in Op A is also updated as object is reused. Best, Zhanghao Chen From: Winterchill <809025...@qq.com.INVALID> Sent: Thursday, April 24, 2025 19:01 To: dev Subject: Re: [DISCUSS] FlinkSQL support enableObjectReuse to optimize CopyingChainingOutput

Re: [DISCUSS] FlinkSQL support enableObjectReuse to optimize CopyingChainingOutput

2025-04-23 Thread Zhanghao Chen
Simply setting config pipeline.object-reuse=true should work for that. Best, Zhanghao Chen From: Winterchill <809025...@qq.com.INVALID> Sent: Wednesday, April 23, 2025 20:12 To: dev Subject: [DISCUSS] FlinkSQL support enableObjectReuse to op

[jira] [Created] (FLINK-37681) Add benchmark for subclass seder with PojoSerializer in Flink benchmark

2025-04-15 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-37681: - Summary: Add benchmark for subclass seder with PojoSerializer in Flink benchmark Key: FLINK-37681 URL: https://issues.apache.org/jira/browse/FLINK-37681 Project

[jira] [Created] (FLINK-37680) Add subclass cache for PojoSerializer

2025-04-15 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-37680: - Summary: Add subclass cache for PojoSerializer Key: FLINK-37680 URL: https://issues.apache.org/jira/browse/FLINK-37680 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-37679) Improve the performance of Flink serialization

2025-04-15 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-37679: - Summary: Improve the performance of Flink serialization Key: FLINK-37679 URL: https://issues.apache.org/jira/browse/FLINK-37679 Project: Flink Issue Type

[jira] [Created] (FLINK-37661) Remove Kryo serializer reference data from version 1.x

2025-04-11 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-37661: - Summary: Remove Kryo serializer reference data from version 1.x Key: FLINK-37661 URL: https://issues.apache.org/jira/browse/FLINK-37661 Project: Flink

[jira] [Created] (FLINK-37660) Reenable Kryo serializer upgrade tests

2025-04-11 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-37660: - Summary: Reenable Kryo serializer upgrade tests Key: FLINK-37660 URL: https://issues.apache.org/jira/browse/FLINK-37660 Project: Flink Issue Type

[jira] [Created] (FLINK-37659) Flink 2.0: update reference data for Migration Tests

2025-04-11 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-37659: - Summary: Flink 2.0: update reference data for Migration Tests Key: FLINK-37659 URL: https://issues.apache.org/jira/browse/FLINK-37659 Project: Flink Issue

Re: [ANNOUNCE] New Apache Flink PMC Member - Zakelly Lan

2025-04-01 Thread Zhanghao Chen
Congrats, Zakelly! Best, Zhanghao Chen From: Yuan Mei Sent: Tuesday, April 1, 2025 15:51 To: dev Subject: [ANNOUNCE] New Apache Flink PMC Member - Zakelly Lan On behalf of the PMC, I'm very happy to announce a new Apache Flink PMC Member - Zakelly Lan. Za

Re: [DISCUSSION] Upgrade to Kryo 5 for Flink 2.0

2025-02-25 Thread Zhanghao Chen
arting new applications can introduce their own serialization stack in this case to resolve Java compatibility issue is this case or for other performance issues. [1] https://spark.apache.org/docs/latest/configuration.html Best, Zhanghao Chen From: Gyula F?ra Se

Re: [VOTE] FLIP-506: Support Reuse Multiple Table Sinks in Planner

2025-02-23 Thread Zhanghao Chen
+1 (non-binding) Thanks for driving this. It's a nice useability improvement for performing partial-updates on datalakes. Best, Zhanghao Chen From: xiangyu feng Sent: Sunday, February 23, 2025 10:44 To: dev@flink.apache.org Subject: [VOTE] FLIP-506: Su

Re: [DISCUSS] Is it a bug that the AdaptiveScheduler does not prioritize releasing TaskManagers during downscaling in Application mode?

2025-02-04 Thread Zhanghao Chen
Thanks for the effort, Yuepeng! The approach LGTM. Best, Zhanghao Chen From: Yuepeng Pan Sent: Saturday, January 25, 2025 21:36 To: dev@flink.apache.org Subject: Re: [DISCUSS] Is it a bug that the AdaptiveScheduler does not prioritize releasing TaskManagers

[jira] [Created] (FLINK-37249) Remove unnecessary --add-opens/--add-exports for java.base/sun.net.util

2025-02-03 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-37249: - Summary: Remove unnecessary --add-opens/--add-exports for java.base/sun.net.util Key: FLINK-37249 URL: https://issues.apache.org/jira/browse/FLINK-37249 Project

[jira] [Created] (FLINK-37226) Replace deprecated methods in the DataStream API introduction doc

2025-01-25 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-37226: - Summary: Replace deprecated methods in the DataStream API introduction doc Key: FLINK-37226 URL: https://issues.apache.org/jira/browse/FLINK-37226 Project: Flink

[jira] [Created] (FLINK-37225) Remove remaining test resources of Gelly

2025-01-25 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-37225: - Summary: Remove remaining test resources of Gelly Key: FLINK-37225 URL: https://issues.apache.org/jira/browse/FLINK-37225 Project: Flink Issue Type

[jira] [Created] (FLINK-37101) Remove internal set methods in SerializerConfig

2025-01-11 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-37101: - Summary: Remove internal set methods in SerializerConfig Key: FLINK-37101 URL: https://issues.apache.org/jira/browse/FLINK-37101 Project: Flink Issue Type

[jira] [Created] (FLINK-37024) Task can be stuck in deploying state forever when canceling job/failover

2025-01-07 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-37024: - Summary: Task can be stuck in deploying state forever when canceling job/failover Key: FLINK-37024 URL: https://issues.apache.org/jira/browse/FLINK-37024 Project

[jira] [Created] (FLINK-37015) Revise serialization doc to reflect the 2.0 breaking changes properly

2025-01-06 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-37015: - Summary: Revise serialization doc to reflect the 2.0 breaking changes properly Key: FLINK-37015 URL: https://issues.apache.org/jira/browse/FLINK-37015 Project

[jira] [Created] (FLINK-36905) Update Chinese document to reflect the changes of FLIP-398

2024-12-15 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-36905: - Summary: Update Chinese document to reflect the changes of FLIP-398 Key: FLINK-36905 URL: https://issues.apache.org/jira/browse/FLINK-36905 Project: Flink

[jira] [Created] (FLINK-36904) Fix doc error on how to programmatically register a 3rd-party serializer

2024-12-14 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-36904: - Summary: Fix doc error on how to programmatically register a 3rd-party serializer Key: FLINK-36904 URL: https://issues.apache.org/jira/browse/FLINK-36904 Project

[jira] [Created] (FLINK-36903) Add switch for built-in serialization support for common collection types

2024-12-14 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-36903: - Summary: Add switch for built-in serialization support for common collection types Key: FLINK-36903 URL: https://issues.apache.org/jira/browse/FLINK-36903 Project

Re: [ANNOUNCE] New Apache Flink Committer - Junrui Li

2024-11-05 Thread Zhanghao Chen
Congrats, Junrui! Best, Zhanghao Chen From: Zhu Zhu Sent: Tuesday, November 5, 2024 19:59 To: dev ; Junrui Lee Subject: [ANNOUNCE] New Apache Flink Committer - Junrui Li Hi everyone, On behalf of the PMC, I'm happy to announce that Junrui Li has become

Re: [VOTE] FLIP-468: Introducing StreamGraph-Based Job Submission

2024-07-26 Thread Zhanghao Chen
Thanks for driving it. +1 (non-binding) Best, Zhanghao Chen From: Junrui Lee Sent: Friday, July 26, 2024 11:02 To: dev@flink.apache.org Subject: [VOTE] FLIP-468: Introducing StreamGraph-Based Job Submission Hi everyone, Thanks for all the feedback about FLIP

[RESULT][VOTE] FLIP-460: Display source/sink I/O metrics on Flink Web UI

2024-07-18 Thread Zhanghao Chen
- Rui Fan (binding) - Zakelly Lan (binding) - Yanquan Lv (non-binding) - Hang Ruan (binding) - Xiqian Yu (non-binding) - Yuepeng Pan (non-binding) There were no votes against. [1] https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=309496355 Best, Zhanghao Chen

[VOTE] FLIP-460: Display source/sink I/O metrics on Flink Web UI

2024-07-15 Thread Zhanghao Chen
https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=309496355 [2] https://lists.apache.org/thread/sy271nhd2jr1r942f29xbvbgq7fsd841 Best, Zhanghao Chen

Re: [DISCUSS] FLIP-460: Display source/sink I/O metrics on Flink Web UI

2024-07-15 Thread Zhanghao Chen
Thanks for all. As the discussion is quite concluded, I'll start voting in a separate thread. From: Leonard Xu Sent: Monday, July 15, 2024 11:22 To: dev Subject: Re: [DISCUSS] FLIP-460: Display source/sink I/O metrics on Flink Web UI Thanks for zhanghao for kick

Re: [VOTE] FLIP-461: Synchronize rescaling with checkpoint creation to minimize reprocessing for the AdaptiveScheduler

2024-06-17 Thread Zhanghao Chen
+1 (non-binding) Best, Zhanghao Chen From: Matthias Pohl Sent: Monday, June 17, 2024 16:24 To: dev@flink.apache.org Subject: [VOTE] FLIP-461: Synchronize rescaling with checkpoint creation to minimize reprocessing for the AdaptiveScheduler Hi everyone, the

Re: [VOTE] FLIP-462: Support Custom Data Distribution for Input Stream of Lookup Join

2024-06-16 Thread Zhanghao Chen
+1 (unbinding) Best, Zhanghao Chen From: weijie guo Sent: Monday, June 17, 2024 10:13 To: dev Subject: [VOTE] FLIP-462: Support Custom Data Distribution for Input Stream of Lookup Join Hi everyone, Thanks for all the feedback about the FLIP-462: Support

Re: [DISCUSS] FLIP-462: Support Custom Data Distribution for Input Stream of Lookup Join

2024-06-11 Thread Zhanghao Chen
Thanks for the clarification, that makes sense. +1 for the proposal. Best, Zhanghao Chen From: weijie guo Sent: Wednesday, June 12, 2024 14:20 To: dev@flink.apache.org Subject: Re: [DISCUSS] FLIP-462: Support Custom Data Distribution for Input Stream of Lookup

Re: [DISCUSS] FLIP-462: Support Custom Data Distribution for Input Stream of Lookup Join

2024-06-11 Thread Zhanghao Chen
ategy. Could you give a more concrete example in production on when a custom partitioning strategy will outperform partitioning by key? Since you've mentioned Paimon in doc, maybe an example on Paimon. Best, Zhanghao Chen From: weijie guo Sent: Friday, June

Re: [June 15 Feature Freeze][SUMMARY] Flink 1.20 Release Sync 11/06/2024

2024-06-11 Thread Zhanghao Chen
Hi Rui, Thanks for the summary! A quick update here: FLIP-398 was decided not to go into 1.20, as it was just found that the effort to add dedicated serialization support for Maps, Sets and Lists, will break state-compatibility. I will revert the relevant changes soon. Best, Zhanghao Chen

[jira] [Created] (FLINK-35555) Serializing List with null values throws NPE

2024-06-07 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-3: - Summary: Serializing List with null values throws NPE Key: FLINK-3 URL: https://issues.apache.org/jira/browse/FLINK-3 Project: Flink Issue Type

Re: Poor Load Balancing across TaskManagers for Multiple Kafka Sources

2024-06-05 Thread Zhanghao Chen
Hi Kevin, The problem here is about how to evenly distribute partitions from multiple Kafka topics to tasks, while FLIP-370 is only concerned about how to evenly distribute tasks to slots & taskmanagers, so FLIP-370 won't help here. Best, Zhanghao Chen

Re: [ANNOUNCE] New Apache Flink PMC Member - Fan Rui

2024-06-05 Thread Zhanghao Chen
Congrats, Rui! Best, Zhanghao Chen From: Piotr Nowojski Sent: Wednesday, June 5, 2024 18:01 To: dev ; rui fan <1996fan...@gmail.com> Subject: [ANNOUNCE] New Apache Flink PMC Member - Fan Rui Hi everyone, On behalf of the PMC, I'm very happy to annou

Re: [ANNOUNCE] New Apache Flink PMC Member - Weijie Guo

2024-06-04 Thread Zhanghao Chen
Congrats, Weijie! Best, Zhanghao Chen From: Hang Ruan Sent: Tuesday, June 4, 2024 16:37 To: dev@flink.apache.org Subject: Re: [ANNOUNCE] New Apache Flink PMC Member - Weijie Guo Congratulations Weijie! Best, Hang Yanfei Lei 于2024年6月4日周二 16:24写道

[DISCUSS] FLIP-460: Display source/sink I/O metrics on Flink Web UI

2024-05-28 Thread Zhanghao Chen
tps://cwiki.apache.org/confluence/display/FLINK/FLIP-33%3A+Standardize+Connector+Metrics Best, Zhanghao Chen

[jira] [Created] (FLINK-35458) Add serializer upgrade test for set serializer

2024-05-26 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-35458: - Summary: Add serializer upgrade test for set serializer Key: FLINK-35458 URL: https://issues.apache.org/jira/browse/FLINK-35458 Project: Flink Issue Type

[jira] [Created] (FLINK-35145) Add timeout for cluster termination

2024-04-17 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-35145: - Summary: Add timeout for cluster termination Key: FLINK-35145 URL: https://issues.apache.org/jira/browse/FLINK-35145 Project: Flink Issue Type

Re: [ANNOUNCE] New Apache Flink Committer - Zakelly Lan

2024-04-16 Thread Zhanghao Chen
Congrats, Zakelly! Best, Zhanghao Chen From: Shawn Huang Sent: Wednesday, April 17, 2024 9:59 To: dev@flink.apache.org Subject: Re: [ANNOUNCE] New Apache Flink Committer - Zakelly Lan Congratulations, Zakelly! Best, Shawn Huang Feng Jin 于2024年4月17日周三 00:16写

[jira] [Created] (FLINK-35068) Introduce built-in serialization support for Set

2024-04-09 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-35068: - Summary: Introduce built-in serialization support for Set Key: FLINK-35068 URL: https://issues.apache.org/jira/browse/FLINK-35068 Project: Flink Issue

Re: [ANNOUNCE] Apache Paimon is graduated to Top Level Project

2024-03-28 Thread Zhanghao Chen
Congratulations! Best, Zhanghao Chen From: Yu Li Sent: Thursday, March 28, 2024 15:55 To: d...@paimon.apache.org Cc: dev ; user Subject: Re: [ANNOUNCE] Apache Paimon is graduated to Top Level Project CC the Flink user and dev mailing list. Paimon originated

Re: [VOTE] FLIP-314: Support Customized Job Lineage Listener

2024-02-28 Thread Zhanghao Chen
+1 (non-binding) Best, Zhanghao Chen From: Yong Fang Sent: Wednesday, February 28, 2024 10:12 To: dev Subject: [VOTE] FLIP-314: Support Customized Job Lineage Listener Hi devs, I would like to restart a vote about FLIP-314: Support Customized Job Lineage

Re: [ANNOUNCE] New Apache Flink Committer - Jiabao Sun

2024-02-19 Thread Zhanghao Chen
Congrats, Jiaba! Best, Zhanghao Chen From: Qingsheng Ren Sent: Monday, February 19, 2024 17:53 To: dev ; jiabao...@apache.org Subject: [ANNOUNCE] New Apache Flink Committer - Jiabao Sun Hi everyone, On behalf of the PMC, I'm happy to announce Jiabao Sun

Re: [DISCUSS] FLIP 411: Chaining-agnostic Operator ID generation for improved state compatibility on parallelism change

2024-02-08 Thread Zhanghao Chen
. The user then configures different parallelism for the source and the remaining part of the job, which breaks a chain, and leads to state-incompatibility. Best, Zhanghao Chen From: Chesnay Schepler Sent: Thursday, February 8, 2024 18:12 To: dev@flink.apach

Re: [DISCUSS] FLIP 411: Chaining-agnostic Operator ID generation for improved state compatibility on parallelism change

2024-02-08 Thread Zhanghao Chen
lines deleted + extending the OperatorIdPair data structure) without much extra effort. Best, Zhanghao Chen From: Piotr Nowojski Sent: Thursday, February 8, 2024 14:50 To: Zhanghao Chen Cc: Chesnay Schepler ; dev@flink.apache.org ; Yu Chen Subject: Re: [DISCUSS

Re: [DISCUSS] FLIP 411: Chaining-agnostic Operator ID generation for improved state compatibility on parallelism change

2024-02-07 Thread Zhanghao Chen
t that multiple companies have developed or trying to develop similar hasher changes in their internal distribution, including ByteDance, Xiaohongshu, and Bilibili. It'll be great if we can improve the SQL experience for all community users as well, WDYT? Best, Zhanghao Chen

Re: [DISCUSS] FLIP 411: Chaining-agnostic Operator ID generation for improved state compatibility on parallelism change

2024-02-07 Thread Zhanghao Chen
ough offline discussion and code debugging help to make this possible. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-411%3A+Chaining-agnostic+Operator+ID+generation+for+improved+state+compatibility+on+parallelism+change [2] https://issues.apache.org/jira/browse/FLIN

[jira] [Created] (FLINK-34354) Release Testing: Verify FLINK-34037 Improve Serialization Configuration and Usage in Flink

2024-02-04 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-34354: - Summary: Release Testing: Verify FLINK-34037 Improve Serialization Configuration and Usage in Flink Key: FLINK-34354 URL: https://issues.apache.org/jira/browse/FLINK-34354

[jira] [Created] (FLINK-34328) Release Testing Instructions: Verify FLINK-34037 Improve Serialization Configuration And Usage In Flink

2024-01-31 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-34328: - Summary: Release Testing Instructions: Verify FLINK-34037 Improve Serialization Configuration And Usage In Flink Key: FLINK-34328 URL: https://issues.apache.org/jira/browse

[jira] [Created] (FLINK-34270) Update connector developer-facing doc

2024-01-29 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-34270: - Summary: Update connector developer-facing doc Key: FLINK-34270 URL: https://issues.apache.org/jira/browse/FLINK-34270 Project: Flink Issue Type: Sub-task

Re: [NOTICE] master branch cannot compile for now

2024-01-26 Thread Zhanghao Chen
Hi devs, The issue has already been resolved via a separate PR [1]. Feel free to rebase master and proceed~ [1] https://github.com/apache/flink/pull/24200 Best, Zhanghao Chen From: Benchao Li Sent: Friday, January 26, 2024 11:39 To: dev Subject: [NOTICE

[jira] [Created] (FLINK-34239) Introduce a deep copy method of SerializerConfig for merging with Table configs in org.apache.flink.table.catalog.DataTypeFactoryImpl

2024-01-25 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-34239: - Summary: Introduce a deep copy method of SerializerConfig for merging with Table configs in org.apache.flink.table.catalog.DataTypeFactoryImpl Key: FLINK-34239 URL: https

[jira] [Created] (FLINK-34230) Update flink-docs README: add -Pskip-webui-build to the config doc generation command

2024-01-24 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-34230: - Summary: Update flink-docs README: add -Pskip-webui-build to the config doc generation command Key: FLINK-34230 URL: https://issues.apache.org/jira/browse/FLINK-34230

[jira] [Created] (FLINK-34217) Update Serialization-related doc with the new way of configuration

2024-01-23 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-34217: - Summary: Update Serialization-related doc with the new way of configuration Key: FLINK-34217 URL: https://issues.apache.org/jira/browse/FLINK-34217 Project: Flink

[jira] [Created] (FLINK-34125) Flink 2.0: Remove deprecated serialization config methods and options

2024-01-16 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-34125: - Summary: Flink 2.0: Remove deprecated serialization config methods and options Key: FLINK-34125 URL: https://issues.apache.org/jira/browse/FLINK-34125 Project

[jira] [Created] (FLINK-34124) Flink 2.0: Disable Kyro by default

2024-01-16 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-34124: - Summary: Flink 2.0: Disable Kyro by default Key: FLINK-34124 URL: https://issues.apache.org/jira/browse/FLINK-34124 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-34123) Introduce built-in serializers for common composited data types

2024-01-16 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-34123: - Summary: Introduce built-in serializers for common composited data types Key: FLINK-34123 URL: https://issues.apache.org/jira/browse/FLINK-34123 Project: Flink

[jira] [Created] (FLINK-34122) Deprecate old serialization config methods and options

2024-01-16 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-34122: - Summary: Deprecate old serialization config methods and options Key: FLINK-34122 URL: https://issues.apache.org/jira/browse/FLINK-34122 Project: Flink

[jira] [Created] (FLINK-34121) Introduce pipeline.force-kryo-avro to control whether to force registration of Avro serializer with Kryo

2024-01-16 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-34121: - Summary: Introduce pipeline.force-kryo-avro to control whether to force registration of Avro serializer with Kryo Key: FLINK-34121 URL: https://issues.apache.org/jira/browse

[jira] [Created] (FLINK-34120) Introduce unified serialization config option for all Kryo, POJO and customized serializers

2024-01-16 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-34120: - Summary: Introduce unified serialization config option for all Kryo, POJO and customized serializers Key: FLINK-34120 URL: https://issues.apache.org/jira/browse/FLINK-34120

[jira] [Created] (FLINK-34103) AsyncIO example failed to run as DataGen Connector is not bundled

2024-01-15 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-34103: - Summary: AsyncIO example failed to run as DataGen Connector is not bundled Key: FLINK-34103 URL: https://issues.apache.org/jira/browse/FLINK-34103 Project: Flink

Re: [VOTE] FLIP-407: Improve Flink Client performance in interactive scenarios

2024-01-15 Thread Zhanghao Chen
+1 (non-binding) Best, Zhanghao Chen From: xiangyu feng Sent: Thursday, January 11, 2024 19:44 To: dev@flink.apache.org Subject: [VOTE] FLIP-407: Improve Flink Client performance in interactive scenarios Hi all, I would like to start the vote for FLIP-407

Re: [DISCUSS] FLIP 411: Chaining-agnostic Operator ID generation for improved state compatibility on parallelism change

2024-01-11 Thread Zhanghao Chen
Thanks for the input, Piotr. It might still be possible to make it compatible with the old snapshots, following the direction of FLINK-5290<https://issues.apache.org/jira/browse/FLINK-5290> suggested by Yu. I'll discuss with Yu on more details. Best, Zh

Re: [DISCUSS] FLIP 411: Chaining-agnostic Operator ID generation for improved state compatibility on parallelism change

2024-01-10 Thread Zhanghao Chen
any suggestions on this? Best, Zhanghao Chen From: Yu Chen Sent: Thursday, January 11, 2024 13:52 To: dev@flink.apache.org Cc: Piotr Nowojski ; zhanghao.c...@outlook.com Subject: Re: [DISCUSS] FLIP 411: Chaining-agnostic Operator ID generation for improved stat

Re: [DISCUSS] FLIP 411: Chaining-agnostic Operator ID generation for improved state compatibility on parallelism change

2024-01-09 Thread Zhanghao Chen
s and has unaligned checkpoints enabled, we will encounter the same issue if they decide to break the chain on a later restart and try to recover from a retained cp. [1] https://nightlies.apache.org/flink/flink-docs-release-1.18/docs/ops/state/checkpointing_under_backpressure/ Best, Zhanghao

[RESULT][VOTE] FLIP-397: Add config options for administrator JVM options

2024-01-08 Thread Zhanghao Chen
ving votes. Thanks again to everyone who participated in the discussion and voting. [1] https://lists.apache.org/thread/5qlr0xl0oyc9dnvcjr0q39pcrzyx4ohb Best, Zhanghao Chen

Re: [VOTE] FLIP-397: Add config options for administrator JVM options

2024-01-08 Thread Zhanghao Chen
Thank you all! Closing the vote. The result will be sent in a separate email. Best, Zhanghao Chen From: Zhanghao Chen Sent: Thursday, January 4, 2024 10:29 To: dev Subject: [VOTE] FLIP-397: Add config options for administrator JVM options Hi everyone, Thanks

Re: FLIP-413: Enable unaligned checkpoints by default

2024-01-07 Thread Zhanghao Chen
s and incidents. From my point of view, we'd better not enable it by default before removing all the limitations listed in https://nightlies.apache.org/flink/flink-docs-release-1.18/docs/ops/state/checkpointing_under_backpressure/#limitations. Best, Zhanghao Chen F

Re: [DISCUSS] FLIP-402: Extend ZooKeeper Curator configurations

2024-01-03 Thread Zhanghao Chen
nfigs may help users in certain scenarios sooner or later. [1] https://issues.apache.org/jira/browse/FLINK-31780 Best, Zhanghao Chen From: Alex Nitavsky Sent: Thursday, December 14, 2023 21:20 To: dev@flink.apache.org Subject: [DISCUSS] FLIP-402: Extend ZooK

[VOTE] FLIP-397: Add config options for administrator JVM options

2024-01-03 Thread Zhanghao Chen
Best, Zhanghao Chen

[jira] [Created] (FLINK-33977) Adaptive scheduler may not minimize the number of TMs during downscaling

2024-01-03 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-33977: - Summary: Adaptive scheduler may not minimize the number of TMs during downscaling Key: FLINK-33977 URL: https://issues.apache.org/jira/browse/FLINK-33977 Project

Re: [Discuss] FLIP-407: Improve Flink Client performance in interactive scenarios

2024-01-03 Thread Zhanghao Chen
Thanks for driving this effort on improving the interactive use experience of Flink. The proposal overall looks good to me. Best, Zhanghao Chen From: xiangyu feng Sent: Tuesday, December 26, 2023 16:51 To: dev@flink.apache.org Subject: [Discuss] FLIP-407

[DISCUSS] FLIP 411: Chaining-agnostic Operator ID generation for improved state compatibility on parallelism change

2024-01-02 Thread Zhanghao Chen
FLIP-411%3A+Chaining-agnostic+Operator+ID+generation+for+improved+state+compatibility+on+parallelism+change Best, Zhanghao Chen

Re: [ANNOUNCE] New Apache Flink Committer - Alexander Fedulov

2024-01-02 Thread Zhanghao Chen
Congrats, Alex! Best, Zhanghao Chen From: Maximilian Michels Sent: Tuesday, January 2, 2024 20:15 To: dev Cc: Alexander Fedulov Subject: [ANNOUNCE] New Apache Flink Committer - Alexander Fedulov Happy New Year everyone, I'd like to start the year o

[jira] [Created] (FLINK-33962) Chaining-agnostic OperatorID generation for improved state compatibility on parallelism change

2024-01-01 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-33962: - Summary: Chaining-agnostic OperatorID generation for improved state compatibility on parallelism change Key: FLINK-33962 URL: https://issues.apache.org/jira/browse/FLINK-33962

Re: [DISCUSS] FLIP-397: Add config options for administrator JVM options

2024-01-01 Thread Zhanghao Chen
of JVM args in most times, there're cases where different set of JVM args are preferable. So I am leaning towards the current design, WDYT? Best, Zhanghao Chen From: xiangyu feng Sent: Friday, December 29, 2023 20:20 To: dev@flink.apache.org Subjec

Re: [VOTE] FLIP-398: Improve Serialization Configuration And Usage In Flink

2023-12-26 Thread Zhanghao Chen
+1 (non-binding) Best, Zhanghao Chen From: Yong Fang Sent: Wednesday, December 27, 2023 14:54 To: dev Subject: [VOTE] FLIP-398: Improve Serialization Configuration And Usage In Flink Hi devs, Thanks for all feedback about the FLIP-398: Improve Serialization

Re: [DISCUSS] FLIP-397: Add config options for administrator JVM options

2023-12-26 Thread Zhanghao Chen
Thanks everyone. I'll start voting after the New Year's holiday if there's no further comment. Best, Zhanghao Chen From: Benchao Li Sent: Friday, December 22, 2023 21:18 To: dev@flink.apache.org Subject: Re: [DISCUSS] FLIP-397: Add con

Re: [DISCUSS] FLIP-403: High Availability Services for OLAP Scenarios

2023-12-26 Thread Zhanghao Chen
comment on naming: would it better to rename PersistentServices to PersistenceServices, as usually we put a noun before Services? Best, Zhanghao Chen From: Yangze Guo Sent: Tuesday, December 19, 2023 17:33 To: dev Subject: [DISCUSS] FLIP-403: High Availability

[jira] [Created] (FLINK-33940) Update Update the auto-derivation rule of max parallelism for enlarged upscaling space

2023-12-25 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-33940: - Summary: Update Update the auto-derivation rule of max parallelism for enlarged upscaling space Key: FLINK-33940 URL: https://issues.apache.org/jira/browse/FLINK-33940

[jira] [Created] (FLINK-33891) Remove the obsolete SingleJobGraphStore

2023-12-19 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-33891: - Summary: Remove the obsolete SingleJobGraphStore Key: FLINK-33891 URL: https://issues.apache.org/jira/browse/FLINK-33891 Project: Flink Issue Type

Re: [DISCUSS] FLIP-395: Deprecate Global Aggregator Manager

2023-12-04 Thread Zhanghao Chen
users. I'm also ccing the email to Piotr and David for their suggestions on this. Best, Zhanghao Chen From: Benchao Li Sent: Monday, November 27, 2023 13:03 To: dev@flink.apache.org Subject: Re: [DISCUSS] FLIP-395: Deprecate Global Aggregator Manager +1 fo

Re: [VOTE] FLIP-364: Improve the restart-strategy

2023-11-30 Thread Zhanghao Chen
+1 (non-binding) Best, Zhanghao Chen From: Rui Fan <1996fan...@gmail.com> Sent: Monday, November 13, 2023 11:01 To: dev Subject: [VOTE] FLIP-364: Improve the restart-strategy Hi everyone, Thank you to everyone for the feedback on FLIP-364: Improve the r

[jira] [Created] (FLINK-33682) Reuse source operator input records/bytes metrics for SourceOperatorStreamTask

2023-11-28 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-33682: - Summary: Reuse source operator input records/bytes metrics for SourceOperatorStreamTask Key: FLINK-33682 URL: https://issues.apache.org/jira/browse/FLINK-33682

[jira] [Created] (FLINK-33681) Display source/sink numRecordsIn/Out & numBytesIn/Out on UI

2023-11-28 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-33681: - Summary: Display source/sink numRecordsIn/Out & numBytesIn/Out on UI Key: FLINK-33681 URL: https://issues.apache.org/jira/browse/FLINK-33681 Project: F

Re: [VOTE] FLIP-391: Deprecate RuntimeContext#getExecutionConfig

2023-11-28 Thread Zhanghao Chen
+1 (non-binding) Best, Zhanghao Chen From: Junrui Lee Sent: Tuesday, November 28, 2023 12:34 To: dev@flink.apache.org Subject: [VOTE] FLIP-391: Deprecate RuntimeContext#getExecutionConfig Hi everyone, Thank you to everyone for the feedback on FLIP-391

Re: [DISCUSS] Contribute Flink Doris Connector to the Flink community

2023-11-27 Thread Zhanghao Chen
Sounds great. Thanks for driving this. Best, Zhanghao Chen From: wudi <676366...@qq.com.INVALID> Sent: Sunday, November 26, 2023 18:22 To: dev@flink.apache.org Subject: [DISCUSS] Contribute Flink Doris Connector to the Flink community Hi all, At present,

[DISCUSS] FLIP-397: Add config options for administrator JVM options

2023-11-27 Thread Zhanghao Chen
FLINK/FLIP-397%3A+Add+config+options+for+administrator+JVM+options [2] https://issues.apache.org/jira/browse/SPARK-23472 Best, Zhanghao Chen

[DISCUSS] FLIP-395: Deprecate Global Aggregator Manager

2023-11-20 Thread Zhanghao Chen
Best, Zhanghao Chen

Re: [VOTE] FLIP-376: Add DISTRIBUTED BY clause

2023-11-07 Thread Zhanghao Chen
+1 (non-binding) Best, Zhanghao Chen From: Timo Walther Sent: Monday, November 6, 2023 19:38 To: dev Subject: [VOTE] FLIP-376: Add DISTRIBUTED BY clause Hi everyone, I'd like to start a vote on FLIP-376: Add DISTRIBUTED BY clause[1] which has been discuss

Re: [DISCUSS][FLINK-33240] Document deprecated options as well

2023-11-01 Thread Zhanghao Chen
cated because the related API/module is entirely deprecated, e.g. DataSet API. In that case, users would not search for replacement on an individual option but rather need to migrate to a new API, and it would be better to move these options to a separate section. WDYT? Best, Zhanghao

Re: [DISCUSS][FLINK-33240] Document deprecated options as well

2023-11-01 Thread Zhanghao Chen
options. Best, Zhanghao Chen From: Alexander Fedulov Sent: Tuesday, October 31, 2023 18:12 To: dev@flink.apache.org Cc: u...@flink.apache.org Subject: Re: [DISCUSS][FLINK-33240] Document deprecated options as well Hi Zhanghao, Thanks for the proposition. In general

Re: [VOTE] FLIP-375: Built-in cross-platform powerful java profiler

2023-10-17 Thread Zhanghao Chen
+1 (non-binding) Best, Zhanghao Chen From: Yu Chen Sent: Tuesday, October 17, 2023 15:51 To: dev@flink.apache.org Cc: myas...@live.com Subject: [VOTE] FLIP-375: Built-in cross-platform powerful java profiler Hi all, Thank you to everyone for the feedback and

Re: [VOTE] FLIP-366: Support standard YAML for FLINK configuration

2023-10-12 Thread Zhanghao Chen
+1 (non-binding) Best, Zhanghao Chen From: Junrui Lee Sent: Friday, October 13, 2023 10:12 To: dev@flink.apache.org Subject: [VOTE] FLIP-366: Support standard YAML for FLINK configuration Hi all, Thank you to everyone for the feedback on FLIP-366[1]: Support

[jira] [Created] (FLINK-33265) Support source parallelism setting for Kafka connector

2023-10-12 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-33265: - Summary: Support source parallelism setting for Kafka connector Key: FLINK-33265 URL: https://issues.apache.org/jira/browse/FLINK-33265 Project: Flink

[jira] [Created] (FLINK-33264) Support source parallelism setting for DataGen connector

2023-10-12 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-33264: - Summary: Support source parallelism setting for DataGen connector Key: FLINK-33264 URL: https://issues.apache.org/jira/browse/FLINK-33264 Project: Flink

  1   2   >