Re: [VOTE] FLIP-531: Initiate Flink Agents as a new Sub-Project

2025-06-02 Thread Yuan Mei
+1 (binding) On Mon, Jun 2, 2025 at 5:07 PM Martijn Visser wrote: > +1 (binding) > > On Mon, Jun 2, 2025 at 9:07 AM Robert Metzger wrote: > > > +1 (binding) > > > > > > On Mon, Jun 2, 2025 at 8:38 AM Jing Ge > wrote: > > > > > +1(binding) > > > > > > Best regards, > > > Jing > > > > > > On Mon

Re: [DISCUSS] FLIP-531: Initiate Flink Agents as a new Sub-Project

2025-05-24 Thread Yuan Mei
Thanks Xintong, Sean and Chris. This is a great step forward for the future of Flink. I'm really looking forward to it! Best, Yuan On Sat, May 24, 2025 at 10:00 PM Robert Metzger wrote: > Thanks for the nice proposal. > > One question: The proposal talks a lot about establishing a "sub project

[ANNOUNCE] New Apache Flink PMC Member - Zakelly Lan

2025-04-05 Thread Yuan Mei
and highlighted his deep technical expertise. Please join me in welcoming and congratulating Zakelly! Best, Yuan Mei (on behalf of the Flink PMC)

Re: [VOTE] FLIP-432: Faster Checkpoint & Recovery for Disaggregated State

2025-04-02 Thread Yuan Mei
Thanks for driving this :-) +1 On Thu, Apr 3, 2025 at 12:34 PM Han Yin wrote: > Hi everyone, > > I'd like to start a vote on the FLIP-432: Faster Checkpoint & Recovery for > Disaggregated State [1]. The discussion thread is here [2]. > > The vote will be open for at least 72 hours unless ther

Re: [ANNOUNCE] Apache Flink 2.0.0 released

2025-03-24 Thread Yuan Mei
Thanks for driving this & Congrats! Best Yuan On Mon, Mar 24, 2025 at 5:38 PM Leonard Xu wrote: > Congratulations! > > Thanks Xintong, Jark, Jiangjie and Martijn for the release management and > all evolved. > > Best, > Leonard > > > > > 2025年3月24日 16:24,Xintong Song 写道: > > > > The Apache Fli

Re: [VOTE] Release 2.0.0, release candidate #2

2025-03-16 Thread Yuan Mei
Thanks for driving this! +1 (binding) - reviewed the release note - reviewed the release blog PR - verified signature and checksum Best Yuan On Sat, Mar 15, 2025 at 6:21 PM Xuannan Su wrote: > +1(non-binding) > > - verified signature and checksum > - built from source using jdk11 and jdk17 >

Re: [VOTE] FLIP-488: Expose Async State Processing and New State APIs in Datastream(V1) APIs

2024-12-19 Thread Yuan Mei
Thanks for driving this +1 Best Yuan On Thu, Dec 19, 2024 at 12:30 PM Hangxiang Yu wrote: > +1 (binding) > > On Wed, Dec 18, 2024 at 6:00 PM Gabor Somogyi > wrote: > > > +1 (binding) > > > > BR, > > G > > > > On Wed, Dec 18, 2024 at 10:17 AM Yunfeng Zhou < > flink.zhouyunf...@gmail.com > > >

Re: [VOTE] Release 2.0-preview1, release candidate #1

2024-10-16 Thread Yuan Mei
+1 - Verify checksum - Review release note Thank Xintong for driving the release and the great efforts put into making 2.0 successful! Best Yuan On Wed, Oct 16, 2024 at 2:49 PM Zhu Zhu wrote: > +1 (binding) > > - Verified checksums and release tag > - Built from source > - Run an example job

Re: [VOTE] FLIP-349: Move RocksDB statebackend classes to o.a.f.state.rocksdb package

2024-10-07 Thread Yuan Mei
+1 Best Yuan On Tue, Oct 8, 2024 at 12:28 AM Gabor Somogyi wrote: > +1 (binding) > > G > > > On Mon, Oct 7, 2024 at 6:20 PM Zakelly Lan wrote: > > > Hi everyone, > > > > I'd like to start a vote on FLIP-349: Move RocksDB statebackend classes > to > > o.a.f.state.rocksdb package [1]. The discus

Re: Re: [VOTE] FLIP-455: Declare async state processing and checkpoint the in-flight requests

2024-08-21 Thread Yuan Mei
+1 Thanks for driving this, Zakelly! Best Yuan On Wed, Aug 21, 2024 at 11:24 AM Zakelly Lan wrote: > +1 (binding) > > Best, > Zakelly > > On Thu, Aug 15, 2024 at 9:02 PM Hangxiang Yu wrote: > > > +1 (binding) > > > > Thanks for driving this. > > > > On Thu, Aug 15, 2024 at 8:42 PM Ahmed Hamdy

Re: [ANNOUNCE] Apache Flink 1.20.0 released

2024-08-03 Thread Yuan Mei
Congratulations! Thanks for the efforts to accomplish the great work! Best Yuan On Sun, Aug 4, 2024 at 9:56 AM Samrat Deb wrote: > Congratulations ! > > Bests, > Samrat > > On Sun, 4 Aug 2024 at 7:24 AM, ConradJam wrote: > > > Congratulations! > > > > Jingsong Li 于2024年8月3日周六 15:14写道: > > > >

Re: [VOTE] FLIP-447: Upgrade FRocksDB from 6.20.3 to 8.10.0

2024-05-05 Thread Yuan Mei
+1(binding) Best Yuan On Mon, May 6, 2024 at 11:28 AM Rui Fan <1996fan...@gmail.com> wrote: > +1 (binding) > > Best, > Rui > > On Mon, May 6, 2024 at 11:01 AM Yanfei Lei wrote: > > > +1 (binding) > > > > Best, > > Yanfei > > > > Zakelly Lan 于2024年5月6日周一 11:00写道: > > > > > > +1 (binding) > > >

Re: [DISCUSS] FLIP-447: Upgrade FRocksDB from 6.20.3 to 8.10.0

2024-04-23 Thread Yuan Mei
Hey Yue, Thanks for all the great efforts significantly improving rescaling and upgrading rocksdb. +1 for this. Best Yuan On Wed, Apr 24, 2024 at 10:46 AM Zakelly Lan wrote: > Hi Yue, > > Thanks for this proposal! > > Given the great improvement we could have, the slight regression in write >

[ANNOUNCE] New Apache Flink Committer - Zakelly Lan

2024-04-14 Thread Yuan Mei
Hi everyone, On behalf of the PMC, I'm happy to let you know that Zakelly Lan has become a new Flink Committer! Zakelly has been continuously contributing to the Flink project since 2020, with a focus area on Checkpointing, State as well as frocksdb (the default on-disk state db). He leads sever

[jira] [Created] (FLINK-34984) Disaggregated State Storage and Management (Umbrella FLIP)

2024-04-01 Thread Yuan Mei (Jira)
Yuan Mei created FLINK-34984: Summary: Disaggregated State Storage and Management (Umbrella FLIP) Key: FLINK-34984 URL: https://issues.apache.org/jira/browse/FLINK-34984 Project: Flink Issue

[RESULT][VOTE] FLIP-423: Disaggregated State Storage and Management (Umbrella FLIP)

2024-04-01 Thread Yuan Mei
Hey dev, I'm happy to announce that FLIP-423: Disaggregated State Storage and Management (Umbrella FLIP) [1] has been accepted with 7 approving votes (5 binding) [2] Piotrek Nowojski (binding) Feifan Wang (non-binding) Jing Ge (binding) Rui Fan (binding) Xintong (binding) Yue (non-binding)

Re: [VOTE] FLIP-423: Disaggregated State Storage and Management (Umbrella FLIP)

2024-04-01 Thread Yuan Mei
+1 vote myself & Thanks all for the voting. I'm closing the vote and the result will be posted in a separate mail. Best Yuan On Fri, Mar 29, 2024 at 3:07 PM yue ma wrote: > +1 (non-binding) > > > Best, > Yue >

Re: [VOTE] FLIP-427: Disaggregated state Store

2024-03-28 Thread Yuan Mei
+1 (binding) Best Yuan On Wed, Mar 27, 2024 at 6:37 PM Hangxiang Yu wrote: > Hi devs, > > Thanks all for your valuable feedback about FLIP-427: Disaggregated state > Store [1]. > I'd like to start a vote on it. The discussion thread is here [2]. > > The vote will be open for at least 72 hou

Re: [ANNOUNCE] Apache Paimon is graduated to Top Level Project

2024-03-28 Thread Yuan Mei
Congratulations Best Yuan On Thu, Mar 28, 2024 at 5:35 PM Samrat Deb wrote: > Congratulations ! > Great news > > Bests, > Samrat > > On Thu, 28 Mar 2024 at 3:00 PM, Ahmed Hamdy wrote: > > > Congratulations! > > Best Regards > > Ahmed Hamdy > > > > > > On Thu, 28 Mar 2024 at 08:16, Paul Lam wr

Re: [VOTE] FLIP-433: State Access on DataStream API V2

2024-03-28 Thread Yuan Mei
+1 (binding) Best, Yuan On Tue, Mar 26, 2024 at 8:59 AM Yunfeng Zhou wrote: > +1 (non-binding) > > Best, > Yunfeng > > On Wed, Mar 20, 2024 at 8:29 PM weijie guo > wrote: > > > > Hi everyone, > > > > > > Thanks for all the feedback about the FLIP-433: State Access on > > DataStream API V2 [1].

Re: [VOTE] FLIP-428: Fault Tolerance/Rescale Integration for Disaggregated State

2024-03-28 Thread Yuan Mei
+1 (binding) Best, Yuan On Wed, Mar 27, 2024 at 7:31 PM Jinzhong Li wrote: > Hi devs, > > > I'd like to start a vote on the FLIP-428: Fault Tolerance/Rescale > Integration for Disaggregated State [1]. The discussion thread is here [2]. > > > The vote will be open for at least 72 hours unless th

Re: [VOTE] FLIP-425: Asynchronous Execution Model

2024-03-28 Thread Yuan Mei
+1 (binding) Best, Yuan On Thu, Mar 28, 2024 at 4:33 PM Xuannan Su wrote: > +1 (non-binding) > > Best regards, > Xuannan > > On Wed, Mar 27, 2024 at 6:28 PM Yanfei Lei wrote: > > > > Hi everyone, > > > > Thanks for all the feedback about the FLIP-425: Asynchronous Execution > > Model [1]. The

Re: [VOTE] FLIP-424: Asynchronous State APIs

2024-03-28 Thread Yuan Mei
+1 (binding) Best, Yuan On Thu, Mar 28, 2024 at 4:30 PM Xuannan Su wrote: > +1 (non-binding) > > Best, > Xuannan > > > On Wed, Mar 27, 2024 at 6:23 PM Zakelly Lan wrote: > > > > Hi devs, > > > > I'd like to start a vote on the FLIP-424: Asynchronous State APIs [1]. > The > > discussion thread

Re: [VOTE] FLIP-426: Grouping Remote State Access

2024-03-28 Thread Yuan Mei
+1 (binding) Best, Yuan On Wed, Mar 27, 2024 at 6:56 PM Jinzhong Li wrote: > Hi devs, > > I'd like to start a vote on the FLIP-426: Grouping Remote State Access [1]. > The discussion thread is here [2]. > > The vote will be open for at least 72 hours unless there is an objection or > insufficie

[VOTE] FLIP-423: Disaggregated State Storage and Management (Umbrella FLIP)

2024-03-28 Thread Yuan Mei
Hi devs, I'd like to start a vote on the FLIP-423: Disaggregated State Storage and Management (Umbrella FLIP) [1]. The discussion thread is here [2]. The vote will be open for at least 72 hours unless there is an objection or insufficient votes. [1] https://cwiki.apache.org/confluence/x/R4p3EQ [

Re: [DISCUSS] FLIP-423 ~FLIP-428: Introduce Disaggregated State Storage and Management in Flink 2.0

2024-03-28 Thread Yuan Mei
> >> > > > > > >>> > >> > > > > > >>> > >> > > My philosophies behind not exposing the two config options > > > are: > > > >>> > >> > > > - There are already to

Re: [ANNOUNCE] Donation Flink CDC into Apache Flink has Completed

2024-03-21 Thread Yuan Mei
Thanks for driving these efforts! Congratulations Best Yuan On Thu, Mar 21, 2024 at 4:35 PM Yu Li wrote: > Congratulations and look forward to its further development! > > Best Regards, > Yu > > On Thu, 21 Mar 2024 at 15:54, ConradJam wrote: > > > > Congrattulations! > > > > Leonard Xu 于2024

Re: [DISCUSS] FLIP-423 ~FLIP-428: Introduce Disaggregated State Storage and Management in Flink 2.0

2024-03-06 Thread Yuan Mei
tead this is a solution > > > embracing the > > > > >> >> > cloud-native era, providing much more scalability and > resource > > > efficiency > > > > >> >> > when handling a *huge state*. > > > > >> >> > > > > > >>

[DISCUSS] FLIP-423 ~FLIP-428: Introduce Disaggregated State Storage and Management in Flink 2.0

2024-02-28 Thread Yuan Mei
Hi Devs, This is a joint work of Yuan Mei, Zakelly Lan, Jinzhong Li, Hangxiang Yu, Yanfei Lei and Feng Wang. We'd like to start a discussion about introducing Disaggregated State Storage and Management in Flink 2.0. The past decade has witnessed a dramatic shift in Flink's deplo

Re: [VOTE] FLIP-406: Reorganize State & Checkpointing & Recovery Configuration

2024-01-24 Thread Yuan Mei
+1 On Thu, Jan 25, 2024 at 10:57 AM Xuannan Su wrote: > +1 (non-binding) > > Best, > Xuannan > > On Thu, Jan 25, 2024 at 10:15 AM Lijie Wang > wrote: > > > > +1 (binding) > > > > Best, > > Lijie > > > > Yanfei Lei 于2024年1月25日周四 10:06写道: > > > > > +1 (binding) > > > > > > Hangxiang Yu 于2024年1月

Re: [VOTE] FLIP-416: Deprecate and remove the RestoreMode#LEGACY

2024-01-18 Thread Yuan Mei
+1 binding Best Yuan On Fri, Jan 19, 2024 at 12:09 PM Zakelly Lan wrote: > Hi everyone, > > I'd like to start a vote on the FLIP-416: Deprecate and remove the > RestoreMode#LEGACY [1]. The discussion thread is here [2]. > > The vote will be open for at least 72 hours unless there is an objectio

Re: [DISCUSS] FLIP-416: Deprecate and remove the RestoreMode#LEGACY

2024-01-15 Thread Yuan Mei
+1 Thanks for driving this Zakelly! Best Yuan On Mon, Jan 15, 2024 at 10:47 PM Piotr Nowojski wrote: > +1 good idea! > > pon., 15 sty 2024 o 05:11 Jinzhong Li > napisał(a): > > > Hi Zakelly, > > > > Thanks for driving the discussion. It makes sense to remove LEGACY mode > in > > Flink 2.0. >

Re: [VOTE] Accept Flink CDC into Apache Flink

2024-01-08 Thread Yuan Mei
+1 binding On Tue, Jan 9, 2024 at 3:21 PM Yuan Mei wrote: > +1 > > Best, > Yuan > > On Tue, Jan 9, 2024 at 3:06 PM tison wrote: > >> +1 non-binding >> >> Best, >> tison. >> >> Leonard Xu 于2024年1月9日周二 15:05写道: >> > >>

Re: [VOTE] Accept Flink CDC into Apache Flink

2024-01-08 Thread Yuan Mei
+1 Best, Yuan On Tue, Jan 9, 2024 at 3:06 PM tison wrote: > +1 non-binding > > Best, > tison. > > Leonard Xu 于2024年1月9日周二 15:05写道: > > > > Hello all, > > > > This is the official vote whether to accept the Flink CDC code > contribution > > to Apache Flink. > > > > The current Flink CDC code,

Re: [ANNOUNCE] The Flink Speed Center and benchmark daily run are back online

2023-10-20 Thread Yuan Mei
Thank you for your great efforts! Best Yuan On Fri, Oct 20, 2023 at 4:08 PM Sergey Nuyanzin wrote: > Thanks a lot for working on this! > > On Fri, Oct 20, 2023 at 9:27 AM Yangze Guo wrote: > > > Thanks for the effort, Zhaoqian! > > > > Best, > > Yangze Guo > > > > On Fri, Oct 20, 2023 at 2:55 

Re: FW: RE: [DISCUSS] FLIP-368 Reorganize the exceptions thrown in state interfaces

2023-10-13 Thread Yuan Mei
+1 for the proposal But "Since the signature of the public state API has been changed", I was wondering whether this would be more fittable in Flink 2.0, instead of 1.19? WDYT? Best Yuan On Wed, Oct 11, 2023 at 4:34 PM David Radley wrote: > Hi Zakelly, > Thanks for making this clear for me.

Re: [ANNOUNCE] Release 1.18.0, release candidate #0

2023-09-19 Thread Yuan Mei
Hey Zakelly, Thanks very much for the efforts to re-build the entire benchmark environment. As long as we have 1) the pipeline set up and ready (no need for the entire portal ready), 2) get benchmark comparison numbers (comparing with the commit just before the benchmark pipeline is down) and 3)

Re: [DISCUSS] Update Flink Roadmap

2023-08-12 Thread Yuan Mei
ou think. Best Yuan On Mon, Jul 24, 2023 at 12:07 PM Yuan Mei wrote: > Sorry have missed this email and respond a bit late. > > I will put a draft for the long-term vision for the state as well as > large-scale state support into the roadmap. > > Best > Yuan > > On Mo

[ANNOUNCE] New Apache Flink Committer - Hangxiang Yu

2023-08-06 Thread Yuan Mei
neric Incremental Checkpoints in Flink Forward and Meet-up. Hangxiang also spent a good amount of time supporting users, participating in Jira/mailing list discussions, and reviewing code. Please join me in congratulating Hangxiang for becoming a Flink Committer! Thanks, Yuan Mei (on behalf o

[ANNOUNCE] New Apache Flink Committer - Yanfei Lei

2023-08-06 Thread Yuan Mei
i for becoming a Flink Committer! Thanks, Yuan Mei (on behalf of the Flink PMC)

Re: [DISCUSS] Update Flink Roadmap

2023-07-23 Thread Yuan Mei
Sorry have missed this email and respond a bit late. I will put a draft for the long-term vision for the state as well as large-scale state support into the roadmap. Best Yuan On Mon, Jul 17, 2023 at 10:34 AM Jark Wu wrote: > Hi Jiabao, > > Thank you for your suggestions. I have added them to

Re: [VOTE] Release 2.0 must-have work items - Round 2

2023-07-23 Thread Yuan Mei
+1 (binding) Thanks for driving the discussion through and for all the efforts in resolving the complexities :-) Best Yuan On Thu, Jul 20, 2023 at 5:23 PM Xintong Song wrote: > Hi all, > > I'd like to start another round of VOTE for the must-have work items for > release 2.0 [1]. The correspon

[jira] [Created] (FLINK-32651) Benchmark Support for Changelog Statebackend

2023-07-23 Thread Yuan Mei (Jira)
Yuan Mei created FLINK-32651: Summary: Benchmark Support for Changelog Statebackend Key: FLINK-32651 URL: https://issues.apache.org/jira/browse/FLINK-32651 Project: Flink Issue Type: Improvement

Re: [VOTE] Release 2.0 must-have work items

2023-07-17 Thread Yuan Mei
> > >> > > > Datastream, Datastream are missing many API. I think it may well > > >> take > > >> > > much > > >> > > > effort to fully cover the missing api. > > >> > > > > > > >> > > > > [1] > > >> https://lists.

Re: [VOTE] Release 2.0 must-have work items

2023-07-11 Thread Yuan Mei
As a second thought, I think "Eager State Declaration" is probably not a must-have. I was originally thinking it is a prerequisite for "state querying for disaggregated state management". Since disaggregated state management itself is not a must-have, "Eager State Declaration" is not as well. We

Re: [VOTE] Release 2.0 must-have work items

2023-07-09 Thread Yuan Mei
+1 (binding) Thanks for driving this! Best Yuan On Mon, Jul 10, 2023 at 10:26 AM Jark Wu wrote: > +1 (binding) > > Thanks for driving this. Looking forward to starting the 2.0 works. > > Best, > Jark > > On Fri, 7 Jul 2023 at 17:31, Xintong Song wrote: > > > Hi all, > > > > I'd like to start

Re: [ANNOUNCE] Apache Flink has won the 2023 SIGMOD Systems Award

2023-07-06 Thread Yuan Mei
Congrats everyone :-) Best Yuan On Fri, Jul 7, 2023 at 11:29 AM Hang Ruan wrote: > Hi, Leonard. > > I would like to help to add this page. Please assign this issue to me. > Thanks. > > Best, > Hang > > Leonard Xu 于2023年7月7日周五 11:26写道: > >> Congrats to all ! >> >> It will be helpful to promote

Re: [DISCUSS] Release 2.0 Work Items

2023-07-03 Thread Yuan Mei
> > > There seems to be no changes needed for "Move Calcite rules from > Scala > > to > > > > Java" as it's already nice-to-have. > > > > > > > > > > > > If there's no objections, I'll update the wiki page a

Re: [DISCUSS] Release 2.0 Work Items

2023-06-29 Thread Yuan Mei
Thanks for driving this effort, Xintong! To Chesnay > I'm curious as to why the "Disaggregated State Management" item is > marked as a must-have; will it require changes that break something? > What prevents it from being added in 2.1? As to "Disaggregated State Management". We plan to provide a

Re: [VOTE] FLIP-306: Unified File Merging Mechanism for Checkpoints - Re-sent

2023-05-09 Thread Yuan Mei
Please ignore this duplicated voting email due to infra outage INFRA-24572[1]. Voting is happening in the thread [2] [1] https://issues.apache.org/jira/browse/INFRA-24572 [2] https://www.mail-archive.com/dev@flink.apache.org/msg66500.html Best, Yuan On Wed, May 10, 2023 at 1:08 AM Zakelly Lan

Re: [VOTE] FLIP-306: Unified File Merging Mechanism for Checkpoints

2023-05-09 Thread Yuan Mei
Please ignore this duplicated voting email due to infra outage INFRA-24572[1]. Voting is happening in the thread [2] [1] https://issues.apache.org/jira/browse/INFRA-24572 [2] https://www.mail-archive.com/dev@flink.apache.org/msg66500.html On Wed, May 10, 2023 at 1:29 AM Zakelly Lan wrote: > Hi

Re: [VOTE] FLIP-306: Unified File Merging Mechanism for Checkpoints

2023-05-09 Thread Yuan Mei
Please ignore this duplicated voting email for due to infra outage INFRA-24572[1]. Voting is happening in the thread [2] [1] https://issues.apache.org/jira/browse/INFRA-24572 [2] https://www.mail-archive.com/dev@flink.apache.org/msg66500.html On Wed, May 10, 2023 at 1:47 AM Zakelly Lan wrote:

Re: [VOTE] FLIP-306: Unified File Merging Mechanism for Checkpoints

2023-05-09 Thread Yuan Mei
Thanks for driving this, Zakelly. As discussed in the thread, +1 for the proposal (binding) Best, Yuan On Wed, May 10, 2023 at 10:39 AM Zakelly Lan wrote: > Hi everyone, > > Sorry for the 4 duplicate emails. There was a problem with the dev > mailing list blocking the mails from Gmail. I t

Re: [DISCUSS] FLIP-306: Unified File Merging Mechanism for Checkpoints

2023-04-27 Thread Yuan Mei
Hey all, Thanks @Zakelly for driving this effort and thanks everyone for the warm discussion. Sorry for the late response. As I and Zakelly have already discussed and reviewed the design carefully when drafting this FLIP, I do not have additional inputs here. But I want to highlight several point

Re: RIC Incremental and GIC Incremental checkpoint use question

2023-03-26 Thread Yuan Mei
Hey Thanks for trying out GIC! As Yanfei mentioned, GIC and RocksDB incremental do not conflict with each other. GIC is a generalized way to do incremental Flink checkpoints. At the same time, RocksDB-incremental is a way to do incremental snapshots for backend db (RocksDB). Please let us know t

Re: [ANNOUNCE] FRocksDB 6.20.3-ververica-2.0 released

2023-01-30 Thread Yuan Mei
Thanks Yanfei for driving the release! Best Yuan On Mon, Jan 30, 2023 at 8:46 PM Jing Ge via user wrote: > Hi Yanfei, > > Thanks for your effort. Looking forward to checking it. > > Best regards, > Jing > > On Mon, Jan 30, 2023 at 1:42 PM Yanfei Lei wrote: > >> It is very happy to announce the

Re: [VOTE] FLIP-290: Operator state compression (FLINK-30113)

2023-01-27 Thread Yuan Mei
+1 binding Best Yuan On Sat, Jan 21, 2023 at 12:49 AM Rui Fan <1996fan...@gmail.com> wrote: > +1 (no-binding) > > Best > Rui Fan > > On Fri, Jan 20, 2023 at 10:46 PM ConradJam wrote: > > > +1 (no-binding) > > thanks driving it > > > > Martijn Visser 于2023年1月20日周五 21:16写道: > > > > > +1 (binding

Re: [DISCUSS] FLIP-290: Operator state compression (FLINK-30113)

2023-01-19 Thread Yuan Mei
The proposal reads quite reasonable! I do not have additional comments as long as the change can insure backward compatibility. And many thanks to Dawid for catching this! Best Yuan On Thu, Jan 19, 2023 at 6:03 PM Piotr Nowojski wrote: > Hi, > > The idea sounds like a nice improvement to comp

Re: [DISCUSS] Incorporate performance regression monitoring into routine process

2023-01-19 Thread Yuan Mei
Hey Yanfei, Thanks so much for the efforts driving the whole process. It's great to see that the performance benchmarks are indeed useful to help find regressions. This is a discussion thread separated from the original performance benchmark announcement thread [1]. Let's continue here so that mor

Re: [ANNOUNCE] Performance Daily Monitoring Moved from Ververica to Apache Flink Slack Channel

2023-01-17 Thread Yuan Mei
t; > >> > > Yanfei > > >> > > > > >> > > Martijn Visser 于2022年11月29日周二 15:54写道: > > >> > > > > >> > > > Hi, > > >> > > > > > >> > > > Is there any upd

Re: [ANNOUNCE] New Apache Flink Committer - Lincoln Lee

2023-01-09 Thread Yuan Mei
Congratulations, Lincoln! Best, Yuan On Tue, Jan 10, 2023 at 12:23 PM Lijie Wang wrote: > Congratulations, Lincoln! > > Best, > Lijie > > Jingsong Li 于2023年1月10日周二 12:07写道: > > > Congratulations, Lincoln! > > > > Best, > > Jingsong > > > > On Tue, Jan 10, 2023 at 11:56 AM Leonard Xu wrote: >

Re: [VOTE] Drop TypeSerializerConfigSnapshot and savepoint support from Flink versions < 1.8.0

2022-10-31 Thread Yuan Mei
+1 Best Yuan On Mon, Oct 31, 2022 at 5:01 PM Dawid Wysakowicz wrote: > +1 > > On 28/10/2022 16:57, Piotr Nowojski wrote: > > Hi, > > > > As discussed on the dev mailing list [0] I would like to start a vote to > > drop support of older savepoint formats (for Flink versions older than > > 1.8).

Re: [ANNOUNCE] Apache Flink 1.16.0 released

2022-10-31 Thread Yuan Mei
Congrats! Thanks everyone who is making this release happen! Best Yuan On Mon, Oct 31, 2022 at 5:18 PM Danny Cranmer wrote: > Nice work everyone! > > Congratulations to all involved :D > > Danny, > > On Mon, Oct 31, 2022 at 4:07 AM Paul Lam wrote: > > > Congrats! Finally! > > > > Best, > > Pau

Re: [DISCUSS] Delete useless branches from Flink repository

2022-10-27 Thread Yuan Mei
Hey Leonard, Thanks for your efforts to clean up our repo! Best Yuan On Thu, Oct 27, 2022 at 11:55 PM Leonard Xu wrote: > Thanks Matthias and Chesnay for the quick ACK. > > I’ve deleted following branches. > > FLINK-29638-1.15 > > FLINK-29638-1.16 > > 28733 > > revert-16606-materialization_o

Re: [VOTE] FLIP-263: Improve resolving schema compatibility

2022-10-27 Thread Yuan Mei
+1 (binding) Thanks for driving this. Best Yuan On Fri, Oct 28, 2022 at 11:17 AM yanfei lei wrote: > +1(non-binding) and thanks for Hangxiang's driving. > > > > Hangxiang Yu 于2022年10月28日周五 09:24写道: > > > Hi everyone, > > > > I'd like to start the vote for FLIP-263 [1]. > > > > Thanks for your

Re: [ANNOUNCE] Performance Daily Monitoring Moved from Ververica to Apache Flink Slack Channel

2022-10-26 Thread Yuan Mei
Thanks, Yanfei, to drive this and make the performance monitoring publicly available. Looking forward to seeing the workflow, and more details as Martijn mentioned. Best Yuan On Wed, Oct 26, 2022 at 2:59 PM Martijn Visser wrote: > Hi Yanfei Lei, > > Thanks for setting this up! It would be inte

Re: [DISCUSS] FLIP-263: Improve resolving schema compatibility

2022-10-25 Thread Yuan Mei
n > all inner > > TypeSerializerSnapshots. > > > > Users may implement their own serializers based on inner serializers, we > > should make sure that the new interface of inner TypeSerializerSnapshots > is > > usable. > > > > > > Then

Re: [DISCUSS] FLIP-263: Improve resolving schema compatibility

2022-10-24 Thread Yuan Mei
Hey Hangxiang, Thanks for driving this issue. I've read through all the discussions and suggestions in this thread, and here is my take: 1. I agree that the compatibility check should be done in the opposite direction. The current interface *causes some real issues* for users using their own

Re: [DISCUSS] Planning Flink 1.17

2022-10-20 Thread Yuan Mei
Thanks, Qingsheng for the kicking-off efforts. 1. January 17th, 2023 as feature freeze data sounds reasonable to me. 2. We will input our plan to the wiki link. Thanks Best Yuan Ververica (Alibaba) On Fri, Oct 21, 2022 at 10:38 AM Xingbo Huang wrote: > Thanks Qingsheng, Leonard and Martijn f

Re: [VOTE] Drop Gelly

2022-10-18 Thread Yuan Mei
+1 On Tue, Oct 18, 2022 at 10:49 AM Dong Lin wrote: > +1 > > On Thu, Oct 13, 2022 at 4:59 AM Martijn Visser > wrote: > > > Hi everyone, > > > > I would like to open a vote for dropping Gelly, which was discussed a > long > > time ago but never put to a vote [1]. > > > > Voting will be open for

Re: Rescuing Queryable State from deprecation

2022-09-08 Thread Yuan Mei
Hey Ron, Sorry for the late response. Thanks for the initiative to bring up this topic and appreciate your efforts to rescue Queryable State :-). I will try to answer your questions at my best! *Why is Queryable State in the deprecation list?* I've seen quite a few users bring up the requests to

[jira] [Created] (FLINK-29082) Clean-up Leftovers for changelog pre-uploading files after failover

2022-08-23 Thread Yuan Mei (Jira)
Yuan Mei created FLINK-29082: Summary: Clean-up Leftovers for changelog pre-uploading files after failover Key: FLINK-29082 URL: https://issues.apache.org/jira/browse/FLINK-29082 Project: Flink

Re: [ANNOUNCE] New Apache Flink Committer - Junhan Yang

2022-08-20 Thread Yuan Mei
Congratulations Junhan! Best, Yuan On Sat, Aug 20, 2022 at 2:11 PM Danny Cranmer wrote: > Congratulations Junhan! Welcome to the team. > > On Sat, 20 Aug 2022, 03:01 yuxia, wrote: > > > Congratulations, Junhan! > > > > Best regards, > > Yuxia > > > > - 原始邮件 - > > 发件人: "Aitozi" > > 收件人

Re: [ANNOUNCE] New Apache Flink Committer - Lijie Wang

2022-08-20 Thread Yuan Mei
Congratulations, Lijie! Best, Yuan On Sat, Aug 20, 2022 at 2:12 PM Danny Cranmer wrote: > Congratulations Lijie! Welcome to the team. > > On Sat, 20 Aug 2022, 03:25 Yun Tang, wrote: > > > Congratulations, Lijie! > > > > > > Best > > Yun Tang > > > > From: Geng

Re: [VOTE] Creating benchmark channel in Apache Flink slack

2022-07-11 Thread Yuan Mei
+1 (binding) & thanks for the efforts! Best Yuan On Mon, Jul 11, 2022 at 2:08 PM Yun Gao wrote: > +1 (binding) > > Thanks Anton for driving this! > > > Best, > Yun Gao > > > -- > From:Anton Kalashnikov > Send Time:2022 Jul. 8 (F

Re: Re: Re: [DISCUSS ] Make state.backend.incremental as true by default

2022-07-10 Thread Yuan Mei
me. > I haven't gotten a better idea about it. > Maybe @ro...@apache.org who is the owner of incremental > checkpoint support of HashMapStateBackend could share more ideas about it. > > On Sat, Jun 25, 2022 at 2:38 PM Lihe Ma wrote: > > > Hi, Yuan Mei, >

Re: [DISCUSS] Creating benchmark channel in Apache Flink slack

2022-07-07 Thread Yuan Mei
+1 for the proposal Anton, and thanks very much to move this effort forward! In long term, I think it would be helpful to ask volunteers to help watching-out the daily micro benchmark results. But let's make it more visible as the very first step! Best Regards, Yuan On Tue, Jul 5, 2022 at 10:1

Re: Re: [ANNOUNCE] New Apache Flink Committers: Qingsheng Ren, Shengkai Fang

2022-06-20 Thread Yuan Mei
Congrats Qingsheng and ShengKai! Best, Yuan On Tue, Jun 21, 2022 at 11:27 AM Terry Wang wrote: > Congratulations, Qingsheng and ShengKai! >

Re: Re: [DISCUSS ] Make state.backend.incremental as true by default

2022-06-19 Thread Yuan Mei
feature of incremental checkpoint is stable. What do you > > > think? > > > > > > > > > Best, > > > Lihe Ma > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > &

Re: [ANNOUNCE] New Apache Flink PMC Member - Jingsong Lee

2022-06-15 Thread Yuan Mei
Congrats, Jingsong! Best, Yuan On Thu, Jun 16, 2022 at 11:31 AM Yang Wang wrote: > Congrats, Jingsong! > > Best, > Yang > > Zakelly Lan 于2022年6月16日周四 11:16写道: > > > Congrats & well deserved! > > > > Best, > > Zakelly > > > > On Thu, Jun 16, 2022 at 10:36 AM Guowei Ma wrote: > > > > > Congrats

Re: [DISCUSS ] Make state.backend.incremental as true by default

2022-06-14 Thread Yuan Mei
Thanks for bringing this up. I am +1 on making incremental checkpoints by default for RocksDB, but not universally for all state backends. Besides being widely used in prod, enabling incremental checkpoint for RocksDB by default is also a pre-requisite when enabling task-local by default FLINK-15

Re: [ANNOUNCE] Welcome to join the Apache Flink community on Slack

2022-06-08 Thread Yuan Mei
ny. > > So > > > > > everyone you want to invite, should considered a 'coworker'. > > > > > > > > > > Best regards, > > > > > > > > > > Martijn > > > > > > > > > > Op za 4

Re: [ANNOUNCE] Welcome to join the Apache Flink community on Slack

2022-06-03 Thread Yuan Mei
Thanks, Xintong and Jark the great effort driving this, and everyone for making this possible. I've also Twittered this announcement on our Apache Flink Twitter account. Best Yuan On Fri, Jun 3, 2022 at 12:54 AM Jing Ge wrote: > Thanks everyone for your effort! > > Best regards, > Jing > >

Re: [VOTE] Creating an Apache Flink slack workspace

2022-05-19 Thread Yuan Mei
+1 (binding) This facilitates people collaborating on the same project from different organizations. I really like this idea. On Thu, May 19, 2022 at 12:43 PM Peter Huang wrote: > +1 (non-binding) > > > Best Regards > Peter Huang > > On Wed, May 18, 2022 at 9:33 PM Leonard Xu wrote: > > > Than

Re: [ANNOUNCE] New Flink PMC member: Yang Wang

2022-05-05 Thread Yuan Mei
Congrats and well Deserved, Yang! Best, Yuan On Thu, May 5, 2022 at 8:21 PM Nicholas Jiang wrote: > Congrats Yang! > > Best regards, > Nicholas Jiang > > On 2022/05/05 11:18:10 Xintong Song wrote: > > Hi all, > > > > I'm very happy to announce that Yang Wang has joined the Flink PMC! > > > > Ya

Re: [ANNOUNCE] Apache Flink 1.15.0 released

2022-05-05 Thread Yuan Mei
Great! Thanks, Yun Gao, Till, and Joe for driving the release, and thanks to everyone for making this release happen! Best Yuan On Thu, May 5, 2022 at 4:40 PM Leonard Xu wrote: > Congratulations! > > Thanks Yun Gao, Till and Joe for the great work as our release manager and > everyone who invo

[jira] [Created] (FLINK-27214) Build Failed on state backend benchmark

2022-04-12 Thread Yuan Mei (Jira)
Yuan Mei created FLINK-27214: Summary: Build Failed on state backend benchmark Key: FLINK-27214 URL: https://issues.apache.org/jira/browse/FLINK-27214 Project: Flink Issue Type: Bug

Re: Flink 1.15 Stabilisation Sync

2022-04-05 Thread Yuan Mei
FLINK-26985 was discovered just before last weekend. We will get it resolved first thing after the holiday (tomorrow). Best Yuan On Tue, Apr 5, 2022 at 5:37 PM Yun Gao wrote: > Hi Robert, > > Very sorry for the long delay before the rc1 could be published. > > For the open critical issues, I p

[jira] [Created] (FLINK-26992) PojoSerializer may cause concurrent exception passing directly between threads

2022-04-01 Thread Yuan Mei (Jira)
Yuan Mei created FLINK-26992: Summary: PojoSerializer may cause concurrent exception passing directly between threads Key: FLINK-26992 URL: https://issues.apache.org/jira/browse/FLINK-26992 Project

Re: [ANNOUNCE] New Apache Flink Committer - David Morávek

2022-03-05 Thread Yuan Mei
Congratulations, David! Best Regards, Yuan On Sat, Mar 5, 2022 at 8:13 PM Roman Khachatryan wrote: > Congratulations, David! > > Regards, > Roman > > On Fri, Mar 4, 2022 at 7:54 PM Austin Cawley-Edwards > wrote: > > > > Congrats David! > > > > On Fri, Mar 4, 2022 at 12:18 PM Zhilong Hong > wr

Re: Re: Change of focus

2022-02-28 Thread Yuan Mei
Thanks Till for everything you've done for the community! Good luck with your new adventure and best wishes to your new life! Best Regards, Yuan On Tue, Mar 1, 2022 at 10:35 AM Zhu Zhu wrote: > Thank you for all the efforts and good luck for the new adventure, Till! > > Thanks, > Zhu > > Terry

Re: [ANNOUNCE] New Flink PMC members: Igal Shilman, Konstantin Knauf and Yun Gao

2022-02-17 Thread Yuan Mei
Congratulations! Best Regards, Yuan On Thu, Feb 17, 2022 at 5:17 PM Aitozi wrote: > Congratulations! > > Best, > Aitozi > > > Guowei Ma 于2022年2月17日周四 15:53写道: > > > Congratulations > > > > Best, > > Guowei > > > > > > On Thu, Feb 17, 2022 at 3:29 PM Yang Wang wrote: > > > > > Congratulations

Re: [ANNOUNCE] New Apache Flink Committers: Feng Wang, Zhipeng Zhang

2022-02-17 Thread Yuan Mei
Congratulations! Best Regards, Yuan On Thu, Feb 17, 2022 at 5:15 PM Aitozi wrote: > Congratulations! > > Best, > Aitozi > > Guowei Ma 于2022年2月17日周四 15:52写道: > > > Congratulations to Feng and Zhipeng! > > Best, > > Guowei > > > > > > On Thu, Feb 17, 2022 at 3:30 PM Yang Wang wrote: > > > > > C

Re: [DISCUSS] Checkpointing (partially) failing jobs

2022-02-08 Thread Yuan Mei
; rescaling case, otherwise it does not work. Is there currently a source > > > implementation where this wouldn't work? For Kafka it should work > because > > > we store the offset per assigned partition. For Kinesis it is probably > > the > > > same. For th

Re: [DISCUSS] Checkpointing (partially) failing jobs

2022-02-07 Thread Yuan Mei
> > individual regions, which can be a big burden to the job manager. The > > meaning of the checkpoint id will also be changed, which can affect many > > aspects. There can be lots of work and risks, and the risks still exist > if > > we only individually checkpoint sepa

Re: [DISCUSS] Checkpointing (partially) failing jobs

2022-02-06 Thread Yuan Mei
Hey Gyula, That's a very interesting idea. The discussion about the `Individual` vs `Global` checkpoint was raised before, but the main concern was from two aspects: - Non-deterministic replaying may lead to an inconsistent view of checkpoint - It is not easy to form a clear cut of past and futur

Re: [DISCUSS] Pushing Apache Flink 1.15 Feature Freeze

2022-01-25 Thread Yuan Mei
+1 extending feature freeze for one week. Code Freeze on 6th (end of Spring Festival) is equivalent to say code freeze at the end of this week for Chinese buddies, since Spring Festival starts next week. It also means they should be partially available during the holiday, otherwise they would bloc

[jira] [Created] (FLINK-25512) Materialization Files are not cleaned up if no checkpoint is using it

2022-01-04 Thread Yuan Mei (Jira)
Yuan Mei created FLINK-25512: Summary: Materialization Files are not cleaned up if no checkpoint is using it Key: FLINK-25512 URL: https://issues.apache.org/jira/browse/FLINK-25512 Project: Flink

[jira] [Created] (FLINK-25511) Leftovers after truncation are not be cleaned up if pre-uploading is enabled

2022-01-04 Thread Yuan Mei (Jira)
Yuan Mei created FLINK-25511: Summary: Leftovers after truncation are not be cleaned up if pre-uploading is enabled Key: FLINK-25511 URL: https://issues.apache.org/jira/browse/FLINK-25511 Project: Flink

[jira] [Created] (FLINK-25470) Add/Expose/differentiate metrics of checkpoint size between changelog size vs materialization size

2021-12-28 Thread Yuan Mei (Jira)
Yuan Mei created FLINK-25470: Summary: Add/Expose/differentiate metrics of checkpoint size between changelog size vs materialization size Key: FLINK-25470 URL: https://issues.apache.org/jira/browse/FLINK-25470

  1   2   >