[DISCUSS] FLIP-45: Reinforce Job Stop Semantic

2019-07-03 Thread Yu Li
Hi Flink devs, Through recent discussion on job stop processing, we found its semantic is incomplete, mainly reflected in two aspects: 1. In our released versions [1], the stop process is as follows: - A “stop” call is a graceful way of stopping a running streaming job. When the user reque

Re: RE: [DISCUSS] Improve Queryable State and introduce aQueryServerProxy component

2019-07-04 Thread Yu Li
Hi Vino, Thanks for the write up. I've left some comments on google doc, please check. Thanks. Best Regards, Yu On Thu, 4 Jul 2019 at 15:37, vino yang wrote: > Hi Jiayi, > > Thanks for your comments. > > It's valuable. I have accepted it and refined my design document. > > You can have anothe

Re: [FLIP-47] Savepoints vs Checkpoints

2019-07-10 Thread Yu Li
Hi all, Please allow me to throw some points in combination of FLIP-45 [1] for discussing, and please don't be confused if some of them are inconsistent or even opposite to current proposals in FLIP-47 (with me as a co-author), because as Kostas pointed out, the discussion is still in progress and

Re: [DISCUSS] META-FLIP: Sticking (or not) to a strict FLIP voting process

2019-07-10 Thread Yu Li
Thanks for the summary and bring the discussion to public again Becket! Looking through the whole thread I think later discussion has covered a broader scope than what Aljoscha initially proposed (strict voting process for FLIP), and please allow me to categorize the topics to help decide how to c

Re: [ANNOUNCE] Rong Rong becomes a Flink committer

2019-07-11 Thread Yu Li
Congratulations Rong! Best Regards, Yu On Thu, 11 Jul 2019 at 22:54, zhijiang wrote: > Congratulations Rong! > > Best, > Zhijiang > > -- > From:Kurt Young > Send Time:2019年7月11日(星期四) 22:54 > To:Kostas Kloudas > Cc:Jark Wu ; Fabi

Flink benchmark Jenkins is broken due to missing 1.10 snapshots

2019-07-12 Thread Yu Li
Hi All, I just found our flink benchmark Jenkins build [1] is broken with below error: *[ERROR] Failed to execute goal on project flink-hackathon-benchmarks: Could not resolve dependencies for project org.apache.flink.benchmark:flink-hackathon-benchmarks:jar:0.1: Failure to find org.apache.flink:

Re: Flink benchmark Jenkins is broken due to missing 1.10 snapshots

2019-07-15 Thread Yu Li
e 1.9 travis cron branch. >>> >>> On 15/07/2019 09:46, Chesnay Schepler wrote: >>> > It is documented in the release guide that a new jenkins deployment >>> > must be setup when creating a new release branch, and even contains >>> > step-by-step i

Re: Flink benchmark Jenkins is broken due to missing 1.10 snapshots

2019-07-15 Thread Yu Li
Thanks for the note Chesnay, will wait and report back then. Best Regards, Yu On Mon, 15 Jul 2019 at 18:51, Chesnay Schepler wrote: > It will likely take about a day for the 1.10 snapshots to be released. > > On 15/07/2019 12:41, Yu Li wrote: > > Thanks for the follow up Ches

Re: Flink benchmark Jenkins is broken due to missing 1.10 snapshots

2019-07-16 Thread Yu Li
> > > > I have created a PR > > (https://github.com/dataArtisans/flink-benchmarks/pull/29) to revise > > pom.xml of `flink-benchmarks` accordingly, and need someone to help > > merge it. @Chesnay Schepler > > > > Best, > > Haobo > > At 2019-07-

Re: [ANNOUNCE] Jiangjie (Becket) Qin has been added as a committer tothe Flink project

2019-07-18 Thread Yu Li
Congratulations Becket! Best Regards, Yu On Thu, 18 Jul 2019 at 18:46, bupt_ljy wrote: > Congratulations ! > > > Best Regards, > Jiayi Liao > > > Original Message > Sender:Hequn chengchenghe...@gmail.com > Recipient:dev...@flink.apache.org > Date:Thursday, Jul 18, 2019 17:51 > Subject:Re: [ANN

Re: [DISCUSS] Flink project bylaws

2019-07-26 Thread Yu Li
Hi Becket, Thanks for noticing and resolving my comment around PMC removal and ASF rules of PMC membership change process, which you seem to neglect in the summary of updates (smile). Best Regards, Yu On Wed, 24 Jul 2019 at 04:32, Becket Qin wrote: > Hi folks, > > Thanks for all the feedback.

Re: Request for permission as a contributor

2019-07-26 Thread Yu Li
Correct me if I'm wrong, but one still needs the contributor identity to be assigned to JIRA, although contributors could no longer assign the JIRA to themselves. On the other hand, due to the recent JIRA permissions change, I'd suggest to only apply for the contributor permission after you have s

Re: [VOTE] Publish the PyFlink into PyPI

2019-08-01 Thread Yu Li
+1 (non-binding) Thanks for driving this! Best Regards, Yu On Thu, 1 Aug 2019 at 11:41, Till Rohrmann wrote: > +1 > > Cheers, > Till > > On Thu, Aug 1, 2019 at 10:39 AM vino yang wrote: > > > +1 (non-binding) > > > > Jeff Zhang 于2019年8月1日周四 下午4:33写道: > > > > > +1 (non-binding) > > > > > > S

Re: [DISCUSS][CODE STYLE] Usage of Java Optional

2019-08-02 Thread Yu Li
TL; DR: I second Timo that we should use Optional only as method return type for non-performance critical code. >From the example given on our AvroFactory [1] I also noticed that Jetbrains marks the OptionalUsedAsFieldOrParameterType inspection as a warning. It's relatively easy to understand why

Re: Re: [ANNOUNCE] Hequn becomes a Flink committer

2019-08-07 Thread Yu Li
Congratulations Hequn! Well deserved! Best Regards, Yu On Thu, 8 Aug 2019 at 03:53, Haibo Sun wrote: > Congratulations! > > Best, > Haibo > > At 2019-08-08 02:08:21, "Yun Tang" wrote: > >Congratulations Hequn. > > > >Best > >Yun Tang > > > >From: Rong Rong > >

Re: [VOTE] Flink Project Bylaws

2019-08-13 Thread Yu Li
+1 (non-binding) Thanks for the efforts Becket! Best Regards, Yu On Tue, 13 Aug 2019 at 16:09, Xintong Song wrote: > +1 (non-binding) > > Thank you~ > > Xintong Song > > > > On Tue, Aug 13, 2019 at 1:48 PM Robert Metzger > wrote: > > > +1 (binding) > > > > On Tue, Aug 13, 2019 at 1:47 PM Bec

[DISCUSS] FLIP-50: Spill-able Heap Keyed State Backend

2019-08-13 Thread Yu Li
Hi All, We ever held a discussion about this feature before [1] but now opening another thread because after a second thought introducing a new backend instead of modifying the existing heap backend is a better option to prevent causing any regression or surprise to existing in-production usage. A

Re: [DISCUSS] FLIP-50: Spill-able Heap Keyed State Backend

2019-08-13 Thread Yu Li
Sorry for forgetting to give the link of the FLIP, here it is: https://cwiki.apache.org/confluence/display/FLINK/FLIP-50%3A+Spill-able+Heap+Keyed+State+Backend Thanks! Best Regards, Yu On Tue, 13 Aug 2019 at 18:06, Yu Li wrote: > Hi All, > > We ever held a discussion about thi

Re: Re: [Discuss] What should the "Data Source" be translated into Chinese

2019-08-13 Thread Yu Li
Hi Hengwei, Since this is a discussion about how to translate "Data Sink" into Chinese, I suggest we keep the discussion in @user-zh mailing list. Or at least please translate the reply into English, although TBH I don't think people without knowledge of Chinese language would be interested in joi

Re: [ANNOUNCE] Andrey Zagrebin becomes a Flink committer

2019-08-14 Thread Yu Li
Congratulations Andrey! Well deserved! Best Regards, Yu On Wed, 14 Aug 2019 at 17:55, Aleksey Pak wrote: > Congratulations, Andrey! > > On Wed, Aug 14, 2019 at 4:53 PM Markos Sfikas > wrote: > > > Congrats Andrey! > > > > On Wed, 14 Aug 2019 at 16:47, Becket Qin wrote: > > > > > Congratulati

Re: [DISCUSS] FLIP-50: Spill-able Heap Keyed State Backend

2019-08-15 Thread Yu Li
xposure is great. > > > > From the implementation plan, it looks like this exists purely in a new > > module and does not require any changes in other parts of Flink's code. > Can > > you confirm that? > > > > Other that that, I have no further questions and

Re: [VOTE] Apache Flink Release 1.9.0, release candidate #2

2019-08-16 Thread Yu Li
+1 (non-binding) - checked release notes: OK - checked sums and signatures: OK - source release - contains no binaries: OK - contains no 1.9-SNAPSHOT references: OK - build from source: OK (8u102) - mvn clean verify: OK (8u102) - binary release - no examples appear to be m

[VOTE] FLIP-50: Spill-able Heap State Backend

2019-08-16 Thread Yu Li
Hi All, Since we have reached a consensus in the discussion thread [1], I'd like to start the voting for FLIP-50 [2]. This vote will be open for at least 72 hours. Unless objection I will try to close it by end of Tuesday August 20, 2019 if we have sufficient votes. Thanks. [1] https://s.apache.

Re: [VOTE] Apache Flink 1.9.0, release candidate #3

2019-08-19 Thread Yu Li
+1 (non-binding) - checked release notes: OK - checked sums and signatures: OK - repository appears to contain all expected artifacts - source release - contains no binaries: OK - contains no 1.9-SNAPSHOT references: OK - build from source: OK (8u102) - binary release - no exam

Re: [DISCUSS][CODE STYLE] Usage of Java Optional

2019-08-20 Thread Yu Li
by null check? > > >> > > >> When I was introducing it there, I have micro-benchmarked this change, > > and > > >> there was no visible throughput change in a pure network only micro > > >> benchmark (with whole Flink running around it any changes wo

Re: [DISCUSS][CODE STYLE] Breaking long function argument lists and chained method calls

2019-08-20 Thread Yu Li
I second Stephan's summarize, and to be more explicit, +1 on: - Set a hard line length limit - Allow arguments on the same line if below length limit - With consistent argument breaking when that length is exceeded - Developers can break before that if they feel it helps with readability FWIW, hba

Re: [DISCUSS] FLIP-50: Spill-able Heap Keyed State Backend

2019-08-20 Thread Yu Li
nce. But increase > parallelism > > will have some other problems, after this FLIP, we can run Flink Job with > > the same parallelism as RocksDBStateBackend and get better performance > > also. > > > > Best, > > Congxian > > > > > > Yu Li 于2

Re: [VOTE] FLIP-50: Spill-able Heap State Backend

2019-08-21 Thread Yu Li
; > On Sun, Aug 18, 2019 at 3:31 PM Till Rohrmann > > wrote: > > > > > +1 > > > > > > On Fri, Aug 16, 2019 at 4:54 PM Yu Li wrote: > > > > > > > Hi All, > > > > > > > > Since we have reached a consensus in th

Re: [VOTE] FLIP-58: Flink Python User-Defined Function for Table API

2019-08-29 Thread Yu Li
+1 (non-binding) Thanks for driving this! Best Regards, Yu On Fri, 30 Aug 2019 at 11:01, Terry Wang wrote: > +1. That would be very helpful. > Best, > Terry Wang > > > > > 在 2019年8月30日,上午10:18,Jark Wu 写道: > > > > +1 > > > > Thanks for the great work! > > > > On Fri, 30 Aug 2019 at 10:04, Xin

Re: [DISCUSS] FLIP-50: Spill-able Heap Keyed State Backend

2019-08-30 Thread Yu Li
Done. Thanks for the reminder Tison! Best Regards, Yu On Thu, 29 Aug 2019 at 21:03, Zili Chen wrote: > Hi Yu, > > Notice that the wiki is still marked as "*Under Discussion*" state. > > I think you can update it correspondingly. > > Best, > tison. &g

Re: State of FLIPs

2019-09-01 Thread Yu Li
Thanks for the reminder Chesnay. I've just moved FLIP-50 into accepted list since it has already passed the vote and is under development. Best Regards, Yu On Fri, 30 Aug 2019 at 22:29, Dian Fu wrote: > Hi Chesnay, > > Thanks a lot for the remind. FLIP-38 has been released in 1.9 and I have >

Re: [SURVEY] Is the default restart delay of 0s causing problems?

2019-09-01 Thread Yu Li
-1 on increasing the default delay to none zero, with below reasons: a) I could see some concerns about setting the delay to zero in the very original JIRA (FLINK-2993 ) but later on in FLINK-9158

Re: [ANNOUNCE] Kinesis connector becomes part of Flink releases

2019-09-01 Thread Yu Li
Great to know, thanks for the efforts Bowen! And I believe it worth a release note in the original JIRA, wdyt? Thanks. Best Regards, Yu On Sat, 31 Aug 2019 at 11:01, Bowen Li wrote: > Hi all, > > I'm glad to announce that, as #9494 > was merged today

Re: [DISCUSS] Releasing Flink 1.8.2

2019-09-01 Thread Yu Li
+1 for a 1.8.2 release, thanks for bringing this up Jincheng! Best Regards, Yu On Mon, 2 Sep 2019 at 09:19, Thomas Weise wrote: > +1 for the 1.8.2 release > > I marked https://issues.apache.org/jira/browse/FLINK-13586 for this > release. It would be good to compensate for the backward incompat

Re: [DISCUSS] FLIP-49: Unified Memory Configuration for TaskExecutors

2019-09-01 Thread Yu Li
Yes I'll address the memory reservation functionality in a separate FLIP to cooperate with FLIP-49 (sorry for being late for the discussion). Best Regards, Yu On Mon, 2 Sep 2019 at 11:14, Xintong Song wrote: > Sorry for the late response. > > - Regarding the `TaskExecutorSpecifics` naming, let

Re: [VOTE] FLIP-62: Set default restart delay for FixedDelay- and FailureRateRestartStrategy to 1s

2019-09-05 Thread Yu Li
+1 (non-binding) Best Regards, Yu On Thu, 5 Sep 2019 at 00:23, zhijiang wrote: > +1 > > Best, > Zhijiang > -- > From:Jark Wu > Send Time:2019年9月4日(星期三) 13:45 > To:dev > Subject:Re: [VOTE] FLIP-62: Set default restart delay for F

Re: [VOTE] FLIP-49: Unified Memory Configuration for TaskExecutors

2019-09-05 Thread Yu Li
+1 (non-binding) Minor: 1. Is it worth a separate "Limitations" section to contain all relative information like the Unsafe support issue in Java 12, just like many other FLIPs? 2. About the config names, if we change them later in PR, does it mean we will need to update the FLIP document? If so,

Re: [ANNOUNCE] Kostas Kloudas joins the Flink PMC

2019-09-06 Thread Yu Li
Congratulations Klou! Best Regards, Yu On Fri, 6 Sep 2019 at 22:43, Forward Xu wrote: > Congratulations Kloudas! > > > Best, > > Forward > > Dawid Wysakowicz 于2019年9月6日周五 下午10:36写道: > > > Congratulations Klou! > > > > Best, > > > > Dawid > > > > On 06/09/2019 14:55, Fabian Hueske wrote: > > >

Re: [ANNOUNCE] Java 11 cron builds activated on master

2019-09-06 Thread Yu Li
Great to know! Thanks for the efforts Chesnay and will keep an eye on it. Best Regards, Yu On Thu, 5 Sep 2019 at 21:58, Chesnay Schepler wrote: > Hello everyone, > > I just wanted to inform everyone that we now run Java 11 builds on > Travis as part of the cron jobs, subsuming the existing Jav

Re: [DISCUSS] Support customize state in customized KeyedStateBackend

2019-09-08 Thread Yu Li
Hi Shimin, Thanks for bring this discussion up. First of all, I'd like to confirm/clarify that this discussion is mainly about managed state with customized state descriptor rather than raw state, right? Asking because raw state was the very first thing came to my mind when seeing the title. And

Re: [DISCUSS] Features for Apache Flink 1.10

2019-09-08 Thread Yu Li
Sat, Sep 7, 2019 at 7:26 AM Zhu Zhu wrote: > > > > > > > Thanks Gary for kicking off this discussion. > > > > Really appreciate that you and Yu offer to help to manage 1.10 > release. > > > > > > > > +1 for Gary and Yu as release managers. > > >

Re: [VOTE] FLIP-306: Unified File Merging Mechanism for Checkpoints

2023-05-10 Thread Yu Li
+1 (binding) Thanks Zakelly for driving this, and thanks everyone for the thorough discussion. On Wed, May 10, 2023 at 11:15 AM Rui Fan <1996fan...@gmail.com> wrote: > Thanks for driving this proposal, Zakelly. > > +1(binding) > > Best, > Rui Fan > > On Wed, May 10, 2023 at 11:04 AM Hangxiang Yu

Re: [VOTE] Release 2.0 must-have work items

2023-07-10 Thread Yu Li
+1 (binding) Thanks for driving this and great to see us moving forward. Best Regards, Yu On Mon, 10 Jul 2023 at 11:59, Feng Wang wrote: > +1 > Thanks for driving this, looking forward to the next stage of flink. > > On Fri, Jul 7, 2023 at 5:31 PM Xintong Song wrote: > > > Hi all, > > > > I'

Re: [VOTE] Release 2.0 must-have work items

2023-07-13 Thread Yu Li
items in 2.0 are marked as must to have, but no > > contributor > > > > has claimed them yet. I think this is a risk and hope the Release > > Managers > > > > could pay attention to it. > > > > > > > > Thank you all RMs for

Re: Re: [ANNOUNCE] New Apache Flink Committer - Yong Fang

2023-07-25 Thread Yu Li
Congrats, Yong! Best Regards, Yu On Tue, 25 Jul 2023 at 18:03, Sergey Nuyanzin wrote: > Congratulations, Yong Fang! > > On Tue, Jul 25, 2023 at 7:53 AM ConradJam wrote: > > > Congratulations, Yong Fang > > > > Mang Zhang 于2023年7月25日周二 12:08写道: > > > > > Congratulations, Yong Fang! > > > > >

Re: [VOTE] Release 2.0 must-have work items - Round 2

2023-07-25 Thread Yu Li
+1 (binding) Thanks for driving this, Xintong! Best Regards, Yu On Sun, 23 Jul 2023 at 18:28, Yuan Mei wrote: > +1 (binding) > > Thanks for driving the discussion through and for all the efforts in > resolving the complexities :-) > > Best > Yuan > > On Thu, Jul 20, 2023 at 5:23 PM Xintong So

Re: [DISCUSS][2.0] FLIP-349: Move RocksDB statebackend classes to o.a.f.state.rocksdb package

2023-07-25 Thread Yu Li
+1 Best Regards, Yu On Wed, 26 Jul 2023 at 10:47, Yanfei Lei wrote: > +1 for moving all classes in the state-backend-rocksdb module under > the classes to o.a.f.state.rocksdb package. > > I have always been curious about the relationship between > o.a.f.contrib.xx and the flink-contrib module.

Re: [DISCUSS] Remove legacy Paimon (TableStore) doc link from Flink web navigation

2023-10-18 Thread Yu Li
+1 Best Regards, Yu On Tue, 17 Oct 2023 at 18:59, Jing Ge wrote: > +1 > > On Tue, Oct 17, 2023 at 11:13 AM Yong Fang wrote: > > > +1 > > > > On Tue, Oct 17, 2023 at 4:52 PM Leonard Xu wrote: > > > > > +1 > > > > > > > > > > 2023年10月17日 下午4:50,Martijn Visser 写道: > > > > > > > > +1 > > > > >

Re: [PROPOSAL] Contribute Flink CDC Connectors project to Apache Flink

2023-12-07 Thread Yu Li
+1 Thanks Leonard for the proposal, and all Flink CDC contributors for the existing great works. I believe these two projects are a perfect fit and the donation will benifit both. Best Regards, Yu On Fri, Dec 8, 2023 at 2:49 PM bai_wentao1 wrote: > +1 for this exciting work > > > Best regards

Re: [VOTE] Accept Flink CDC into Apache Flink

2024-01-09 Thread Yu Li
+1 (binding) Good luck! Best Regards, Yu On Tue, 9 Jan 2024 at 16:49, Rui Fan <1996fan...@gmail.com> wrote: > +1 (non-binding) > > Best, > Rui > > On Tue, Jan 9, 2024 at 4:41 PM Hang Ruan wrote: > > > +1 (non-binding) > > > > Best, > > Hang > > > > gongzhongqiang 于2024年1月9日周二 16:25写道: > > >

Re: [DISCUSS] Release flink-shaded 10.0

2020-02-07 Thread Yu Li
+1 for starting a new flink-shaded release. Thanks for bringing this up Chesnay. Best Regards, Yu On Thu, 6 Feb 2020 at 20:59, Hequn Cheng wrote: > +1. It sounds great to allow us to support zk 3.4 and 3.5. > Thanks for starting the discussion. > > Best, > Hequn > > On Thu, Feb 6, 2020 at 12:

Re: [VOTE] Release 1.10.0, release candidate #3

2020-02-09 Thread Yu Li
Thanks for the efforts Aihua! These could definitely improve our RC test coverage! Just to confirm, that the stability tests were executed with the same test suite for Alibaba production usage, and the e2e performance one was executed with the test suite proposed in FLIP-83 [1] and FLINK-14917 [2]

Notice: moving fix version of unresolved issues to 1.11.0/1.10.1

2020-02-09 Thread Yu Li
Hi All, Since we're about to release 1.10.0 (the vote of RC3 [1] is in good shape although still not concluded), we plan to change fix version of the unresolved issues to 1.11.0/1.10.1. We will start from issues with "Open" status, and then the "In-Progress" ones. Any concerns, please let us know,

Re: [Question] Anyone know where I can find performance test result?

2020-02-10 Thread Yu Li
Hi Xu, Do you mean the flink-benchmark [1] project for micro benchmark? If so, you could find the daily run result from our code-speed center [2]. Please note that the result of the benchmark is hardware sensitive, so you may find your local result different from the online ones. Best Regards, Y

Re: [VOTE] Release 1.10.0, release candidate #3

2020-02-10 Thread Yu Li
files point to the 1.10.0 version > > > > > > > > > > > > > > - Test Hive integration and SQL client: work well > > > > > > > > > > > > > > > > > > > > > Best, > > > > > > > > > > > &

[ANNOUNCE] Apache Flink 1.10.0 released

2020-02-12 Thread Yu Li
The Apache Flink community is very happy to announce the release of Apache Flink 1.10.0, which is the latest major release. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streaming applications. The release is avai

Re: [VOTE] Release flink-shaded 10.0, release candidate #3

2020-02-13 Thread Yu Li
+1 (non-binding) Checked issues listed in release notes: ok Checked sums and signatures: ok Checked the maven central artifices: ok Built from source: ok (8u101, 11.0.4) Built from source (with -Dshade-sources): ok (8u101, 11.0.4) Checked contents of zookeeper shaded jars: ok - no unshaded classes

Re: [ANNOUNCE] New Documentation Style Guide

2020-02-17 Thread Yu Li
I think the guide itself is a great example of the new style! Thanks for driving this, Aljoscha! Best Regards, Yu On Mon, 17 Feb 2020 at 16:44, Becket Qin wrote: > The guideline is very practical! I like it! Thanks for putting it together, > Aljoscha. > > Jiangjie (Becket) Qin > > On Mon, Feb

Re: [ANNOUNCE] Apache Flink-shaded 10.0 released

2020-02-19 Thread Yu Li
Thanks Chesnay and all participants for making the release possible! Best Regards, Yu On Thu, 20 Feb 2020 at 09:50, Zhu Zhu wrote: > Thanks Chesnay for the great work and everyone who helps with the > improvements and release! > > Thanks, > Zhu Zhu > > Dian Fu 于2020年2月20日周四 上午9:44写道: > > > Th

Re: [DISCUSS] Kicking off the 1.11 release cycle

2020-02-19 Thread Yu Li
Thanks Stephan for the kicking off! And thanks Piotr and Zhijiang for volunteering as the release managers! Aiming for a shorter release cycle than 1.10 makes a lot of sense, and +1 to target the feature freeze date around end of April. Best Regards, Yu On Thu, 20 Feb 2020 at 10:37, Xintong Son

Re: [ANNOUNCE] Jingsong Lee becomes a Flink committer

2020-02-23 Thread Yu Li
Congratulations Jingsong! Well deserved. Best Regards, Yu On Mon, 24 Feb 2020 at 14:10, Congxian Qiu wrote: > Congratulations Jingsong! > > Best, > Congxian > > > jincheng sun 于2020年2月24日周一 下午1:38写道: > >> Congratulations Jingsong! >> >> Best, >> Jincheng >> >> >> Zhu Zhu 于2020年2月24日周一 上午11:5

Re: [DISCUSS] FLIP-76: Unaligned checkpoints

2020-02-25 Thread Yu Li
Hi All, Sorry for being late to the discussion. I've gone through the latest FLIP document and have below questions/suggestions: 1. Do we support asynchronous checkpointing on the in-flight data? * From the doc the answer seems to be yes (state-based storage for the first version), and if so,

Re: [DISCUSS] FLIP-76: Unaligned checkpoints

2020-02-25 Thread Yu Li
Hi Zhijiang, Thanks for the quick reply! For the 1st question, please allow me to confirm, that when doing asynchronous checkpointing, disk spilling should happen in background in parallel with receiving/sending new data, or else it would become synchronous, right? Based on such assumption, some

Re: [DISCUSS] FLIP-76: Unaligned checkpoints

2020-02-28 Thread Yu Li
Thanks for the further feedback Zhijiang and Piotr! I think this is a great feature and will watch the progress. Please also feel free to involve me in discussions/reviews on state-related part. Thanks. Best Regards, Yu On Thu, 27 Feb 2020 at 23:24, Piotr Nowojski wrote: > Hi Yu, > > Re 4. > >

Re: Contributor permission application

2020-03-03 Thread Yu Li
Welcome to the Flink community yutao! In addition to what Congxian mentioned, you may also find the guide of code contribution process [1] useful, especially the "Requirements for a Jira ticket to get consensus" part. Best Regards, Yu [1] https://flink.apache.org/contributing/contribute-code.htm

Re: Flink dev blog

2020-03-03 Thread Yu Li
Big +1 on adding a dev blog and starting with wiki. And +1 to promote the fully polished articles to blog web with a formal process. The latter one also brings up another good-to-have improvement that adding categories and navigation in our blog so people could easily find different topics like re

Re: Flink dev blog

2020-03-07 Thread Yu Li
+1 to Arvid's proposal, thanks for the efforts! Best Regards, Yu On Thu, 5 Mar 2020 at 23:04, Zhijiang wrote: > Thanks for this proposal Arvid! > +1 and looking forward to the wiki structure and more following blogs. > > Best, > Zhijiang > > > --

Re: Flink dev blog

2020-03-09 Thread Yu Li
ime, we would discuss blog > > > > structure and find out easy ways/tools to migrate revised articles to > > the > > > > official Flink blog. > > > > > > > > [1] > > https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+

[DISCUSS] Releasing Flink 1.10.1

2020-03-10 Thread Yu Li
Hi All, It has been almost one month since we released Flink 1.10.0. We already have more than 40 resolved improvements/bugs in the release-1.10 branch, and I propose to start the 1.10.1 release cycle. Most noticeable fixes are: - FLINK-16241 [legal] Remove the license and notice file in flink-m

Re: [DISCUSS] Releasing Flink 1.10.1

2020-03-10 Thread Yu Li
, > Jincheng > > > > Yu Li 于2020年3月10日周二 下午5:49写道: > > > Hi All, > > > > It has been almost one month since we released Flink 1.10.0. We already > > have more than 40 resolved improvements/bugs in the release-1.10 branch, > > and I propose to start

Re: [DISCUSS] Releasing Flink 1.10.1

2020-03-10 Thread Yu Li
when use > flink-sql-connector-elasticsearch7 > - FLINK-16018 Improve error reporting when submitting batch job (instead of > AskTimeoutException) > > These may also need to be resolved in 1.10.1. > > Best, > Hequn > > [1] https://issues.apache.org/jira/projects/FLINK/versions

Re: [DISCUSS] Link Stateful Functions from the Flink Website

2020-03-10 Thread Yu Li
+1 on adding a "What is Stateful Functions" link below the "What is Apache Flink" entry and integrating into the Flink docs gradually (instead of hiding it behind until fully integrated). Best Regards, Yu On Tue, 10 Mar 2020 at 19:33, Stephan Ewen wrote: > Hi all! > > I think it would be nice

Re: [VOTE] [FLIP-76] Unaligned checkpoints

2020-03-10 Thread Yu Li
+1 on the overall design and thanks for the efforts! I totally agree with the plan of implementing the MVP first. However, since the FLIP is for the whole feature instead of only MVP, how about adding a *Roadmap* or *Future Work* section to write down plans include (but not limited to): * Dynamic

Re: [DISCUSS] Releasing Flink 1.10.1

2020-03-10 Thread Yu Li
kaProducer.Semantic.EXACTLY_ONCE and usrlib directory > > > - FLINK-16170 SearchTemplateRequest ClassNotFoundException when use > > > flink-sql-connector-elasticsearch7 > > > - FLINK-16018 Improve error reporting when submitting batch job > (instead > > of > &g

Re: [DISCUSS] Features of Apache Flink 1.11

2020-03-10 Thread Yu Li
Thanks for compiling the list of 1.11 efforts Zhijiang and Piotr! This helps a lot to better understand what the community is currently working on. Looking forward to another successful release. Best Regards, Yu On Wed, 11 Mar 2020 at 11:17, Zhijiang wrote: > Hi community, > > > Not more than

Re: [DISCUSS] Releasing Flink 1.10.1

2020-03-11 Thread Yu Li
: > > > > > > > > Yu, > > > > Thanks for the explanation. > > > > I've no concerns. I was just trying to get some inputs for > prioritizing > > > > tasks on my side, and ~1month sounds good to me. > > > > > > > > &

Re: [DISCUSS] Releasing Flink 1.10.1

2020-03-11 Thread Yu Li
s thrown > this will improve much experience when using SQL CLI > > Best, > Jark > > > On Wed, 11 Mar 2020 at 20:37, Yu Li wrote: > > > Thanks for the suggestion Andrey! I've added 1.10.1 into FLINK-16225 fix > > versions and promoted its priority t

Re: [DISCUSS] Releasing Flink 1.10.1

2020-03-12 Thread Yu Li
hink improving the message error with > reference > > to > > > >> the metaspace option should help the most > > > >> because user would not have to read all docs to fix it > > > >> then maybe this change is not even needed. > > > &

Re: [DISCUSS] Drop Bucketing Sink

2020-03-13 Thread Yu Li
Thanks for bringing up this discussion Robert! According to the inputs, I suggest we create an umbrella JIRA issue to track all critical improvements StreamingFileSink should have before we could completely discard bucketing sink, so we could have a clear view of the progress and how soon we could

Re: [VOTE] [FLIP-76] Unaligned checkpoints

2020-03-13 Thread Yu Li
+1 (binding) The updated FLIP doc LGTM. Thanks for addressing the comments Arvid and Roman. Best Regards, Yu On Fri, 13 Mar 2020 at 03:48, Arvid Heise wrote: > I added a roadmap section to the FLIP as suggested by Yu and Roman. > > Unless someone objects, I'd still consider the voting period

Re: [DISCUSS] Releasing Flink 1.10.1

2020-03-13 Thread Yu Li
Best Regards, Yu On Fri, 13 Mar 2020 at 18:21, Stephan Ewen wrote: > @Andrey and @Xintong - could we have a quick poll on the user mailing list > about increasing the metaspace size in Flink 1.10.1? Specifically asking > for who has very small TM setups? > > On Fri, Mar 13, 2

Re: FLIP-117: HBase catalog

2020-03-17 Thread Yu Li
Thanks for bringing up this discussion Flavio. And thanks Bowen for the ping. For me, I'm not quite sure whether adding an HBase catalog suits into the existing Catalog interface. It seems to be coupled with SQL standard instead of a more general database catalog [1], which also reflects in the FL

Re: [DISCUSS] Releasing Flink 1.10.1

2020-03-17 Thread Yu Li
> > > about increasing the metaspace size in Flink 1.10.1? Specifically > asking > > > for who has very small TM setups? > > > > There has been a survey about this topic since 10 days: > > > > `[Survey] Default size for the new JVM Metaspace limit in 1

Re: [DISCUSS] Releasing Flink 1.10.1

2020-03-20 Thread Yu Li
Please let me know if you see any new blockers to add to the list. Thanks. Best Regards, Yu On Wed, 18 Mar 2020 at 00:11, Yu Li wrote: > Thanks for the updates Till! > > For FLINK-16018, maybe we could create two sub-tasks for easy and complete > fix separately, and only include the

Re: The question about the FLIP-45

2020-03-23 Thread Yu Li
Hi LakeShen, Sorry for the late response. For the first question, literally, the stop command should be used if one means to stop the job instead of canceling it. For the second one, since FLIP-45 is still under discussion [1] [2] (although a little bit stalled due to priority), we still don't s

Re: [DISCUSS] Switch to Azure Pipelines as the primary CI tool / switch off Travis

2020-03-25 Thread Yu Li
Thanks for the efforts Robert! Checking the pipeline failure report [1] the pass rate is relatively low, and I'm wondering whether we need more efforts to stabilize it before replacing travis PR runs. >From the report, uploading log fails 1/5 of the tests, which indicates the access from azure to

Re: [DISCUSS] Switch to Azure Pipelines as the primary CI tool / switch off Travis

2020-03-26 Thread Yu Li
nId=4 On Thu, 26 Mar 2020 at 03:28, Robert Metzger wrote: > Thank you for your responses. > > @Yu Li: In the current master, the log upload always fails, if the e2e job > failed. I just merged a PR that fixes this issue [1]. The problem was not > really the network stability, rathe

Re: [DISCUSS] Creating a new repo to host Stateful Functions Dockerfiles

2020-03-26 Thread Yu Li
+1 to use a dedicated repository. All reasons listed in the proposal make sense to me. Best Regards, Yu On Thu, 26 Mar 2020 at 23:56, Igal Shilman wrote: > +1 for a separate repository. > > Thanks, > Igal > > On Thursday, March 26, 2020, Stephan Ewen wrote: > > > +1 to a separate repository.

Re: [DISCUSS] Releasing Flink 1.10.1

2020-03-27 Thread Yu Li
Error in TaskManager - [Open] FLINK-16408 Bind user code class loader to lifetime of a slot There's a new blocker added. Please let me know if you find any other issues should be put into the watch list. Thanks. Best Regards, Yu On Sat, 21 Mar 2020 at 14:37, Yu Li wrote: > Hi All, >

Re: [VOTE] Apache Flink Stateful Functions Release 2.0.0, release candidate #4

2020-03-30 Thread Yu Li
+1 (non-binding) Checked sums and signatures: OK Checked no binaries in source distribution: OK Checked RAT and end-to-end tests (8u101, 11.0.4): OK Checked version in pom/README/setup.py files: OK Checked quick start: OK Checked Greeter local docker-compose examples: OK Checked Ridesharing local

Re: [VOTE] Apache Flink Stateful Functions Release 2.0.0, release candidate #4

2020-03-31 Thread Yu Li
Hi Stephan, Could you also share the method of license check, so more people could help in future votes? And maybe adding some instructions into our wiki [1]? I skipped the licensing check in my vote because not aware of a good way to do it thoroughly, not sure whether I'm the only one having such

Re: [VOTE] Apache Flink Stateful Functions Release 2.0.0, release candidate #4

2020-04-01 Thread Yu Li
ependencies and mixing compile / > provided is not straightforward in maven. > > Best, > Stephan > > > > On Wed, Apr 1, 2020 at 4:47 AM Yu Li wrote: > >> Hi Stephan, >> >> Could you also share the method of license check, so more people could >> help

Re: [ANNOUNCE] New Committers and PMC member

2020-04-01 Thread Yu Li
Congratulations Konstantin, Dawid and Zhijiang! Well deserved. Best Regards, Yu On Wed, 1 Apr 2020 at 18:13, Benchao Li wrote: > Congratulations to all of you! > > Congxian Qiu 于2020年4月1日周三 下午6:03写道: > > > congratulations to all of you > > > > Best, > > Congxian > > > > > > Xingbo Huang 于202

Re: [DISCUSS] Releasing Flink 1.10.1

2020-04-03 Thread Yu Li
Of Memory should be handled as Fatal Error in TaskManager - [May Postpone] FLINK-16408 Bind user code class loader to lifetime of a slot Please let me know if you find any missing ones, thanks. Best Regards, Yu On Fri, 27 Mar 2020 at 21:06, Yu Li wrote: > Here comes the latest status of iss

Re: [VOTE] Apache Flink Stateful Functions Release 2.0.0, release candidate #6

2020-04-06 Thread Yu Li
+1 (non-binding) Checked sums and signatures: OK Checked no binaries in source distribution: OK Checked RAT and end-to-end tests (8u101, 11.0.4): OK Checked version in pom/README/setup.py files: OK Checked quick start: OK Checked Greeter local docker-compose examples: OK Checked Ridesharing local

Re: [ANNOUNCE] New Flink committer: Seth Wiesman

2020-04-07 Thread Yu Li
Congratulations, Seth! Best Regards, Yu On Tue, 7 Apr 2020 at 18:16, Benchao Li wrote: > Congratulations~ > > Hequn Cheng 于2020年4月7日周二 下午5:22写道: > > > Congratulations Seth! > > > > Best, Hequn > > > > On Tue, Apr 7, 2020 at 4:11 PM Fabian Hueske wrote: > > > > > Congrats Seth! Well deserved

Re: Configuring autolinks to Flink JIRA ticket in github repos

2020-04-09 Thread Yu Li
Great! Thanks for the efforts Yun. Best Regards, Yu On Thu, 9 Apr 2020 at 16:15, Jark Wu wrote: > Thanks Yun, > > This's a great feature! I was surprised by the autolink feature yesterday > (didn't know your work at that time). > > Best, > Jark > > On Thu, 9 Apr 2020 at 16:12, Yun Tang wrote:

Re: [DISCUSS] Creating a new repo to host Flink benchmarks

2020-04-10 Thread Yu Li
+1 for the proposal, thanks for driving this Yun. Best Regards, Yu On Fri, 10 Apr 2020 at 11:25, Dian Fu wrote: > +1 for this proposal. > > > 在 2020年4月10日,上午10:58,Zhijiang 写道: > > > > +1 for the proposal. > > > > Best, > > Zhijiang > > > > > > -

Re: [DISCUSS] Releasing Flink 1.10.1

2020-04-12 Thread Yu Li
ds, Yu On Fri, 3 Apr 2020 at 21:35, DONG, Weike wrote: > Hi Yu, > > Thanks for your updates. I am still working on the fix for FLINK-16626 and > it is expected to be completed by this Sunday after thorough testing. > > Sincerely, > Weike > > On Fri, Apr 3, 2020 at 8:4

Re: [DISCUSS] Releasing Flink 1.9.3

2020-04-15 Thread Yu Li
+1 to create a new 1.9 bug fix release. Thanks Dian for volunteering as our RM. Best Regards, Yu On Wed, 15 Apr 2020 at 16:25, Hequn Cheng wrote: > +1 for the release and for Dian being the RM. > Thanks Jincheng for your continuous efforts on helping the releasing. > > Best, > Hequn > > On Wed

  1   2   3   4   5   >