Re: RE: [DISCUSS] Improve Queryable State and introduce a QueryServerProxy component

2019-07-02 Thread vino yang
; It will be very useful if someone from the committers joins the topic and > give us some insights what’s going to happen with that feature. > > > > > > Kind Regards, > > Georgi > > > > > > > > *From:* vino yang > *Sent:* Thursday, April 25, 2

Re: [DISCUSS] FLIP-44: Support Local Aggregation in Flink

2019-07-03 Thread vino yang
current Flink's design, and we should first focus to > discuss around this. Previously, we actually had a wrong target, which > focused on how to do proper *local aggregation*. > > If the community is OK with this changes, we can further discuss how do we > do the changes step b

[DISCUSS] Make window state queryable

2019-07-03 Thread vino yang
Hi folks, Currently, the queryable state is not widely used in production. IMO, there are two key reasons caused this result. 1) the client of the queryable state is hard to use. Because it requires users to know the address of TaskManager and the port of the proxy. Actually, most business users w

Re: RE: [DISCUSS] Improve Queryable State and introduce aQueryServerProxy component

2019-07-04 Thread vino yang
eft some comments on it. > > > Best Regards, > > Jiayi Liao > > Original Message > *Sender:* vino yang > *Recipient:* Georgi Stoyanov > *Cc:* dev; user; Stefan > Richter; Aljoscha Krettek; > kklou...@gmail.com; Stephan Ewen; > l...@apache.org; Tzu-Li (Gordon)

Re: [DISCUSS] Flink framework and user log separation

2019-07-04 Thread vino yang
omething that can just be done by the right logging framework and > configuration? > > Like having a log framework with two targets, one filtered on > "org.apache.flink" and the other one filtered on "my.company.project" or > so? > > On Fri, Mar 1,

Re: [VOTE] Migrate to sponsored Travis account

2019-07-04 Thread vino yang
+1 Dian Fu 于2019年7月4日周四 下午7:09写道: > +1. Thanks Chesnay and Bowen for pushing this forward. > > Regards, > Dian > > > 在 2019年7月4日,下午6:28,zhijiang 写道: > > > > +1 and thanks for Chesnay' work on this. > > > > Best, > > Zhijiang > > > > --

Re: [DISCUSS] Make window state queryable

2019-07-04 Thread vino yang
. > +1 from my side. > > > 在 2019年7月4日,11:41,vino yang 写道: > > > > Hi folks, > > > > Currently, the queryable state is not widely used in production. IMO, > there > > are two key reasons caused this result. 1) the client of the queryable > >

Re: [ANNOUNCE] Rong Rong becomes a Flink committer

2019-07-11 Thread vino yang
congratulations Rong Rong! Fabian Hueske 于2019年7月11日周四 下午10:25写道: > Hi everyone, > > I'm very happy to announce that Rong Rong accepted the offer of the Flink > PMC to become a committer of the Flink project. > > Rong has been contributing to Flink for many years, mainly working on SQL > and Yar

Re: [ANNOUNCE] Jiangjie (Becket) Qin has been added as a committer to the Flink project

2019-07-18 Thread vino yang
Congratulations! Best, Vino Yun Gao 于2019年7月18日周四 下午5:31写道: > Congratulations! > > Best, > Yun > > > -- > From:Kostas Kloudas > Send Time:2019 Jul. 18 (Thu.) 17:30 > To:dev > Subject:Re: [ANNOUNCE] Jiangjie (Becket) Qin has been

Re: Re: [ANNOUNCE] Zhijiang Wang has been added as a committer to the Flink project

2019-07-22 Thread vino yang
Congratulations Zhijiang! Haibo Sun 于2019年7月23日周二 上午10:48写道: > Congrats, Zhejiang! > > > Best, > Haibo > 在 2019-07-23 10:26:20,"Yun Tang" 写道: > >Congratulations Zhijiang, well deserved. > > > >Best > > > >From: Yingjie Cao > >Sent: Tuesday, July 23, 2019 10:23 >

Re: [ANNOUNCE] Kete Young is now part of the Flink PMC

2019-07-23 Thread vino yang
Congratulations Kurt! Bo WANG 于2019年7月23日周二 下午7:13写道: > Congratulations Kurt! > > > Best, > > Bo WANG > > > On Tue, Jul 23, 2019 at 5:24 PM Robert Metzger > wrote: > > > Hi all, > > > > On behalf of the Flink PMC, I'm happy to announce that Kete Young is now > > part of the Apache Flink Project

Re: [VOTE] Publish the PyFlink into PyPI

2019-08-01 Thread vino yang
+1 (non-binding) Jeff Zhang 于2019年8月1日周四 下午4:33写道: > +1 (non-binding) > > Stephan Ewen 于2019年8月1日周四 下午4:29写道: > > > +1 (binding) > > > > On Thu, Aug 1, 2019 at 9:52 AM Dian Fu wrote: > > > > > Hi Jincheng, > > > > > > Thanks a lot for driving this. > > > +1 (non-binding). > > > > > > Regards,

Re: [ANNOUNCE] Hequn becomes a Flink committer

2019-08-07 Thread vino yang
Congratulations! highfei2...@126.com 于2019年8月7日周三 下午7:09写道: > Congrats Hequn! > > Best, > Jeff Yang > > > Original Message > Subject: Re: [ANNOUNCE] Hequn becomes a Flink committer > From: Piotr Nowojski > To: JingsongLee > CC: Biao Liu ,Zhu Zhu ,Zili Chen ,Jeff Zhang ,Paul Lam

Re: [VOTE] Flink Project Bylaws

2019-08-13 Thread vino yang
+1 Tzu-Li (Gordon) Tai 于2019年8月13日周二 下午6:32写道: > +1 > > On Tue, Aug 13, 2019, 12:31 PM Hequn Cheng wrote: > > > +1 (non-binding) > > > > Thanks a lot for driving this! Good job. @Becket Qin < > becket@gmail.com > > > > > > > Best, Hequn > > > > On Tue, Aug 13, 2019 at 6:26 PM Stephan Ewen

Re: [ANNOUNCE] Andrey Zagrebin becomes a Flink committer

2019-08-14 Thread vino yang
Congratulations Andrey! Best, Vino Yun Gao 于2019年8月15日周四 上午10:49写道: > Congratulations Andrey! > > Best, > Yun > > > -- > From:Congxian Qiu > Send Time:2019 Aug. 15 (Thu.) 10:28 > To:dev@flink.apache.org > Subject:Re: [ANNOUNCE] A

Re: [VOTE] Apache Flink 1.9.0, release candidate #3

2019-08-20 Thread vino yang
+1 (non-binding) - checkout source code and build successfully - started a local cluster and ran some example jobs successfully - verified signatures and hashes - checked release notes and post Best, Vino Stephan Ewen 于2019年8月21日周三 上午4:20写道: > +1 (binding) > > - Downloaded the binary release

Re: CiBot Update

2019-08-21 Thread vino yang
+1 for "@flinkbot run travis", it is very convenient. Chesnay Schepler 于2019年8月21日周三 下午9:12写道: > Hi everyone, > > this is an update on recent changes to the CI bot. > > > The bot now cancels builds if a new commit was added to a PR, and > cancels all builds if the PR was closed. > (This was impl

Re: [DISCUSS] Use Java's Duration instead of Flink's Time

2019-08-23 Thread vino yang
+1 to replace the Time class provided by Flink with Java's Duration: - Java's Duration has better representation than the Flink's Time class; - As a built-in Java class, Duration class has a clear advantage over Java's Time class when interacting with other Java APIs and third-party l

Re: [VOTE] FLIP-54: Evolve ConfigOption and Configuration

2019-09-02 Thread vino yang
+1 Dawid Wysakowicz 于2019年8月30日周五 下午7:34写道: > +1 to the design > > On 29/08/2019 15:53, Timo Walther wrote: > > I converted the mentioned Google doc into a wiki page: > > > > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-54%3A+Evolve+ConfigOption+and+Configuration > > > > > > The core

Re: [DISCUSS] FLIP-60: Restructure the Table API & SQL documentation

2019-09-02 Thread vino yang
Agree with Dawid's suggestion about function. Having a Functions section to unify the built-in function and UDF would be better. Dawid Wysakowicz 于2019年8月30日周五 下午7:43写道: > +1 to the idea of restructuring the docs. > > My only suggestion to consider is how about moving the > User-Defined-Extensi

Re: State of FLIPs

2019-09-03 Thread vino yang
Hi Chesnay, I created FLIP-44 two months ago. Originally, the discussion of local aggregation feature happened in the ML thread.[1] After many people agree with this feature, I created an umbrella issue and split into some subtasks and opened one PR. However, @Aljoscha Krettek thinks it's a big

Re: [ANNOUNCE] Kinesis connector becomes part of Flink releases

2019-09-03 Thread vino yang
Good news! Thanks for your efforts, Bowen! Best, Vino Yu Li 于2019年9月2日周一 上午6:04写道: > Great to know, thanks for the efforts Bowen! > > And I believe it worth a release note in the original JIRA, wdyt? Thanks. > > Best Regards, > Yu > > > On Sat, 31 Aug 2019 at 11:01, Bowen Li wrote: > >> Hi all

Re: [VOTE] FLIP-61 Simplify Flink's cluster level RestartStrategy configuration

2019-09-04 Thread vino yang
+1 (non-binding) Zili Chen 于2019年9月5日周四 上午10:55写道: > +1 > > > zhijiang 于2019年9月5日周四 上午12:36写道: > > > +1 > > -- > > From:Till Rohrmann > > Send Time:2019年9月4日(星期三) 13:39 > > To:dev > > Cc:Zhu Zhu > > Subject:Re: [VOTE] FLIP-61 Si

Re: Re: [DISCUSS] Support JSON functions in Flink SQL

2019-09-05 Thread vino yang
+1 to have JSON functions in Flink SQL JingsongLee 于2019年9月5日周四 下午4:46写道: > +1 > Nice document. I think it is easier to do after expression reworking[1]. > By the way, which planner do you want to start? > > [1] > https://cwiki.apache.org/confluence/display/FLINK/FLIP-51%3A+Rework+of+the+Express

Re: [ANNOUNCE] Java 11 cron builds activated on master

2019-09-05 Thread vino yang
Great news Chesnay! Thanks for your hard work and effort! Best, Vino Chesnay Schepler 于2019年9月5日周四 下午9:58写道: > Hello everyone, > > I just wanted to inform everyone that we now run Java 11 builds on > Travis as part of the cron jobs, subsuming the existing Java 9 tests. > All existing Java 9 bui

Re: [VOTE] FLIP-62: Set default restart delay for FixedDelay- and FailureRateRestartStrategy to 1s

2019-09-05 Thread vino yang
+1 (non-binding) Best, Vino Yu Li 于2019年9月6日周五 上午2:13写道: > +1 (non-binding) > > Best Regards, > Yu > > > On Thu, 5 Sep 2019 at 00:23, zhijiang > wrote: > > > +1 > > > > Best, > > Zhijiang > > -- > > From:Jark Wu > > Send Time:201

Re: [ANNOUNCE] Kostas Kloudas joins the Flink PMC

2019-09-07 Thread vino yang
Congratulations Klou! Best, Vino zhijiang 于2019年9月7日周六 上午12:22写道: > Congratulations Klou! > > Best, > Zhijiang > -- > From:Zhu Zhu > Send Time:2019年9月6日(星期五) 17:19 > To:dev > Subject:Re: [ANNOUNCE] Kostas Kloudas joins the Flink

Call for approving Elasticsearch 7.x connector

2019-09-09 Thread vino yang
Hi guys, There is an issue about supporting Elasticsearch 7.x.[1] Based on our validation and discussion. We found that Elasticsearch 7.x does not guarantee API compatibility. Therefore, it does not have the ability to provide a universal connector like Kafka. It seems that we have to provide a ne

Re: [PROPOSAL] Contribute Stateful Functions to Apache Flink

2019-10-14 Thread vino yang
+1 to add Stateful Function to flink core to let it stay in the Flink repository. Best, Vino Stephan Ewen 于2019年10月14日周一 下午7:29写道: > Thank you all for the encouraging feedback! So far the reaction to add this > to Flink was exclusively positive, which is really great to see! > > To make this ha

Re: Ignore operator failure

2019-10-14 Thread vino yang
Hi Dom, If you consider ignoring checkpoint failures, you can use this API: setTolerableCheckpointFailureNumber[1]. But for Jobs with checkpoints enabled and failed operators containing states, Flink can't ignore these failures without restarting Jobs. Subsequent regional recovery may be appropria

Re: [VOTE] FLIP-74: Flink JobClient API

2019-10-15 Thread vino yang
+1 (non-binding) Best, Vino Aljoscha Krettek 于2019年10月15日周二 下午2:59写道: > +1 (binding) > > Best, > Aljoscha > > > On 15. Oct 2019, at 04:01, Zili Chen wrote: > > > > Hi all, > > > > +1 from my side. > > > > Given the current state of this voting thread, FLIP-74 is accepted > > with 3 binding vot

Re: [VOTE] FLIP-64: Support for Temporary Objects in Table module

2019-10-15 Thread vino yang
+1 Best, Vino Aljoscha Krettek 于2019年10月15日周二 下午4:31写道: > +1 > > Best, > Aljoscha > > > On 14. Oct 2019, at 14:55, Kurt Young wrote: > > > > +1 > > > > Best, > > Kurt > > > > > > On Fri, Oct 11, 2019 at 1:39 PM Dawid Wysakowicz > > > wrote: > > > >> Hi everyone, > >> I would like to start a v

Re: [VOTE] Drop Python 2 support for 1.10

2019-10-16 Thread vino yang
+1 Bowen Li 于2019年10月16日周三 上午5:12写道: > +1 > > On Sun, Oct 13, 2019 at 10:54 PM Hequn Cheng wrote: > > > +1 > > > > Thanks a lot for driving this, Dian! > > > > On Mon, Oct 14, 2019 at 1:46 PM jincheng sun > > wrote: > > > > > +1 > > > > > > Dian Fu 于2019年10月14日周一 下午1:21写道: > > > > > > > Hi al

Re: [DISCUSS] Stateful Functions - in which form to contribute? (same or different repository)

2019-10-16 Thread vino yang
Hi, Fast release cycles seems a good viewpoint to support keeping it in a separate repository. IMO, the placement of documentation should keep consistency with the repository. Best, Vino Timo Walther 于2019年10月16日周三 下午4:02写道: > Hi Stephan, > > +1 for keeping it in a separate repository for fas

Re: [NOTICE] Binary licensing is now auto-generated

2019-10-17 Thread vino yang
Thanks Chesnay! Great job! Best, Vino Jark Wu 于2019年10月18日周五 上午9:51写道: > Thanks Chesnay! This is really a great job! > > Best, > Jark > > > 在 2019年10月17日,22:03,未来阳光 <2217232...@qq.com> 写道: > > > > Thanks for this improvement Chesnay ! > > > > > > > > > > ---Original--- > > From: "Chesnay Schepl

[DISCUSS] Introduce a location-oriented two-stage query mechanism to improve the queryable state.

2019-10-22 Thread vino yang
Hi guys, Currently, queryable state's client is hard to use. Because it requires users to know the address of TaskManager and the port of the proxy. Actually, most users who do not have good knowledge about the Flink's inner and runtime in production. The queryable state clients directly interact

Re: [VOTE] Accept Stateful Functions into Apache Flink

2019-10-22 Thread vino yang
+1 (non-binding) Best, Vino Zhu Zhu 于2019年10月22日周二 下午4:33写道: > +1 (non-binding) > > Thanks, > Zhu Zhu > > Biao Liu 于2019年10月22日周二 上午11:06写道: > > > +1 (non-binding) > > > > Thanks, > > Biao /'bɪ.aʊ/ > > > > > > > > On Tue, 22 Oct 2019 at 10:26, Jark Wu wrote: > > > > > +1 (non-binding) > > > >

Re: [VOTE] FLIP-81: Executor-related new ConfigOptions

2019-10-24 Thread vino yang
+1 (non-binding) Best, Vino Yang Wang 于2019年10月23日周三 下午9:05写道: > We could benefit a lot from unifying the cli options and config options. > > +1(non-binding) > > Best, > Yang > > Aljoscha Krettek 于2019年10月23日周三 下午5:24写道: > > > +1 (binding) > > > >

Re: [DISCUSS] Introduce a location-oriented two-stage query mechanism toimprove the queryable state.

2019-10-25 Thread vino yang
r maybe integrate them in a graceful way in the future. > > Anyway, this is a great work and it’d be better if we can hear more > thoughts and use cases. > > Best Regards, > Jiayi Liao > > Original Message > *Sender:* vino yang > *Recipient:* dev@flink.apache.org &g

Re: [DISCUSS] Introduce a location-oriented two-stage query mechanism toimprove the queryable state.

2019-10-25 Thread vino yang
e sense that it > reflects an earlier point in time than what may've been previously > fetched. > > (4) The state that is wanted (e.g., window state, or operator state) > isn't queryable. > > Best, > David > > On Fri, Oct 25, 2019 at 9:51 AM vino yang wrote: >

Re: [ANNOUNCE] Becket Qin joins the Flink PMC

2019-10-28 Thread vino yang
Congratulations Becket! Best, Vino Wei Zhong 于2019年10月29日周二 上午9:42写道: > Congratulations Becket! > > Best, > Wei > > > 在 2019年10月29日,09:36,Paul Lam 写道: > > > > Congrats Becket! > > > > Best, > > Paul Lam > > > >> 在 2019年10月29日,02:18,Xingcan Cui 写道: > >> > >> Congratulations, Becket! > >> > >>

Re: [VOTE] Move flink-orc to flink-formats from flink-connectors

2019-10-30 Thread vino yang
+1 (non-binding) Best, Vino Dawid Wysakowicz 于2019年10月30日周三 下午4:07写道: > +1 > > Best, > > Dawid > > On 30/10/2019 04:49, Jingsong Li wrote: > > Hi all: > > > > We already have the parent model of formats. we have put other > > formats(flink-avro, flink-json, flink-parquet, flink-json, flink-csv,

Re: [DISCUSS] Introduce a location-oriented two-stage query mechanism toimprove the queryable state.

2019-10-31 Thread vino yang
apache.org/MaOl > [2] https://s.apache.org/r8k8a > > Best Regards, > Yu > > > On Fri, 25 Oct 2019 at 23:59, vino yang wrote: > >> Hi David, >> >> I know that in some scenarios, the queryable state has some limitations. >> But in some scenarios, it is

Re: FW: Unit testing for ProcessAllWindowFunction

2019-10-31 Thread vino yang
Hi Diogo, In order to test ProcessAllWindowFunction, you need to do a little more. You can refer to Flink's own test code.[1] In short: 1) Write a Flink Streaming job that uses your UDF (here is ProcessAllWindowFunction) and return a DataStream. 2) Get OneInputTransformation through DataStream,

Re: Unit testing for ProcessAllWindowFunction

2019-11-04 Thread vino yang
.com/ctechworks> < > https://www.facebook.com/CriticalTechWorks/> > > > On 01/11/2019, 03:38, "vino yang" wrote: > > Hi Diogo, > > In order to test ProcessAllWindowFunction, you need to do a little > more. > > You can refe

Re: Checkpoint in FlinkSQL

2019-11-04 Thread vino yang
Hi Simon, Absolutely, yes. Before using Flink SQL, you need to initialize a StreamExecutionEnvirnoment instance[1], then call StreamExecutionEnvirnoment#setStateBackend or StreamExecutionEnvirnoment#enableCheckpointing to specify the information what you want. [1]: https://ci.apache.org/projects/

Re: [ANNOUNCE] Jark Wu is now part of the Flink PMC

2019-11-09 Thread vino yang
Congratulations, Jark. Best, Vino Leonard Xu 于2019年11月8日周五 下午8:40写道: > Congratulations, Jark. > Thanks for your contribution and help. > > Best, > Leonard Xu > > > On 2019年11月8日, at 下午6:37, Yun Gao wrote: > > > > Congratulations Jark! > > > > Best, > > Yun > > > > > > -

Re: [VOTE] FLIP-79: Flink Function DDL Support (1.10 Release Feature Only)

2019-11-11 Thread vino yang
+1 (non-binding) Best, Vino Xuefu Z 于2019年11月12日周二 上午3:27写道: > +1 (non-binding) > > On Mon, Nov 11, 2019 at 9:54 AM Shuyi Chen wrote: > > > +1 (binding) > > > > On Sat, Nov 9, 2019 at 11:17 PM Kurt Young wrote: > > > > > +1 (binding) > > > > > > Best, > > > Kurt > > > > > > > > > On Sun, Nov

Re: Flink on Yarn resource arrangement

2019-11-13 Thread vino yang
Hi Alex, Which Flink version are you using? AFAIK, since Flink 1.8+, the config option: "-yn" for Flink on YARN job cluster mode does not take effect(always 1 and would be overridden). So, the config option "-ys" and "-p" will decide the number of TM. The first example: -p(20)/-ys(3) should be

Re: [VOTE] FLIP-83: Flink End-to-end Performance Testing Framework

2019-11-18 Thread vino yang
+1 (non-binding) Best, Vino jincheng sun 于2019年11月18日周一 下午2:31写道: > +1 (binding) > > OpenInx 于2019年11月18日周一 下午12:09写道: > > > +1 (non-binding) > > > > On Mon, Nov 18, 2019 at 11:54 AM aihua li wrote: > > > > > +1 (non-binding) > > > > > > Thanks Yu Li for driving on this. > > > > > > > 在 20

Re: [ANNOUNCE] Launch of flink-packages.org: A website to foster the Flink Ecosystem

2019-11-19 Thread vino yang
Thanks Robert. Great job! The web site looks great. In the future, we can also add my Kylin Flink cube engine[1] to the ecosystem projects list. [1]: https://github.com/apache/kylin/tree/engine-flink Best, Vino Oytun Tez 于2019年11月19日周二 上午12:09写道: > Congratulations! This is exciting. > > > --

Re: [DISCUSS] Release flink-shaded 9.0

2019-11-19 Thread vino yang
+1 Best, Vino Dian Fu 于2019年11月19日周二 下午4:17写道: > Hi Chesnay, > > Thanks a lot for kicking off this release. +1 to release flink-shaded 9.0. > > I'm willing to help on the release. Please feel free to let me know > if there is anything I could help. > > Regards, > Dian > > On Mon, Nov 18, 2019 a

Re: [ANNOUNCE] Launch of flink-packages.org: A website to foster the Flink Ecosystem

2019-11-19 Thread vino yang
Hi Robert, Just added it under the "Tools" category[1]. [1]: https://flink-packages.org/packages/kylin-flink-cube-engine Best, Vino Robert Metzger 于2019年11月19日周二 下午4:33写道: > Thanks. > You can add Kylin whenever you think it is ready. > > On Tue, Nov 19, 2019 at 9:

Re: [DISCUSS] Remove old WebUI

2019-11-24 Thread vino yang
+1 Best, Vino Congxian Qiu 于2019年11月25日周一 上午10:48写道: > +1 to drop the old UI > Best, > Congxian > > > aihua li 于2019年11月25日周一 上午9:38写道: > > > +1 to drop the old UI. > > > > > 在 2019年11月21日,下午8:04,Chesnay Schepler 写道: > > > > > > Hello everyone, > > > > > > Flink 1.9 shipped with a new UI, wit

Re: I want to contribute to Flink!

2019-11-24 Thread vino yang
Hi, Currently, you do not need a JIRA permission. Only committers can assign a Jira ticket. Please read the official contribution guide[1] before contributing. Best, Vino [1]: https://flink.apache.org/contributing/contribute-code.html#consensus 470905446 <470905...@qq.com> 于2019年11月24日周日 下午8:4

Re: [DISCUSS] Remove old WebUI

2019-11-25 Thread vino yang
+1 Best, Vino Zhu Zhu 于2019年11月25日周一 下午2:06写道: > +1 > > Thanks, > Zhu Zhu > > Dian Fu 于2019年11月25日周一 上午11:09写道: > > > +1 to drop the old UI. > > > > > 在 2019年11月25日,上午10:59,Zhenghua Gao 写道: > > > > > > +1 to drop the old one. > > > > > > *Best Regards,* > > > *Zhenghua Gao* > > > > > > > > >

Re: [DISCUSS] Drop RequiredParameters and OptionType

2019-12-03 Thread vino yang
+1, One concern: these two classes are marked with `@publicEvolving` annotation. Shall we mark them with `@Deprecated` annotation firstly? Best, Vino Dian Fu 于2019年12月3日周二 下午8:56写道: > +1 to remove them. It seems that we should also drop the class Option as > it's currently only used in Require

Re: Building with Hadoop 3

2019-12-03 Thread vino yang
cc @Chesnay Schepler to answer this question. Foster, Craig 于2019年12月4日周三 上午1:22写道: > Hi: > > I don’t see a JIRA for Hadoop 3 support. I see a comment on a JIRA here > from a year ago that no one is looking into Hadoop 3 support [1]. Is there > a document or JIRA that now exists which would poi

Re: Building with Hadoop 3

2019-12-04 Thread vino yang
Hi Marton, Thanks for your explanation. Personally, I look forward to your contribution! Best, Vino Márton Balassi 于2019年12月4日周三 下午5:15写道: > Wearing my Cloudera hat I can tell you that we have done this exercise for > our distros of the 3.0 and 3.1 Hadoop versions. We have not contributed > t

Re: [DISCUSS] Drop Kafka 0.8/0.9

2019-12-04 Thread vino yang
+1 jincheng sun 于2019年12月5日周四 上午10:26写道: > +1 for drop it, and Thanks for bring up this discussion Chesnay! > > Best, > Jincheng > > Jark Wu 于2019年12月5日周四 上午10:19写道: > >> +1 for dropping, also cc'ed user mailing list. >> >> >> Best, >> Jark >> >> On Thu, 5 Dec 2019 at 03:39, Konstantin Knauf

Re: [VOTE] Multi-topics consuming from KafkaTableSource

2019-12-04 Thread vino yang
Hi Leo, IMO, if you want to vote a proposal. It would be better to start a new VOTE ML thread. Best, Vino leo 于2019年12月5日周四 上午9:07写道: > Hi everyone, > > > Please vote for this FLINK-14729. The JIRA can be found here, > > https://issues.apache.org/jira/browse/FLINK-14729 > > The discussion can

Re: [ANNOUNCE] Zhu Zhu becomes a Flink committer

2019-12-15 Thread vino yang
Congratulations, Zhu Zhu! Best, Vino Yang Wang 于2019年12月16日周一 上午10:01写道: > Congratulations, Zhu Zhu! > > wenlong.lwl 于2019年12月16日周一 上午9:56写道: > > > Congratulations, Zhu Zhu! > > > > On Mon, 16 Dec 2019 at 09:14, Leonard Xu wrote: > > > > >

Re: Documentation tasks for release-1.10

2019-12-16 Thread vino yang
+1 for centralizing all the documentation issues so that the community can take more effective to fix them. Best, Vino Xintong Song 于2019年12月16日周一 下午6:02写道: > Thank you Kostas. > Big +1 for keeping all the documentation related issues at one place. > > I've added the documentation task for reso

Re: [Question] How to use different filesystem between checkpoint data and user data sink

2019-12-18 Thread vino yang
Hi ouywl, *>>Thread.currentThread().getContextClassLoader();* What does this statement mean in your program? In addition, can you share your implementation of the customized file system plugin and the related exception? Best, Vino ouywl 于2019年12月18日周三 下午4:59写道: > Hi all, > We have im

Re: Flink On K8s, build docker image very slowly, is there some way to make it faster?

2019-12-22 Thread vino yang
Hi Lake, Can you clearly count or identify which steps are taking a long time? Best, Vino LakeShen 于2019年12月23日周一 下午2:46写道: > Hi community , when I run the flink task on k8s , the first thing is that > to build the flink task jar to > Docker Image . I find that It would spend much time to buil

Re: [ANNOUNCE] Progress of Apache Flink 1.10 #3

2020-01-03 Thread vino yang
Hi Yu, Thanks for your great work. Best, Vino Congxian Qiu 于2020年1月3日周五 下午6:18写道: > Thanks for the great work, and look forward to the first RC. > > Best, > Congxian > > > Jingsong Li 于2020年1月3日周五 下午12:58写道: > > > Thanks Yu and Gary, > > > > Table and hive layer have resolved all blockers and

Re: [DISCUSS] Release Flink 1.5.1

2018-07-02 Thread vino yang
+1 2018-07-02 18:19 GMT+08:00 Chesnay Schepler : > Hello, > > it has been a little over a month since we've release 1.5.0. Since then > we've addressed 56 JIRAs [1] for the 1.5 branch, including stability > enhancement to the new execution mode (FLIP-6), fixes for critical issues > in the metric

Re: [TABLE][SQL] Enirchment/Time versioned joins support in Flink

2018-07-02 Thread vino yang
+1, great work! 2018-07-02 22:57 GMT+08:00 Rong Rong : > Huge +1!!! > > On Mon, Jul 2, 2018 at 6:07 AM Piotr Nowojski > wrote: > > > Hi, > > > > Together with Fabian, Timo and Stephan we were working on a proposal to > > add a support for time versioned joins in Flink SQL/Table API. The idea > >

Re: [VOTE] Release 1.5.1, release candidate #2

2018-07-07 Thread vino yang
+1, but announcement blog should change the release date. 2018-07-07 7:31 GMT+08:00 Ted Yu : > +1 > > Checked signatures of artifacts > > Ran test suite > > On Fri, Jul 6, 2018 at 11:42 AM Yaz Sh wrote: > > > +1 > > > > Tests have been done on OS X > > > > - Ran in cluster mode ./bin/start-clust

Re: [VOTE] Release 1.5.1, release candidate #3

2018-07-10 Thread vino yang
+1 reviewed [1], [4] and [6] 2018-07-11 3:10 GMT+08:00 Chesnay Schepler : > Hi everyone, > Please review and vote on the release candidate #3 for the version 1.5.1, > as follows: > [ ] +1, Approve the release > [ ] -1, Do not approve the release (please provide specific comments) > > > The comple

Re: Flink on Mesos - have to manually add host name to /etc/hosts

2018-07-11 Thread vino yang
Hi Alex, It seems it's a issue about finding host mapping. If you use hostname, flink will try to find the real IP address, if it can not find the host/ip mapping, will throw the exception. I think the link of the answer is a correct way of fixing this issue. Thanks. Vino. 2018-07-11 21:30 GMT

Re: Adding a part suffix setter to the BucketingSink

2018-07-12 Thread vino yang
Hi Kostas, good job! 2018-07-12 19:40 GMT+08:00 Kostas Kloudas : > Hi Lakshmi, > > Since Flink-1.5 you have the ability to set the part suffix. > As you said, you only want the .gzip to be the suffix of the final (or > “completed”) part files, which is exactly what is currently supported. > > If

Re: [ANNOUNCE] Apache Flink 1.5.1 released

2018-07-13 Thread vino yang
Thanks Chesnay, great job! Thanks, Vino 2018-07-13 20:20 GMT+08:00 Till Rohrmann : > Great to hear. Big thank you to the community for the hard work and to > Chesnay for being our release manager. > > Cheers, > Till > > On Fri, Jul 13, 2018 at 12:05 PM Chesnay Schepler > wrote: > >> The Apache

Re: Flink Query Optimizer

2018-07-13 Thread vino yang
Hi Albert, First I guess the query optimizer you mentioned is about Flink table & sql (for batch API there is another optimizer which is implemented by Flink). Yes, now for table & sql, Flink use Apache Calcite's query optimizer to translate into a Calcite plan which is then optimized according t

Re: Flink CLI properties with HA

2018-07-16 Thread vino yang
Hi Sampath, Flink CLI need to retrieve the JobManager leader address, so it need to access the HA specific configuration. Because if based on Zookeeper to implement the HA, the leader address information will fetch from Zookeeper. The main use of config item *high-availability.storageDir* is sto

Re: Flink CLI properties with HA

2018-07-17 Thread vino yang
k client will connect to zookeeper to get > leader address and necessary information for job submission but my > confusion is with *high-availability.storageDir* and its necessity in > flink CLI configuration. > > On Mon, Jul 16, 2018 at 2:44 PM, vino yang wrote: > >> Hi Sa

Re: Flink Docker 1.5.x local mode

2018-07-22 Thread vino yang
Hi Thomas, I watched the code of docker flink v1.5[1], it just starts job manager component when you run with local mode. More information you can refer: Flink official documentation of docker deployment : https://ci.apache.org/projects/flink/flink-docs-release-1.5/ops/deployment/docker.html (out

Re: Cherry picking FLINK-9753 and FLINK-9753 on release-1.6

2018-07-23 Thread vino yang
I also see some file sink questions, so +1 for picking the PR about StreamingFileSink. Thanks, vino. 2018-07-23 20:53 GMT+08:00 Kostas Kloudas : > Thanks for the +1’s. > > I added the relevant commits to the release-1.6 branch. > > Cheers, > Kostas > > > On Jul 22, 2018, at 3:05 PM, Till Rohrman

Re: is Flink's recovery speed still slow?

2018-07-24 Thread vino yang
Hi jiaxl, The paper you mentioned was published at 2017. I think it doesn't have much reference value now. Over time, both frameworks are constantly evolving. At the end of May this year, Flink has supported the major feature of local recovery in the latest release of version 1.5. This greatly imp

Re: Intro

2018-07-24 Thread vino yang
Hi Kevin, Welcome, I think you should read the offiicial documentation to know more about Flink community.[1] And you can read this documentation to learn how to contribute.[2] [1]: http://flink.apache.org/community.html [2]: http://flink.apache.org/how-to-contribute.html Thanks, vino. 2018-07

Re: is Flink's recovery speed still slow?

2018-07-25 Thread vino yang
Hi jiaxl, Thanks for your verification! Yes, Flink is growing very fast. There is really not much benchmark or blog to explore this topic, after all, the local recovery feature is released in version 1.5. The time point is not long before, and this part is still being improved and not very mature

Re: Release roadmap

2018-07-30 Thread vino yang
Hi Artsem, As far as I know, Flink's official documentation does not have a clear Roadmap for the release version. According to the previous plan of the Flink community, a major version was released in almost two months, but this time range is not fixed. For example, the 1.5 version takes longer.

Re: [RESULT][VOTE] Release 1.5.2, release candidate #2

2018-07-31 Thread vino yang
Thanks for releasing Flink 1.5.2, Chesnay! Thanks. Vino. 2018-07-31 16:49 GMT+08:00 Till Rohrmann : > Thanks Chesnay for being our release manager and thanks to the community > for all the work! > > Cheers, > Till > > On Tue, Jul 31, 2018 at 10:17 AM Timo Walther wrote: > > > Thanks for managin

Re: Error while building 1.5.1 from source

2018-08-01 Thread vino yang
Hi shashank, Can you provide more details to assist with locating problems? Thanks, vino. 2018-08-01 15:46 GMT+08:00 shashank734 : > Facing issue with Apache flink 1.5.1 while building from source. > > MVN : 3.2.5 > > Command : mvn clean install -DskipTests -Dscala.version=2.11.7 > -Pvendor-rep

Re: [VOTE] Release 1.6.0, release candidate #2

2018-08-03 Thread vino yang
Hi Elias, Usually in order to make the release note clear and brief. It will only contain issues that have been fixed before the pre-release branch is cut. For issues that are scheduled to be processed in this version but not processed, they will be postponed to the next minor or major version. T

Re: Setting an allowable number of checkpoint failures

2018-08-03 Thread vino yang
Hi Lakshmi, Your understanding of " *CheckpointConfig#setFailOnCheckpointingErrors(false)*" is correct, If this is set to false, the task will only decline a the checkpoint and continue running. I think it is also a good choice to allow a number of failures to be set. Flink currently only support

Re: Setting an allowable number of checkpoint failures

2018-08-06 Thread vino yang
> Till > > On Sat, Aug 4, 2018 at 4:58 AM vino yang wrote: > > > Hi Lakshmi, > > > > Your understanding of " > > *CheckpointConfig#setFailOnCheckpointingErrors(false)*" is correct, If > this > > is set to false, the task will only decline a t

Re: Setting an allowable number of checkpoint failures

2018-08-06 Thread vino yang
of allowable > subsequent failures until a restart occurs. > > The reason is that every restart is a service interruption that is > potentially very expensive. > > Thanks, > Thomas > > > > > > > > On Mon, Aug 6, 2018 at 5:09 AM vino yang wrote: > > >

Re: [VOTE] Release 1.6.0, release candidate #4

2018-08-08 Thread vino yang
+1 - checkout 1.6 source code and successfully run `mvn clean package -DskipTests` - searched '1.5' and '1.5.2' in all modules pom file and successfully verified flink version was changed - successfully run table and sql test locally Thanks, vino. Timo Walther 于2018年8月9日周四 上午3:24写道: > +1 > >

Re: [ANNOUNCE] Apache Flink 1.6.0 released

2018-08-09 Thread vino yang
Congratulations! Great work! Till, thank you for advancing the smooth release of Flink 1.6. Vino. Till Rohrmann 于2018年8月9日周四 下午7:21写道: > The Apache Flink community is very happy to announce the release of Apache > Flink 1.6.0. > > Apache Flink® is an open-source stream processing framework for

Re: [DISCUSS] Improve Tutorials section of documentation

2018-08-09 Thread vino yang
+1 I have previously fixed the outdated API usage of the sample code in the documentation. In addition, the user also encountered a problem in the mailing list but the program could not be compiled or the correct result could not be obtained. We should come up with a solution to deal with the chan

Re: [DISCUSS] Release Flink 1.5.3

2018-08-15 Thread vino yang
Hi Chesnay, +1 I want to know when you plan to cut the branch. Thanks, vino. Chesnay Schepler 于2018年8月16日周四 下午2:29写道: > Hello everyone, > > it has been a little over 2 weeks since 1.5.2 was released, and since > then a number of fixes were added to the release-1.5 that I think we > should pus

Re: [DISCUSS] Release Flink 1.5.3

2018-08-16 Thread vino yang
cremental > improvements faster. > > Cheers, > Till > > On Thu, Aug 16, 2018 at 8:52 AM Chesnay Schepler > wrote: > >> I would actually start with the release process today unless anyone >> objects. >> >> On 16.08.2018 08:46, vino yang wrote: >> > Hi Ch

Re: [Proposal] Utilities for reading, transforming and creatingStreaming savepoints

2018-08-17 Thread vino yang
Hi, +1, from my side. Considering that Savepoint is not compatible with every version of Flink. It would be very useful if it could do some conversion between different versions of Flink Savepoint. Thanks, vino. bupt_ljy 于2018年8月18日周六 上午2:55写道: > Hi, > +1, I think it will be a very great tool

Re: [VOTE] Release 1.5.3, release candidate #1

2018-08-18 Thread vino yang
+1, - checkout the source code of Flink v1.5.3-rc1 and packaged (skip tests) successfully - reviewed announcement blog post and gave a little comment - ran flink-table's test successfully - checked all modules' version number is 1.5.3 Thanks, vino. Till Rohrmann 于2018年8月18日周六 上午12:25写道: > +1 (

Re: Flink 1.7 Development Priorities

2018-08-23 Thread vino yang
Hi, I think Kafka 1.0/1.1/2.0 connector can be part of the Flink 1.7 release. The current kafka 1.0 connector PR has been submitted. I am refactoring the existing kafka connector test code to reduce the amount of duplicate code. Thanks, vino. Coo1 min 于2018年8月23日周四 下午5:59写道: > Hi, > > I am con

Re: [DISCUSS] Remove the slides under "Community & Project Info"

2018-08-26 Thread vino yang
+1 The reason is the same as Hequn, because we have given a link to SlideShare under the "Flink Forward" section. Thanks, vino. Hequn Cheng 于2018年8月27日周一 上午9:31写道: > Hi Stephan, > > Thanks for bringing up this discussion. > I think we can just remove it, because slides have already be provided

Re: Cancel flink job occur exception.

2018-09-04 Thread vino yang
Hi Devin, Why do you trigger cancel with savepoint immediately after the job status changes to Deployed? A more secure way is to wait for the job to become running after it has been running for a while before triggering. We have also encountered before, there will be a case where the client times

Re: Flink1.6.0 submit job and got "No content to map due to end-of-input" Error

2018-09-04 Thread vino yang
Hi Pangongsen, Do you upgrade the Flink-related dependencies you use at the same time? In other words, is the dependency consistent with the flink version? Thanks, vino. ? ?? 于2018年9月4日周二 下午10:07写道: > Hi all, > I use below way to submit jar to Flink : > > StreamExecutionEnvironment env =

Re: [ANNOUNCE] New committer Gary Yao

2018-09-07 Thread vino yang
Congratulations Gary! Chen Qin 于2018年9月8日周六 上午2:07写道: > Congrats! > > Chen > > > On Sep 7, 2018, at 10:51, Xingcan Cui wrote: > > > > Congratulations, Gary! > > > > Xingcan > > > >> On Sep 7, 2018, at 11:20 PM, Hequn Cheng wrote: > >> > >> Congratulations Gary! > >> > >> Hequn > >> > >>> On Fr

  1   2   >