Re: [ANNOUNCE] Jiangjie (Becket) Qin has been added as a committer to the Flink project

Congrats Becket! Best, Guowei Terry Wang 于2019年7月18日周四 下午5:17写道： > Congratulations Becket! > > > 在 2019年7月18日，下午5:09，Dawid Wysakowicz 写道： > > > > Congratulations Becket! Good to have you onboard! > > > > On 18/07/2019 10:56, Till Rohrmann wrote: > >> Congrats Becket! > >> > >> On Thu, Jul 18,

Re: [ANNOUNCE] Zhijiang Wang has been added as a committer to the Flink project

Congratulations Zhijiang 发自我的 iPhone > 在 2019年7月23日，上午12:55，Xuefu Z 写道： > > Congratulations, Zhijiang! > >> On Mon, Jul 22, 2019 at 7:42 AM Bo WANG wrote: >> >> Congratulations Zhijiang! >> >> >> Best, >> >> Bo WANG >> >> >> On Mon, Jul 22, 2019 at 10:12 PM Robert Metzger >> wrote: >>

Re: [ANNOUNCE] Kete Young is now part of the Flink PMC

Congratulations Kurt! 发自我的 iPhone > 在 2019年7月23日，下午7:13，Bo WANG 写道： > > Congratulations Kurt! > > > Best, > > Bo WANG > > >> On Tue, Jul 23, 2019 at 5:24 PM Robert Metzger wrote: >> >> Hi all, >> >> On behalf of the Flink PMC, I'm happy to announce that Kete Young is now >> part of the

Re: Fine Grained Recovery / FLIP-1

Hi, 1. Currently, much work in FLINK-4256 is about failover improvements in the bouded dataset scenario. 2. For the streaming scenario, a new shuffle plugin + proper failover strategy could avoid the "stop-the-word" recovery. 3. We have already done many works about the new shuffle in the old Flin

Re: [VOTE] Apache Flink Release 1.9.0, release candidate #2

Hi, -1 We have a benchmark job, which includes a two-input operator. This job has a big performance regression using 1.9 compared to 1.8. It's still not very clear why this regression happens. Best, Guowei Yu Li 于2019年8月16日周五 下午3:27写道： > +1 (non-binding) > > - checked release notes: OK > - che

Re: [VOTE] Apache Flink Release 1.9.0, release candidate #2

t; > Cheers, > Till > > On Fri, Aug 16, 2019 at 10:27 AM Guowei Ma wrote: > > > Hi, > > -1 > > We have a benchmark job, which includes a two-input operator. > > This job has a big performance regression using 1.9 compared to 1.8. > > It's still not

Re: [DISCUSS] Enhance Support for Multicast Communication Pattern

Thanks Yun for bringing up this discussion and very thanks for all the deep thoughts! For now, I think this discussion contains two scenarios: one if for iteration library support and the other is for SQL join support. I think both of the two scenarios are useful but they seem to have different be

Re: [ANNOUNCE] Zili Chen becomes a Flink committer

Congratulations Zili ! Best, Guowei Fabian Hueske 于2019年9月11日周三 下午7:02写道： > Congrats Zili Chen :-) > > Cheers, Fabian > > Am Mi., 11. Sept. 2019 um 12:48 Uhr schrieb Biao Liu : > >> Congrats Zili! >> >> Thanks, >> Biao /'bɪ.aʊ/ >> >> >> >> On Wed, 11 Sep 2019 at 18:43, Oytun Tez wrote: >> >>>

Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog

+1（binding） Best, Guowei On Wed, Jul 19, 2023 at 11:18 AM Hang Ruan wrote: > +1 (non-binding) > > Thanks for driving. > > Best, > Hang > > Leonard Xu 于2023年7月19日周三 10:42写道： > > > Thanks Dong for the continuous work. > > > > +1(binding) > > > > Best, > > Leonard > > > > > On Jul 18, 2023, at 10

Re: [DISCUSS] FLIP-383: Support Job Recovery for Batch Jobs

Hi, This is a very good proposal, as far as I know, it can solve some very critical production operations in certain scenarios. I have two minor issues: As far as I know, there are multiple job managers on standby in some scenarios. In this case, is your design still effective? I'm unsure if you

Re: [VOTE] Accept Flink CDC into Apache Flink

+1 (binding) Best, Guowei On Tue, Jan 9, 2024 at 4:49 PM Rui Fan <1996fan...@gmail.com> wrote: > +1 (non-binding) > > Best, > Rui > > On Tue, Jan 9, 2024 at 4:41 PM Hang Ruan wrote: > > > +1 (non-binding) > > > > Best, > > Hang > > > > gongzhongqiang 于2024年1月9日周二 16:25写道： > > > > > +1 non-bind

Re: [ANNOUNCE] Jingsong Lee becomes a Flink committer

Congratulations !! Best, Guowei Yun Tang 于2020年2月27日周四 上午2:11写道： > Congratulations and well deserved! > > > Best > Yun Tang > > From: Canbin Zheng > Sent: Monday, February 24, 2020 16:07 > To: dev > Subject: Re: [ANNOUNCE] Jingsong Lee becomes a Flink committe

Re: [DISCUSS] Drop Bucketing Sink

+1 to drop it. To Jingsong : we are planning to implement the orc StreamingFileSink in 1.11. I think users also could reference the old BucktSink from the old version. Best, Guowei Jingsong Li 于2020年3月13日周五 上午10:07写道： > Hi Robert, > > +1 to drop it but maybe not 1.11. > > ORC has not been sup

Re: [DISCUSS] FLIP-115: Filesystem connector in Table

Hi, I am very interested in the topic. I would like to join the offline discussion if possible. I think you guys already give many inputs and concerns. I would share some of my thoughts. Correct me if I misunderstand you. Flink is a unified engine. Since that Flink should provide the e2e exactly

Re: [ANNOUNCE] New Committers and PMC member

Congratulations! Best, Guowei Dawid Wysakowicz 于2020年4月7日周二 下午2:50写道： > Thank you all for the support! > > Best, > > Dawid > > On 02/04/2020 04:33, godfrey he wrote: > > Congratulations to all of you~ > > > > Best, > > Godfrey > > > > Ismaël Mejía 于2020年4月2日周四 上午6:42写道： > > > >> Congrats ever

Re: [ANNOUNCE] New Apache Flink PMC Member - Hequn Chen

Congratulations! Best, Guowei Xintong Song 于2020年4月17日周五 下午5:21写道： > Congratulations, Hequn~! > > Thank you~ > > Xintong Song > > > > On Fri, Apr 17, 2020 at 4:50 PM godfrey he wrote: > > > Congratulations, Hequn! > > > > Best, > > Godfrey > > > > Leonard Xu 于2020年4月17日周五 下午4:30写道： > > > > >

Re: [ANNOUNCE] Becket Qin joins the Flink PMC

Congratulations, Becket! Best, Guowei Steven Wu 于2019年11月1日周五 上午6:20写道： > Congratulations, Becket! > > On Wed, Oct 30, 2019 at 9:51 PM Shaoxuan Wang wrote: > > > Congratulations, Becket! > > > > On Mon, Oct 28, 2019 at 6:08 PM Fabian Hueske wrote: > > > > > Hi everyone, > > > > > > I'm happy

Re: [ANNOUNCE] Zhu Zhu becomes a Flink committer

Congrats Zhuzhu! Best, Guowei Zhenghua Gao 于2019年12月16日周一 上午10:47写道： > Congrats! > > *Best Regards,* > *Zhenghua Gao* > > > On Mon, Dec 16, 2019 at 10:36 AM Biao Liu wrote: > > > Congrats Zhu Zhu! > > > > Thanks, > > Biao /'bɪ.aʊ/ > > > > > > > > On Mon, 16 Dec 2019 at 10:23, Congxian Qiu > w

Re: Understanding watermark

Hi, Cam, I think you might want to know why the web page does not show the watermark of the source. Currently, the web only shows the "input" watermark. The source only outputs the watermark so the web shows you that there is "No Watermark". Actually Flink has "output" watermark metrics. I think F

Re: Understanding watermark

since the source doesn't have input watermark show it show > "No Watermark" ? And we should have output watermark for source? > > And, yes we want to understand when we should expect to see watermarks for > our "combined" sources (bounded and un-bounded) for our pi

Re: [ANNOUNCE] Yu Li became a Flink committer

Congratulations Best, Guowei 刘建刚 于2020年1月24日周五 下午5:56写道： > Congratulations！ > > > 2020年1月23日 下午4:59，Stephan Ewen 写道： > > > > Hi all! > > > > We are announcing that Yu Li has joined the rank of Flink committers. > > > > Yu joined already in late December, but the announcement got lost because >

Re: [VOTE] FLIP-27 - Refactor Source Interface

+1 (non-binding), thanks for driving. Best, Guowei Jingsong Li 于2020年2月4日周二 上午11:20写道： > +1 (non-binding), thanks for driving. > FLIP-27 is the basis of a lot of follow-up work. > > Best, > Jingsong Lee > > On Tue, Feb 4, 2020 at 10:26 AM Jark Wu wrote: > > > Thanks for driving this Becket! >

Re: [DISCUSS] FLIP-27: Refactor Source Interface

Hi, Thanks Aljoscha for this FLIP. 1. I agree with Piotr and Becket that the non-blocking source is very important. But in addition to `Future/poll`, there may be another way to achieve this. I think it may be not very memory friendly if every advance call return a Future. public interface Listen

Re: [DISCUSS] FLIP-27: Refactor Source Interface

> to > >>> be a source API concern. In fact, that's what we are working on right > now > >>> as improvement to the existing consumer: Each shard consumer thread > will > >>> push to a queue, the consumer main thread will poll the queue(s). It is >

Re: [DISCUSS]Enhancing flink scheduler by implementing blacklist mechanism

thanks yingjie to share this doc and I think this is very important feature for production. As you mentioned in your document, an unhealthy node can cause a TM startup failure but cluster management may offer the same node for some reason. (I have encountered such a scenario in our production env

Re: [DISCUSS] Unified Core API for Streaming and Batch

Hi, all Thanks to Haibo for initiating this discussion in the community. - Relationship of DataStream, DataSet, and Table API Table/DataStream/Dataset does have different aspects. For example, DataStream can access State and Table cannot. DataStream can be easily extended by users because they d

Re: [DISCUSS] Start a user...@flink.apache.org mailing list for the Chinese-speaking community?

+1 This not only helps Chinese users but also helps the community to collect more feedback and scenarios. > 在 2019年1月25日，上午2:29，Zhang, Xuefu 写道： > > +1 on the idea. This will certainly help promote Flink in China industries. > On a side note, it would be great if anyone in the list can help

Re: [DISCUSS] Shall we make SpillableSubpartition repeatedly readable to support fine grained recovery

Thanks to zhijiang for a detailed explanation. I would do some supplements Blink has indeed solved this particular problem. This problem can be identified in Blink and the upstream will be restarted by Blink thanks zhijiang 于2019年1月25日周五 下午12:04写道： > Hi Bo, > > Your mentioned problems can be sum

[DISCUSS] Enhance Operator API to Support Dynamically Selective Reading and EndOfInput Event

2. Notify "StreamOperator" that an input has ended. This proposal was discussed with Piotr Nowojski, Kostas Kloudas, Haibo Sun offlline. It will be great to hear the feed backs and suggestions from the community. Please kindly share your comments and suggestions. Best GuoWei Ma. Enhance Ope

Re: [DISCUSS] Enhance Operator API to Support Dynamically Selective Reading and EndOfInput Event

put, so they should still work if an input ends. > There are cases where some state in the operator that is only relevant as > long as an input still has data (like in symmetric joins) and the timers > are relevant to that state. > When the state is dropped, the timers should also b

Re: [DISCUSS] FLIP-33: Terminate/Suspend Job with Savepoint

thanks for starting this discussion. It is a very cool feature. +1 for the FLIP Best Guowei jincheng sun 于2019年2月13日周三 上午9:35写道： > Thank you for starting the discussion about cancel-with-savepoint Kostas. > > +1 for the FLIP. > > Cheers, > Jincheng > > Fabian Hueske 于2019年2月13日周三 上午4:31写道： >

Re: [DISCUSS] Enhance Operator API to Support Dynamically Selective Reading and EndOfInput Event

ike some cleanup of the > > Operator Config or the Operator Chain? > > > > Best, > > Stephan > > > > > > On Sun, Feb 10, 2019 at 7:25 AM Guowei Ma wrote: > > > >> 2019.2.10 > >> > >> > >> Hi,Stephan > >> >

Re: [ANNOUNCE] Apache Flink 1.8.0 released

Congratulations! Thanks Aljoscha and all contributors! Best, Guowei Jark Wu 于2019年4月10日周三 下午5:47写道： > Cheers! > > Thanks Aljoscha and all others who make 1.8.0 possible. > > On Wed, 10 Apr 2019 at 17:33, vino yang wrote: > > > Great news! > > > > Thanks Aljoscha for being the release manage

Re: [PROGRESS-UPDATE] Redesign Flink Scheduling, introducing dedicated Scheduler Component

Thanks Gary for sharing the documents to the community. The idea makes scheduler more flexible. Best, Guowei Till Rohrmann 于2019年4月13日周六 上午12:21写道： > Thanks for sharing the current state of the scheduler refactorings with the > community Gary. The proposed changes look good to me and, hence, +

Re: [ANNOUNCE] Jincheng Sun is now part of the Flink PMC

Congratulations, Jincheng ! Best, Guowei zhisheng <173855...@qq.com> 于2019年6月25日周二 下午6:32写道： > Congratulations, Jincheng > > > > ---Original--- > From: "Fan Liya" > Date: Tue, Jun 25, 2019 18:23 PM > To: "dev"; > Subject: Re: [ANNOUNCE] Jincheng Sun is now part of the Flink PMC > > > Congratula

Re: DataStream of Future

Hi,Albert I think that the futures may be lost if the machine is down for some reasons. So simply using the futures may not be acceptable in production. I hope this is helpful. Thanks > 在 2016年9月16日，下午3:01，alghimo 写道： > > Hi Timo, > > Thank you for the fast reply :) I will check and follow th

Re: [VOTE] FLIP-131: Consolidate the user-facing Dataflow SDKs/APIs (and deprecate the DataSet API)

+1 Looking forward to having a unified datastream api. Best, Guowei On Thu, Sep 3, 2020 at 3:46 PM Dawid Wysakowicz wrote: > +1 > > I think it gives a clear idea why we should deprecate and eventually > remove the DataSet API. > > Best, > > Dawid > > On 03/09/2020 09:37, Yun Gao wrote: > > Very

[DISCUSS] FLIP-143: Unified Sink API

Hi, devs & users As discussed in FLIP-131[1], Flink will deprecate the DataSet API in favor of DataStream API and Table API. Users should be able to use DataStream API to write jobs that support both bounded and unbounded execution modes. However, Flink does not provide a sink API to guarantee the

Re: [DISCUSS] FLIP-143: Unified Sink API

Hi all, Very thanks for the discussion and the valuable opinions! Currently there are several ongoing issues and we would like to show what we are thinking in the next few mails. It seems that the biggest issue now is about the topology of the sinks. Before deciding what the sink API would look

Re: [DISCUSS] FLIP-143: Unified Sink API

sink > framework or not. > > > A alternative topology option for the IcebergSink might be : > DataFileWriter > -> Agg -> GlobalCommitter. One pro of this method is that we can let Agg > take care of the cleanup instead of coupling the cleanup logic to the > committer. &

Re: [DISCUSS] FLIP-143: Unified Sink API

. Maybe I miss something but I do not get why the second alternative would depend on `flink-runtime` or `flink-streaming-java`. The all the state api currently is in the flink-core. Could you give some further explanation? thanks :) Best, Guowei On Tue, Sep 15, 2020 at 12:05 PM Guowei Ma wrote:

Re: [DISCUSS] FLIP-143: Unified Sink API

>> I would think that we only need flush() and the semantics are that it >> prepares for a commit, so on a physical level it would be called from >> "prepareSnapshotPreBarrier". Now that I'm thinking about it more I >> think flush() should be renamed to something like "prepareCommit()". > Generall

Re: [DISCUSS] FLIP-143: Unified Sink API

non-global)? Again it might be just me not getting the > example. > > I've just briefly skimmed over the proposed interfaces. I would suggest one > addition to the Writer interface (as I understand this is the runtime > interface in this proposal?): add some availability method, to

Re: [DISCUSS] FLIP-143: Unified Sink API

not see the file-1-2 when ck1 happens in the > ExactlyOnce mode. > > @Guowei Ma I think you are right for exactly once > checkpoint semantics. what about "at least once"? I guess we can argue that > it is fine to commit file-1-2 for at least once mode. > > I stil

Re: [DISCUSS] FLIP-143: Unified Sink API

Wed, Sep 16, 2020 at 12:02 PM Guowei Ma wrote: > > Hi, Steven > Thanks you for your thoughtful ideas and concerns. > > >>I still like the concept of grouping data files per checkpoint for > streaming mode. it is cleaner and probably easier to manage and deal with > commit

Re: [ANNOUNCE] New Apache Flink Committer - Godfrey He

Congratulations :) Best, Guowei On Wed, Sep 16, 2020 at 12:19 PM Jark Wu wrote: > Hi everyone, > > It's great seeing many new Flink committers recently, and on behalf of the > PMC, > I'd like to announce one more new committer: Godfrey He. > > Godfrey is a very long time contributor in the Fli

Re: Re: [ANNOUNCE] New Apache Flink Committer - Igal Shilman

Congratulations :) Best, Guowei On Wed, Sep 16, 2020 at 11:54 AM Zhijiang wrote: > Congratulations and welcome, Igal! > > > -- > From:Yun Gao > Send Time:2020年9月16日(星期三) 10:59 > To:Stephan Ewen ; dev > Subject:Re: Re: [ANNOUNCE]

Re: [ANNOUNCE] New Apache Flink Committer - Yun Tang

Congratulations :) Best, Guowei On Wed, Sep 16, 2020 at 11:54 AM Zhijiang wrote: > Congratulations and welcome, Yun! > > > -- > From:Jark Wu > Send Time:2020年9月16日(星期三) 11:35 > To:dev > Cc:tangyun ; Yun Tang > Subject:Re: [ANNO

Re: [ANNOUNCE] New Apache Flink Committer - Niels Basjes

Congratulations :) Best, Guowei On Tue, Sep 15, 2020 at 6:14 PM Matthias Pohl wrote: > Congrats! > > Best, > Matthias > > On Tue, Sep 15, 2020 at 9:26 AM Dawid Wysakowicz > wrote: > > > Welcome, Niels! > > > > Best, > > > > Dawid > > > > On 14/09/2020 11:22, Matt Wang wrote: > > > Congratulat

Re: [ANNOUNCE] New Apache Flink Committer - Arvid Heise

Congratulations :) Best, Guowei On Tue, Sep 15, 2020 at 6:41 PM 刘建刚 wrote: > Congratulations! > > Best > > Matthias Pohl 于2020年9月15日周二 下午6:07写道： > > > Congratulations! ;-) > > > > On Tue, Sep 15, 2020 at 11:47 AM Xingbo Huang > wrote: > > > > > Congratulations! > > > > > > Best, > > > Xingbo

Re: Re: [VOTE] FLIP-134: Batch execution for the DataStream API

+1 (non-binding) Best, Guowei On Wed, Sep 16, 2020 at 3:03 PM Yun Gao wrote: > +1 (non-binding) > > Very thanks for bring this up! And the FLIP is indeed necessary for stream > & batch unification. > > -- > Sender:Dawid Wysakowicz

Re: [DISCUSS] FLIP-143: Unified Sink API

as is the network stack in the most part and as > are the FLIP-27 sources), we will be able to snapshot state of the operator > immediately. For example, change from blocking to non blocking sources was > speeding up unaligned checkpoints from ~30seconds down to ~5seconds in >

Re: [DISCUSS] FLIP-143: Unified Sink API

> > blocking some things from happening (checkpointing, closing, ...). If we > > make sinks non blocking (as is the network stack in the most part and as > > are the FLIP-27 sources), we will be able to snapshot state of the > operator > > immediately. For example, c

Re: Re: [ANNOUNCE] Apache Flink 1.11.2 released

Thanks Zhuzhu for driving the release!!! Best, Guowei On Fri, Sep 18, 2020 at 5:10 PM Yun Gao wrote: > Great! Very thanks @ZhuZhu for driving this and thanks for all contributed > to the release! > > Best, > Yun > > --Original Mail -- > *Sender:*Jingsong Li >

Re: [DISCUSS] FLIP-143: Unified Sink API

Hi, all >>Just to add to what Aljoscha said regarding the unique id. Iceberg sink >>checkpoints the unique id into state during snapshot. It also inserts the >>unique id into the Iceberg snapshot metadata during commit. When a job >>restores the state after failure, it needs to know if the restore

Re: [DISCUSS] FLIP-143: Unified Sink API

n jobmanager (e.g. like sink coordinator) >2. help with checkpointing, bookkeeping, commit failure handling, >recovery > > > @Guowei Ma regarding the GlobalCommitter > interface, I have some clarifying questions. > > > void recoveredGlobalCommittables(List globalCommits

Re: [DISCUSS] FLIP-143: Unified Sink API

sformation createWriteTopology(); CommitFunction createCommitter(); } Best, Guowei On Sun, Sep 20, 2020 at 6:09 PM Guowei Ma wrote: > Hi, Stevn > I want to make a clarification first, the following reply only considers > the Iceberge sink, but does not consider other sinks. Before

Re: [DISCUSS] FLIP-143: Unified Sink API

Thanks @aljoscha summary. I agree we should postpone the discussion of the sink topology first and focus on the normal file sink and IcebergSink in the Flink 1.12. I have three little questions: 1. I think maybe we could add a EOI interface to the `GlobalCommit`. So that we could make `write succ

Re: [DISCUSS] FLIP-143: Unified Sink API

am not sure adding `isAvailable` is enough. Maybe it is not. But for the initial version I hope we could make the sink api sync because there is already a lot of stuff that has to finish. :--) What do you think? Best, Guowei On Tue, Sep 22, 2020 at 5:25 PM Aljoscha Krettek wrote: > On 22.09.20 1

Re: [DISCUSS] FLIP-143: Unified Sink API

the commit is successful so that the next checkpoint won't include the > >> committed GlobalCommT. > >> > >> Maybe GlobalCommitter can have an API like this? > >>> List snapshotState(); > >> > >> But then we still need the recover API if we d

Re: [DISCUSS] FLIP-143: Unified Sink API

3, 2020 at 12:03 PM Guowei Ma wrote: > >> I think we should go with something like > > >> List filterRecoveredCommittables(List<>) > > >> to keep things simple. This should also be easy to do from the framework > >> side and then the sink doesn&#x

Re: [DISCUSS] FLIP-143: Unified Sink API

s and then vote. > > Best, > Aljoscha > > On 23.09.20 06:13, Guowei Ma wrote: > > Hi, all > > > > Thank everyone very much for your ideas and suggestions. I would try to > > summarize again the consensus :). Correct me if I am wrong or > misunderstand > >

[VOTE] FLIP-143: Unified Sink API

Hi, all After the discussion in [1], I would like to open a voting thread for FLIP-143 [2], which proposes a unified sink api. The vote will be open until September 29th (72h + weekend), unless there is an objection or not enough votes. [1] https://lists.apache.org/thread.html/rf09dfeeaf35da5ee9

Re: [DISCUSS] FLIP-143: Unified Sink API

Since getWriterStateSerializer() returns Optional, that is clear and > we can return Optional.empty(). > > Thanks, > Steven > > On Wed, Sep 23, 2020 at 6:59 PM Guowei Ma wrote: > > > Thanks Aljoscha for your suggestion. I have updated FLIP. Any comments > are > >

Re: [DISCUSS] FLIP-143: Unified Sink API

(). Yes I think you could do it. If you return Optional.empty() we would ignore all the state you return. Best, Guowei On Fri, Sep 25, 2020 at 3:14 PM Guowei Ma wrote: > Hi,Steven > > Thank you for reading the FLIP so carefully. > 1. The frame can not know which `GlobalCommT` to ret

Re: [DISCUSS] FLIP-143: Unified Sink API

ere. Sorry for the inconvenience. [1]https://cwiki.apache.org/confluence/x/KEJ4CQ Best, Guowei On Fri, Sep 25, 2020 at 3:26 PM Guowei Ma wrote: > Hi, Steven > > >>I also have a clarifying question regarding the WriterStateT. Since > >>IcebergWriter won't need to checkpoint a

Re: [VOTE] FLIP-143: Unified Sink API

inconvenience. [1] https://lists.apache.org/thread.html/rf09dfeeaf35da5ee98afe559b5a6e955c9f03ade0262727f6b5c4c1e%40%3Cdev.flink.apache.org%3E [2] https://cwiki.apache.org/confluence/x/KEJ4CQ Best, Guowei On Thu, Sep 24, 2020 at 8:13 PM Guowei Ma wrote: > Hi, all > > After the discuss

Re: [DISCUSS] FLIP-143: Unified Sink API

items. we > don't > > want to commit them one by one. It is faster to commit the whole list as > > one batch. > > > > > 3. On the other hand, I think only when restoring IcebergSink needs a > > > collection of `GlobalCommT` and giving back another collect

Re: [VOTE] FLIP-143: Unified Sink API

ep 27, 2020 at 7:56 PM Steven Wu > wrote: > > > > > > > > +1 (non-binding) > > > > > > > > Although I would love to continue the discussion for tweaking the > > > > CommitResult/GlobaCommitter interface maybe during the implementation > > &g

Re: Re: [ANNOUNCE] New PMC member: Zhu Zhu

Congratulations Zhu Zhu! Best, Guowei On Tue, Oct 6, 2020 at 5:47 AM Fabian Hueske wrote: > Congrats and welcome Zhu! > > Best, Fabian > > Am Mo., 5. Okt. 2020 um 14:33 Uhr schrieb Yun Gao > : > > > Congratulations Zhu! > > > > Best, > > Yun--

Re: [VOTE] FLIP-143: Unified Sink API

, 2020 at 10:11 AM Guowei Ma wrote: > Hi all, > > The voting time for FLIP-143 [1] has passed. I'm closing the vote now. > > There were 5 votes, 4 of which are binding: > > - Aljoscha Krettek (binding) > - Steven Wu > - Kostas Kloudas (binding) > - Jingsong Li

Re: [VOTE] Remove flink-connector-filesystem module.

+1 Best, Guowei On Fri, Oct 30, 2020 at 6:02 PM Aljoscha Krettek wrote: > +1 > > Aljoscha > > On 29.10.20 09:18, Kostas Kloudas wrote: > > Hi all, > > > > Following the discussion in [1], I would like to start a vote on > > removing the flink-connector-filesystem module which includes the > > B

Re: [ANNOUNCE] New Apache Flink Committer - Congxian Qiu

Congratulations! Congxian Best, Guowei On Wed, Nov 4, 2020 at 10:36 AM godfrey he wrote: > Congratulations! Congxian > > Best, > Godfrey > > Fabian Hueske 于2020年11月2日周一 下午7:00写道： > > > Congrats Congxian! > > > > Cheers, Fabian > > > > Am Mo., 2. Nov. 2020 um 10:33 Uhr schrieb Yang Wang < > da

Re: [VOTE] Release 1.12.0, release candidate #3

+1(non-binding) - build from source - build a docker image - start a session from local k8s cluster - submit a wordcount job in streaming mode. - submit a wordcount job in batch mode. Best, Guowei On Sat, Dec 5, 2020 at 3:13 PM Zhu Zhu wrote: > +1 (binding) > > - verified signature and checksum

Re: [ANNOUNCE] Apache Flink 1.12.0 released

Congratulations to everyone who contributed! Thanks for being our release managers Dian and Robert! Best, Guowei On Mon, Dec 14, 2020 at 11:41 AM Yang Wang wrote: > Congratulations! > Thanks Robert and Dian for being our release manager and everyone who > contributed. > > > Best, > Yang > > Zh

Re: [DISCUSS] Releasing Apache Flink 1.12.1

Thanks for driving this release Xintong. I think https://issues.apache.org/jira/browse/FLINK-20652 should be addressed. Best, Guowei On Fri, Dec 18, 2020 at 11:53 AM Jingsong Li wrote: > Thanks for volunteering as our release manager Xintong. +1 for releasing > Flink 1.12.1 soon. > > I think h

Re: [DISCUSS] FLIP-266: Simplify network memory configurations for TaskManager

Hi, Thank you very much for driving this FLIP in order to improve user usability. I understand that a key goal of this FLIP is to adjust the memory requirements of shuffle to a more reasonable range. Through this adaptive range adjustment, the memory efficiency can be improved under the premise of

Re: [ANNOUNCE] New Apache Flink Committer - Lincoln Lee

Congratulations, Lincoln! Best, Guowei On Tue, Jan 10, 2023 at 2:57 PM Biao Geng wrote: > Congrats, Lincoln! > Best, > Biao Geng > > 获取 Outlook for iOS > > 发件人: Wencong Liu > 发送时间: Tuesday, January 10, 2023 2:39:47 PM > 收件人: dev@flink.ap

Re: Re: [ANNOUNCE] New Apache Flink Committer - Weijie Guo

Congratulations!!! Weijie Best, Guowei On Tue, Feb 14, 2023 at 1:49 PM Dian Fu wrote: > Congratulations, Weijie! > > Regards, > Dian > > On Mon, Feb 13, 2023 at 10:55 PM Matthias Pohl > wrote: > > > Congrats, Weijie! :-) > > > > On Mon, Feb 13, 2023 at 10:50 AM Sergey Nuyanzin > > wrote: > >

Re: [ANNOUNCE] New Apache Flink Committer - Jing Ge

Congratulations! Best, Guowei On Tue, Feb 14, 2023 at 5:11 PM Leonard Xu wrote: > Congratulations!! Jing > > Best, > Leonard > > > On Feb 14, 2023, at 4:33 PM, Hang Ruan wrote: > > > > Congratulations Jing! > > > > Shammon FY 于2023年2月14日周二 16:04写道： > > > >> Congratulations Jing! > >> > >> Bes

[ANNOUNCE] New Apache Flink PMC Member - Dong Lin

Hi, everyone On behalf of the PMC, I'm very happy to announce Dong Lin as a new Flink PMC. Dong is currently the main driver of Flink ML. He reviewed a large number of Flink ML related PRs and also participated in many Flink ML improvements, such as "FLIP-173","FLIP-174" etc. At the same

Re: [ANNOUNCE] New Apache Flink Committer - Rui Fan

Congratulations, Rui! Best, Guowei On Tue, Feb 21, 2023 at 2:57 PM Wei Zhong wrote: > Congratulations, Rui! > > Best, > Wei > > > 2023年2月21日 下午1:52，Shammon FY 写道： > > > > Congratulations, Rui! > > > > > > Best, > > Shammon > > > > On Tue, Feb 21, 2023 at 1:40 PM Sergey Nuyanzin > wrote: > >

Re: [ANNOUNCE] New Apache Flink Committer - Anton Kalashnikov

Congratulations, Anton! Best, Guowei On Tue, Feb 21, 2023 at 1:52 PM Shammon FY wrote: > Congratulations, Anton! > > Best, > Shammon > > On Tue, Feb 21, 2023 at 1:41 PM Sergey Nuyanzin > wrote: > > > Congratulations, Anton! > > > > On Tue, Feb 21, 2023 at 4:53 AM Weihua Hu > wrote: > > > > >

Re: [ANNOUNCE] New Apache Flink Committer - Yuxia Luo

congratulations Yuxia Best, Guowei On Mon, Mar 13, 2023 at 10:43 AM Junrui Lee wrote: > Congratulations, Yuxia! > > Best, > Junrui > > Yanfei Lei 于2023年3月13日周一 10:42写道： > > > Congratulations, Yuxia! > > > > Best, > > Yanfei > > > > > > Samrat Deb 于2023年3月13日周一 10:41写道： > > > > > > congratulat

Re: [ANNOUNCE] Flink Table Store Joins Apache Incubator as Apache Paimon(incubating)

Congratulations! Best, Guowei On Tue, Mar 28, 2023 at 12:02 PM Yuxin Tan wrote: > Congratulations！ > > Best, > Yuxin > > > Guanghui Zhang 于2023年3月28日周二 11:06写道： > >> Congratulations！ >> >> Best, >> Zhang Guanghui >> >> Hang Ruan 于2023年3月28日周二 10:29写道： >> >> > Congratulations! >> > >> > Best,

Re: [VOTE] Apache Flink ML Release 2.2.0, release candidate #2

Hi Dong, Thanks for driving this release! +1 (binding) * Checked JIRA release notes * Verified signature and checksum for the source * Download the source code and build the code with JDK8 * Browsed through README.md files. Best, Guowei On Fri, Apr 14, 2023 at 2:48 PM Zhipeng Zhang wrote: >

Re: [DISCUSS] FLIP-408: [Umbrella] Introduce DataStream API V2

Hi,weijie Thank you very much to Weijie for proposing this series of improvements, especially the complete decoupling of user interface and implementation. This part is actually a very serious problem that disturbs downstream users in the community. I hope this problem can be completely solved in

Re: [DISCUSS] FLIP-408: [Umbrella] Introduce DataStream API V2

ing. > > But for the Table API, it relies on the original DataStream(i.e. DataStream > V1), so the implementation is not decoupled from the API. > > In the future, we will consider building the Table API on top of DataStream > API V2, which solves this problem also. > > > Best

Re: [VOTE] FLIP-408: [Umbrella] Introduce DataStream API V2

+1(binding) Best, Guowei On Tue, Feb 27, 2024 at 10:06 AM Rui Fan <1996fan...@gmail.com> wrote: > +1(binding) > > Best, > Rui > > On Tue, Feb 27, 2024 at 9:43 AM weijie guo > wrote: > > > +1(binding) > > > > Best regards, > > > > Weijie > > > > > > Xintong Song 于2024年2月27日周二 09:36写道： > > > > >

Re: [VOTE] FLIP-410: Config, Context and Processing Timer Service of DataStream API V2

+1 (binding) Best, Guowei On Tue, Feb 27, 2024 at 10:09 AM Xuannan Su wrote: > +1 (non-binding) > > Best, > Xuannan > > On Tue, Feb 27, 2024 at 9:37 AM Xintong Song > wrote: > > > > +1 (binding) > > > > Best, > > > > Xintong > > > > > > > > On Mon, Feb 26, 2024 at 6:10 PM weijie guo > > wrote

Re: [VOTE] FLIP-409: DataStream V2 Building Blocks: DataStream, Partitioning and ProcessFunction

+1 (binding) Best, Guowei On Tue, Feb 27, 2024 at 10:08 AM Rui Fan <1996fan...@gmail.com> wrote: > +1(binding) > > Best, > Rui > > On Tue, Feb 27, 2024 at 9:44 AM weijie guo > wrote: > > > +1(binding) > > > > Best regards, > > > > Weijie > > > > > > Xintong Song 于2024年2月27日周二 09:38写道： > > > >

Re: Re: [ANNOUNCE] Apache Paimon is graduated to Top Level Project

Congratulations! Best, Guowei On Mon, Apr 1, 2024 at 11:15 AM Feng Jin wrote: > Congratulations! > > Best, > Feng Jin > > On Mon, Apr 1, 2024 at 10:51 AM weijie guo > wrote: > >> Congratulations! >> >> Best regards, >> >> Weijie >> >> >> Hang Ruan 于2024年4月1日周一 09:49写道： >> >> > Congratulations

Re: [ANNOUNCE] New Apache Flink PMC Member - Weijie Guo

Congratulations! Best, Guowei On Tue, Jun 4, 2024 at 4:55 PM gongzhongqiang wrote: > Congratulations Weijie! Best, > Zhongqiang Gong > > Xintong Song 于2024年6月4日周二 14:46写道： > > > Hi everyone, > > > > On behalf of the PMC, I'm very happy to announce that Weijie Guo has > joined > > the Flink PM

Re: [ANNOUNCE] New Apache Flink Committer - Martijn Visser

Congrats Martijn! Best, Guowei On Fri, Mar 11, 2022 at 10:36 PM Marios Trivyzas wrote: > Congrats Martijn!! > > Best, > Marios > > On Thu, Mar 10, 2022 at 4:50 PM yu'an huang wrote: > > > Congrats, Martijn! > > > > > > Best > > Yuan > > > > > > > On 3 Mar 2022, at 11:49 PM, Robert Metzger > w

Re: [ANNOUNCE] New scalafmt formatter has been merged

Hi, Francesco Thanks for your work! Best, Guowei On Wed, Apr 13, 2022 at 5:35 PM Dian Fu wrote: > Thanks a lot for this great work Francesco! > > Regards, > Dian > > On Wed, Apr 13, 2022 at 3:23 PM Marios Trivyzas wrote: > > > Thank you for this Francesco! > > > > It will really improve the li

Re: [VOTE] Release 1.15.0, release candidate #3

+1(binding) - Verified the signature and checksum of the release binary - Run the SqlClient example - Run the WordCount example - Compile from the source and success Best, Guowei On Mon, Apr 18, 2022 at 11:13 AM Xintong Song wrote: > +1 (binding) > > - verified signature and checksum > - buil

Re: Re: [VOTE] Release 1.15.0, release candidate #4

+1 (binding) 1. Build from the source 2. Verify the checksums and signatures 3. Start a local standalone cluster 4. Submit a streaming example job and stop it on the ui. 5. Submit a job running with batch mode. Best, Guowei On Tue, Apr 26, 2022 at 10:56 AM Zhu Zhu wrote: > +1 (binding) > - Ch

Re: Re: [DISCUSS] FLIP-168: Speculative execution for Batch Job

Hi, zhu Many thanks to zhuzhu for initiating the FLIP discussion. Overall I think it's ok, I just have 3 small questions 1. How to judge whether the Execution Vertex belongs to a slow task. The current calculation method is: the current timestamp minus the timestamp of the execution deployment. I

Re: Failed Unit Test on Master Branch

Hi Haizhou I ran the test and there is no problem. And commit is "d940af688be90c92ce4f8b9ca883f6753c94aa0f" Best, Guowei On Fri, Apr 29, 2022 at 5:39 AM Haizhou Zhao wrote: > Hello Flink Community, > > I was encountering some unit test failure in the flink-avro sub-module when > I tried to pu

Re: [ANNOUNCE] Apache Flink 1.15.0 released

Hi, Yun Great job! Thank you very much for your efforts to release Flink-1.15 during this time. Thanks also to all the contributors who worked on this release! Best, Guowei On Thu, May 5, 2022 at 3:24 PM Peter Schrott wrote: > Great! > > Will install it on the cluster asap! :) > > One thing I

  1   2   3   4   >