Re: Possibility of supporting Reactive mode for native Kubernetes application mode

2021-11-03 Thread Nicolaus Weidner
the company’s email box. Sorry for the confusion. > > > > > > Best Regards, > > Fuyao > > > > *From: *David Morávek > *Date: *Tuesday, November 2, 2021 at 05:53 > *To: *Fuyao Li > *Cc: *user , Yang Wang , > Robert Metzger , tonysong...@gmail.com <

Re: Possibility of supporting Reactive mode for native Kubernetes application mode

2021-11-02 Thread Fuyao Li
From: Fuyao Li Date: Tuesday, November 2, 2021 at 14:14 To: David Morávek , nicolaus.weid...@ververica.com Cc: user , Yang Wang , Robert Metzger , tonysong...@gmail.com , Sandeep Sooryaprakash Subject: [External] : Re: Possibility of supporting Reactive mode for native Kubernetes application

Re: Possibility of supporting Reactive mode for native Kubernetes application mode

2021-11-02 Thread Fuyao Li
uesday, November 2, 2021 at 05:53 To: Fuyao Li Cc: user , Yang Wang , Robert Metzger , tonysong...@gmail.com , Sandeep Sooryaprakash Subject: Re: [External] : Re: Possibility of supporting Reactive mode for native Kubernetes application mode Similar to Reactive mode, checkpoint must be enabled to s

Re: Possibility of supporting Reactive mode for native Kubernetes application mode

2021-11-02 Thread Nicolaus Weidner
Hi Fuyao, About your second question: You are right that taking and restoring from savepoints will incur a performance loss. They cannot be incremental, and cannot use native (low-level) data formats - for now. These issues are on the list of things to improve for Flink 1.15, so if the changes mak

Re: [External] : Re: Possibility of supporting Reactive mode for native Kubernetes application mode

2021-11-02 Thread David Morávek
reporters/#prometheus > > [2] > https://nightlies.apache.org/flink/flink-docs-master/docs/dev/datastream/fault-tolerance/checkpointing/#enabling-and-configuring-checkpointing > > > > Best, > > Fuyao > > > > > > > > *From: *David Morávek >

Re: [External] : Re: Possibility of supporting Reactive mode for native Kubernetes application mode

2021-11-01 Thread Fuyao Li
] : Re: Possibility of supporting Reactive mode for native Kubernetes application mode Hi Fuyao, this is a great question ;) 1) First let's be clear on what the reactive mode actually is. Reactive Mode is related to how the Flink makes use of the newly available resources. It greedily uses a

Re: Possibility of supporting Reactive mode for native Kubernetes application mode

2021-10-29 Thread David Morávek
Hi Fuyao, this is a great question ;) 1) First let's be clear on what the reactive mode actually is. Reactive Mode is related to how the Flink makes use of the newly available resources. It greedily uses all of the resources that are available in your Flink cluster (if new task manager joins in,

Possibility of supporting Reactive mode for native Kubernetes application mode

2021-10-27 Thread Fuyao Li
Hello Community, I am checking the reactive mode for Flink deployment. I noticed that this is supported in Kubernetes environment, but only for standalone Kubernetes as of now. I have read some previous discussion threads regarding this issue. See [1][2][3][4][5][6]. Question 1: It seems that