Re: Some question about flink temp files

2020-03-23 Thread Reo Lei
for standalone deployment > [1]. > > [1] > > https://ci.apache.org/projects/flink/flink-docs-release-1.10/ops/config.html > > Regards, > Roman > > > On Fri, Mar 20, 2020 at 11:55 AM Reo Lei wrote: > >> Hi all, >> >> Recently, I found flink tmp f

Some question about flink temp files

2020-03-20 Thread Reo Lei
Hi all, Recently, I found flink tmp files(localState, blobStore-*, flink-dist-cach-*, flink-io-*, flink-netty-shuffle-* etc.) has been grown to a total of about 6GB size. I have no idea what usage abot this files, and How big it will grow. So, I have some questions about the tmep files of flink a

Re: Upgrade flink fail from 1.9.1 to 1.10.0

2020-03-18 Thread Reo Lei
upon job > recovery. > This mechanism assumes that nothing has changed: neither job nor Flink > version. It is for recovery from a failure. > > Best, > Andrey > > [1] > https://ci.apache.org/projects/flink/flink-docs-release-1.10/ops/state/savepoints.html > > On W

Upgrade flink fail from 1.9.1 to 1.10.0

2020-03-18 Thread Reo Lei
Hi all, I encountered a problem when I upgrade flink from 1.9.1 to 1.10.0. At first, my job is running on flink stably which JM and TM is flink 1.9.1. And then I try to upgrade to 1.10.0. I stop the JM progress and start another JM progress. At this time, the JM is 1.10.0 and the TM is 1.9.1,

Fwd: How to recover state from savepoint on embedded mode?

2019-11-25 Thread Reo Lei
-- Forwarded message - 发件人: Reo Lei Date: 2019年11月26日周二 上午9:53 Subject: Re: How to recover state from savepoint on embedded mode? To: Yun Tang Hi Yun, Thanks for your reply. what I say the embedded mode is the whole flink cluster and job, include jobmanager, taskmanager and the

How to recover state from savepoint on embedded mode?

2019-11-25 Thread Reo Lei
Hi, I have a job need running on embedded mode, but need to init some rule data from a database before start. So I used the State Processor API to construct my state data and save it to the local disk. When I want to used this savepoint to recover my job, I found resume a job from a savepoint need